The statue and another Confederate tribute are to be taken down Saturday, nearly four years after violence erupted at 'Unite the Right' rally