Pollard was hospitalized with COVID over weekend after her condition deteriorated; 'I did not imagine I would lose Esther,' husband says