Some warn of plot to dismantle the body they see as a 'reminder' of the issue of Palestinian refugees, and not just a service provider