Aid workers say hundreds of refugees still living in an unused naval base on Manus Island in Papua New Guinea are living in dire conditions.