The father of a toddler who died after months of abuse despite the intervention of social workers has spoken of his anguish.