One GP from Strood says he feels let down by government after Boris Johnson admits attending the event.