A man from Aylesbury was caught stealing Greggs in the town centre right in front of a police officer.