Novak Djokovic admitted he has concerns over his fitness after he struggled in his first round US Open win.