Prince Louis put on a serious face as he shook hands with the pastors as he left the service