Jennifer Lopez is disappointed to leave the house after arguing with Ben Affleck about the wedding