Whitney Port's husband wants their journey to having another child to "be over" following years of struggles.