Top athletes decline White House visits over president's policies and attacks on sports personalities.