Ray J isn't backing down from challenging Mario in a singing battle ... despite his opp not taking the competition too seriously.
