Cynthia Erivo is doubling down on her singing in theaters stance ... so much so, she's teasing an appearance at the upcoming sing-along screenings.