Tens of thousands of Japanese refugees who've faced the triple horror of earthquake, tsunami and nuclear crisis now have another worry - their fellow citizens.