Agreed.
I am also semi conversational in Japanese, and the first time I wore a kimono, it was because my host mom put me in it. The one I own was a gift from my exchange student.
I mean, there's lots of people who take issue with me speaking Japanese, liking the culture, and being involved in my school's Japanese program. All of those people are white.
Incidentally: I didn't get really into anime until AFTER I had decided I would take Japanese in high school. I figured watching anime would give me a feel for fiction-culture and pronunciation.
Bookmarks