Conversations with people that "like" anime, but not too much

Well its kinda awkward due to the conclusions people jump to when anime is brought up. A buddy I met at school joked about me watching "tentecel porn monsters raping little girls" when introducing me to some now mutual friends. Its scary when someone asks "what shows do you watch" and the first thing i can think of is anime. I cant really answer that to someone who may not know soo much about the culture. This is why i normally keep my anime to myself. I tell them I watch Walking Dead or Breaking Bad or somthin.

Most people here just think anime is for little kids. The library has an anime club and about everyone I see join in is under 12.

This is a real concern for me as well. I am an obsessed fan. I want to let other people know what I have researched and all the cool stuff I've found out. But trying to tell people what I know does nothing but alienate me from everyone I talk to. For the most part I want to share what I know so more people can see what's beyond their narrow scope. But all I ever seem to get are people that too nostalgic about what used to be, too focused on a single show, or just casuals that have no idea or interest in what I'm saying.