Can I wear a latex top out without it screaming 'latex'?

I want to wear my latex a lot more in normal settings, not only at events, but a full-shine top on its own feels like a lot for, say, dinner or a gig. Has anyone properly cracked the art of dressing it down? I am picturing a latex top under a blazer, or paired with a matte skirt so only a hint of shine peeks through. Does that read as genuinely stylish, or just a bit odd once someone is close up? And does layering wool or denim over latex cause any grief for the rubber underneath? I want to enjoy it far more often, minus the big entrance every time.