I think you need to show the syntax for LaTeX formatting in the "How to Format" box when writing a question or answer. I just mean showing how to surround in $ or $$, not how to actually write LaTeX formulas. (But maybe there could be a link to an external LaTeX syntax help page too?)
Edit Something like suggested here. Here's a mockup:
