In 1.2 the Console, Script and Net panels are enabled per site. Keep them off for Gmail and anything you're not debugging. Script and Net are the slow ones.
I keep a separate Firefox profile for development with Firebug and Web Developer toolbar, and a clean one for normal browsing. Problem solved and no more toolbar clutter.