I've ridden in just about everything at one time or another. Generally speaking, if it's dry I ride, regardless of temperature. I avoid rain when possible but still get soaked good and regular.
Also, a little lesson for those of us year-rounders:
http://twowheelfix.com/showthread.php?t=17585