Does anyone paddle out in the winter on the days that are anywhere from 1-3 on a longboard once it gets cold?

I haven't surfed the colder months yet, but at this point I feel like an idiot out there by myself when no one else seems to go out.
Am I the only one that wastes their time in the small stuff when you gotta get fully suited up?