For recreational slow speed cruising In a ski boat I usually don't. For faster rides in faster boats yes.

IF I was a weekend boater out with the crowds or offshore boating I would wear it.