An avid bicyclist, Rosser has cycled extensively in Europe with the Lafayette Riders, a club of French and American cyclists. In his age group, he was a New Jersey State champion for the three years that he indulged in top-level competition. He has three daughters, five grandchildren, and two great-grandchildren. Rosser published a collection of his early columns in 2012 in a book titled A Collection of Stuff. He now lives in Holiday Village, a retirement community in Mount Laurel, New Jersey, and writes for the village newspaper.