He might have meant something like “never took a day off beyond the usual weekend/holiday”. Or “even on vacation, I did things like exercise and reading books, so it doesn’t count as taking a day off”. Who knows.