Can you source that? A lot of places have gravity fed reservoirs that are energy positive/neutral (LA, San Francisco and New York all rely on gravity fed reservoirs that were built before energy intensive pumping was practical). There are some costs but they are pretty small per gallon.
I’m assuming that calculation is amortizing the cost of running the water system (including wastewater treatment) adding the cost pumping it to the point that gravity can push it through the pipes. It’s never free.
There seems to be a vast gap between "free" and "more expensive than running LLMs". Also, the water seems...more necessary. Going without LLMs for three days will not threaten your life.