> For example one could easily do the coin toss and write down the actual 1s and 0s coming out of the tosses

This is a really common teaching activity for the topic.

It's not that maths is 'never an experiment', but that people make uninformed assumptions about what maths education involves.