Not to jump in for someone else but your use of “OS level” prompts me to opine: I think the features of a meaningful new OS would extend far beyond the programmatic level of the kernel, the drivers, the dependencies, etc. A “new OS” could just be Linux with some cool UX innovations on top enabled by ensembles of lightweight, purpose built LLMs. Think window management, file management, password management, etc.
For one potentially compelling example that happily (sadly?) isn’t using LLMs: the SimulaVR people are developing their own Linux fork of some kind, claiming it’s necessary for comfortable VR use for office work. And I sorta believe them!