Something that worries me a little is how comma would handle anomalies. Telsa has such scale that they're likely to encounter more anomalies and their software will learn from them. I'm particularly concerned about the sudden kind of anomalies (e.g. animal jumping in front of vehicle, or a getaway car coming from an illegal ergo uncommon direction); one that comma may be unable to handle, but a human would have very little time to take over from.
Their compatibility page calls out which car models will lose their built-in advanced safety features (such as automatic emergency braking) when using comma, and whether comma replaces the built-in adaptive cruise control. Their FAQ includes:
> Do I retain my car factory safety features with openpilot installed?
>When openpilot is enabled in settings, Lane Keep Assist (LKAS), and Automated Lane Centering (ALC) are replaced by openpilot lateral control and only function when openpilot is engaged. Lane Departure Warning (LDW) works whether engaged or disengaged.
> On certain cars, Adaptive Cruise Control (ACC) is replaced by openpilot longitudinal control.
> openpilot preserves any other vehicle safety features, including, but are not limited to: AEB, auto high-beam, blind spot warning, and side collision warning.
The FAQs about comma's automated lane centering and adaptive cruise control also say:
> openpilot is designed to be limited in the amount of steering torque it can produce.
So comma isn't even trying to be the subsystem responsible for handling sudden surprises. It's only trying to upgrade a suitably-equipped car from SAE Level 0 or Level 1 up to Level 2.
