I avoid anything with kernel level anti-cheat. It is a theoretical attack vector - if the anti-cheat were somehow compromised, you've granted it low-level access to your system so whatever payload it is injecting would have that same level of access.

Even if you only play the single player part of a game the anti-cheat will be installed and running in the background.

You think they don't add anti-cheats to singleplayer/co-op?

They definitely can add anticheat to cooperative games, though again it feels a bit much.

I would say not to worry too much? The potential for abuse exists, but is not actually used. The companies that make the anti cheat software these days have way too much on the line to risk that kind of behaviour. It's one of those things that it's in a bit of a weird state, and some people like to keep an eye on it, but for the vast majority of cases is a minor inconvenience.