As you say, even with Internet connection, LLMs only infer. The software you run it on (or online) is a different story, and it’s literally already the case with everything else for decades (although it is getting worse).

We weren’t upset enough when Google started scraping everyone’s emails, or how Meta/Amazon/Google/Microsoft/ByteDance track all your Internet activity right now via browser fingerprinting.