Preview for review. Not live, not indexed, and the form doesn't send anything yet.
Palo Alto Networks is buying Applied Compute for $4.5BWhat it means for you →

What is a private LLM, and does your company need one?

"Private LLM" means different things to different vendors. Here's what the options really are, and how to tell which one you need.

Short answer: a private LLM is a language model that runs where you control it, such as your own cloud account or your own servers, so your data never goes to a shared service. Most companies don't need one: the business plans of ChatGPT and Claude already keep business data out of model training by default. You need a private model when regulation, contracts or the sensitivity of the data rule out any third-party service, or when you want a model trained on your own work.

The four levels of "private"

OptionWhere it runsWho sees the dataFits
Business plan (ChatGPT, Claude)Provider's cloudProvider, under business termsMost companies
Provider via your cloudYour AWS, Azure or Google Cloud accountYour cloud provider, under your existing agreementCompanies with cloud compliance already set up
Open model, self-hostedYour cloud or data centreOnly youRegulated data, strict contracts
Your own trained modelWherever you chooseOnly youA core task where you want an edge

When you actually need one

The trade-offs

Self-hosting means you own the uptime, the security patches and the upgrades. Open models that fit on modest hardware are usually behind the best frontier models on general tasks, which is why the strongest private setups are trained for a specific job. See how to build your own model.

Questions

Is ChatGPT Business private?

OpenAI says data from ChatGPT Business and Enterprise isn't used to train its models by default. It still runs on OpenAI's service, so check it against your own contracts and regulators.

What is the best LLM to run privately?

It changes every few months. Choose by testing open models on your own tasks, at the hardware size you can afford to run.