AI and LLMs · Concept

Open-weight models

Models whose trained weights are published for anyone to download and run, such as Llama, Gemma, Mistral, Qwen and DeepSeek, instead of being reachable only through one company's API.

Run it yourself · updated

How it works

The weights are the billions of numbers a model learns in training. When they are published, usually on Hugging Face, you can run the model on your own hardware, host it with any provider, inspect it and fine-tune it. Families from Meta (Llama), Google (Gemma), Mistral, Alibaba (Qwen), DeepSeek, Microsoft (Phi) and OpenAI (gpt-oss) come in sizes from a few billion parameters, which run on a laptop, to hundreds of billions or more, which need a cluster of GPUs.

Open weight is not the same as open source: the training data and code are rarely released, and licences range from permissive (Apache 2.0, MIT) to custom ones with conditions for very large companies or on certain uses. Quantisation stores each weight in 4 or 8 bits so models fit in less memory, at some cost in quality. Tools such as Ollama, llama.cpp and vLLM run them, and hosts such as OpenRouter serve them per token.

More in AI and LLMs

Run it yourself

All 22 AI and LLMs terms

Crafted in the dark. Shipped to the world.

Tell us what you are building. You get a private project space with a proposal and a line-by-line quote within a day.