Large language model (LLM)
A large language model is a neural network trained on very large amounts of text to predict the next piece of text given what came before. Everything it does — answering, translating, writing code, summarising — is that one operation applied repeatedly.
How it is built
Almost all current models use the transformer architecture. Text is cut into tokens, each token becomes a vector, and attention layers let every position weigh every other position in the input before the model emits a probability distribution over the next token. One token is sampled, appended to the input, and the whole thing runs again.
Training happens in stages. Pre-training on a very large text corpus produces a model that continues text. Post-training — instruction tuning, then some form of preference optimisation — turns that into something that follows requests and behaves like an assistant. The assistant persona is a trained behaviour, not a property of the underlying network.
What follows from that design
Several practical consequences fall straight out of "it predicts text":
- It has no lookup table. Facts are diffuse patterns in the weights, not rows in a database. This is why hallucination is a structural property rather than a bug awaiting a patch, and why retrieval-augmented generation exists.
- It is stateless between calls. Any "memory" is text re-sent inside the context window.
- Its knowledge has a cutoff date, set by when the training data was collected.
- Output varies. Sampling is random unless the temperature is zero, and even then hardware and batching can shift results slightly.
What the numbers do and do not tell you
Parameter count is a capacity ceiling, not a quality score. A well post-trained 8B model beats a badly trained 70B model on most real tasks, and a large model asked a badly framed question performs worse than a small model asked a clear one. Data quality, post-training and how much the model is allowed to reason before answering all move results more than raw size.
Benchmark tables are worth even less than they look. Contamination is common, the tasks rarely resemble yours, and a two-point difference on a leaderboard is not something your users will notice. Test candidate models on twenty examples of your own work instead.
Frequently asked questions
Does a language model learn from my conversations?
Not by itself. The weights are fixed once training is finished, so nothing you type changes the model. What can happen is that the provider stores your conversations and uses them in a later training run, which is a policy question about that provider rather than a property of the technology.
What is the difference between a model and a chatbot?
The model is the weights plus the code that runs them, and it only turns text into more text. A chatbot is a product built around one: it stores the conversation, adds a system prompt, may search the web or call tools, and applies filtering. Two chatbots on the same model can behave very differently.
Build it yourself
NorthernGo turns a plain-text description into a working web app with a database, login and a live URL. Local AI generation runs on your own GPU, is unlimited, and is free on every plan.