Large language model (LLM)

AI search basicsAlso called LLM

A large language model is an AI system trained on a huge amount of text that predicts what words come next, which lets it write answers, summaries, and replies in plain language.

Why it matters

An LLM is the engine inside the AI assistants your customers ask for recommendations. It doesn't look up a business the way a phone book does. It writes the most plausible answer from what it learned and from any pages it's handed. That's why it can describe your business well when the facts about your business are clear and consistent, and get it wrong when they aren't.

Example

A dentist asks an AI assistant to describe her own practice. The reply sounds confident but gives the wrong street and says she offers a service she doesn't. The model wasn't lying. It filled gaps with plausible text. Her fix was ordinary. She made her address and services plain and identical on her website and listings, so there were fewer gaps for a model to fill.

What an LLM actually does

Google's machine learning course describes large language models as predicting a token or sequence of tokens, sometimes many paragraphs worth. A token can be a word, part of a word, or even a single character. In plain terms, the model works out which text most likely comes next, one piece at a time.

Google says LLMs make much better predictions than earlier language models because they contain far more parameters and gather far more context. Building one means gathering an enormous training set and using huge amounts of computing power.

Why LLMs make mistakes

The same course lists the problems. LLMs hallucinate, meaning their predictions often contain mistakes. Google's glossary defines a hallucination as plausible-seeming but factually incorrect output. The model produces language that reads well whether or not the underlying fact is right.

For a local business, that means the accuracy of what an assistant says about you depends heavily on what it has to work with. Clear pages, matching listings, and plain statements of your name, address, hours, and services give it something real to draw on instead of a guess.

Sources

Ready to see how AI describes your business?

Set up in ten minutes with a 14-day free trial on every self-serve plan, or talk to a specialist first.

Start Free Trial