Skip to content

Tour

How a sentence becomes an answer

Six stations, straight across. Just scroll — the tour takes you along, and by the end you will know what happens in the two seconds a model takes to answer.

01Station 1 of 6

A sentence falls apart

First the sentence is split. Not into words and not into letters, but into pieces in between — by frequency. What appears often stays whole; what is rare breaks up. That is why "invoice" is one piece and "reimbursement" is several.

The tram leaves at 2:30 pm — best regards!

The·tram·leaves·at·2:30·pm·—·best·regards!
02Station 2 of 6

Pieces become numbers

A model computes, it does not read. Every piece becomes a list of numbers — four here, several thousand in real models. These numbers are not a code and not a dictionary index: they are learned, and everything the model knows about the piece sits in them.

The four numbers per word are set by hand so you can see what they do. A model learns them from billions of sentences.

  1. The
  2. invoice
  3. arrived
  4. yesterday
  5. and
  6. it
  7. was
  8. wrong
03Station 3 of 6

Closeness is meaning

Because they are numbers, there are distances. And because there are distances, related things sit together: "invoice" next to "receipt", far from "server". A search then no longer asks whether a word appears in the text, but what lies near it.

invoicereceiptbillpaymentreminderserverdatabasememorynetworkcontractterminationdeadlinemodeltraininganswerquestion
04Station 4 of 6

Every word looks at every other

Now comes the actual invention. Every piece assigns weights to all the others — "it" looks at "invoice" and finds more there than at "yesterday". The lines show it: the thicker, the more attention. That is the whole trick behind everything built since 2017.

  1. The
  2. invoice
  3. arrived
  4. yesterday
  5. and
  6. it
  7. was
  8. wrong
05Station 5 of 6

And then it guesses

At the end there is no answer, just a list: a probability for every possible next piece. The model picks one, appends it and starts over. Word by word. It never knows how the sentence it is writing will end.

The probabilities are set — real ones would need a running model. The orders of magnitude match what you actually see at this point.

  1. wrong41 %
  2. too19 %
  3. already12 %
  4. still9 %
  5. not7 %
  6. overdue5 %
  7. correct4 %
  8. higher3 %
06Station 6 of 6

And where does all this happen?

That is exactly the question we care about. The same path runs twice: once on a machine in your building, once in a data centre that is not yours. The computation is identical. What differs is who gets to watch.

On your machine

In house. It never leaves the machine.

In the cloud

At the provider. Every request crosses the network.