AILLMProductivityTools

The World of LLMs, in One Sitting

There's a much bigger world beyond ChatGPT. From tokens and context windows to thinking models, deep research, Artifacts and your own AI agent, the whole picture in 20 steps.

· 15 min read

A story first

Imagine there's a huge library in your neighbourhood. The librarian has read nearly every book in it at least once. Whatever you ask, he gives you a tidy answer on the spot. But there are three problems:

  1. He hasn't memorised every book; he read them and kept an impression in his head. So now and then he confidently gives the wrong date or the wrong name.
  2. He doesn't know anything that happened after the last day he read.
  3. Hand him too many papers at once and he mixes up what was at the start.

An LLM (Large Language Model) is exactly this librarian. In this piece we'll see how he works inside, where you can rely on him and where you can't, and which tools make him ten times more useful.

The map: who's out there

1. The LLM world: ChatGPT isn't alone

To many people AI simply means ChatGPT. But there are now several powerful models side by side, and each has its own strengths:

ModelCompanyUsually good at
ChatGPTOpenAIAll kinds of work, voice, image generation, a big ecosystem
ClaudeAnthropicLong writing, code, understanding big documents, Artifacts
GeminiGoogleFitting in with Google's services, long context, understanding video
GrokxAIFresh news and discussion from X (Twitter)

They aren't substitutes for each other so much as different tools. You can't undo a screw with a hammer.

How it works inside

2. Tokenization: the model reads pieces, not words

When you write "Learning how to learn", the model doesn't see letters or whole words. It breaks the text into small pieces called tokens. Each token has a number, and the model really works with these numbers.

"Learning how to learn"Learn46255ing287␣how1268␣to311␣learn3449tokens → numbers: what the model actually readsLLMguess the next token␣fast ✓token ids are illustrative; every model has its own vocabulary
A sentence breaks into tokens, and each token is a number. The model reads this row of numbers and guesses what the next token will be.

Why this is useful to know:

  • Prices and limits are measured in tokens. API bills, "message too long" errors: all of them count tokens.
  • Bangla text uses more tokens. In English one word is usually one or two tokens. Saying the same thing in Bangla often takes several times more. So long jobs in Bangla hit the limit sooner.
  • Models are weak at counting letters. Questions like "how many r's are in strawberry?" go wrong, because the model doesn't see letters at all, only pieces.

3. Context window: the model's desk

The context window is the model's working memory. Everything in one conversation (what you wrote, what the model answered, the files you gave it) can be kept "in view" at once up to a certain number of tokens. Go beyond that and the older parts drop out or blur.

systemhi!CORS?answerhugelog…log…fix?codetestagainthankssystemhi!CORS?answerhugelog…log…fix?codetestagainthankscontext window = working memoryforgottennew tokens enter here →← slides out of viewkeep it lean: every pasted line takes a seat at the table
New tokens come in and the window moves forward. Whatever leaves the window, the model can no longer see.

Think of a study desk. However big the desk, fill it with junk and the paper you need is hard to find. So:

  • Give it only what's needed. Instead of a whole 200-page log, give the part around the error.
  • Open a new chat when you change topic. Go from a cooking recipe to Kubernetes in one chat and everything said before sits on the desk taking up room.
  • In long chats, ask for a summary now and then, then start a new chat with that summary.

4. A model's limits: a "lossy zip file"

An LLM is built by having it read a vast amount of text from the internet. But the model doesn't store those texts word for word. It squeezes the whole internet into a small "zip file", and some information is lost in the squeezing. Like a JPEG photo that goes blurry when you compress it too much.

the internetmodelsqueezed, not stored.zipanswermostly right · some bits made up
The vast internet is squeezed into one model. Pull it back out and most of it comes back right, but some pieces are blurry or made up.

As a result:

  • Hallucination: it can confidently make up things it doesn't know. Books that don't exist, wrong citations, library functions that aren't real.
  • Knowledge cutoff: the model doesn't know about events after its training, unless it searches (see step 8).
  • Good at popular things, weak at rare ones. A topic with thousands of pages written about it, it remembers well. A small local topic, it often gets wrong.

5. The most important warning: verify

Everything above boils down to one thing: AI answers aren't always 100% right, so verifying is mandatory.

How to verify:

  1. Ask for sources, then open the links and look yourself. Is the link real, and does it really say that?
  2. Run the code. Write tests. "It looks right" isn't enough.
  3. Ask another model. Two models are unlikely to make the same mistake (see the council in the next section).
  4. Check numbers and dates separately. That's where models make the most mistakes.

The right model for the job

6. Model selection and the "council"

Not every job needs the biggest model. A fast, cheap model is enough for a short email. Thinking through a complex architecture needs a big one. A rough rule:

JobWhat to choose
A quick question, short writing, translationA fast, small model
Understanding a long document, organising writingA model with a big context
Hard maths, debugging, planningA thinking model (step 7)
Fresh newsA model with search on (step 8)

And when the answer really matters, form a council: ask the same question to two or three different models and put the answers side by side. Where they all agree, you can trust it more. Where they disagree, dig in yourself.

your questionModel A42Model B42Model C41?compare2 agree → keep ✓1 differs → verify ?
The same question goes to three models. The answers are compared: keep what they all agree on, and check where they differ.

7. Thinking models: they think before answering

An ordinary model starts writing its answer as soon as it reads the question, a bit like doing maths in your head. A thinking model (reasoning model) first works step by step on a scratchpad, catches its own mistakes, tries other routes, and then answers.

They're built with reinforcement learning: the model is given thousands of maths and coding problems whose right answers can be checked. Right earns a reward, wrong doesn't. That way it learns how to think to reach the right answer.

  • When to use one: hard maths, complex bugs, algorithms, multi-step planning.
  • When not to: simple questions or short writing. Thinking models are slow and expensive. There's no point making one think for 30 seconds about "what should I cook today".

The model's tools

On its own, an LLM works only with the knowledge in its head. But give it tools and it can reach out into the world. Everything in this section is really the same idea: when the model can't do something itself, it uses a tool.

A model's knowledge stops at its training date. Today's news, a new library's version, yesterday's prices: it doesn't know them. With search on, the model first searches the internet, then reads that fresh information to answer, and gives you links to the sources.

9. Deep Research

Ordinary search looks once, reads a few pages and answers. Deep Research works like a researcher: it breaks the question into smaller parts, runs many searches, reads a few dozen sources, then writes a full report with a source next to every claim. It takes a few minutes.

Useful for: comparing a new technology, getting the whole picture of a market or topic, background reading before a thesis or proposal. But however polished the report, open the sources for the important claims yourself.

10. File upload: talk about your own documents

You can upload PDFs, Word files, slides, code, even photos of handwritten notes and ask questions directly: "Give me the main points of this 40-page research paper in three lines", "Where are the risks for me in this contract?", "Make a 30-day study plan from this syllabus."

Then the model answers from the text you gave it, not from its "blurry memory", so mistakes drop a lot. But the whole file takes up room in the context window, so for a very big file give it the part that matters.

11. Python interpreter: calculate, don't guess

Remember that the model sees tokens, not words? That's why big multiplications, date arithmetic or data work done "in its head" goes wrong. So good models write a small Python program themselves, run it, and answer from the result.

What is 48,213 × 7,919− 1,000,000?LLMdon't guess: compute# python, by the modelprint(48213*7919-1_000_000)sandbox runs it380,798,747resultAnswer: 380,798,747 (computed, not recalled)
A question comes in; instead of calculating itself, the model writes Python code, runs it in a sandbox, reads the result, then answers.

You can also tell it: "Run code to calculate this." The answer to the calculation is then far more reliable.

12. Data analysis and charts

Once it can run Python, the next step is easy: upload an Excel or CSV file and say "make a chart of sales by month", "which product's sales dropped the most?", "is there anything unusual in this data?". The model reads the data, writes code to analyse it, and draws you a chart.

Tools for building and learning

13. Claude Artifacts

Ask Claude to build something (a web page, a small game, a diagram, a calculator) and it runs right away in a separate panel next to the chat. That's called an Artifact. You look at it, click around, then say "make the button bigger", "add dark mode", and it changes on the spot.

It's wonderful for testing a UI idea, building interactive things for learning, or explaining an idea with a picture.

14. Cursor

Cursor is a code editor with AI built in (it looks like VS Code). It's not just autocomplete; it can read your whole project. Jobs like "where is this function used?" or "add rate limiting to login" it can do across several files.

15. Advanced Voice Mode

The old voice feature turned speech into text first, then wrote an answer and read it aloud. Advanced voice understands audio directly and answers in audio. So you can interrupt it mid-sentence, it picks up on tone and emotion, and the conversation feels much more natural.

Useful for: understanding a topic while out on a walk, interview practice, practising spoken English.

16. NotebookLM

In Google's NotebookLM you give it your own sources (PDFs, notes, websites, YouTube videos), and it works only from those: summaries, study guides, Q&A, and the most fun of all, a podcast that sounds like a conversation between two hosts. Turning your class notes into a podcast before an exam and listening to it on the bus is, in a word, great.

17. Multi-modality

Today's models understand not just text but images, audio and video too. Take a photo of a broken circuit and ask where the problem is. Give it a photo of a whiteboard and ask it to write the code. Give it a screenshot of a chart and ask what it means. Build a real web page from a hand-drawn UI sketch.

18. Video generation

Models like Sora (OpenAI) and Veo (Google) make video from text: "rickshaws in Dhaka on a rainy night, the camera slowly moving forward". For short clips for ads, explainers, social media or teaching, they're incredible.

Make it your own

19. Custom instructions and memory

There's no need to write "I'm a Go backend developer, keep answers short, use few comments in code" every time. Write it once in custom instructions and the model follows it in every chat. Many apps also have memory: the model remembers your preferences and your ongoing projects.

Good custom instructions include:

  • Who you are and what you work on
  • The style of answer: short or detailed, language, tone
  • What you don't want: unnecessary preambles, too many emoji, and so on

20. Custom GPTs and agents

One step further, you can build a separate AI for one particular job: with its own instructions, its own files and its own tools. For example:

  • A language-learning companion: gives you 10 new words a day and corrects your sentences.
  • A translator: translates from English to Bangla following your company's own glossary.
  • A code reviewer: reviews PRs following your team's style guide.

In ChatGPT these are called Custom GPTs, in Claude Projects, in Gemini Gems. And an agent goes a bit further: it doesn't just answer, it works step by step on its own, like searching, writing files and running code, and reports the result at the end.

At a glance: what for which job

You wantUse
A quick answer or some writingAny ordinary model
Hard maths, a bug, a planA thinking model
Today's news, prices, new versionsSearch
A full research reportDeep Research
To understand your own PDF or documentFile upload, NotebookLM
Exact calculations, chartsPython / data analysis
To build a UI or a small toolClaude Artifacts
To write code across a whole projectCursor
An important decisionA council of several models, then check it yourself
The same kind of job again and againCustom instructions, a Custom GPT / agent

Was this post useful?

You get one vote, and it's final.