Notice: This page requires JavaScript to function properly.
Please enable JavaScript in your browser settings or update your browser.
Learn Generative AI vs. Traditional Software | How Modern AI Works
Understanding AI for Work

bookGenerative AI vs. Traditional Software

Swipe to show menu

When you type =SUM(A1:A10) in Excel, you always get the same answer. When you ask ChatGPT the same question twice, you might get two different responses. This isn't a flaw — it's the defining characteristic of generative AI, and understanding it changes how you work with it.

Deterministic vs. Probabilistic Tools

Traditional software follows fixed rules:

  • Same input → same output, every time;
  • The result is predictable and auditable;
  • Examples: excel formulas, database queries, search engines.

Generative AI is probabilistic:

  • Same input → varied output, depending on context and randomness;
  • Results are flexible and creative, but require verification;
  • Examples: ChatGPT, Claude, Gemini, Copilot.

Neither approach is superior — they serve different purposes. The mistake is treating AI like a calculator, or expecting a calculator to be creative.

Screenshot description: Side-by-side comparison. Left panel: Google Search results page for the query "best subject line for a follow-up email" — shows a list of 10 blue links to articles. Labeled "Traditional search: gives you links". Right panel: A chat interface (ChatGPT or generic) with the same question — the AI responds with 5 ready-to-use subject line options, each on its own line. Labeled "Generative AI: gives you the answer". Both panels cropped cleanly, no clutter.

The Context Window: AI's Working Memory

AI doesn't have a persistent memory. It only knows what's in the current conversation — this is called the context window.

  • Everything you've written in the current chat is in the context window;
  • The moment you start a new conversation, the AI has no memory of the previous one;
  • Some tools offer optional memory features, but they're not on by default.
5. Screenshot description: Two chat windows side by side. Left window: a multi-turn conversation where the user references something said earlier ("Make it shorter, like I asked") and the AI correctly responds because it's in the same session. A bracket on the left labeled "Context window — AI can see all of this". Right window: a fresh chat where the user types "Make it shorter, like I asked" and the AI responds confused ("I'm not sure what you're referring to — could you share the text?"). Labeled "New session — AI has no memory".
Note
Analogy

Imagine a brilliant consultant who reads everything you give them in a single meeting, then forgets the entire conversation when they walk out the door. The next meeting, you start from scratch.

What This Means in Practice

  • Always provide context in your message — don't assume the AI knows your role, your project, or your preferences;
  • Within a conversation, you can refer back — the AI remembers everything said in the current session;
  • Start fresh when topics change — a cluttered, long conversation can confuse the model;
  • Some tools offer memory — ChatGPT and Claude have optional memory features that persist across sessions, but these need to be enabled.

1. Which statements correctly describe the difference between deterministic and probabilistic tools, and provide accurate examples of each

2. Which statement best describes how generative AI remembers information during a conversation?

question mark

Which statements correctly describe the difference between deterministic and probabilistic tools, and provide accurate examples of each

Select all correct answers

question mark

Which statement best describes how generative AI remembers information during a conversation?

Select the correct answer

Everything was clear?

How can we improve it?

Thanks for your feedback!

Section 1. Chapter 3

Ask AI

expand

Ask AI

ChatGPT

Ask anything or try one of the suggested questions to begin our chat

Section 1. Chapter 3
some-alt