Generative AI vs. Traditional Software
Swipe to show menu
When you type =SUM(A1:A10) in Excel, you always get the same answer.
When you ask ChatGPT the same question twice, you might get two different
responses. This isn't a flaw — it's the defining characteristic of
generative AI, and understanding it changes how you work with it.
Deterministic vs. Probabilistic Tools
Traditional software follows fixed rules:
- Same input → same output, every time;
- The result is predictable and auditable;
- Examples: excel formulas, database queries, search engines.
Generative AI is probabilistic:
- Same input → varied output, depending on context and randomness;
- Results are flexible and creative, but require verification;
- Examples: ChatGPT, Claude, Gemini, Copilot.
Neither approach is superior — they serve different purposes. The mistake is treating AI like a calculator, or expecting a calculator to be creative.
The Context Window: AI's Working Memory
AI doesn't have a persistent memory. It only knows what's in the current conversation — this is called the context window.
- Everything you've written in the current chat is in the context window;
- The moment you start a new conversation, the AI has no memory of the previous one;
- Some tools offer optional memory features, but they're not on by default.
Imagine a brilliant consultant who reads everything you give them in a single meeting, then forgets the entire conversation when they walk out the door. The next meeting, you start from scratch.
What This Means in Practice
- Always provide context in your message — don't assume the AI knows your role, your project, or your preferences;
- Within a conversation, you can refer back — the AI remembers everything said in the current session;
- Start fresh when topics change — a cluttered, long conversation can confuse the model;
- Some tools offer memory — ChatGPT and Claude have optional memory features that persist across sessions, but these need to be enabled.
1. Which statements correctly describe the difference between deterministic and probabilistic tools, and provide accurate examples of each
2. Which statement best describes how generative AI remembers information during a conversation?
Thanks for your feedback!
Ask AI
Ask AI
Ask anything or try one of the suggested questions to begin our chat