You're having a great chat with an AI. It's keeping up, building on your ideas, actually being useful. Then, somewhere around message fifteen, something shifts. The answers get vaguer. It contradicts something it said earlier. It feels, well, dumber.
It hasn't gotten dumber. It's just starting to forget.
Every AI chatbot has a kind of working memory. A limited space where it holds your conversation. The longer your chat gets, the more it has to juggle, and when things get too full, something has to give.
This is called the context window — basically, the size of that memory space. Every AI has one, and once your conversation grows past it, older parts of the chat start slipping out of reach.
Think about your own memory for a second.
If someone tells you their name and one fun fact, you'll probably remember both an hour later. Easy. Short, contained.
Now imagine you've been at a party for three hours, talking to person after person, conversation after conversation. By the end of the night you can probably recall the first person you spoke to and whoever you were just chatting to when you grabbed your coat. But everyone in the middle? A blur. The details have gone fuzzy.
That's pretty much what's happening with your AI.
The beginning of your conversation and the most recent messages are usually easier to remember. However, the information in between can become unclear. The nuances you established at the start and the context you've set may not be as firmly held by the AI as you might expect.
That's a fair question.
Your phone holds every photo you've taken. Your laptop doesn't lose a spreadsheet halfway through. So why can't AI just keep up?
Here's the thing. It's not forgetting the way you do. It's doing something a little weirder.
Every time you send a message, even if you just type "why?", the AI isn't reading one word. It's reading that word plus every single message in the whole conversation, all over again from the top. Your message, its response, your next one, its next one. The whole thread, bundled up fresh with every single prompt.
By message twenty you're not sending one message. You're sending twenty conversations' worth of text on repeat, every time you hit enter.