Ever wondered why some AI can handle video and others can't? The answer is context length. You can think of it like AI memory - the more tokens it can handle, the bigger the files it can process. And it’s not going to be as talked about, but Microsoft's already cooking up infinite context windows. Get ready for AI that remembers… almost everything. #ai #artificialintelligence #technology

Context length absolutely matters in AI. They will be getting longer. So context length is the number of tokens that an AI model can store in memory. The more tokens that it can fit in, the longer the conversation can go on and also the more files or larger files an AI system can take in. So right now we're in the like millions of token zone with Google Gemini and Gemini is the only model that can take in video files because video is so large. It's so many tokens to take in audio and visual component. I do think that context length will grow. I do think that it is still a focus area of labs. There are also a lot of research papers and there was one from Microsoft that showed that you could have like infinite context length that will still be a large piece of 2025 releases. It's just not gonna be as talked about.