Doubling Gemini 1.5 Pro's context window from 1 million to 2 million tokens could dramatically improve the results you get from Google's LLM. But tokens, context windows and other AI jargon is ...

The paper introduces Infini-attention, a technique that configures language models in a way that extends their “context window” while keeping memory and compute requirements constant.