Link. Gemini 1.4 can hold about 750,000 words in memory at once.
“Researchers gave the five hundred or so available pages of reference material on a language with 200 speakers (and so with no real online presence) to Gemini and to a human translator. They found that the AI was able to learn the language about as well as the human could, from the same documentation”