In “needle-in-a-haystack” testing wherever they look for that needle in the huge number of facts stored inside the context window, they have been capable of finding certain pieces of knowledge with 99.7% accuracy Despite 10 million tokens of knowledge. As additional persons and companies discover and add to Mixtral 8x22B, https://hansi801bbz2.robhasawiki.com/user