In Kazakhstan, a large language model called KazLLM has been developed.

In Kazakhstan, the training of the large language model KazLLM, based on 148 billion tokens in Kazakh, English, Russian, and Turkish, has been completed. The model was developed by the team of the Institute for Smart Systems and Artificial Intelligence at Nazarbayev University, with the support and coordination of the Ministry of Digital Development, Innovations and Aerospace Industry of the Republic of Kazakhstan (MCRIAI RK) and the Ministry of National Education of the Republic of Kazakhstan (MNVO RK).

Key partners included Beeline Kazakhstan and QazCode, which provided computing power through eight DGX H100 servers, accelerating the training process. KazLLM opens up broad opportunities for business, science, and education, including improving user experience, analyzing scientific texts, and developing the Kazakh language in the digital space.

KazLLM is available to developers, startups, and large companies and will serve as the foundation for the TurkLLM project, aimed at advancing natural language processing technologies in the Turkic-speaking world. Two versions of the model have been created—with eight and 70 billion parameters—both of which surpass similar models in quality and accuracy.

KazLLM is a modern artificial intelligence language model designed for processing, analyzing, and generating texts in the Kazakh language. This unique development aims to promote the use of the Kazakh language in the digital space, supporting business, science, and society. It is capable of performing a wide range of tasks: from translation and document processing to automating communication.

KazLLM can be accessed here.

Source: gov.kz