Corpus of Written Tatar

The size of the Corpus of Tatar language at the end of 2014 is more than 116 mln words. Amount of sentences - 10 mln, the number of different word forms is about 1,5 mln.
To prevent copy, texts are stored as mixed sentences in the Corpus.

Access to the Tatar Corpus for research purposes is free of charge.

Creating of the Corpus of Tatar language was initiated in 2010 by a group of enthusiasts. The task was considered urgent as it would provide the necessary database of texts for the work on machine translation systems for the Tatar language, and it was also indispensable in solving problems in Tatar speech synthesis and recognition.

The basic purpose of the Corpus of Written Tatar language is to provide assistance in research into the Tatar lexicon. Furthermore, the corpus can be used in language learning, and as a source of models for various types of documents.
The Corpus of Written Tatar allows the user to do searches for words by specific features, to see the words in their contexts, and it also provides the user with frequency data.

This type of search makes it possible to see the right, left and semantic contexts of a specific word, sorted by frequency.
Right context - words placed directly after the current word.
Left context - words placed directly before the current word.
Semantic context - words located in the same sentence with the current word, i.e. there is some kind of implied semantic connection between the words.

In 2014, the morphological marking of the Tatar Corpus was carried out. The meta-language of grammatical labels is based on the system of tags for Turkic languages developed by the international project Apertium. This project is aimed to develop automatic translating system for a big variety of languages. The main arguments in favor of choosing Apertium's morphological tagger for marking the Corpus are:
- high quality of morphological annotation;
- its being an Open Source project: all the source code and data are publicly available for all for free.
The Complex Morphological Search system developed by us in 2015-2016 allows to perform searches in the Corpus by different combinations of such parameters as word form, lemma, morphological (grammatical) tags set, beginning of the word, middle part, end of the word, and the distance between searched words. The maximum length of the search query is five tokens + accordingly four distances between them.

The Corpus of Written Tatar offers the user a unique opportunity to listen to the sentences found in a search, and also to listen any other text that the user enters to this facility, see http://search.corpus.tatar/search/sintez_en.html.

The creators of the Corpus of Tatar language upload various additional statistical data as soon as they become available as a result of processing the Corpus, see http://corpus.tatar/stat_en.htm.

• Absence of offline corpus version.
• Automatic disambiguation.

Creators of the Corpus:

• Saykhunov M.R. (Candidate of Philology, research fellow at the Institute of Informatics)
• Ibragimov T.I. (Candidate of Philology, associate professor at the Applied Linguistics Department of Kazan Federal University)
• Khusainov R.R. (Engineer, "GDC")

With the assistance of:

• The Republican Center for Development of Traditional Culture
• The Research Unit for Volgaic Languages at the Turku University (Finland)
• «RX5» company
• The editorial office of the popular scientific journal "Фән һәм Тел"

• Татар теленең язма корпусы // «Мәдәни җомга» (2012 № 20)
• Татар теленең язма корпусы // "Фән һәм Тел" (2012 №1-2)
• Татар теленең язма корпусы һәм тел мәсьәләләре // "Мәдәни җомга" (2012 №32)
• К построению структурно-функциональной модели ценностной ориентации татарского этноса (по материалам письменного корпуса татарского языка) // Языки России и стран ближнего зарубежья как иностранные: преподавание и изучение: материалы Международной научно-практической конференции (28-29 ноября 2013 г.)
• Письменный корпус татарского языка: идеи, проблемы, решения // Нематериальное культурное наследие тюркских народов как объект сохранения: сборник материалов Международной научно-практической конференции (16-19 июля 2014 г.)
• Письменный корпус татарского языка с озвучением визуализированных предложений как инструмент лингвистических исследований // Сопоставительная филология и полилингвизм: Материалы Всероссийской научно-практической конференции (Казань, 19-21 ноября 2014 г.)
• Письменный корпус татарского языка: структурные и функциональные характеристики // Актуальные проблемы диалектологии языков народов России: Материалы XIV Всероссийской научной конференции (Уфа, 20-22 ноября 2014 г.)
• Татар теле, татарлар һәм ассимиляция күренеше // "Фәнни Татарстан" (2015 №1)
• The language situation of an ethnic community (on the material of the Corpus of written Tatar language) // "Tatarica" (2015 №4)
• Языковое состояние этнической общности на материале Письменного корпуса татарского языка // "Tatarica" (2015 №4)
• Фонология татарского языка в плане теории фонемы И.А. Бодуэна де Куртенэ // И.А. Бодуэн де Куртенэ и мировая лингвистика: международная конференция: V Бодуэновские чтения (Казанский федеральный университет, 12-15 октября 2015 г.)

• Corpus of Written Tatar (Corpus of Tatar language) - Official site