Lemmatization with TreeTagger for Russian
Standard reference
Helmut Schmid (1995): Improvements in Part-of-Speech Tagging with an Application to German. Proceedings of the ACL SIGDAT-Workshop. Dublin, Ireland.
Analysis citation
Språkbanken (2021). sbx-rus-lemmatization-treetagger (updated: 2021-03-24). [Analysis]. Enriched and distributed by Språkbanken. https://doi.org/10.23695/n0qk-rt80
Example
This analysis is used with Sparv. Check out Sparv's quick start guide to get started!
To use this analysis, add the following line under export.annotations in the Sparv corpus configuration file:
- <token>:treetagger.baseform # Baseforms from TreeTagger
In order to use this annotation you need to add the following setting to your Sparv corpus configuration file:
metadata:
language: rus
For more info on how to use Sparv, check out the Sparv documentation.
Example output:
<token baseform="существовать">Существует</token>
<token baseform="ряд">ряд</token>
<token baseform="гипотеза">гипотез</token>
<token baseform="о">о</token>
<token baseform="происхождение">происхождении</token>
<token baseform="язык">языка</token>
<token baseform=",">,</token>
<token baseform="но">но</token>
<token baseform="ни">ни</token>
<token baseform="один">одна</token>
<token baseform="из">из</token>
<token baseform="они">них</token>
<token baseform="не">не</token>
<token baseform="мочь">может</token>
<token baseform="быть">быть</token>
<token baseform="подтвердить">подтверждена</token>
<token baseform="факт">фактами</token>
<token baseform="из-за">из-за</token>
<token baseform="огромный">огромной</token>
<token baseform="отдалённости">отдалённости</token>
<token baseform="происхождение">происхождения</token>
<token baseform="язык">языка</token>
<token baseform="от">от</token>
<token baseform="наш">нашего</token>
<token baseform="время">времени</token>
<token baseform=".">.</token>
Other references
Helmut Schmid (1994): Probabilistic Part-of-Speech Tagging Using Decision Trees. Proceedings of International Conference on New Methods in Language Processing, Manchester, UK.