Swith to large model in splitting sentences. The results are better.

Small script to fix GigaCloud bug

Sentence separator

Split text by sentences with spacy

Clean up code

update count_lemmas.py

Optimize tokenization

Iterate by sentences

Convert to lowercase

Text files

First version.