main
Stanislav N Mikhailov
Test srtings
Added TokkenThread class
Downgrading cmake
Initial commit
Added boost::nowide for Cyrillic characters
Files are correctly distributed among the threads
Added tokenizer