Metadata-Version: 2.1
Name: nlpvocab
Version: 1.2.0
Summary: Frequency vocabulary for NLP purposes
Home-page: https://github.com/shkarupa-alex/nlpvocab
Author: Shkarupa Alex
Author-email: shkarupa.alex@gmail.com
License: MIT
Description: # nlpvocab
        
        Tokens frequency counter with save/load features.
        Supports save/load with Pickle and TSV formats.
        
        Provides 2 command-line scripts for building words and characters frequency vocabularies.
        
        ## Usage from Python
        
        ```python
        
        from nlpvocab import Vocabulary
        
        text  = 'token1 token2 token1 token2 token3'
        
        vocab = Vocabulary()
        vocab.update(text.split())
        vocab.save('vocab.tsv', format=Vocabulary.FORMAT_TSV_WITH_HEADERS)
        ```
        
        ## Usage from command line
        
        ```bash
        
        nlpvocab-chars /a/b/d/e dir_chars_vocab.tsv
        nlpvocab-words /a/b/d/e dir_words_vocab.tsv
        nlpvocab-chars /a/b.txt file_chars_vocab.tsv
        nlpvocab-words /a/b.txt file_words_vocab.tsv
        ```
        
Platform: UNKNOWN
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering
Classifier: Topic :: Software Development
Classifier: Topic :: Software Development :: Libraries
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Description-Content-Type: text/markdown
