Metadata-Version: 2.1
Name: language-detector
Version: 5.0.0
Summary: Detect language of text
Home-page: https://github.com/DanielJDufour/language-detector
Author: Daniel J. Dufour
Author-email: daniel.j.dufour@gmail.com
License: UNKNOWN
Download-URL: https://github.com/DanielJDufour/language-detector/tarball/download
Description: [![Build Status](https://travis-ci.org/DanielJDufour/language-detector.svg?branch=master)](https://travis-ci.org/DanielJDufour/language-detector)
        
        # language-detector
        language-detector detects the language of text
        
        # Installation
        ```
        pip install language-detector
        ```
        
        # Python Version
        Works with both Python 2 and 3
        
        # Use
        ```
        from language_detector import detect_language
        text = "I arrived in that city on January 4, 1937"
        language = detect_language(text)
        # prints English
        ```
        
        # Features
        | Languages Supported |
        | ------------------- |
        | Arabic |
        | English |
        | Farsi |
        | French |
        | German |
        | Kurmanci (Kurdish) |
        | Mandarin |
        | Russian |
        | Sorani (Kurdish) |
        | Spanish |
        | Turkish |
        
        # Testing
        To test the package run
        ```
        python -m unittest language_detector.tests.test
        ```
        
        # Comparison
        Test is a comparison of how well language-detector and langid identify languages in the [data sources](language_detector/prep/sources).
        | package | language-detector | langid |
        | ------- | ----------------- | ------ |
        | test-duration (in seconds)| 0.10 | 3.83 |
        | accuracy | 96.77% | 67.74% |
        
        
        # Excluding Languages
        If you don't want language-detector to look for certain languages, you can monkey-patch the code.  For example, in order to exclude English:
        ```
        import language_detector
        language_detector.char_language = [cl for cl in char_language if cl[1] != "English"]
        
        # proceed as normal
        ``` 
        
        # Datasets
        The following is a list of datasets used for each language:
        | Language | Datasets |
        | ------------------- | -- |
        | Arabic | [UN Corpora](http://www.uncorpora.org/) |
        | English |  [UN Corpora](http://www.uncorpora.org/) |
        | Farsi | [BBC News Persian](https://www.bbc.com/persian) | 
        | French | [UN Corpora](http://www.uncorpora.org/) |
        | German | [Deutsche Welle](https://www.dw.com/de) |
        | Kurmanci (Kurdish) | [Rudaw](https://rudaw.net/kurmanci) |
        | Mandarin | [UN Corpora](http://www.uncorpora.org/) |
        | Russian | [UN Corpora](http://www.uncorpora.org/) |
        | Sorani (Kurdish) | [Rudaw](https://www.rudaw.net/sorani) |
        | Spanish | [UN Corpora](http://www.uncorpora.org/) |
        | Turkish | [BBC News Türkçe](https://www.bbc.com/turkce) | 
        
        # Contributing
        If you'd like to contribute a new language, please consult [CONTRIBUTING.md](CONTRIBUTING.md)
        
        # Support
        Contact the package author, Daniel J. Dufour, at daniel.j.dufour@gmail.com
        
Keywords: arabic,farsi,french,kurdish,kurmanci,language,nlp,python,sorani,spanish,tagging,turkish
Platform: UNKNOWN
Classifier: Development Status :: 5 - Production/Stable
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Description-Content-Type: text/markdown
