Metadata-Version: 1.1
Name: overtokenizer
Version: 0.2.0
Summary: Unicode-based language-agnostic (over-) tokenizer.
Home-page: https://bitbucket.org/luismsgomes/overtokenizer
Author: Luís Gomes
Author-email: luismsgomes@gmail.com
License: LGPLv2
Description: ===============
         overtokenizer
        ===============
        
        This package provides a simple language-agnostic tokenizer.
        
        Copyright ® 2016, Luís Gomes <luismsgomes@gmail.com>.
        
        This library is free software; you can redistribute it and/or
        modify it under the terms of the GNU Lesser General Public
        License as published by the Free Software Foundation; either
        version 2.1 of the License, or (at your option) any later version.
        
        This library is distributed in the hope that it will be useful,
        but WITHOUT ANY WARRANTY; without even the implied warranty of
        MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU
        Lesser General Public License for more details.
        
        You should have received a copy of the GNU Lesser General Public
        License along with this library; if not, write to the Free Software
        Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA  02110-1301  USA
        
Keywords: text tokenization pre-processing
Platform: UNKNOWN
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Topic :: Text Processing :: Linguistic
Classifier: License :: OSI Approved :: GNU Lesser General Public License v2 or later (LGPLv2+)
Classifier: Programming Language :: Python :: 3.5
