Metadata-Version: 1.1
Name: rakutenma
Version: 0.3.1
Summary: morphological analyzer (word segmentor + PoS Tagger) for Chinese and Japanese
Home-page: https://github.com/ikegami-yukino/rakutenma-python
Author: Yukino Ikegami
Author-email: yukino0131@me.com
License: Apache Software License
Description: Rakuten MA Python
        ===================
        
        |travis| |coveralls| |downloads| |pyversion| |version|  |landscape|  |license|
        
        Rakuten MA Python (morphological analyzer) is a Python version of Rakuten MA (word segmentor + PoS Tagger) for Chinese and Japanese.
        
        For details about Rakuten MA, See https://github.com/rakuten-nlp/rakutenma
        
        See also http://qiita.com/yukinoi/items/925bc238185aa2fad8a7 (In Japanese)
        
        Contributions are welcome!
        
        
        Installation
        ==============
        
        ::
        
         pip install rakutenma
        
        Example
        ===========
        
        .. code:: python
        
         from rakutenma import RakutenMA
        
         # Initialize a RakutenMA instance with an empty model
         # the default ja feature set is set already
         rma = RakutenMA()
        
         # Let's analyze a sample sentence (from http://tatoeba.org/jpn/sentences/show/103809)
         # With a disastrous result, since the model is empty!
         print(rma.tokenize("彼は新しい仕事できっと成功するだろう。"))
        
         # Feed the model with ten sample sentences from tatoeba.com
         # "tatoeba.json" is available at https://github.com/rakuten-nlp/rakutenma
         import json
         tatoeba = json.load(open("tatoeba.json"))
         for i in tatoeba:
             rma.train_one(i)
        
         # Now what does the result look like?
         print(rma.tokenize("彼は新しい仕事できっと成功するだろう。"))
        
         # Initialize a RakutenMA instance with a pre-trained model
         rma = RakutenMA(phi=1024, c=0.007812)  # Specify hyperparameter for SCW (for demonstration purpose)
         rma.load("model_ja.json")
        
         # Set the feature hash function (15bit)
         rma.hash_func = rma.create_hash_func(15)
        
         # Tokenize one sample sentence
         print(rma.tokenize("うらにわにはにわにわとりがいる"));
        
         # Re-train the model feeding the right answer (pairs of [token, PoS tag])
         res = rma.train_one(
                [["うらにわ","N-nc"],
                 ["に","P-k"],
                 ["は","P-rj"],
                 ["にわ","N-n"],
                 ["にわとり","N-nc"],
                 ["が","P-k"],
                 ["いる","V-c"]])
         # The result of train_one contains:
         #   sys: the system output (using the current model)
         #   ans: answer fed by the user
         #   update: whether the model was updated
         print(res)
        
         # Now what does the result look like?
         print(rma.tokenize("うらにわにはにわにわとりがいる"))
        
        
        NOTE
        ===========
        
        Added API
        --------------
        As compared to original RakutenMA, following methods are added:
        
        - RakutenMA::load(model_path)
          - Load model from JSON file
        
        - RakutenMA::save(model_path)
          - Save model to path
        
        misc
        --------------
        As initial setting, following values are set:
        
        - rma.featset = CTYPE_JA_PATTERNS  # RakutenMA.default_featset_ja
        - rma.hash_func = rma.create_hash_func(15)
        
        LICENSE
        =========
        
        Apache License version 2.0
        
        
        Copyright
        =============
        
        Rakuten MA Python
        (c) 2015- Yukino Ikegami. All Rights Reserved.
        
        Rakuten MA (original)
        (c) 2014 Rakuten NLP Project. All Rights Reserved.
        
        .. |travis| image:: https://travis-ci.org/ikegami-yukino/rakutenma-python.svg?branch=master
            :target: https://travis-ci.org/ikegami-yukino/rakutenma-python
            :alt: travis-ci.org
        .. |coveralls| image:: https://coveralls.io/repos/ikegami-yukino/rakutenma-python/badge.png
            :target: https://coveralls.io/r/ikegami-yukino/rakutenma-python
            :alt: coveralls.io
        
        .. |pyversion| image:: https://img.shields.io/pypi/pyversions/rakutenma.svg
        
        .. |downloads| image:: https://img.shields.io/pypi/dm/rakutenma.svg
            :target: http://pypi.python.org/pypi/rakutenma/
            :alt: downloads
        
        .. |version| image:: https://img.shields.io/pypi/v/rakutenma.svg
            :target: http://pypi.python.org/pypi/rakutenma/
            :alt: latest version
        
        .. |landscape| image:: https://landscape.io/github/ikegami-yukino/rakutenma-python/master/landscape.svg?style=flat
           :target: https://landscape.io/github/ikegami-yukino/rakutenma-python/master
           :alt: Code Health
        
        .. |license| image:: https://img.shields.io/pypi/l/rakutenma.svg
            :target: http://pypi.python.org/pypi/rakutenma/
            :alt: license
        
        
        CHANGES
        =======
        
        0.3 (2016-04-10)
        -------------------------
        
        - Add CUI ($ rakutenma)
        
        0.2.2 (2016-04-09)
        -------------------------
        
        - Bundle model files (model_ja.json, model_ja_min.json)
        - Support Windows
        
        0.2 (2015-01-10)
        -------------------------
        
        - Support Python 2.6 and 2.7
        
        0.1.1 (2015-01-08)
        -------------------------
        
        - Slightly improve performance
        
        0.1 (2015-01-01)
        -------------------------
        
        - First release.
        
Keywords: morphological analyzer,word segmentor,PoS Tagger
Platform: POSIX
Platform: Windows
Platform: Unix
Platform: MacOS
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Information Technology
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Natural Language :: Japanese
Classifier: Natural Language :: Chinese (Simplified)
Classifier: Natural Language :: Chinese (Traditional)
Classifier: Programming Language :: Python :: 2.6
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3.3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Classifier: Topic :: Text Processing :: Linguistic
