Metadata-Version: 2.1
Name: pipekit
Version: 0.3.2
Summary: Tools for flow-based programming
Home-page: https://github.com/ncadou/pipekit
Author: Nicolas Cadou
Author-email: ncadou@cadou.ca
License: UNKNOWN
Keywords: etl workflow flow-based pipe pipeline queue data processing
Platform: UNKNOWN
Classifier: Development Status :: 3 - Alpha
Classifier: Framework :: AsyncIO
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Dist: python-box
Requires-Dist: janus
Requires-Dist: strictyaml

Pipekit
=======

Pipekit_ is a flow-based_ programming toolkit, with a control layer.

.. _Pipekit: https://github.com/ncadou/pipekit
.. _flow-based: https://en.wikipedia.org/wiki/Flow-based_programming


Quick start
===========

Pipekit connects message processors using pipes. Pipes are just a thin layer on
top of Queue_ objects and 0mq_ sockets, wrapping them under a common API. The
basic idea behind this abstraction is the possibility to transparently replace
a pipe implementation with another one, with no code change needed in the
producers/consumers.

Pipes simply have an input and an output channel; creating and using them is
pretty straightforward:

.. code:: python

    from pipekit import ThreadPipe

    # Pipes need to be given a name
    mypipe = ThreadPipe('my-pipe')
    mypipe.send('Hello world')

    print(mypipe.receive())
    # Hello world

Pipes are iterables, too:

.. code:: python

    for msg in mypipe:
        dosomething(msg)

Need a 0mq-based pipe instead?

.. code:: python

    from pipekit import ZMQPipe

    my0mqpipe = ZMQPipe('my-0mq-pipe', address='tcp://*:5555')

Alternatively:

.. code:: python

    from pipekit import Pipe

    my0mqpipe = Pipe('my-0mq-pipe', impl='zmq', address='tcp://*:5555')
    print(my0mqpipe)
    # <pipekit.ZMQPipe object at 0x7fe...>

.. _Queue: https://docs.python.org/3/library/queue.html
.. _0mq: http://zeromq.org/


