Metadata-Version: 2.1
Name: dagster-unity-catalog-polars
Version: 0.1.4
Summary: Polars Unity Catalog IO Managers for Dagster
Author-email: Gian Violi <96206151+gfvioli@users.noreply.github.com>, Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>, Stefan Verbruggen <27513235+sverbruggen@users.noreply.github.com>
Keywords: dagster,polars,io manager,databricks,unity catalog
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: dagster
Requires-Dist: databricks-sdk>=0.40.0
Requires-Dist: databricks-sql-connector>=3.7.0
Requires-Dist: polars
Requires-Dist: pydantic>=2.9.2

# Dagster Unity Catalog Polars

A IO Manager to read Unity Catalog Tables in Dagster orchestrated pipelines.

## Instantiating the IO Manager

To instantiate the IO Manager you need to pass a non-cached token generating function as a `Callable[..., str]` such that the load functions generate and refresh the thoken as needed. Is set to every 1000 queries by default, this should suffice most of the time.
You also need to pass the server hostname to your databricks workspace and the SQL Warehouse endpoint to which you'll be connecting to.

