Home

Kedro Light provides a minimal interface to Kedro and Kedro-Viz. You can install it via PyPI with 

pip install kedro-light
Kedro Light is intended for when you want to use Kedro's data catalog system and pipeline objects (to separate data from logic), as well as its visualisation capabilities, but don't want to embrace the full Kedro project structure and workflow. Kedro Light defines/re-exports the following functions:

  • data_catalog creates a DataCatalog (for loading/saving named datasets)
  • node creates a Node (for transforming named datasets)
  • pipeline creates a Pipeline using Kedro's modular pipeline constructor (this defines a DAG of data transformations)
  • run and run_node run a pipeline or node respectively
  • show serves a web app that displays a collection of pipelines

A condensed usage example is given below. Further details can be found here.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
import kedro_light as kl

catalog = kl.data_catalog(project_path=..., conf_source=...)

node = kl.node(func=..., inputs=..., outputs=...)
dag = [node, ...]

pipeline = kl.pipeline(dag)
kl.run(pipeline, catalog)

pipelines = {"__default__": pipeline, ...}
kl.show(pipelines, catalog)