Installation

Introduction

To use the Tokern Lineage engine, you need to:

  • Deploy the engine with access to a Postgres database.
  • Set up and test integration libraries with your favorite ETL tools like Apache Airflow or dbt.
  • Browse lineage graphs or programmatically analyze graphs in Python notebooks.

Getting started using Docker

This guide will help you get the Tokern Lineage engine and Postgres running as Docker containers using Docker Compose. This is the easiest way to set up Tokern Lineage engine on your local environment.

Prerequisites

Step 1: Get the docker-compose file

The tokern/data-lineage/install-manifests repo contains all installation manifests required to deploy Tokern anywhere. Get the docker compose file from there.

Tokern Lineage with Postgres loaded with demo data

# in a new directory run
wget https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose-demodb/docker-compose.yml
# or run
curl https://raw.githubusercontent.com/tokern/data-lineage/master/install-manifests/docker-compose-demodb/docker-compose.yml -o docker-compose.yml

Step 2: Run Tokern Lineage engine & Postgres

docker-compose up -d

Check if the containers are running

docker ps
CONTAINER ID IMAGE CREATED STATUS PORTS NAMES
3f4e77845b81 tokern/data-lineage-viz:latest ... 4 hours ago Up 4 hours 0.0.0.0:8000->80/tcp tokern-data-lineage-visualizer
1e1ce4efd792 tokern/data-lineage:latest ... 5 days ago Up 5 days tokern-data-lineage
38be15bedd39 tokern/demodb:latest ... 2 weeks ago Up 2 weeks tokern-demodb

Step 3: Try out the Tokern Lineage App

Head to http://localhost:8000/ to open the Tokern Lineage app