dagster

About this project

Dagster is a cloud-native data pipeline orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. It is designed for developing and maintaining data assets, such as tables, data sets, machine learning models, and reports. With Dagster, you declare—as Python functions—the data assets that you want to build. Dagster then helps you run your functions at the right time and keep your assets up-to-date. Here is an example of a graph of three assets defined in Python: The graph loaded into Dagster's web UI: Dagster is built to be used at every stage of the data development lifecycle -…

GitHub

Reviews

Built by

dagster-io

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain dagster-io/dagster? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

d3

Data

Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:

★ New113.7K stars

by d3

devops-exercises

Data

Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes, Terraform, OpenStack, SQL, NoSQL, Azure,

★ New84.4K stars

by bregman-arie

grafana

Data

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple

★ New76.6K stars

by grafana

redis

Data

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-r

★ New76.3K stars

by redis