Data Orchestration · Founded by Pete Hunt in 2019

Dagster io

Data orchestrator platform that helps you build, schedule, and monitor reliable data pipelines - fast, flexible, and built for teams.

Cost

Free Tier

Rating

★ People love it

Time to value

Moderate Setup (1-3 hours)

You can use Dagster to build, schedule, and monitor reliable data pipelines across your organization. It helps you orchestrate ETL/ELT processes, data transformations, and AI/ML workflows while providing built-in observability features. The tool includes data lineage tracking, alerting, and real-time health metrics to keep your data flows running smoothly. You can integrate it with popular services like dbt, Databricks, Snowflake, and BigQuery for comprehensive data operations management.

What Dagster io does

Schedule and run ETL jobs that move data between systemsMonitor pipeline health and get notified of failures immediatelyTrack data lineage from raw sources to final dashboardsDebug pipeline issues using AI-powered error analysisSet up automated data quality checks at each pipeline stageCreate multi-tenant deployments for different business unitsOrchestrate machine learning model training and deploymentGenerate documentation that updates automatically with code changesBuilt-in data lineage visualization shows how data flows through pipelinesReal-time pipeline health metrics track freshness and performanceIntelligent alerts notify teams of issues in Slack automaticallyAI-powered debugging helps identify and resolve pipeline problemsMulti-tenant code deployments keep data isolated between teamsAuto-generated documentation stays current with pipeline changesGitOps integration manages pipeline changes through pull requestsCross-workspace orchestration connects multiple Databricks environments