Data & analytics, with a verdict on each.
Moving data between systems, scheduling the jobs that do it, and putting a chart in front of someone who needs to decide.
Self-hosting these has real operational weight. Price your own hours before you price the licence you are avoiding.
Moving fastest this week: superset (+468), kestra (+452), airflow (+359).
Adopt now
3Mature enough to put in production this quarter.
Python workflow orchestration framework
Instead of: Manual scripting or paid Zapier/IFTTT
Data validation and profiling tool
Instead of: Manual data quality checks
Data engineering best practices in Python
Instead of: Manual data engineering research
Pilot it
7Worth a timeboxed spike before you bet on it.
Open-source workflow orchestration platform
Instead of: Apache Airflow or manual scripting
A self-hosted business-intelligence platform: dashboards, charts and SQL exploration over your existing databases.
Instead of: Per-viewer pricing on a hosted BI tool.
Open-source data integration for ELT pipelines
Instead of: Manual data scripting or paid ETL tools
Data pipeline orchestration tool
Instead of: Manual scripting or paid ETL tools
Kubernetes workflow engine
Instead of: Manual scripts or paid workflow tools
Python tool for building data web apps
Instead of: Manual web app development or paid data platforms
Data pipeline builder and manager
Instead of: Manual ETL scripts or paid tools like Fivetran
Watch, or skip
5Real software; just not where a small team's next hundred hours should go.
Rust-based incremental data indexing engine
Instead of: Manual data indexing or paid ETL tools
Python library for graph‑native context storage and retrieval for AI systems
Instead of: custom ad‑hoc context databases or flat‑file logs
The long-standing standard for scheduling and monitoring data pipelines with dependencies between steps.
Instead of: A wall of cron entries and no idea which one failed last night.
Real-time event streaming platform
Instead of: Custom Kafka or ETL pipelines
Python-powered shell for data tasks
Instead of: Bash or manual Python scripts
Data & analytics, in short
- What are the best open source data and analytics tools right now?
- We would put prefect, great_expectations, Cookbook into production this quarter. prefect — Python workflow orchestration framework The full list below ranks 15 by momentum, size and how recently they shipped.
- Which of these can I use in a commercial product?
- 13 of the 15 carry a permissive licence (MIT, Apache-2.0, BSD). 2 do not — airbyte (Custom / check the LICENSE file), xonsh (Custom / check the LICENSE file). Copyleft and source-available licences carry obligations when you ship them inside something you sell. Read the LICENSE file; this is a reading of the label, not legal advice.
- How is this list ranked?
- By real week-over-week star movement first, with a size floor so an established tool is not buried by a two-week-old project, and a hard penalty for anything that has stopped shipping. Verdicts are an editorial call for a team of 2-20 with limited engineering hours — not a judgement on the software, and not the same call we would make for a lab.
Which of these matters to your business?
Tell us what you sell in one sentence and we will hand you three specific moves — priced per month, with the arithmetic shown. Free, no signup.
Give me three moves