v0.3.0
·
167 commits
to main
since this release
Immutable
release. Only release title and notes can be modified.
What's New?
- Parallel Step Execution: You can now run independent steps concurrently by passing the
--parallelismCLI flag or settingMaxDegreeOfParallelismin your execution options. Use--parallelism autoto match your machine's core count automatically. Flowthru's DAG guarantees are preserved — steps only run in parallel when their dependencies allow it. - GraphQL Extension: We've added Flowthru.Extensions.GQL, which lets you use GraphQL endpoints as catalog entry sources and sinks. You can wire queries and mutations into your catalog using
GqlItemFactory, with built-in pagination support for large result sets.
To demonstrate both parallelism and the new GraphQL support, we've added an end-to-end Spaceflights pipeline that runs ingestion, data science, and reporting stages against GraphQL data sources.
🚀 Features
🩹 Fixes
- agent hook (98c1cad)
- programmatic defaults for core counts (67a1065)
- corrected log output (107ceea)
- correct test assertion on CLI incoming (780386d)
- add multithread to split pipeline example (4b7f4af)
- refactor gql to better fit (c32837b)
❤️ Thank You
- Spencer Elkington