Skip to content

v0.3.0

Choose a tag to compare

@github-actions github-actions released this 13 Apr 21:11
· 167 commits to main since this release
Immutable release. Only release title and notes can be modified.

What's New?

  • Parallel Step Execution: You can now run independent steps concurrently by passing the --parallelism CLI flag or setting MaxDegreeOfParallelism in your execution options. Use --parallelism auto to match your machine's core count automatically. Flowthru's DAG guarantees are preserved — steps only run in parallel when their dependencies allow it.
  • GraphQL Extension: We've added Flowthru.Extensions.GQL, which lets you use GraphQL endpoints as catalog entry sources and sinks. You can wire queries and mutations into your catalog using GqlItemFactory, with built-in pagination support for large result sets.

To demonstrate both parallelism and the new GraphQL support, we've added an end-to-end Spaceflights pipeline that runs ingestion, data science, and reporting stages against GraphQL data sources.

🚀 Features

  • multithreading implementation (934adee)
  • multithreaded flows (e0331e5)

🩹 Fixes

  • agent hook (98c1cad)
  • programmatic defaults for core counts (67a1065)
  • corrected log output (107ceea)
  • correct test assertion on CLI incoming (780386d)
  • add multithread to split pipeline example (4b7f4af)
  • refactor gql to better fit (c32837b)

❤️ Thank You

  • Spencer Elkington