🚀 Impact Stream provides instant insights into downstream pipeline dependencies

Welcome back to the Maia New Features Blog! This week, we're excited to introduce Impact Stream, a game-changing feature that transforms how you handle pipeline failures by automatically surfacing downstream dependencies right when you need them most.

🔍 Trace dependencies in seconds with Impact Stream

When a pipeline fails, there’s always one question that your engineers need to answer: What else is affected? Until now, answering that required previous tribal knowledge or manual review—locating the failed dataset and tracing dependencies by hand.

Impact Stream solves this problem. It surfaces downstream dependency information automatically at the moment of a pipeline failure, with no manual lineage navigation required. It’s made up of two parts:

• Pipeline tree: The pipeline tree on the left shows the hierarchy of pipelines involved in the run, starting from the root pipeline. Each node displays the orchestration or transformation pipeline’s name, its environment, and a colored dot indicating its status.
• Impact Stream canvas: When lineage is available, the Impact Stream canvas shows how datasets and pipelines connect to one another, with arrows showing the direction of data flow. Each node is outlined in a color indicating its status:
  • 🔴 Failed:The pipeline or dataset encountered an error
  • 🟡 Potentially affected: The pipeline or dataset is downstream of the failure and may be affected, but wasn't directly executed
  • ⚪ Unaffected: The pipeline or dataset has no dependency relationship with the failure
  • 🟢 Success: The pipeline or dataset was processed without error
  • Not executed: The pipeline or dataset didn't run as part of this execution

To access a failed pipeline’s impact stream, in the left navigation, click Activity, then Pipeline runs. Click the target icon next to any failed run to view its impact stream.

It’s important to note that Impact Stream isn't a replacement for Lineage. Lineage is your always-on, comprehensive dependency map. Impact Stream is a run-specific, on-demand triage view, scoped to a single failure, generated instantly.

For more information, read our Impact Stream guide.

💬 We'd Love to Hear From You!

Let us know how these new features are improving your workflows—we're all ears! Feel free to add any comments or questions below.

‍