📂 This week in Maia: File uploads, OpenLineage events, and more

Welcome back to the Maia New Features Blog! This week you can load your own files straight into Maia, send lineage to your data catalog, and get more from the pipeline activity page and Convert Workloads. Read on for the highlights, and see the changelog updates for more.

📂 Upload files straight into Maia

What's new: You can now upload files from your own computer directly into Maia, with no cloud storage setup. This works for CSV, Excel, JSON, Avro, Parquet and ORC files. You can also upload PDFs and images, and Maia reads them automatically. Add files in three places: Maia chat, the Add to Canvas window, and the file picker inside each component.

Why it helps: You can try Maia on data you already know, without first moving files into your own S3 or Blob storage.

• Simple uploads: Choose what to upload and when. Drag in several files at once and watch the progress. If a file has the same name as an existing one, it gets a version number instead of being overwritten.
• Safe by default: Every file is scanned for viruses before you can use it.
• Available across the product: Uploaded files appear in Maia chat, in Add to Canvas and in seven components, including Excel, CSV, JSON, Avro, Parquet, ORC and the File Iterator. When you add a file from Add to Canvas, the right load component is placed on the canvas and set up for you.
• PDFs and images: The Amazon Textract component processes these files, so Maia can pull structured data, such as a table of email addresses, out of a scanned document.

Availability: File upload is available today for Snowflake and Databricks projects that use Matillion Hosted Runners.

🔗 OpenLineage emitter

What's new: Maia now sends lineage as OpenLineage events to any tool that supports the standard. Create a lineage integration once, and Maia sends the lineage for each pipeline execution to your endpoint in near real time.

Why it helps: Your data catalog or governance platform stays up to date as your pipelines run, without a custom integration to maintain.

• Governance teams: See Maia pipelines in the same lineage graph as the rest of your data stack.
• Data owners: Check what a change to a table will affect before you make it.
• Analysts: Trace a number back through Maia to where it started.

📊 A better pipeline activity page

What's new: The pipeline activity page is built around the way you monitor your pipelines day to day, so you can find what you need with less scrolling.

• Runner column and filter: Show the runner column and filter executions by runner, so you can spot a runner that needs attention.
• Jump to the schedule: Go straight from an execution to its schedule.
• Link to the runner: Go directly from an execution to the runner management page.
• Expand all: Expand all child pipelines and steps in one click, with lines that make the structure easy to follow.
• Resizable columns: Resize columns so you can read the whole value.

Also in this release:

• Column filters and saved views: Filter by any column, and save your custom columns view to your profile to re-apply next time.
• Reorder and sort: Reorder columns and sort by any of them.
• Global search: Search across all column values.
• Step status filter: Filter steps by status: Success, Failed or Skipped.

🔄 Convert Workloads improvements

What's new: Convert Workloads has had a number of updates to help you move existing workloads into Maia.

• Ascend.io support: Ascend.io is now a supported source platform.
• SQL and Other sources: SQL is a first-class source platform. You can also choose "Other" to upload any text-based source platform that does not have native support yet.
• Better analysis: Platform-specific analysis has improved across the board.
• Live progress: Streaming updates in the UI show which stage the analysis has reached and how many workloads it has found.
• Resume where you left off: If you refresh your Maia tab or your network connection drops briefly, your analysis is kept. It resumes automatically, or asks if you want to resume when the page loads.

💬 We'd love to hear from you!

Let us know how these features are helping you in the Matillion Community. Your ideas and stories help shape what we build next.