Operations & Incident Response

Performance Optimization

Optimize pipelines when they're missing SLAs, warehouse costs are climbing, or you need to prove ROI on optimization efforts.

Prompt Template

Copy Template

Review [PIPELINE_NAME] for performance optimization:- Identify bottlenecks- Suggest component improvements- Recommend clustering/partitioning strategies- Estimate performance gains

Retail

Industry Example

Copy Example

Review retail-analytics/daily_store_inventory_reconciliation.orch.yaml for performance optimization:- Identify bottlenecks (currently taking 2.5 hours to process 150 stores)- Suggest component improvements for the store-level aggregations- Recommend clustering/partitioning strategies for the INVENTORY.TRANSACTIONS table (500M rows)- Estimate performance gains if we switch to incremental processing

Prompt Details