/
2.30 Release Notes

2.30 Release Notes

 

Oct 30, 2025

This release introduces powerful improvements in incident clarity, cost accuracy, workflow analysis, and top recommendations performance, while also addressing critical bugs and user feedback. The update focuses on making cost governance even more actionable and precise.

🔍 Key Highlights:

  • Smarter incident insights with clearer signals and improved filtering logic

  • Faster Top Recommendations loading and better sorting for large environments

  • Enhanced workflow cost analysis including multi-attempt breakdowns and foreach tasks

  • Refined budgeting tools to help you align with commits and forecast usage accurately

  • Dozens of UI, stability, and performance fixes across core modules

 

🔔 Incident Detection & Clarity

📌 Improved Cost Incident Signals

  • Incident icons now reflect cost source: We now show whether an incident is based on real or estimated costs, and display warning icons when only estimated data is available.

  • Suppress false positives: Incidents from deleted warehouses or invalid assets are now excluded from reports.

  • Better duplicate detection: We’ve corrected logic that caused repeated incidents for the same cost issue in some cases.

📊 Accurate Percentages in Small Cost Changes

  • Cost differences under $2 no longer show misleading large percentage shifts (e.g., from $1 to $2 no longer shown as 100%).

🏷️ Incidents Ticket Design Update

  • support hide/show path of the incidents tickets

  • support show/hide ticket details table per incidents ticket

  • update design of incidents page to new tabular format

  • enhance background color for incidents root cause

image-20251030-151816.png

 

 

💡 Top Recommendations

  • expose VM Category in the table for recommended VMs

image-20251030-154530.png

 

⚡ Faster Load & More Relevant Sorting

  • Sorting by average cost or total cost now works correctly across environments, even when data volume is large.

  • Optimized queries ensure the Top Recommendations view loads in seconds, even for customers with thousands of jobs.

🛠️ Recommendation Quality Fixes

  • Corrected a mismatch where run recommendations showed higher cost than the actual job/workload report.

  • Added missing Photon flags in cluster recommendations.

  • Reworked labels and suggestions for better guidance in decision-making.

🗂️ Vendor Consolidation

  • filter by workspace on Migration Opportunities table

image-20251030-151559.png

 

📈 Spend Insights & Forecasting

  • enhance Workspace Cost breakdown columns search

    • navigate and preselect columns when navigating from Cost Over Time

    • selected column scrolls into view

image-20251030-150924.png
step 1 - select feature to see breakdown by workspace
image-20251030-150949.png
step 2 - selected feature
image-20251030-150838.png
step 3 - customize view

📆 Budget & Commit Enhancements

  • You can now accurately configure monthly commits for past and current years.

  • Fixed incorrect saving of values when navigating without clicking Save.

  • UI adjustments improve understanding of forecast accuracy and commit utilization.

 

 

🔄 Workflow Cost Breakdown

  • on cluster instances page for APCs add column "Cost per GB"

image-20251030-154352.png
Cost of Data

  • cost breakdown at job run level

image-20251030-154915.png

  • tooltip stating the reasons why costs are NA when 24h have not passed

    • pending state for recent costs

image-20251030-155214.png

 

 

🔍 Per-Attempt Cost Attribution

  • Job runs with multiple attempts now show cost and duration per attempt, improving visibility into retry-heavy workloads.

  • Foreach task costs are now isolated and shown correctly in the cost breakdowns.

🧱 Pipeline & Cluster Analysis

  • Improvements in cluster start time recording for pipeline tasks and foreach runs.

  • DLT pipeline cost attribution is now more stable and no longer misclassified in “Other” cost.

📁 CSV export

  • rename "Data Processed" to "Data Usage" in Export CSV for pages

    • Workflow Runs > Single Run

    • All Purpose Clusters | Jobs

    • Workflows > Workflow Runs

    • Workload > Notebooks

 

🧪 Navigation, Quality of Life & Bug Fixes

  • Tooltips and label inconsistencies across recommendations and incidents have been corrected.

  • UI errors when switching between Workloads, Incidents, and Telemetry views are now resolved.

  • Show workspaceId alongside name on dropdown selector

image-20251030-151151.png

  • export assessment provides more information, a text that explains the catalog/schema in UC where results are exported

  • updated Settings menu

    • rename Settings to Monitor Setup

    • moved email notifications to navigation sidebar

    • move tags management to sidebar navigation under Settings

    • moved incidents policies to as a unique page in settings

image-20251030-153101.png
main settins panel

 

image-20251030-153121.png
updated Monitor Setup panel
image-20251030-153154.png
updated Incidents policies panel

 

 

✅ Behind the Scenes

  • Improved performance of rules engine for SKU Cost and Forecasting incidents.

  • Added internal support for identifying and filtering serverless and system tables more efficiently.

  • Enhanced support for scoped incident rules by subscription and workspace (visible in rule configuration).

  • updated LHO emails design

    • template now supported by older email clients

image-20251030-152927.png

 

 

 

📧 If you’re interested in enabling fine-grained thresholds, custom scoped rules, or want support in rolling out new forecasting features, please contact our team.

 

 

Sep 18, 2025

Cost Over Time Total

Updated Total Cost summary on Cost Over Time page to only show the total of selected components.

  • disclaimer: Cost Over Time page displays rounded numbers. For complete decimals please see tooltips.

image-20250918-134947.png

 

Weekly Data KPIs

Weekly granularity for Data KPIs trends

  • total cost

  • data usage

  • TB per day – average amount of

  • cost per TB – cost per TB for processed data

  • cost per cluster hour – average cost per hour of all active clusters

  • cost per hour – average total cost per hour

image-20250918-071635.png
cost and data usage trends aggregated per week
image-20250918-071650.png
TB per day aggregated per week
image-20250918-071719.png
image-20250918-071804.png
image-20250918-071816.png

 

Cost Breakdown Clarity

Update tooltips for Cost Over Time charts to include also day of the week besides the date.

image-20250918-134434.png

Updated tooltips for subscription and workspace selection to include ID information.

image-20250918-134600.png

 

 

Selecting candidates for optimization

Added navigation from recommendations from Job Runs to trends of those Runs to enhance outlier detection and choosing which run to review in order to optimize.

image-20250919-125146.png
image-20250919-125100.png
image-20250919-125123.png

 

 

Unitiy Catalog Export History

  • user is now be able to see the last export's timestamp, by whom it was generated 

    and where it saved and how long it took (duration)

  • export history also supports filtering by subscription and workspace and time when the export occured

image-20250919-140006.png
image-20250919-140030.png
image-20250919-140049.png
image-20250919-140238.png
image-20250919-140107.png

 

 

Notebooks name

  • exposed "Name" of the notebook by extracting it from Notebook Path

image-20250919-141016.png
image-20250919-141109.png

 

 

 

Performance improvements

  • improved performance when listing dependent vendors for pipelines

  • subscriptions and workspaces are loaded from LHO database instead of being read from Databricks API

 

 

Simplified Cost Information

  • on workloads abbreviate numbers over 1000 ($1345.57 = $1.35k)

 

 

Fixed Bugs

  • Workloads: Trend - Tasks: tooltip wrongly displays "Ran on All Purpose Cluster" for serverless tasks

  • Date range is lost when navigating from Workloads Jobs and APC to Recommendations after changing workspace or applying search