2.8.0 Release Notes

 

 

 

✨ Release Highlights

  • Rearchitected the analysis pipeline and separated telemetry analysis from cluster events/configurations loading for:

    • removing the dependency of estimate cost from the telemetry so they can be computed from day one without Databricks or Cloud consumption data sources (all up tenant/account and tag distribution)

    • significantly improving the scalability of the Databricks Analyzer Job (DAJ)

  • “all subscriptions” option on Workspace Cost page

  • telemetry, cost estimates and performance reporting

  • DLT telemetry is back! with full support for incidents and recommendations

  • Analysis Management complete with all LHO background services

  • Google Cloud as Identity Provider supported for the AWS version of LHO

 

📊 Evaluation Reports

Telemetry Snapshot

Success Criteria (Optimization) Report

Cost Estimation Report

 

 

🔦 Tenant Overview

  • 7683 - Report telemetry snapshot data by month ( report last three months )

Workspace Cost Overview

 

📂 Workloads // Workspaces

 

Workloads // Workflows

 

🖥️ Workloads // All purpose clusters

 

💠 Workloads // Pools

 

💠 Workloads // SQL Warehouses

 

✅ Incidents & Recommendations

  • 7808 - Expose recommendations for DLT pipeline updates

❤️ Incidents // Cost

 

❤️ Incidents // Performance

 

🔔 Incidents Notifications

 

Security

 

Performance Optimizations

 

📊 Analysis Optimizations

  • 7684 - handle cluster idleness computation for the scenario in which the cluster has been running for several days without generating new cluster events

  • 7470 - save the timestamp of the max cpu and max memory points of a workload/cluster

  • 7713 - Use case-insensitive regex matching for resourceType in Azure

  • 7771 - optimize Databricks cluster configuration retrieval

  • 7818 - investigate missing tags in the cluster configuration

    • Added better logic to retrieve the cluster config from analysis during the migration

    • Added improved logic that will not reprocess the already processed cluster instances.

    • When Databricks config not available use the latest cluster configuration.

  • 7822 - Spot instance negative max bid price causes underestimation of vm prices

🪩 UX Optimizations

  • 7646 - group multiple actions menu for cells with multiple icons

  • 7652 - add "Reanalyze this run" action button the group action menu

  • 7624 - enhance width by using minimized tabs for Workloads, Incidents, Provisioning pages

🎛️ Configuration & Provisioning

  • 7648 - make "shared compute" clusters use an orange badge

  • 5518: [ui] settings per workspace - show if unity catalog is enabled or not

Operational Management // Telemetry Analysis

  • 7834 - Add audit for estimated cost and tags analysis

📈 Operational Management // Consumption (Cost) Analysis

 

📙 AWS Support

 

Miscellaneous

  • 7653 - show cluster time breakdown tooltip on hover over the entire cell, not only when hovering over the bar chart

🐞 Fixed Bugs

  • 7732 - Miss-match between line position and Monthly total commit

  • 7698 - Data Skew icon on badge not visible when using light theme

  • 7733 - Hide right side when no workspaces available for the selected subscription

  • 7438 - Refresh progress button not visible on Detection history when white theme is used

  • 7297 - On Consumption run history, clear searchValue when the window is closed and reopened

  • 7809 - DLT Incidents start and end time are not set in the URL

Documentation

  • 7600 - add policy documentation for Clusters > Shutdown Timeout Missing

🎁 Coming Soon