2.7.0 Release Notes

 

✨ Release Highlights

  • Support "Published Workspaces" configuration for Azure deployments similar with what is supported for AWS

  • Auto Pilot for the SP to provision all jobs and clusters in Share Access Mode

  • Tenant Overview – provide global cost information across all accounts and subscriptions in one view

    • with Organizational Tagging support

    • with Estimated costs

  • Organizational Tagging Reporting

  • Integrated view for incidents and associated recommendations per job cluster for each job run

  • Support Annual Databricks and Cloud services commit per subscription

  • Provisioning Log

 

 

🔦 Tenant Overview

  • provide global cost information across all accounts and subscriptions in one view

    • with Organizational Tagging support

    • with Estimated costs

Tenant overview with Organizational Mapping support
  • 7249 - Total cost widget current month line is dotted since the estimated costs are not yet final

  • pre-compute estimated cost for selected tags

tags with cost estimation pre-computation

 

Workspace Cost Overview

  • 7080 - support add Annual Databricks commit option per subscription

 

Workloads // Workflows

  • 6951 - Provide provisioning incidents and Recommendations per job run and cluster id

  • 7052 - add duration, cost, start, end time per run on job runs page

    • summary information per job run

 

🖥️ Workloads // All purpose clusters

  • 6673 - in the cluster stats windows add cluster identification information

  • 7270 - on clusters view show entire cluster name in the tooltip besides the cluster id

  • 7110 - show pool badge on the autoscaling timeline when VMs are drawing from a Pool

 

❤️ Incidents // Performance

  • 6085 - generate a incident alert // performance when a job run fails

  • 6086: generate incident for jobs running on on all purpose clusters

 

✅ Incidents & Recommendations

  • 7246 - Cluster Information Update in Incidents and Recommendations Dialog

    • integrated view for incidents and associated recommendations per job cluster for each job run

  • 7254 - add scale-out recommendation for under-provisioned and spillage tickets

 

🪩 UX Optimizations

  • 6957: [UI] Incidents - Add a search button on the incidents page

    • trigger search on click instead on filter change to improve query efficiency and computation resource usage when searching with different combinations of time intervals and incident type selections

  • 6705 - make good skew, bad skew, n/a badges for Data skew to be of the same width

  • 4888 - Display truncated ids for DLT updates

 

🎛️ Configuration & Provisioning

  • 7000 - Auto Pilot for the SP to provision all jobs and clusters in Share Access Mode

  • 5629 - support "Published Workspaces" configuration for Azure deployments as we have for AWS

 

  • 6807 - add "Run Job" as new execution engine type on Provisioning page

Provisioning Log

  • track provisioning status when you enable monitor on all assets in a workspace

 

Operational Management // Telemetry Analysis

  • 7023 - Add Execution Group Id to analysis history

  • 6381 - add start and status info for Reanalyze Telemetry section

 

📈 Operational Management // Consumption (Cost) Analysis

  • 6068 - support filter by status and date-range-interval filter by start-time on consumption loading

 

Miscellaneous

  • 6808 - include selected workspace and subscription in the URL as params

  • 7055 - Remember url page when user access a link with expired session

  • 7243 - add (i) icon for tooltip documentation on Incident Policies to explain Incident Rules

  • 6981 - update app documentation for "System Update" panel

🐞 Fixed Bugs

  • 7005 - Subscription selection on the Overview page does not get saved into the Workloads

  • 6192 - Workspace selection changes when navigating through the app

  • 7324 - Firefox in windows, white theme, could not see maximize symbol Pool Contention

 

Documentation