🎉 Highlights of this Release

• SQL Warehouse reporting

• Pool Cost breakdown

• Cluster Memory and CPU details

• Autoscaling timeline for clusters, jobs and notebooks running on all-purpose-clusters

Overview

• Pool resources cost breakdown

  • Idle VMs

  • Share resources

Reporting // Workflows

• expose Driver Memory and CPU and Cluster Nodes Memory and CPU data

🖥️ Reporting // All purpose clusters

• 5490 - All Purpose Cluster Configuration Timeline

• 5086 - improved feedback when the autoscale timeline is not found or not yet computed

• 5792 - expose autoscaling timeline for Notebooks and Jobs running on all-purpose-cluster

🖥️ Reporting // SQL Warehouse

• 5439 - SQL Warehouse analysis and reporting

• 5643 - Add cpu/memory information per driver and cluster information

❤️ Health Alerts // Cost

• 5827- support date range filter and sort by event type

❤️ Health Alerts // Performance

• 5895 - Added over/under provision alerts

🔔 Health Alerts Notifications

• 5882 - support email group configuration for a health alert

Performance Optimizations

• 4779 - ability to REFRESH cache for user per subscription and workspace

• 5780 - clear cache for all users in the selected subscription and selected single workspace

📊 Analysis Optimizations

• 5721 - Fix the cluster idleness uptime calculation for clusters containing multiple app IDs within a single running segment

• 5749 - Make analysis detection stages independent

• 5621 - Enhance CPU-driven cluster idleness report by using task and executor metrics

• 5853 - support Repair Jobs Telemetry in Reanalyze Telemetry section

🎛️ Configuration

• 5350: limit user action on provisioning jobs or clusters and DLTs based on service principal and global init scripts configuration

Operational Management // Telemetry Analysis

• 5646 - Added correlationId to the diagnosisservice

• 5731 - startup logs with database stats (# subs, # workspaces, # jobs, # workspaces )

• 5208 - expose run frequency of the Health Alerts Detection Engine in the Operational Management section under Scheduled Analysis Intervals

Documentation

• 5633: add supporting information to tooltip when N/A shown for cost on overview pages

• 5639: updated app documentation for "billing admin"

• 5640: update "service principal" tooltip on the settings page