🎉 Highlights of this Release

• Pool reports

• Custom rules for health alerts

• Scheduled email notifications for health alerts

• Absolute and relative MoM views

• Eco mode for consumption loading

• Improved pagination, filtering and search capabilities on operational management pages

• performance improvements on Reports pagination when using authorization rules

Overview

• 6132 - Add absolute and relative MoM views

Open

MoM $ Change

Open

MoM % Change

• [6013] - Improve predicted costs on overview api

• [5897] - add totals on top of widgets for bars on overview page

• [6251] - Improve subscription breakdown costs time options

Reporting

• [6309] - Improve jobs reports performance

• [6120] - Support server-side searching by field on Reports pages, main page

• [6083] - Add fields for last run info in job and notebooks reports api

• [6323] - Fix searching by task name in job run reports

• [6099] - Maintenance job runs reported only if provisioned

• [6279] - Estimated vm cost for both azure and aws environments

• [5779] - Sql warehouse uptime should count the overlapping clusters uptime multiple times

• [6157] - DLT incorrect cost and breakdown reported for update that ran for multiple days

• [4777] - Add caching for maintenance jobs reporting

Reporting // Workflows

• 5965 - Add failed runs and skipped runs columns to tables next to the Analyzed Runs column

• 5861 - Add ID columns to reports tables

• 6120 - Support server-side searching by field on Reports pages, main page

🖥️ Reporting // All purpose clusters

• 5098 - Create One-time runs (Submit-runs) reporting tab for all purpose clusters

• 5700 - for each cluster add "Analyze Now" support on Cluster view

💠 Reporting // Pools

Pool contention and usage reports

• 6409 - expose min capacity and max capacity on the tab with the graph for pool contention

• 6411 - Sort clusters in Pool Contention Report by start/end time

  • the cluster with earlier starting time comes first (appears closer to the bottom)

  • if two clusters have same starting time, the first comes the cluster with longest duration

💠 Reporting // SQL Warehouses

• 5914 - Sql Warehouses cluster timeline

❤️ Health Diagnostics

• [6338] Support alert rule customization and use these for alert generation

• [6341] Scheduled email notifications for health alerts

• [6066] Alert generation for under/over provision driver

🔔 Health Diagnostics Notifications

• 6104 - support different types of authentication for email configuration on health notifications email

📊 Analysis Optimizations

• [6309] - Improve jobs reports performance

• Other small included tasks:

  • [6315] - Fix the analysis scenario for when the notebook path is null

  • [6300] - Notebook analysis error

  • [4884] - Add missing workspace configuration checks to cluster events status api

  • [6253] - Fix spill score parsing

• 6350 - Reduce metrics field set. Remove redundant or unused fields that are collected

🪩 UX

• [5745] - Merge provisioning pages for workflows, clusters, delta live tables under one page named "Monitor Provisioning" and use tabs as on Reports page

• [6291] - Change of fiscal year on Subscription budget should be automatically reflected in the fiscal year on Cost breakdown

• [6286] - Workspace stats - tooltips for the months with 0 costs correspond to the tooltip of the first month with cost

• [6262] - AWS - Settings page - Admin login -> Only current selected workspaces display if workspace is enabled or not. We should display the enable icon for all workspaces in list.

🎛️ Configuration

• 5590 - show badge if a workspace is Standard or Premium or not on the settings page when provisioning

• 6352 - hide/show managed identity button for azure subscription configuration based on USE_SP_FOR_BACKGROUND_PROCESSORS value

• 6351 - change default value to true for Service Principal env USE_SP_FOR_BACKGROUND_PROCESSORS

Operational Management // Telemetry Analysis

• 6344 - Add support to filter audit records based on multiple statuses and sources.

• 6055 - add "filter by", "search by" and pagination on On Demand Telemetry Analysis page

📈 Operational Management // Consumption (Cost) Analysis

• 6161 - Eco mode for consumption loading
  In the Eco mode only workspaces, where telemetry data exists, are processed.
  The mode can be enabled with CONSUMPTION_ECO_MODE=true

• 6419 - Make Eco mode enable by default in consumption

🐞 Fixed Bugs

• 6153 - Analyzer audit fails to update 'In Progress' statuses upon restart

• 6208 - Fix idle vm raport calculation

• 6264 - Overview - Date interval shows a wrong start date due to timezone differences

• 6377 - Navigating from Pools cluster activity to one time runs view doesn't show any run

• 6334 - Pools view / Charts - Update tooltip label and mouse cursor

• 6335 - Pools View / Clusters timeline expand chart to bottom when maximizing widget

• 6336 - Pools view / Maximize clusters activity chart is overflowing container

• 6337 - Pools View / Activity Tab / Search not working properly

• 6385 - pool chart not aligned when running in maximized view

Documentation

• Azure quick setup guide

  • Deployment and Quick Setup Guide on Azure

🎁 Coming Soon

MoM $ Change widgets on Overview

Executive Dashboard

Alerts Report for Workflow Runs