2.16.2 Release Notes

Owned by Ciprian LUCACI
Jul 12, 2024
2 min read

 

✨ Release Highlights

  • Serverless support for execution and idle cost for Workloads (Jobs and One-Time Runs) and Notebooks

  • improved provisioning incidents generation by using median as detection function

 

Workloads // Workflows

  • 10230 - set Tasks as the second column as default on cluster instances view

 

🖥️ Workloads // All purpose clusters

  • 10223 - remove failed/skipped runs columns from APC/notebooks view

    • this metric is not applicable to notebooks

  • 10250 - remove cluster/driver cpu/memory columns from the APC overview page

    • more useful information is present on cluster instance view

 

💠 Workloads // Serverless

  • 10200 - serverless costs for workloads and notebooks in Azure

  • 10207 - serverless jobs summary panel

 

💠 Workloads // SQL Warehouses

  • 8986 - Fixes and improvements for SQL warehouses

    • show warehouses even when they have no activity as long as they are present in Databricks

    • only show deleted warehouses costs for Admins

    • don't show any warehouses for users that are not Admins and also don't have sql-warehouse permission in Databricks

    • fix status field to use the realtime data

    • moved the filtering searching sorting and ordering from the sql query to the end and done in memory, since there are few warehouses and we have to apply them to warehouses coming from DBX as well

 

✅ Incidents & Recommendations

  • 9964 - update recommendations disclaimer and guide

  • 10143 - Use median CPU/memory to compute provisioning incidents

  • 10182 - Eagerly generate provisioning incidents and delete healed ones

    • Support eager generation of provisioning incidents and deleting healed ones

    • Remove usage of average CPU/memory for underprovisioned incidents generation

    • Update memory provisioning incident's rootCause message to include the process memory

 

🪩 UX Optimizations

  • 10179 - add "estimated" note for the user in the tooltip on the cluster instances page

 

🐞 Fixed Bugs

  • 10194 - fixed sorting and pagination for table dialog in notebook runs and pipeline updates

  • 9436 - update active/idle/up fields to have in the name the unit of measure for APC overview