2.13.2 Release Notes

 

✨ Release Highlights

  • “Data Processed” information for a Job Run

  • Cluster Instances view for Delta Live Tables Pipelines

  • Sort by “Longest Run”

 

Workloads // Workflows

  • 8538 - support "Longest Run" as a Sort By criteria for Workloads / Jobs

  • 9037 - expose "Data Processed" with details breakdown for Data In, Data Out, Shuffle In, Shuffle Out fields in the Job Run Details screen

image-20240411-144822.png
Longest Job Run Sorting
image-20240411-144910.png
Data Processed

 

🖥️ Workloads // Delta Live Tables

  • 8506 - DLT cluster instance view

 

🔔 Incidents Notifications

  • 9285 - Prevent multiple incident policies with the same threshold from being created

 

 

📊 Analysis Optimizations

  • 9274 - Redundant artificial TERMINATING event added, causing incomplete segments

  • 9312 - Add option to specify the load analysis cutoff date, in addition to the maxDurationToLoadAnalysis option

  • 9130 - Estimated costs zombie record caused issues where legit costs didn't got stored successfully

  • 9162 - Improve repair logic for job run/cluster analysis

  • 9326 - Reintroduce the estimated cost based on the cluster configuration (in case of absent timelines)

 

🪩 UX Optimizations

  • 9023 - Info point about the date interval should be visible for maintenance job runs too, when navigating from Telemetry analysis history

  • 8501 - When user selects only one date and closes the date interval it should be set as start and end date

  • 9095 - replace terms "job" "notebook" with generic term "workload" and add duration on Incidents Recommendations view for jobs and notebooks

  • 8574 - add the down triangle from "Display" dropdown to the "tasks" button to inform the user that it is clickable

  • 6755 - Misleading time filter label name "Last Month" for Incidents and Workloads filtering

 

 

🎛️ Configuration & Provisioning

  • 1234 - Make heart-beat job timeout configurable

  • 9205 - expose all env variables – read-only

 

🐞 Fixed Bugs

  • 9296 - Job Runs - shortcut to cluster instances histograms not working

  • 9320 - Wrong date interval set when navigating from telemetry history to job runs

  • 9064 - Status dropdown on Consumption loading history moves left and right when the options are checked/unchecked

  • 9065 - Columns move on Analysis Stats when the items page is changed

  • 8502 - Fix metadata for DLT cluster instances per Pipeline Update