Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

🎉 Highlights of 2.2 release

  • summary info panels on overview

  • update results on filter criteria change

  • one-time runs view

  • cost alerts for monthly cost increase

  • cluster events analyzer

  • personal access token management for AWS deployments

🧭 Overview

  • 4769 - summary info panels on overview page

    • month to month changes

    • cost per day

    • current month cost

    • cloud monthly total

    • Databricks monthly total

...

  • 4906: Make subscription cost report display costs only for authorized workspaces in a given subscription for that user

💾 Documentation

📋 Reports

🔑 Security

🏎️ Performance Optimizations

🎁 UX Optimizations

    • if the user has access to only two workspaces, then the total cost per subscription represents the total cost for only those two workspaces, not all workspaces configured per subscription

📋 Reports

  • 4896: update default aggregations of the columns on the Reports page

    • 4894: set default view for CPU on Reports to Average

...

  • 4184 - identify DLT pipeline run started from a job. job reports - identify that a task run is of DLT type

  • 4782: add info bar for Workflows Runs Details

    • improved styling for job runs details

...

  • 4681: Resize filter components on the Reports to display more information

  • 4951: improve tooltips for N/A values on Reports page

Search on Filter Change

...

  • User Story 4988: remove the search button and call the search API on each filter change for Reports page

  • User Story 4987: update calendar selectors to current month and last month

  • User Story 4989: remove the search button and call the search API on each filter change for details pages on Reports

One-Time Runs

  • 4696: monitor one-time runs started by submit-api feature in Databrics

...

❤️ Health Alerts

  • 4964: Show historical cost alerts and improve the design of cost alerts

    • cost alerts for monthly cost increase

...

🏎️ Performance Optimizations

  • 4836: Stop the delta live table pipeline after it started by updating the configuration when enabling the monitor

...

(blue star) Analysis Optimizations

Cluster Events Analyzer

  • Added logic for cluster events & timeline analyzer

  • 3891: build autoscaling timeline during telemetry analysis, expose it in the job run UI independent of the consumption data

  • 4814: cost summary with max worker count per day and cost, and driver cost per day, without the pool id for jobs drawing straight out of Azure

...

🎁 UX Optimizations

  • 4891: write on 2 rows the titles of columns with more than 1 word in the reports

  • 4922: order of tooltip items must match the colors in the widget for Azure vs Databricks widget

...

  • 4929: order columns in the filter alphabetically on the reports page

  • 4772: do not allow to click away when I navigate to the error details for an analysis job that failed

  • 4757: Boost vue js library to 2.7+ thus leveraging the composition implemantation and removing the vue-compositon library that was the glue between vue 2 and composition API

⚙️ Operational Management – Telemetry & Consumption

🎛️ Configuration

🖥️ Deployment

🛠️ Miscellaneous

🐞Fixed Bugs

  • 4903: Cost tooltips on Reports page display the Total as NA4805: update dialog name to "Scheduled Telemetry Analysis History" from "Telemetry Analysis History"

  • 4806: update dialog name to "On Demand Telemetry Analysis History" from "Telemetry Analysis Details"

  • 4978: add job name in the title of the dialog for cluster configuration of a run

  • 4774: expose warning messages in the audit tables for analysis jobs that have warnings or errors

  • 5001: limit the batch size in days (consumption area) to max of 30 days, both Azure and AWS

📙AWS Support

Security

  • personal access token management with integrated identity

  • support IAM credentials ( see diagram: 5, 6, 8, 9 )

    • requirement from NationWide

    • no secrets

  • AWS Deployment Diagram

🐞Fixed Bugs

  • 4880: Fixed nested child not appearing

  • 4897: Fix pagination for job runs reports

  • 4813: Changes to a scheduler are lost when switching tabs

  • 4965: subscription and workspace is not preselected when I click "open in reports"

  • 4971: browser console error while provisioning Workflows

  • 4958: DLTs cannot be unprovisioned

  • 4974: Redundant api calls when on login page.

  • 4325: Consumption last run does not show status and error message for failed load

Last commit id: e... fd0063cc4