Incidents & Recommendations (Azure)

 

Lakehouse Optimizer tracks and provides guidance related to the following suboptimal scenarios that you might have encounter in your Lakehouse deployment.

 

LHO provides recommendations for the the following types of incidents:

Entity

Incident

Entity

Incident

Subscriptions

Monthly Cost above Threshold

Workspaces

Monthly Cost above Threshold

Workflows

Monthly Cost above Threshold

Workflows

  • Over-Provisioning

    • Cluster CPU

    • Driver Memory

    • Driver CPU

    • Driver Memory

Workflows

  • Under-Provisioning

    • Cluster CPU

    • Driver Memory

    • Driver CPU

    • Driver Memory

Workflows

  • Imbalanced-Provisioning

    • CPU

    • Memory

Workflows

Bad Skew

Workflows

Disk Spillage

Workflows

Run Failure

Workflows

Job with All Purpose Clusters

Delta Live Tables

Over Provisioning

  • Cluster CPU

  • Cluster Memory

Delta Live Tables

Under Provisioning

  • Cluster CPU

  • Cluster Memory

Delta Live Tables

Update Failure

Delta Live Tables

Monthly Cost above Threshold

All Purpose Clusters

Monthly Cost above Threshold

All Purpose Clusters

Auto Shutdown Timeout

  • Shutdown Timeout above Threshold

  • Shutdown Timeout Missing

All Purpose Clusters

Total Idle Time above Threshold

All Purpose Clusters

  • Over-Provisioning

    • Cluster CPU

    • Driver Memory

    • Driver CPU

    • Driver Memory

All Purpose Clusters

  • Under-Provisioning

    • Cluster CPU

    • Driver Memory

    • Driver CPU

    • Driver Memory

Pools

Auto Shutdown Timeout

  • Shutdown Timeout above Threshold

 

 

 

image-20241008-161540.png
list of incidents

 

 

image-20241008-161707.png
over-provisioning incidents

 

 

Related articles