Welcome to the Lakehouse Monitor for AWS Azure Databricks users! Our tool incorporates the deep experience of our team and leverages advanced analytics to increase cost transparency and enhance performance of your AWS Azure Databricks environment. This is accomplished by consolidating all available consumption data, spark metrics and operating system-level data. The tool tracks Azure Databricks job-level metrics and leverages pattern-based analysis to alert you to outliers and optimization opportunities. This is enabled by a data enrichment process for the data across these internal platform data sources.
...