Page Comparison

...

cluster-init-script - is a LHO script that copies the LHO Telemetry Agent jar from DBFS to the storage area accessible by clusters, i.e. /Volumes vs worksopace fileswhich can be either in /Volumes or in /Workspace (workspace files) depending on Unity Catalog setup.

Unity Catalog Enabled

Shared-Compute resources are available only with Unity Catalog enabled.

At the moment of this documentation creation, Databricks does not offer an API to upload the cluster-init-script in /Volumes, therefore the admin needs to configure the cluster-init-script by following the next steps.

Step 1) Use the following link to download the LHO cluster-init-script

• https://bplmdemoappstg.blob.core.windows.net/libraries/LHO_VERSION/init_script.sh

  • e.g. https://bplmdemoappstg.blob.core.windows.net/libraries/2.7.2/init_script.sh

Step 2) Upload script downloaded before Prepare storage path in Catalog Explorer

...

• open Catalog Explorer

• select schema: main/default

• create volume: bp-lakehouse-monitor

Step 3) Upload script to

/Volumes/main/default/bp-lakehouse-monitor/script/

...

/Volumes/main/default/bp-lakehouse-monitor/script/init_script.sh

Step 34) In Databricks

• open Catalog

• open Metastore details

• open Allowed JARs/Init Scripts

• add a new entry for

...