...

1. Processing and analyzing telemetry data

2. Processing cluster-events (including tags and estimated costs)

3. Persisting data in the LHO database

Step 1 Download Files

1. Download the JAR file for bplm-analyser
   from blobstorage location for LHO libraries

2. Download from LHO libraries from analysis-module the scala files which contain the notebook files that will be used to configure the Databricks Jobs

Step 2

...

Create a Databricks job for each DAJ

...

task

1. each job has a task

2. attach

...

1. analyzer JAR file

2. set DBX Task parameters

...

job Required: Job cluster must use Java 11

• required env

...

  Recommended cluster specs:
  - for analyses: depending on load (4/8 moderate nodes)
  - for cluster events: SINGLENODE cluster of moderate instance type
  - for persisting (storage): SINGLENODE cluster of moderate instance type

...

METRIC_PROCESSOR_ENABLED=false
DAJ_WORKSPACE_HOST=dbc-f4095c7c-e857.cloud.databricks.com
DAJ_JOB_ID=967951742258704,931886104401413
DAJ_SCHEDULE_CRON_EXPRESSION="0 30 */3 * * ?"

Step 5 Validate that DAJ is enabled

Navigate to the analysis management dashboard in LHO to validate that DAJ is enabled.

...