Snowplow (Databricks) RDBLoader cluster termination

Hello Team,

We have setup Snowplow spstreamrdbloader cluster on lower environment to test the functionalities.
However, After testing is done on lower environments we wanted to terminate the cluster which is up and running all the time.
We tried following 2 options:

  • Databricks auto termination option which should automatically terminate the cluster after 60 minutes of inactivity.
  • Switched off the healthcheck option on lower environments.
    However, Cluster is getting restarted again.
    Do you have any suggestions on how we can terminate lower environment cluster when it is not in use.

Thanks in advance!