Databricks
Data Warehouse integration · 11 node(s).
00Overview
Every field below is exactly what you see in the Flomation editor. Fields marked ● live picker let you choose from a list pulled live from your account — no IDs to look up.
01Connecting Databricks
Add your credentials as a Flomation environment secret, then pick them in each node. The connection fields are:
| Field | Type | Details | |
|---|---|---|---|
| Access Token (PAT) | secret | Required | dapi... |
${secrets.your_secret}.02Cancel
Databricks Cancel Run
databricks/cancel_run · Action
Cancel an in-progress Databricks job run
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Run ID | integer | Required |
Returns: tool_result, success, error
03Delete
Databricks Delete File
databricks/delete_file · Action
Delete a file from a Databricks Unity Catalog Volume
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Volume File Path | string | Required | /Volumes/main/default/my_volume/file.csv |
Returns: tool_result, success, error
04Download
Databricks Download File
databricks/download_file · Action
Download a file from a Databricks Unity Catalog Volume
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Volume File Path | string | Required | /Volumes/main/default/my_volume/file.csv |
Returns: tool_result, content, size, success, error
05Get
Databricks Get Run
databricks/get_run · Action
Get the status and details of a Databricks job run
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Run ID | integer | Required |
Returns: tool_result, life_cycle_state, result_state, run_page_url, run, success, error
Databricks Get Run Output
databricks/get_run_output · Action
Get the output of a completed Databricks job task run
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Task Run ID | integer | Required | The run_id of a single task, not the job run |
Returns: tool_result, result, logs, run_error, output, success, error
06Invoke
Databricks Invoke Model
databricks/invoke_model · Action
Invoke a Databricks Model Serving endpoint (ML model or LLM) with a JSON payload
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Serving Endpoint Name | string | Required | my-model-endpoint |
| Request Payload (JSON) | text | Required | {"messages":[{"role":"user","content":"Hello"}]} or {"dataframe_records":[{"x":1}]} |
Returns: tool_result, response, predictions, content, success, error
07List
Databricks List Files
databricks/list_files · Action
List the contents of a directory in a Databricks Unity Catalog Volume
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Directory Path | string | Required | /Volumes/main/default/my_volume |
| Page Token | string | Optional — for the next page of results |
Returns: tool_result, files, count, next_page_token, success, error
Databricks List Runs
databricks/list_runs · Action
List runs for a Databricks job, optionally filtered to active runs
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Job ID | integer | Optional — omit to list runs across all jobs | |
| Limit | integer | Default 20, max 25 (runs/list API cap) | |
| Active Runs Only | boolean |
Returns: tool_result, runs, count, has_more, success, error
08Run
Databricks Run Job
databricks/run_job · Action
Trigger a Databricks job to run now and return the run ID
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Job ID | integer | Required | |
| Job Parameters | key_value_array | ||
| Idempotency Token | string | Optional — dedupe duplicate triggers |
Returns: tool_result, run_id, number_in_job, success, error
Databricks Run SQL
databricks/run_sql · Action
Execute a SQL statement against a Databricks SQL Warehouse and return the rows
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| SQL Warehouse ID | string | Required | 1234567890abcdef |
| SQL Statement | text | Required | SELECT * FROM samples.nyctaxi.trips LIMIT 100 |
| Catalog | string | main | |
| Schema | string | default | |
| Timeout (seconds) | integer | Default 300 |
Returns: tool_result, results, row_count, columns
09Upload
Databricks Upload File
databricks/upload_file · Action
Upload a file to a Databricks Unity Catalog Volume
| Field | Type | Details | |
|---|---|---|---|
| Workspace URL | string | Required | https://dbc-xxxxxxxx.cloud.databricks.com |
| Access Token (PAT) | secret | Required | dapi... |
| Volume File Path | string | Required | /Volumes/main/default/my_volume/file.csv |
| File Content | text | Required | |
| Content is Base64 | boolean | Enable for binary files | |
| Overwrite if Exists | boolean |
Returns: tool_result, path, size, success, error
10Notes & Limitations
Behaviours and constraints worth knowing before you build with these nodes.
- Triggering a job with run_job returns a run ID immediately and does not wait for the job to finish, so poll get_run for completion and use get_run_output to retrieve its results.
- SQL Warehouses and Model Serving endpoints that have scaled down while idle cold-start on their first request, so an initial run_sql or invoke_model call can be noticeably slower or time out while capacity spins up.
- run_sql returns rows subject to the warehouse's statement size limits, so very large queries may come back truncated rather than as the complete result set.
- Cancelling a run with cancel_run is a request rather than an instant stop, and the run may report as terminating for a short time before it shows as cancelled.
- File actions operate only on Unity Catalog Volume paths, so the target catalog, schema and volume must already exist and be reachable by the connected credentials.