Saturday, October 14, 2023
HomeBig DataOrchestrate the Lakehouse: Asserting Help for Refreshing SQL Queries, Dashboards and Alerts...

Orchestrate the Lakehouse: Asserting Help for Refreshing SQL Queries, Dashboards and Alerts in Databricks Workflows


Databricks Workflows is the extremely accessible, fully-managed orchestrator for all of your information, analytics, and AI workloads. Right this moment, we’re completely satisfied to announce the general public preview of the brand new SQL activity sort, which helps you to simply writer, schedule, examine, and function workflows that refresh Databricks SQL queries, dashboards and alerts. You may mix this new activity sort with present sturdy help for notebooks, Python scripts and dbt tasks to orchestrate the total energy of the lakehouse.

Actual-world workflows orchestrate many alternative actions throughout the lakehouse. Think about a workflow that ingests information into Delta Lake and transforms it utilizing a Delta Dwell Desk. As soon as this information is up to date, now you can instruct Databricks to refresh a number of dashboards or execute SQL queries. You may as well run alerts to verify numerous information high quality dimensions and ship notifications to Slack or Groups if specified circumstances are met. Orchestrating these SQL duties contained in the workflow the place information is ready has a number of advantages: not solely is the workflow simpler to purpose about, it is usually straightforward to restore and decide up the place it failed.

A workflow refreshing multiple queries and a dashboard
A workflow refreshing a number of queries and a dashboard

So as to create a Databricks SQL activity, merely go to Databricks Workflows and choose “SQL” from the Kind dropdown:

 Creating a SQL task to refresh a query
Making a SQL activity to refresh a question

You additionally profit from the observability and stability advantages that include our jobs scheduler equivalent to managing schedules and inspecting earlier runs.

Run details for a SQL task
Run particulars for a SQL activity

For pricing and availability in your surroundings, see the Databricks SQL pricing web page (AWS, Azure).



Supply hyperlink

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -
Google search engine

Most Popular

Recent Comments