Databricks Workflows is the extremely accessible, fully-managed orchestrator for all of your information, analytics, and AI workloads. Right this moment, we’re completely satisfied to announce the general public preview of the brand new SQL activity sort, which helps you to simply writer, schedule, examine, and function workflows that refresh Databricks SQL queries, dashboards and alerts. You may mix this new activity sort with present sturdy help for notebooks, Python scripts and dbt tasks to orchestrate the total energy of the lakehouse.
Actual-world workflows orchestrate many alternative actions throughout the lakehouse. Think about a workflow that ingests information into Delta Lake and transforms it utilizing a Delta Dwell Desk. As soon as this information is up to date, now you can instruct Databricks to refresh a number of dashboards or execute SQL queries. You may as well run alerts to verify numerous information high quality dimensions and ship notifications to Slack or Groups if specified circumstances are met. Orchestrating these SQL duties contained in the workflow the place information is ready has a number of advantages: not solely is the workflow simpler to purpose about, it is usually straightforward to restore and decide up the place it failed.
So as to create a Databricks SQL activity, merely go to Databricks Workflows and choose “SQL” from the Kind dropdown:
You additionally profit from the observability and stability advantages that include our jobs scheduler equivalent to managing schedules and inspecting earlier runs.
For pricing and availability in your surroundings, see the Databricks SQL pricing web page (AWS, Azure).
