Integrating Snowflake SaaS with AutoSys Workload Automation
Article ID: 427300
Updated On:
Products
Issue/Introduction
You need to execute Snowflake Tasks, Stored Procedures, and DBT (Data Build Tool) Jobs using Autosys Workload Automation․
SYMPTOMS:
-
Requirement to integrate Snowflake SaaS workloads with AutoSys․
Environment
-
Product: Autosys Workload Automation
-
Version: 12.X, 24.X
-
Component: ATSYS
-
Third-Party: Snowflake SaaS
Resolution
PREREQUISITES:
-
Autosys Workload Automation 12․1 or higher․
-
Snowflake JDBC Driver (obtained directly from Snowflake)․
-
Network connectivity to Snowflake SaaS endpoints․
STEPS:
-
CONFIGURE STORED PROCEDURES (JDBC)
Use the System Agent Database plugin to execute Snowflake Stored Procedures․
Action: Download the JDBC driver from the Snowflake developer site․
Configuration: Update the JDBC URL to match the specific Snowflake format requirements․EXPECTED: The System Agent connects via JDBC to execute stored procedures․
NOTE: Broadcom does not provide the Snowflake JDBC driver; it must be sourced from the vendor․ -
CONFIGURE DBT JOBS
Use the dedicated DBT (Data Build Tool) Plugin Extension for these workloads․
Path: dbt Plugin Extension
EXPECTED: DBT jobs execute using the specific extension․
-
CONFIGURE SNOWFLAKE TASKS (HTTP)
Use the HTTP Job type (HTTP Plugin) to trigger Snowflake Tasks․
Action: Configure the job to make REST API calls to the Snowflake endpoint․
EXPECTED: Snowflake tasks trigger via REST API interaction․
VERIFY SUCCESS:
-
Stored Procedures execute successfully via JDBC connection․
-
DBT jobs run using the plugin extension․
-
Snowflake Tasks trigger via HTTP REST calls․
Additional Information
Currently, no single dedicated plugin exists to execute all Snowflake task types (Tasks, Procedures, DBT) natively in one component․
RELATED RESOURCES:
Feedback
