Data Engineering Radar

Updates from official sources across leading data platforms and open-source projects, including AWS, Snowflake, Databricks, BigQuery, and Microsoft Fabric, with selected research spotlights published weekly.

Last updated:

21 articles · Showing 21–21

Sep 24, 2026: Code Bundles (Preview)

Snowflake Code Bundles adds two execution options in preview: running Python code directly on warehouse compute and submitting Scala, Java, or Python Spark applications as batch jobs. Spark execution is built on Snowpark Connect. Scheduling notebooks on compute pools, previously offered as Notebook Projects, is now generally available. Inline specification overrides and the REST API, Python API, and Snowflake CLI clients are also in preview.

SnowflakePythonSparkScalaJavaSnowpark ConnectSnowpark Container ServicesREST APISnowflake CLI
Read more

Changes

Warehouse execution for Python is selected with compute_type: warehouse; Spark batch execution uses type: spark. Code Bundles runs non-SQL code without wrapping it in a stored procedure.

Read the source ↗ (Snowflake Release Notes)
Sources (24)

Official sites, blogs, release notes, and research sources we collect from. Some sources are filtered for data engineering updates, and selected research spotlights are published weekly.