We’re excited to share what’s new in Prophecy 4.2.6: a release focused on broader platform support, better developer experience, and deeper pipeline observability. Here’s what shipped:
Parity for Snowflake Fabrics
Prophecy now supports Snowflake as a SQL execution engine. Snowflake is popular in enterprises because of its tremendous performance, and we’ve now brought Snowflake to parity with Databricks and Google BigQuery. Regardless of what data warehouse platform you’re using, you’re set with Prophecy.
Check out the help docs for more information on how to get started: Create a Snowflake fabric
Note: A few things aren’t supported yet in this first release: case sensitivity, creating new partitioned tables, and modifying existing table partitioning. We will expand support in upcoming releases.
Increase Development Speed with Rename & Duplicate Pipelines
We’ve made two quality-of-life improvements that have been on the wishlist for a while. You can now rename pipelines directly from the Project Explorer, and duplicate pipelines from the Studio canvas, creating a full copy of the pipeline structure so you can reuse and adapt existing workflows without starting from scratch.
These are small changes with a big impact on day-to-day development speed.
Reliable Debugging with Persistent Runtime Logs
Pipeline logs are no longer ephemeral. With 4.2.6, runtime logs are persisted and tied to individual pipeline runs, so you can revisit past executions long after the cluster has shut down. Past runs are accessible via the Run History or Observability UI, and each run is linked to a pipeline snapshot, so you always have a clear record of exactly what was running at the time. The result is consistent & reliable debugging, reproducibility, and performance monitoring across your entire pipeline history.
Under the hood, a log aggregation pipeline collects output from the orchestrator and sandbox pods and stores it in a centralized backend. This is a meaningful step forward for teams that need auditability and production-grade observability.
Learn more about the latest release in our docs here.