Prophecy 4.2.11 contains improvements that make onboarding data and building pipelines in Prophecy easier, while maintaining better documentation and version control. Keep reading to learn about the biggest changes:
Load and compile large SQL projects faster
Great news for organizations with complex pipelines: large SQL projects now open and compile up to 50% faster. In testing with a 13,000-node project, load time decreased from 46 seconds to 25 seconds. Additional performance improvements speed up SQL parsing during validation and compilation, and use the faster dbt Fusion engine for dbt-backed projects.
Work with data from Excel like a spreadsheet pro
Excel is the de facto standard for business data work in small volumes. So, working with Excel in Prophecy should be a breeze. That’s why we’ve rebuilt the Upload Files gem experience for Excel files. For your messy spreadsheets, AI suggests table areas to select, and you can adjust and edit as needed.
You can also mark multiple regions of a workbook as separate tables. In the Upload Files gem, each marked table becomes its own output port, with independent schema editing, drift-handling, and the ability to unmark or delete it.
Read more and watch a demo here. Available now on Enterprise Express and Enterprise Editions.
Build confidently with guided gem experiences
In the last release, we made the Aggregate gem more functional. This release, it’s time for the Join gem and the Pivot gem to get a makeover.
The Join gem now has a guided Simple mode that walks you through choosing a join type, defining match conditions, and selecting output columns for two-input joins. A “where rows go” panel shows exactly which output port each row lands on for the selected join type. For those familiar with Alteryx, this is the same three-output pattern to make identifying unjoined data much easier. Record counts and data previews make validation easier than ever.
The Pivot gem also has a Simple mode. Forget manually typing pivot column values– just click “Fetch unique values” to retrieve and select the distinct values from your pivot column directly.
Read more about the Join and Pivot gems in the docs.
Expand and document pipelines cleanly
When you’re building out a pipeline, dragging and dropping each gem can slow you down. For more speed with the same control, you can now insert a gem directly into an existing connection on the canvas. Hover over a connector or a gem’s input or output port to reveal a + button that opens the gem palette right at that point in the flow.
For orchestration, the Pipeline gem now has a Version parameter for choosing which published version of the target pipeline to trigger: Current, Last Released, or a specific version number, which keeps triggering that exact release even as the target pipeline is edited, drafted, or republished.
You can also now mark an individual pipeline as draft to keep working on it while excluding its in-progress changes from the project’s next published version.
And finally, you can do more with visual containers–select Add to AI, Explain, and Edit Background Color, alongside the existing Ungroup, Attach Annotation, and Collapse/Expand options on their action menu.
For even more release goodies, check out the Prophecy release documentation. We’re excited to see what you build in Prophecy!