Skip to main content
Log inGet a demo
Get a demo

Introducing dbt CI Checks

Validate how dbt code changes impact Hightouch syncs directly from GitHub

Hugo Darwood.

Hugo Darwood

Alexis Jones .

Alexis Jones

October 18, 2022

4 minutes

Validate how dbt code changes impact Hightouch syncs directly from GitHub.

Today, we’re excited to announce our latest dbt integration: dbt CI checks ✅. Now, as you make changes to your dbt models in GitHub, Hightouch can check your pull requests to ensure that nothing unexpectedly breaks downstream 🙌. Coupled with our other market-leading dbt integrations, including native support for dbt Exposures, engineers get a new observability layer into dbt, giving them the peace of mind that their data pipelines between dbt, Hightouch, and their operational tools stay resilient. dbt CI checks is available today for all Hightouch customers.

dbt + Hightouch (continues to) = ❤️

dbt has taken the data world by storm, with no signs of stopping and we’re excited to experience the magic in person (and virtually!) with ten thousand of our closest friends at dbt Coalesce. This launch further deepens our integrations with the popular data transformation tool, making it easier than ever for our customers to use the warehouse as their single source of truth for Data Activation. By enabling our dbt integration, you can:

  • Pull existing dbt models via Git and sync modeled data directly from the warehouse to 100+ apps
  • Trigger Hightouch syncs and sync sequences to execute after dbt Cloud jobs run
  • See your Hightouch sync dependencies on your dbt lineage graph with our support for dbt Exposures, and now
  • Check your GitHub commits and pull requests before they go live to validate that your dbt model changes won’t impact downstream syncs.

If you’re new to dbt (we’ve been there!), we recently wrote a primer on dbt with some simple tips on how you can jumpstart your knowledge.

Erik Edelmann.

Hightouch drives our mission-critical workflows, so it’s important to be able to know when our syncs break and what’s impacted downstream, or more preferably, to avoid breaking them altogether. Thanks to Hightouch’s Git Sync, dbt Exposures, and dbt CI checks features, we’re able to avoid sync outages by knowing exactly what will happen to our models and syncs before we make changes to the upstream entities and systems they depend on.

Erik Edelmann

Erik Edelmann

Head of BI & Analytics Engineering

Vendr

Setting up dbt CI Checks

In the Hightouch app, navigate to Extensions >> dbt Models and your configured source (Snowflake in our example). Toggle "GitHub Pull Request Checks" to "Enabled". Please note: as a prerequisite, you'll need to first activate dbt model sync for your source.

CI-checks-config.png

dbt CI checks configuration in Hightouch app

And that's it! Once configured, Hightouch will run a check on any pull request made to the dbt model's git repository.

dbt-failed-ci-check.png

Validate your model changes won't break a downstream sync with dbt CI checks

The check will fail if a downstream Hightouch sync is impacted by the PR.

dbt-CI-checks-broken-sync.png

Failed code check details

Coupled with our dbt Exposures integration, you now have both a lineage graph for how your dbt models are related to your Hightouch syncs along with the real-time guardrails needed to ensure sync resliency as you submit pull requests.

dbt-lineage.png

Lineage graph via dbt Exposures

This initial release supports CI checks for model-level changes. Our next release will also run checks at the column level 🙌.

Next Steps

dbt CI checks is in public beta today for all Hightouch customers. You can read the docs to learn more. And if you’re at Coalesce, check out our talk all about how to capture value locked in your data warehouse, and come join us at Dave & Busters for a night of games, gimlets, and good times!

More on the blog

  • dbt and Hightouch are Putting Your Transformed Data to Work.

    dbt and Hightouch are Putting Your Transformed Data to Work

    Give your business teams access to transformed data in the tools they use every day. See how Hightouch integrates with dbt to help you bring “Reverse ETL” to your stack.

  • Introducing dbt Exposures for Hightouch.

    Introducing dbt Exposures for Hightouch

    Get end-to-end visibility for how your data is flowing between dbt and Hightouch.

  • Should You Learn dbt?.

    Should You Learn dbt?

    A look at why everyone seems to be learning dbt, and some practical tips on getting started

Share

Sign up for our newsletter

It takes less than 5 minutes to activate your data. Get started today.

Recognized as an industry leader
by industry leaders

We are proud to be recognized as a leader in Reverse ETL and Marketing & Analytics by customers, technology partners, and industry analysts.

Gartner, Cool Vendor.
Snowflake, Marketplace Partner of the Year.
G2, Fall Leader 2022.
G2, Best Software 2023.
G2, Winter Leader 2023.
Snowflake, One to Watch for Activation and Measurement.
Fivetran, Ecosystem Partner of the Year.