From six hours to 22 minutes.

A warehouse migration to Snowflake shortened the nightly batch without interrupting reporting.

An anonymized client engagement.

A new path to the same reporting
Reporting kept live.A new path, validated alongside the old one.

Reporting could not pause for a migration.

The existing on-premise warehouse needed six hours to complete its nightly batch. Moving it to Snowflake meant changing the data platform while people still relied on its reports.

The constraint shaped the delivery: keep the legacy reporting path available until the new route had been reconciled.

Explore our data engineering work

Validate the new path before cutover.

The new platform ran alongside the existing warehouse. Reporting stayed on the legacy path until the new route was reconciled.

  1. Keep reporting live

    Reports keep reading from the existing warehouse while the new platform is built beside it.

    Result No reporting interruption

  2. Validate in parallel

    Both paths run the same nightly workload until the results are reconciled.

    Result Reconciled results on Snowflake

  3. Switch the path

    Reporting moves to the new route; the legacy path is retired once it is no longer needed.

    Result A 22-minute nightly batch

Built in the client’s production stack.

Two data engineers and an Inpro lead worked across migration, cutover and handover. The warehouse, transformations, orchestration and infrastructure were delivered together.

  1. dbt

    The transformation layer. Data transformations managed as code within the production stack.

  2. Airflow

    The job orchestration. Coordinating the jobs that make up the nightly data workflow.

  3. Snowflake

    The target warehouse. The new platform for the nightly workload and the reporting it supports.

  4. Terraform

    The infrastructure. Repeatable infrastructure definitions for the new environment.

Nightly batch runtimeBefore: 6 hoursAfter: 22 minutes

A smaller window for the same nightly workload.

The same nightly workload went from six hours to 22 minutes, while reporting remained available during the migration.

Results from the anonymized engagement described here.

Planning a warehouse migration?

Tell us what runs today, where the bottlenecks are, and which reporting needs to stay available. We’ll start there.

Back to top