irus.tech
RU

Delivery, migration & support

Data infrastructure migration: cloud and on-premise

I move warehouses and pipelines between clouds, from on-premise to the cloud and from the cloud to on-premise — without data loss and with minimal downtime, verifying integrity at every step.

What is data infrastructure migration

Data infrastructure migration is moving a warehouse, ETL/ELT pipelines, integrations and dashboards to a new platform without data loss and with minimal downtime, while controlling integrity and the consistency of the numbers at every step. The relocation scenarios vary: between clouds, from on-premise to the cloud and from the cloud to on-premise, as well as a change of database. It's needed when changing providers, moving to regional or on-premise infrastructure, scaling under growing load, or when the platform has become expensive or outdated. I plan the move so that the business keeps running and the reporting reconciles after the switchover.

When you need a migration

You need to change cloud provider or move to on-premise or a regional cloud for compliance and data-residency reasons
The current platform has become too expensive to maintain or is outdated
The business has grown, and the current infrastructure can no longer cope with the data volume and load
Vendor lock-in is holding you back — you're tied to a single provider and can't change the stack flexibly
Several disparate warehouses have accumulated and need to be consolidated into a single system

What the service includes

Infrastructure audit and migration plan

I examine the current warehouse, pipelines, integrations and dashboards, assess the volume and risks, and put together a step-by-step relocation plan.

Data transfer with integrity control

I move historical data and increments to the target platform and reconcile volumes and control figures so that nothing is lost.

Pipeline migration and adaptation

I move the ETL/ELT pipelines to the new platform, rewrite the SQL and transformations, and set up orchestration on Apache Airflow and transformations with tests on dbt.

Dashboard and reporting migration

I switch dashboards and reports to the new warehouse, adapt the sources and queries, and verify that the visualizations work as before.

Number reconciliation

I run the old and new systems in parallel and compare data marts and key metrics — row by row and by aggregates, using SQL and Python. I make the numbers match before acceptance.

Cutover and support

I switch production over in an agreed window with minimal downtime, stabilize operations, and support the infrastructure after the move.

How the migration works

  1. 01

    Audit and inventory

    I examine the current infrastructure: warehouse, sources, pipelines, integrations and dashboards. I record volumes, dependencies and risks.

  2. 02

    Designing the target architecture

    I design the target data model and choose the migration strategy — phased or all at once, with the old and new systems running in parallel.

  3. 03

    Migrating the schema and historical data

    I move the warehouse structure and historical data to the target platform, controlling the integrity and completeness of the load.

  4. 04

    Migrating pipelines and integrations

    I move and adapt the ETL/ELT pipelines and source integrations, and set up scheduled loads and orchestration. For incremental synchronization and CDC during a hot migration, I use Kafka.

  5. 05

    Reconciliation and validation

    I compare data marts and key metrics on both platforms — row by row and by aggregates, using SQL and Python. I make the numbers match before acceptance.

  6. 06

    Switchover and stabilization

    I perform the cutover in an agreed window with minimal downtime, stabilize operations, and support the infrastructure after the move.

Tech stack

Warehouses (source/target)
Google BigQuery
ClickHouse
PostgreSQL
Transfer, streaming and orchestration
Apache Airflow
dbt dbt
Kafka
Catalog and languages
OpenMetadata OpenMetadata
SQL SQL
Python
BI
Google Looker Studio
Metabase

Clients

ASH
Подорожник
Тайрай
EKF
Неоломбард
Авто-Подбор.рф
WiseAdvice
Familio
Гастрофабрика
Entera
Visual Sectors
JUVTEK
Феникс
Blue Sleep
Cerera

Testimonials

★★★★★
«Quickly and precisely built dashboards in a BI tool according to the spec. A few months after the work was done, we made changes to our databases and the dashboards broke. Rustam advised us for free and got everything working again. Recommended!»
Andrey KorsakovProfi.ru
★★★★★
«Continued our collaboration on my real-world case. Rustam explains how to write SQL queries in Google BigQuery really well, and I'm learning to write them myself. On top of that, I'm solving my specific tasks. The perfect mix!»
SviridovOnlineKwork
★★★★★
«A very knowledgeable specialist. The consultation took place in a friendly and pleasant atmosphere, and he answered all my questions. Very satisfied.»
AnnaProfi.ru
★★★★★
«Rustam did a great job with the task and really knows his way around BI tools. He responds promptly to all small revisions. I'll definitely reach out again.»
ProdWorkKwork
★★★★★
«Built interactive dashboards in a BI tool very quickly. All revisions were done, and I'm happy with the result.»
ki4pusKwork
★★★★★
«Rustam, thank you for your help. Quite prompt. Everything is discussed. Recommended!»
Lika_byKwork
★★★★★
«Rustam gets in touch quickly. He explains everything clearly, even in text messages. He actively takes part in solving the client's problem. Absolutely recommend!»
fkn_dshKwork
★★★★★
«Everything is great. I'll reach out again.»
George_ShKwork

Migration isn’t just copying data to a new platform — it’s moving the whole chain from sources to dashboards so the business never stops. I carry out the move with parallel runs and number reconciliation, so that after the switchover the reporting matches the old one and the team keeps working without disruption.

Shall we discuss your task?

FAQ

How do you avoid business downtime during a migration? +

I run the old and new systems in parallel and keep the data synchronized incrementally, while performing the final switchover in an agreed window. This way the business keeps running on the current platform until the new one is ready for acceptance.

How do you make sure no data is lost and the numbers match? +

I reconcile volumes and data marts on both platforms — comparing rows and aggregates with SQL and Python, checking key metrics and discrepancies before the switchover. Acceptance happens only once the numbers match.

Can you migrate between different databases, for example BigQuery to ClickHouse? +

Yes. A change of database is a common scenario: I move the schema and data, rewrite the SQL and adapt the pipelines to the specifics of the target platform, then reconcile the result against the source system.

What happens to the dashboards and integrations? +

I move and adapt the dashboards and integrations to the new warehouse: switch the sources, rewrite the queries and verify that the reports compute the same numbers as before.

Does migration support on-premise or regional infrastructure? +

Yes. I migrate infrastructure to on-premise or a regional cloud, including a change of database and cloud provider, with the same approach — data reconciliation and minimal downtime.

How long does a migration take? +

I don't quote fixed timelines in advance: they depend on the data volume, the number of pipelines and integrations, and the chosen strategy. I give an estimate after auditing the current infrastructure.

Leave a request

Tell me about your task — I’ll reply within one business day.