Data migration to ClickHouse and dashboard rebuild for MnogoSna
About the client
MnogoSna is an online store of sleep products with a showroom in Moscow. For over 12 years the company has been selling certified mattresses, beds and bedding as an authorised dealer.
The task
The client already had dashboards in Yandex DataLens built on data from an internal CRM and other sources in MySQL, but they loaded slowly and the figures diverged from the CRM. The dashboards needed to be sped up and their data made accurate.
Goals
- →Speed up loading of the existing dashboards
- →Eliminate discrepancies between the dashboard data and the CRM
- →Move the data to a more performant warehouse
- →Rebuild the existing dashboards on the new source
What was built
- 01
ETL migration pipeline to ClickHouse
Building an ETL pipeline to move data from the internal MySQL database into ClickHouse.
- 02
Dashboard rebuild
Migrating the existing Yandex DataLens dashboards to the new, faster data source.
- 03
Metric reconciliation and fixes
Together with the client, comparing the calculation logic of every dashboard metric and its results against the CRM, and eliminating the discrepancies.
- 04
Support and refinements
Refining the dashboards on the client's requests.
Result
The dashboards now load noticeably faster, and their data has been brought in line with the CRM — the reporting can be trusted again. The cooperation continues: the dashboards are refined as needed.