Data warehouse for the financial analytics project VISUALSECTORS
About the client
VISUALSECTORS.COM is a startup from England in the field of financial analytics. The project aggregates data on trading instruments along with fundamental and technical indicators.
The task
The main task the client approached me with was designing a ClickHouse database, collecting the required data, and implementing mathematical formulas to calculate additional financial indicators.
Goals
- →Collect data from various sources
- →Design the ClickHouse database
- →Implement the calculation of financial indicators based on the incoming data
What was built
- 01
Integration with data source APIs
Connectors to source APIs were built to retrieve trading data.
- 02
Data warehouse on ClickHouse
A single warehouse for all data used in the project was designed on top of ClickHouse.
- 03
Calculating financial indicators
The data in ClickHouse is not only processed but also enriched with new derived indicators. It is then sent to PostgreSQL for use on the project's website.
Result
The project's tasks were successfully delivered, but since the project is at an early stage of development, work on it is ongoing. New data sources are constantly being added, the technologies in use are being restructured, and additional financial indicators are being calculated.