004 · The SPAR Group

Data lake and reporting platform

2017–2021RetailDurban

Legacy stores
Operational sources
Azure
SQL, Data Factory, Synapse
APIs
Reporting for business apps

Stack

C# · ASP.NET Web API · Azure SQL Server · Azure Data Factory · Azure Synapse

Context

Operational data sat across disparate legacy systems, so reporting and investigation were inconsistent. The business needed a central store, and APIs that application teams could call without binding each app to every source system.

Approach

We replicated operational data into Azure SQL Server as the central lake, and built C# and ASP.NET Web API endpoints for reporting and investigation. As the platform matured, the pipelines moved onto Azure Data Factory and Synapse.

Outcome

Business applications query the lake through stable APIs. The pipelines continue onto Azure Data Factory and Synapse.

Selected work