GSE: Datamart Design and Build
The Problem
A government-sponsored enterprise needed a centralized data solution for its forecasting process, which involved cross-functional teams from different business lines.
The firm also sought a cloud-based data warehouse to host forecasting outputs for reporting purposes with faster querying and processing speeds.
The firm also needed assistance migrating data from legacy data sources to new datamarts. The input and output files and datasets had different sources and were often in different formats. Analysis and transformation were required prior to designing, developing and loading tables.
The Solution
RiskSpan built and now maintains a new centralized datamart (in both Oracle and Amazon Web Services) for the client’s revenue and loss forecasting processes. This includes data modeling, historical data upload, and the monthly recurring data process.
The Deliverables
- Analyzed the end-to-end data flow and data elements
- Designed data models satisfying business requirements
- Processed and mapped forecasting input and output files
- Migrated data from legacy databases to the new sources
- Built an Oracle datamart and a cloud-based data warehouse (Amazon Web Services)
- Led development team to develop schemas, tables and views, process scripts to maintain data updates and table partitioning logic
- Resolved data issues with the source and assisted in reconciliation of results