A data transformation platform on AWS
Role: Technical lead, technical consultant, engineer
This platform replaced an ageing SAP system. It ingests data from external systems, transforms it, and serves it back out to everything downstream. We built all of it on AWS, infrastructure included.
Performance drove the design, because millions of records have to move through it promptly. The harder problem was the interfaces at both ends: a mix of technologies, delivery patterns and ages, every one of which had to keep working.
I sat between engineering and delivery. As technical lead I gathered and documented requirements with the project owners, the business and the product owners, then cut and scheduled the work in refinements. Ticket quality stayed high and the pace stayed steady.
I ran the meetings and kept them short and on point, advised on technical decisions, and made sure the right people were in the room and actually got heard.
I also prepared and documented the codebase for its security clearance, and worked on the infrastructure side: automating deployments, tidying up the infrastructure code and extending it. The platform has shipped and is running.
Technologies
- React
- Spring
- Aurora DB (Postgres)
- Dynamo DB
- AWS
- GoLang
- Rust
- Java
- Python
- Terraform
- Terragrunt
- GitLab