Intermediate Data Engineer

A South African fintech transforming the digital commerce space — from QR-based payments and digital vouchers to loyalty programmes and store cards. Data is at the heart of everything we do, and we’re building the infrastructure, pipelines, and analytics that fuel smarter decisions and continuous innovation,

Are you an Intermediate Data Engineer capable in shaping and scaling their AWS-based data environment? You will endure data flows smoothly from source to insight — powering dashboards, AI models, and data-driven decision-making across the business.

Responsibilities:

• Design, build, and maintain data ingestion pipelines (Glue, DataSync, Lambda, APIs).
• Develop data transformation and enrichment workflows using Athena, Step Functions, and Lambda.
• Build and manage ETL processes that keep our data fresh, reliable, and analytics-ready.
• Partner with analysts and data scientists to surface datasets for Quicksight dashboards and ML models.
• Automate data validation, monitoring, and alerts to keep everything running smoothly.
• Manage metadata, schema evolution, and the data catalogue for easy discovery and governance.
• Use Python (boto3) and AWS SDKs to automate pipeline orchestration and monitoring.
• Continuously tune performance, storage, and costs across our data platform.

Qualifications and Experience:

• A degree in Computer Science, Information Systems, or a related field.
• 3–5 years of hands-on experience as a Data Engineer or Data Platform Developer.
• Solid AWS data stack knowledge: Glue, Athena, Lambda, Step Functions, S3, DataSync.
• Strong Python skills and experience automating with boto3 or AWS SDKs.
• Experience building ETL pipelines and integrating APIs.
• Familiarity with data architecture principles (batch/streaming, schema evolution).
• Bonus: experience with AWS monitoring tools like CloudWatch or CloudTrail.

The Reference Number for this position is NG60861 which is a Permanent Hybrid position based in Century City, Cape Town offering a cost to company of R750k up to R950k per annum negotiable on experience and ability. Contact Nokuthula at nokuthulag@ e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the e-Merge website www.e-merge.co.za for more great positions.

Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!

Posted on 11 Nov 09:56, Closing date 10 Jan