AWS Data Engineer
An information technology and business consulting company that provides highly specialised solutions to large and small enterprises in both the private and public sectors seeks a highly motivated and experienced
AWS data engineer to join their Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business. The ideal candidate should have a strong background in
C# or
Python programming and building data pipelines on
AWS, especially with
AWS Glue Jobs using
PySpark or
AWS Glue Spark.
Responsibilities: - Creating data models that can be used to extract information from various sources
- Lead the design, implementation, and successful delivery of large-scale, critical, or difficult data solutions involving a significant amount of data
- Utilise expertise in SQL and have a strong understanding of ETL and data modelling
- Ability to ingest data into AWS S3, perform ETL into RDS or Redshift
- Use AWS Lambda (C# or Python) for event-driven data transformations
- Designing and implementing security measures to protect data from unauthorised access or misuse
- Maintaining the integrity of data by designing backup and recovery procedures
- Work on automating the migration process in AWS from development to production
Experience and qualifications: - Bachelor's degree in computer science, information systems, or related field.
- AWS Certified Machine Learning – Specialty Certificate
- Must have experience with AWS Glue Jobs using PySpark or AWS Glue Spark
- 5 Years Python/C# Development
- 3 Years AWS Data Engineering
- Strong SQL and C# or Python programming knowledge
- Objective oriented principles in C# or Python
- AWS technical certifications (Developer Associate or Solutions Architect)
- services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM)
- Experience working with RDBMS databases, such as Postgres, SQL Server
The Reference Number for this position is
NG58761 which is a
permanent hybrid position based in
Johannesburg offering a cost to company salary negotiable from
R500k to R650k Per Annum based experience and ability. Contact Nokuthula at
az.oc.egrem-e@galuhtukon or call her on
011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website
www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals.
Posted on 28 Feb 10:14, Closing date 28 Apr
