Senior Data Engineer

AWS Senior Data Engineer - AI

Key Responsibilities
  • Design, build, and optimise scalable ETL/ELT pipelines for batch and streaming data.
  • Develop and orchestrate workflows using AWS Glue and Apache Airflow.
  • Implement and manage serverless data processing solutions using AWS Lambda and other AWS native services.
  • Write and optimise complex SQL queries for data transformation, modelling, and reporting.
  • Drive CI/CD implementation for data workflows, ensuring reliability and repeatability.
  • Partner with stakeholders to design data models and ensure best practices for data architecture.
  • Monitor, troubleshoot, and enhance pipeline performance, focusing on cost management and optimisation.
  • Collaborate with cross-functional teams to support real-time analytics and business intelligence initiatives.
  • Stay up to date with emerging data engineering practices and AWS innovations.
Required Skills & Experience
  • 8+ years of professional experience in Data Engineering and related area.
  • Expertise with AWS cloud services (Glue, Lambda, S3, Redshift, Kafka, Kinesis, etc.).
  • Proven experience with workflow orchestration tools (Airflow, Step Functions, or equivalent).
  • Solid knowledge of SQL and experience in relational and non-relational databases.
  • Hands-on experience designing and maintaining data pipelines for both batch and streaming data.
  • Proficiency in CI/CD concepts and implementation (GitHub Actions, CodePipeline, or equivalent).
  • Strong understanding of data modelling concepts, performance tuning, and cost optimisation in cloud environments.
  • Proficiency in at least one programming language such as Python, Java, or Scala.
  • Excellent problem-solving skills and the ability to work independently as well as in a team.
Nice to Have
  • Experience with real-time data streaming tools (Kafka, Kinesis Data Streams, or Flink).
  • Familiarity with containerisation and orchestration (Docker, Kubernetes).
  • Exposure to machine learning pipelines or supporting data science workloads.
  • Understanding of data governance, security, and compliance in cloud-based systems.
  • Aviation or Airlines experience a bonus 

"As a candidate looking for work, MAP helped me out on getting my current job as a tech lead.

During those days MAP called me regularly to give me clear information and suggestions on the company / the position I was applying and the whole hiring process.

MAP has been looking after my journey all the time since I joined and he is one of the most professional guys in his industry to work with.

Thank you MAP for your sincere support and for anyone who wants to find a new start in the career I would always recommend to reach out to MAP for your next step."

Chatgpt Image Sep 18, 2025, 07 36 31 PM

Liwen Chen - Technical Lead @ Westpac

"If you’re looking for a recruiter in the data space, I highly recommend MAP TALENT.

As a candidate I found MAP are approachable and provided great guidance throughout the process.

I really appreciated his support in making the whole experience smooth and stress-free"

Chatgpt Image Sep 18, 2025, 07 39 42 PM

Alan Nguyen @ Ausgrid

"As a candidate, straight out of the gate, MAP were open and honest with me.

Once I'd established that trust with MAP, it was easy to be upfront with him about my expectations.

MAP don't just acknowledge them, they fought for them on my behalf in a respectful but determined way.

It's those 1% things that can make the world of difference.

Regardless of the outcome, you are in good hands when you are working with MAP"

Chatgpt Image Sep 17, 2025, 11 16 42 PM

Jardian Ormsby - Director of Product @ Kayo Sports

"I want to express my gratitude to MAP for his incredible support.

From our first conversation, they were kind, professional, friendly, and attentive.

MAP kept me informed every step of the way, answered all my questions promptly, and made the entire experience smooth and positive.

Thank you again, MAP — I truly appreciated your guidance!"

Chatgpt Image Sep 18, 2025, 07 46 45 PM

Romina Abasto - Designer @ Livestock

"MAP was a revelation to work with. After meeting several recruitment companies.

MAP was the last in the door but the first to deliver. They are always responsive and followed through on their promises.

I would recommend MAP without hesitation."

Chatgpt Image Sep 18, 2025, 07 58 12 PM

Steven Davidson - Senior Delivery Manager @ Telstra

"MAP are true professionals and champions for the talent they represent... that’s how I describe MAP

MAP dedication and passion for his craft ensure that the talent they represent is always positioned for success.

MAP have approachability, loyalty, and unwavering commitment make them exceptional and trusted partner in the hiring process.

I highly recommend MAP to anyone seeking a recruitment group that delivers exceptional results with professionalism and care.
"

Chatgpt Image Sep 18, 2025, 08 05 54 PM

Vincent Wijangco - Senior Business Analyst @ Nine