Senior Data Engineer

Job Description:

We are seeking a highly skilled Data Engineer / Data Architect to design, build, and optimize scalable data architectures and frameworks. The ideal candidate will have expertise in Kafka, ETL processes, Databricks, and data platforms, ensuring efficient data ingestion, transformation, and processing.

Key Responsibilities:

• Design and implement data architectures for scalable, high-performance data pipelines.
• Develop and maintain ETL/ELT workflows using modern data engineering tools.
• Implement real-time and batch data processing using Apache Kafka and other streaming technologies.
• Work with Databricks, Spark, and cloud-based data platforms to optimize big data processing.
• Build data frameworks and automation pipelines for efficient data engineering practices.
• Ensure data governance, security, and compliance best practices.
• Collaborate with cross-functional teams (Data Scientists, Analysts, Software Engineers) to ensure smooth data operations.

Required Skills & Experience:

• 15 years of experience in Data Engineering / Data Architecture.
• Strong hands-on experience with Apache Kafka (data ingestion, streaming).
• Expertise in ETL tools, data modelling, and pipeline development.
• Experience with Databricks, Apache Spark, or similar big data frameworks.
• Knowledge of cloud platforms (AWS, Azure, GCP) for data storage and processing.
• Experience with SQL, Python or Scala for data engineering tasks.
• Strong understanding of data governance, security, and best practices.

Preferred Qualifications:

• Experience with modern data stack technologies ( Delta Lake, Airflow).
• Hands-on experience with containerization (Docker, Kubernetes) for data workloads.
• Familiarity with CI/CD for data pipelines.

In accordance with recruitment policy and hiring standard of AIA (Thailand) Company Limited, after completing the selection process, you are required for criminal background check before joining the company. Your criminal record information will be retained according to the PDPA policy of the company. As per attached link []

Responsibilities:

• Develop and maintain the existing integration framework to handle routine data pipelines in the Data Platform.
• Define and implement the data pipelines (ingestion and transformation) for real-time and batch processing across layers in the Data Platform.
• Maintain a good understanding of Logical/Physical data models and the AIA business glossary.
• Participate in performance tuning to continually improve the quality of data platform
• Work collaboratively with the data governance team to maintain data integrity and data availability across data domains.

Required Skills:

• Bachelor's degree or higher in Computer Engineering, Computer Science, Information Technology, or related fields.
• Have strong programming skills in Python, PySpark, SQL. And hands-on knowledge in SDLC or Agile methodology.
• 3-5 years of working experience in Big Data technology and Cloud platforms such as Azure, AWS, or GCP. A hands-on experience would be advantageous.
• 3-5 years of experience in building and managing data pipeline for real-time and batch with large-scale data in the distributed data platform (Data Warehouse or Data Lake).
• Have hands-on experience in Databricks, Kubernetes, Kafka, and Jenkins is preferred.
• Strong analytical thinking, problem-solving, and interpersonal skills.
• Good communication in Thai and English.

เพื่อให้เป็นไปตามมาตรฐานและนโยบายการคัดสรรบุคลากรของบริษัท เอไอเอ (ประเทศไทย) หลังผ่านการคัดเลือกแล้ว ผู้สมัครต้องได้รับการตรวจประวัติอาชญกรรมก่อนเริ่มงาน ทั้งนี้ บริษัทจะเก็บประวัติอาชญากรรมของท่านตามนโยบายข้อมูลส่วนบุคคลของบริษัท รายละเอียดตามลิงค์แนบ []

In accordance with recruitment policy and hiring standard of AIA (Thailand) Company Limited, after completing the selection process, you are required for criminal background check before joining the company. Your criminal record information will be retained according to the PDPA policy of the company. As per attached link []