Data Engineer – Databricks

2 weeks ago

Bangkok, Bangkok, Thailand HCL Singapore Pte Ltd Full time

Job Summary:

We are seeking a highly skilled and experienced Senior Data Engineer with deep expertise in Databricks and Azure Data Factory. Employee will be responsible for designing and implementing robust data pipelines that ingest, transform, and model data from our SAP systems into scalable and reusable data products. This role requires strong proficiency in PySpark and SQL, a solid understanding of data modelling principles, and hands-on experience with Databricks.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Databricks and Azure Data Factory.
  • Ingest and process data from SAP systems, ensuring data quality, consistency, and reliability.
  • Model raw data into structured, reusable data products that support business intelligence and analytics use cases.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions.
  • Optimize data workflows for performance and cost-efficiency in a cloud-native environment.
  • Implement best practices for data engineering, including version control, testing, and documentation.
  • Monitor and troubleshoot data pipelines to ensure high availability and performance.
  • Communicate proactively and clearly with stakeholders, demonstrating a "can-do" attitude and a collaborative mindset.

Primary Skills (Must Have):

  • Databricks Extensive experience building and managing data pipelines and notebooks.
  • Azure Data Factory Strong expertise in orchestrating data workflows and integrating with various data sources.
  • Data Modelling – Proficient in designing logical and physical data models for analytics and reporting.
  • PySpark – Advanced programming skills for large-scale data processing.
  • SQL – Expert-level skills in writing complex queries and optimizing performance.

Skills (Nice to Have):

  • Azure Synapse Analytics – Experience with data warehousing and analytics solutions.
  • CI/CD for Data Pipelines – Familiarity with DevOps practices in data engineering.
  • Delta Lake – Knowledge of ACID transactions and time travel in Databricks.

Experience:

  • Total Experience: 5+ years in data engineering and analytics.
  • Relevant Experience: 3+ years working with Databricks and Azure Data Factory

Location: Soi Sukhapiban, Bangkok

Work Set-up: Hybrid (1 day WFH)

  • Data Engineer

    4 days ago

    Bangkok, Bangkok, Thailand ttb bank Full time

    Job Summary:We are a forward-thinking team dedicated to building innovative AI applications. We're seeking a talented Data Engineer with strong software engineering expertise to join our dynamic team in a hybrid role. You will be responsible for designing and maintaining scalable data pipelines and ETL processes, while also developing AI applications that...

  • Data Engineer

    2 weeks ago

    Bangkok, Bangkok, Thailand ttb bank Full time

    We are a forward-thinking team dedicated to building innovative AI applications. We're seeking a talented Data Engineer with strong software engineering expertise to join our dynamic team in a hybrid role. You will be responsible for designing and maintaining scalable data pipelines and ETL processes, while also developing AI applications that encompass both...

  • Senior Data Engineer

    2 weeks ago

    Bangkok, Bangkok, Thailand CGP Recruitment (Thailand) Company Limited Full time

    ResponsibilitiesBuild, operate, and maintain scalable data pipelines on Microsoft AzureImplement Change Data Capture (CDC) solutions for near real-time data ingestionDevelop and optimize data processing using Azure Databricks (PySpark / Apache Spark)Design, build, and tune Snowflake data models and SQL queriesDevelop and manage ELT/ETL pipelines using Azure...

  • Data Engineer

    2 weeks ago

    Bangkok, Bangkok, Thailand CGP Recruitment (Thailand) Company Limited Full time

    Job Overview:We are seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms that support analytics and business reporting.Key Responsibilities:Build and maintain batch and real-time data pipelinesDesign and manage data models, data lakes, and warehousesEnsure data quality, reliability, and securityOptimize data processing...

  • Data Platform Admin

    7 days ago

    Bangkok, Bangkok, Thailand Makro PRO Full time

    Key ResponsibilitiesAdminister and monitor Azure-based data services, including Azure Databricks, Azure Blob Storage, and Power BI.Manage and support Databricks workspaces, clusters, and user access.Implement and enforce security best practices across data platforms.Monitor system performance and perform tuning and troubleshooting as needed.Assist in setting...

  • Data Engineer

    2 weeks ago

    Bangkok, Bangkok, Thailand The Able by King Power Full time

    ResponsibilityDevelop and maintain ETL processes to extract, transform, and load data from various sources to target data repositories.Work closely with the Data Architect to understand data models and ensure that ETL processes align with the overall data architecture.Monitor and maintain data infrastructure to ensure data quality and accuracy, including...

  • Data Service Engineer

    7 days ago

    Bangkok, Bangkok, Thailand Makro PRO Full time

    We are looking for a highly responsible and proactive Data Service Engineer to ensure smooth operations across the company's data ecosystem. This role plays a critical part in monitoring data workflows, resolving operational issues, supporting business users with data-related inquiries, and collaborating across multiple technical and business teams. The...

  • AI and Data Science Analyst

    2 days ago

    Bangkok, Bangkok, Thailand ArcFusion Full time

    We are looking for an AI and Data Science Analyst to join a team of Forward Deployed Engineers for one of our clients based in the US. This is a hands-on role in helping the company build and apply data-driven insights and machine learning solutions across Sales, Marketing, and Supply Chain.This role is the ideal role for somebody with a strong academic...

  • Cloud Data Platform, Big Data, Datawarehouse, and BI Consultant

    6 days ago

    Bangkok, Bangkok, Thailand Inteltion Co., Ltd. Full time

    Join Our Team at InteltionResponsibilities:Business Analyst/System Analyst: Gather requirements, develop functional specifications, design data models, create reports/dashboards, understand source systems, document data mapping, create test documents, and assist in deployment.Data Engineer: Develop and test solutions using Azure, Databricks, AWS, GCP,...

  • Data Designer

    7 days ago

    Bangkok, Bangkok, Thailand Omega Grit (OMG) Full time

    Job Position:Data Designer & Data Solution SpecialistDepartment:Data SolutionLocation:Hybrid workingType:Full-timeMonthly salary range:(negotiable)Omega Grit in a Glance:Omega Grit, established in 2021, is a data & marketing technology consultancy at the forefront of marketing technology and experience solutions. Our expertise drives the transformation of...