Data Engineer

6 days ago


Hong Kong, Central and Western District, Hong Kong SAR China Oliver James Associates Full time

Our client, a leading insurer, is seeking an experienced Data Engineer with strong expertise in Azure Databricks to join their team. This position focuses on building and optimizing scalable data pipelines, enhancing data workflows, and ensuring data reliability and performance.

The ideal candidate will bring hands-on experience with Azure Databricks, Delta Lake, and Apache Spark, along with strong coding skills in Python or Scala. This role presents an opportunity to work on cutting-edge data engineering challenges within a dynamic, technology-driven organization.



Key Responsibilities:
  • Build and Optimize Scalable Data Pipelines
    Develop and maintain robust data workflows using Azure Databricks, Delta Lake, and Apache Spark to support the organization's growing data needs.

  • Enhance Data Performance and Reliability
    Monitor and fine-tune data systems for performance, scalability, and reliability, ensuring seamless data processing and delivery.

  • Implement Data Quality Standards
    Design and execute data validation and quality control processes to maintain high levels of accuracy and consistency in data pipelines.

  • Collaborate with Cross-Functional Teams
    Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver effective technical solutions.



Requirements:
  • Education:
    Bachelor's degree in Computer Science, Data Engineering, or a related field.

  • Experience:

    • A minimum of 3 years of experience in data engineering, with significant exposure to Azure Databricks and Apache Spark.
    • Strong experience with Delta Lake for data lakehouse architecture.
  • Technical Skills:

    • Proficiency in Python or Scala programming for data workflows.
    • Advanced SQL skills for querying and manipulating large datasets.
    • Familiarity with cloud-based data platforms, particularly Microsoft Azure (e.g., Azure Data Factory, Azure Synapse).
  • Soft Skills:

    • Excellent problem-solving and analytical skills.
    • Strong communication and collaboration abilities to work effectively with technical and non-technical teams.
    • Ability to thrive in a fast-paced, results-driven environment.


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    About the RoleWe are seeking an experienced Automation Engineer to join our team at BDx Data Centres. As a key member of the facilities maintenance team, the successful candidate will be responsible for ensuring the smooth operation of our data centre infrastructure.Key Requirements:Bachelor of Science in Automation, Instrumentation, Electrical Engineering,...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    About the RoleA technical specialist with experience in building management systems project management, managing large IT operations in data centers or equivalent structures. Strong technical skills around proactively responding to network, BMS designing, network designing, and IT infrastructure technical issues.Responsible for the day-to-day automation,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Data Intellect Full time

    At Data Intellect, we're dedicated to turning big data challenges into smart data solutions. Our team of experts is passionate about delivering innovative technology and financial market solutions that drive business success.Job Description:We're seeking a highly skilled Data Intelligence Specialist to join our team. As a key member of our development team,...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    At BDx Data Centers, we are seeking a skilled Facilities and Technical Services Director to join our team. This is an exciting opportunity for a seasoned professional to lead our data center operations and technical services teams.About the RoleThe successful candidate will be responsible for managing all aspects of our data center facilities, including...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Job Description\We are seeking an experienced Technical Operations Engineer to join our team at BDx Data Centers.The successful candidate will be responsible for maintaining and troubleshooting data center IT operations, including control systems and physical security controls.The role requires a strong track record in IT infrastructure and the ability to...


  • Hong Kong, Central and Western District, Hong Kong SAR China Data Intellect Full time

    Data Intellect is a data and technology consultancy firm specializing in financial and capital markets technology solutions. We're dedicated to applying fintech data expertise to other industries, such as smart energy and healthcare.Job Overview:We're looking for a talented Senior Data Developer to join our team. As a key contributor, you'll be responsible...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    At Bdx Data Centers, we're seeking a skilled Technical Facilities Engineer to join our team. This role involves overseeing the day-to-day automation, maintenance, and troubleshooting of facilities.Manage and maintain Building Management Systems (BMS), Power Management Systems (PMS), Critical Equipment Monitoring Systems (CEMS), Life Safety and Security...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    About the Role:This is an exciting opportunity to join BDX Data Centers as a Technical Operations Engineer. The successful candidate will have a strong background in IT infrastructure and experience in maintaining and troubleshooting within Data Center IT Operations, IT Automation, and Compliance.In this role, you will be responsible for designing and...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    We are seeking a skilled Data Center Automation Specialist to join our team at BDx Data Centers. This role will be responsible for the day-to-day automation, maintenance and troubleshooting of our data center facilities.The ideal candidate will have a strong background in automation systems, building management systems (BMS), and IT infrastructure. They will...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    At BDx Data Centers, we're looking for a seasoned professional to join our team as a Data Center Operations Specialist. This role involves overseeing the day-to-day operations of our facilities, ensuring that all systems are running smoothly and efficiently.The ideal candidate will have a strong background in automation systems, with experience in managing...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Company Overview\BDx Data Centers is a leading provider of hybrid, hyperscale, and edge solutions in the Pan-Asian region.Our ecosystem offers colocation, enterprise services, private cloud services, disaster recovery services, and interconnect solutions across cloud service providers, telcos, internet exchanges, and major data centers.We empower digital...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from BDx Data Centers Global Data Center Hiring across APAC || Tech & Non-Tech Hiring || COMPANY OVERVIEW Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and...

  • Data Engineer

    5 days ago


    Hong Kong, Central and Western District, Hong Kong SAR China Options Group (Hong Kong) Full time

    Data Engineer (HK or SG based) Key Responsibilities: Customer-Focused Data Solutions: Work closely with clients to identify their unique requirements, converting them into effective, scalable data solutions tailored for hedge fund operations. This involves integrating new financial data sets, creating data pipelines, and establishing external connections,...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Become part of our team as a Data Center Automation Expert! We're seeking a skilled professional with experience in designing and implementing automation processes for physical security systems, BMS, and IT automation.The ideal candidate will have a strong background in IT operations systems, including control systems and physical security controls....

  • Data Engineer

    1 week ago


    Hong Kong, Central and Western District, Hong Kong SAR China Selby Jennings Full time

    SUMMARY:As a Data Engineer, you'll be the backbone of our analytics, creating scalable data pipelines that provide real-time insights for over 630 ships globally. Your role transforms raw data into actionable intelligence, driving machine learning models and AI decisions that revolutionize fleet operations. This role goes beyond ETL; it's about building...

  • Data Engineer

    2 weeks ago


    Hong Kong, Central and Western District, Hong Kong SAR China OKX Full time

    Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking...

  • Data Engineer

    2 weeks ago


    Hong Kong, Central and Western District, Hong Kong SAR China IGNITE RECRUITMENT HONG KONG LIMITED Full time

    The RoleImplementing Back-end cloud-based data lake/ data warehouse with best practices Working closely with the development team to build and deliver back-end data pipelining components following industry best-practices and in adherence with architectural principles Design, develop, and maintain scalable and efficient ETL/ELT data pipelines from various...


  • Hong Kong, Central and Western District, Hong Kong SAR China Crypto Full time

    About the Role:We are seeking a highly skilled Data Engineer to join our team and help build a universal data platform that meets real-time and offline computing and storage requirements. As a Data Engineer, you will be responsible for defining the data pipeline scheme according to demand scenarios and delivering it through multiple methods based on various...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    BDx Data Centers seeks a highly skilled Technical Operations Engineer to join their team. This role involves designing and testing automation processes for physical security systems, BMS, and IT automation from a management perspective.The ideal candidate will have proven experience with IT operations systems, including control systems and physical security...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    3 days ago Be among the first 25 applicants Direct message the job poster from BDx Data Centers Global Data Center Hiring across APAC || Tech & Non -Tech Hiring || COMPANY OVERVIEW: Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and...