Senior Data Engineer

5 days ago


Hong Kong, Central and Western District, Hong Kong SAR China Oliver James Associates Full time

Our client, a leading insurer, is seeking a Senior Data Engineer with strong expertise in Azure Databricks to join their team. This position focuses on building and optimizing scalable data pipelines, enhancing data workflows, and ensuring data reliability and performance.

The ideal candidate will bring hands-on experience with Azure Databricks, Delta Lake, and Apache Spark, along with strong coding skills in Python or Scala. This role presents an opportunity to work on cutting-edge data engineering challenges within a dynamic, technology-driven organization.



Key Responsibilities

  1. Data Architecture & Engineering:

    • Develop and maintain end-to-end data pipelines using Azure Databricks, Delta Lake, and other Azure data services.
    • Architect and implement scalable, high-performance data solutions to support business needs.
    • Apply best practices for data modeling, using both relational and dimensional techniques.
  2. Platform Development and Ownership:

    • Act as the technical lead for the organization's cloud-based analytics platform, encompassing the data warehouse, data lake, and operational data stores.
    • Partner with cross-functional stakeholders to ensure the platform supports analytics, reporting, and decision-making requirements.
  3. Mentorship and Collaboration:

    • Guide and mentor junior engineers to foster technical growth within the team.
    • Collaborate with business analysts, architects, and other team members to define and deliver data solutions.
  4. Data Quality and Transformation:

    • Design and implement ETL/ELT workflows to transform raw data into clean, usable datasets.
    • Ensure data quality by implementing validation, monitoring, and governance practices.
  5. Cloud Technology SME:

    • Stay informed on emerging cloud technologies and incorporate them into the organization's data strategy


Required Qualifications

Technical Expertise
  • Azure Cloud Expertise:

    • Deep knowledge of Azure Databricks, Azure Data Factory, Azure Data Lake, Azure SQL, and related Azure services.
    • Experience in ETL frameworks and data pipeline orchestration.
  • Programming and Data Processing:

    • Proficiency in Python and PySpark for developing scalable data solutions.
    • Advanced knowledge of SQL for querying and transforming data.
    • Experience with distributed computing frameworks such as Apache Spark.
  • Data Modeling and Transformation:

    • Experience designing and implementing data models using dimensional and relational approaches.
    • Strong knowledge of data transformation techniques for building analytics-ready datasets.
  • Automation and DevOps Integration:

    • Experience with DevOps, version control, and CI/CD pipelines.


Experience
  • Bachelor's degree in Computer Science, Data Science, or a related field.
  • 8+ years of experience in data engineering, with a focus on cloud-based solutions.
  • Proven experience delivering enterprise-scale data platforms, including data lakes and warehouses.
  • Exposure to end-to-end software development lifecycle (SDLC), from design to deployment.


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    About the RoleWe are seeking an experienced Automation Engineer to join our team at BDx Data Centres. As a key member of the facilities maintenance team, the successful candidate will be responsible for ensuring the smooth operation of our data centre infrastructure.Key Requirements:Bachelor of Science in Automation, Instrumentation, Electrical Engineering,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Data Intellect Full time

    Data Intellect is a data and technology consultancy firm specializing in financial and capital markets technology solutions. We're dedicated to applying fintech data expertise to other industries, such as smart energy and healthcare.Job Overview:We're looking for a talented Senior Data Developer to join our team. As a key contributor, you'll be responsible...

  • Senior Data Engineer

    10 hours ago


    Hong Kong, Central and Western District, Hong Kong SAR China Hyphen Partners Full time

    4 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Hyphen Partners Connecting the best talent with the most innovative firms in APAC | About the Company We are looking for a Senior Data Engineer to join a company that applies machine learning and AI techniques to...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    About the RoleA technical specialist with experience in building management systems project management, managing large IT operations in data centers or equivalent structures. Strong technical skills around proactively responding to network, BMS designing, network designing, and IT infrastructure technical issues.Responsible for the day-to-day automation,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Hermeneutic Investments Full time

    We are looking for a Senior Data Engineer to help us architect, implement and operate the complete data infrastructure pipeline for our Research and Trading operations. This role will be crucial in building a scalable, reliable, and cost-efficient system for handling vast amounts of market trading data, real-time news feeds and a variety of internal and...


  • Hong Kong, Central and Western District, Hong Kong SAR China Data Intellect Full time

    At Data Intellect, we're dedicated to turning big data challenges into smart data solutions. Our team of experts is passionate about delivering innovative technology and financial market solutions that drive business success.Job Description:We're seeking a highly skilled Data Intelligence Specialist to join our team. As a key member of our development team,...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Get AI-powered advice on this job and more exclusive features. Direct message the job poster from BDx Data Centers Global Data Center Hiring across APAC || Tech & Non-Tech Hiring || COMPANY OVERVIEW Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and...


  • Hong Kong, Central and Western District, Hong Kong SAR China RAISOUND (HONGKONG) CO., LIMITED Full time

    About the Role:We are looking for an experienced Senior Data Science Engineer to drive the development of intelligent speech technology. As a key member of our team, you will be responsible for researching and developing cutting-edge AI technologies, focusing on speaker recognition. You will also participate in strategic planning, undertake basic research...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    At BDx Data Centers, we are seeking a skilled Facilities and Technical Services Director to join our team. This is an exciting opportunity for a seasoned professional to lead our data center operations and technical services teams.About the RoleThe successful candidate will be responsible for managing all aspects of our data center facilities, including...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Job Description\We are seeking an experienced Technical Operations Engineer to join our team at BDx Data Centers.The successful candidate will be responsible for maintaining and troubleshooting data center IT operations, including control systems and physical security controls.The role requires a strong track record in IT infrastructure and the ability to...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    At Bdx Data Centers, we're seeking a skilled Technical Facilities Engineer to join our team. This role involves overseeing the day-to-day automation, maintenance, and troubleshooting of facilities.Manage and maintain Building Management Systems (BMS), Power Management Systems (PMS), Critical Equipment Monitoring Systems (CEMS), Life Safety and Security...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    About the Role:This is an exciting opportunity to join BDX Data Centers as a Technical Operations Engineer. The successful candidate will have a strong background in IT infrastructure and experience in maintaining and troubleshooting within Data Center IT Operations, IT Automation, and Compliance.In this role, you will be responsible for designing and...

  • Data Engineering Lead

    2 weeks ago


    Hong Kong, Central and Western District, Hong Kong SAR China Microsoft Corporation Full time

    Job DescriptionThe Senior Consultant will implement technical solutions by completing assigned project tasks with defined quality standards and following Industry Solutions processes, and oversee aspects of implementation.You will proactively identify issues and risks and engage with customers/partners or internal stakeholders as appropriate to address and...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    We are seeking a skilled Data Center Automation Specialist to join our team at BDx Data Centers. This role will be responsible for the day-to-day automation, maintenance and troubleshooting of our data center facilities.The ideal candidate will have a strong background in automation systems, building management systems (BMS), and IT infrastructure. They will...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    3 days ago Be among the first 25 applicants Direct message the job poster from BDx Data Centers Global Data Center Hiring across APAC || Tech & Non -Tech Hiring || COMPANY OVERVIEW: Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and...

  • Data Engineer

    6 days ago


    Hong Kong, Central and Western District, Hong Kong SAR China Oliver James Associates Full time

    Our client, a leading insurer, is seeking an experienced Data Engineer with strong expertise in Azure Databricks to join their team. This position focuses on building and optimizing scalable data pipelines, enhancing data workflows, and ensuring data reliability and performance. The ideal candidate will bring hands-on experience with Azure Databricks, Delta...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    Job SummaryWe are looking for a Senior Building Management Systems Engineer to lead our team in designing, implementing, and maintaining our Building Management Systems (BMS) across multiple sites.Responsible for the daily operation and maintenance of BMS systems, including monitoring and control of HVAC, lighting, security, and fire safety systems.Perform...


  • Hong Kong, Central and Western District, Hong Kong SAR China Viu Full time

    We are now looking for a professional to join our data management team for OTT service, Viu located in Hong Kong. With over 66 million monthly active users (MAU) and 12 million paid subscribers, Viu is a leading pan-regional OTT video service with presence across Asia, the Middle East, and South Africa.The role will be responsible for building up...


  • Hong Kong, Central and Western District, Hong Kong SAR China Crypto Full time

    Senior Python Data Engineer (Finance Digital Transformation) We are a team to design, develop, maintain, and improve software for various ventures projects, i.e., projects that are adjacent to our core businesses and are bootstrapped fast with a lean team. You will be actively involved in the design of various components behind scalable applications, from...


  • Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time

    At BDx Data Centers, we're looking for a seasoned professional to join our team as a Data Center Operations Specialist. This role involves overseeing the day-to-day operations of our facilities, ensuring that all systems are running smoothly and efficiently.The ideal candidate will have a strong background in automation systems, with experience in managing...