Senior Data Engineer
5 days ago
Our client, a leading insurer, is seeking a Senior Data Engineer with strong expertise in Azure Databricks to join their team. This position focuses on building and optimizing scalable data pipelines, enhancing data workflows, and ensuring data reliability and performance.
The ideal candidate will bring hands-on experience with Azure Databricks, Delta Lake, and Apache Spark, along with strong coding skills in Python or Scala. This role presents an opportunity to work on cutting-edge data engineering challenges within a dynamic, technology-driven organization.
Key Responsibilities
Data Architecture & Engineering:
- Develop and maintain end-to-end data pipelines using Azure Databricks, Delta Lake, and other Azure data services.
- Architect and implement scalable, high-performance data solutions to support business needs.
- Apply best practices for data modeling, using both relational and dimensional techniques.
Platform Development and Ownership:
- Act as the technical lead for the organization's cloud-based analytics platform, encompassing the data warehouse, data lake, and operational data stores.
- Partner with cross-functional stakeholders to ensure the platform supports analytics, reporting, and decision-making requirements.
Mentorship and Collaboration:
- Guide and mentor junior engineers to foster technical growth within the team.
- Collaborate with business analysts, architects, and other team members to define and deliver data solutions.
Data Quality and Transformation:
- Design and implement ETL/ELT workflows to transform raw data into clean, usable datasets.
- Ensure data quality by implementing validation, monitoring, and governance practices.
Cloud Technology SME:
- Stay informed on emerging cloud technologies and incorporate them into the organization's data strategy
Required Qualifications
Technical Expertise
Azure Cloud Expertise:
- Deep knowledge of Azure Databricks, Azure Data Factory, Azure Data Lake, Azure SQL, and related Azure services.
- Experience in ETL frameworks and data pipeline orchestration.
Programming and Data Processing:
- Proficiency in Python and PySpark for developing scalable data solutions.
- Advanced knowledge of SQL for querying and transforming data.
- Experience with distributed computing frameworks such as Apache Spark.
Data Modeling and Transformation:
- Experience designing and implementing data models using dimensional and relational approaches.
- Strong knowledge of data transformation techniques for building analytics-ready datasets.
Automation and DevOps Integration:
- Experience with DevOps, version control, and CI/CD pipelines.
Experience
- Bachelor's degree in Computer Science, Data Science, or a related field.
- 8+ years of experience in data engineering, with a focus on cloud-based solutions.
- Proven experience delivering enterprise-scale data platforms, including data lakes and warehouses.
- Exposure to end-to-end software development lifecycle (SDLC), from design to deployment.
-
Automation Engineer for Data Centres
6 days ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeAbout the RoleWe are seeking an experienced Automation Engineer to join our team at BDx Data Centres. As a key member of the facilities maintenance team, the successful candidate will be responsible for ensuring the smooth operation of our data centre infrastructure.Key Requirements:Bachelor of Science in Automation, Instrumentation, Electrical Engineering,...
-
Senior Data Developer Position
9 hours ago
Hong Kong, Central and Western District, Hong Kong SAR China Data Intellect Full timeData Intellect is a data and technology consultancy firm specializing in financial and capital markets technology solutions. We're dedicated to applying fintech data expertise to other industries, such as smart energy and healthcare.Job Overview:We're looking for a talented Senior Data Developer to join our team. As a key contributor, you'll be responsible...
-
Senior Data Engineer
10 hours ago
Hong Kong, Central and Western District, Hong Kong SAR China Hyphen Partners Full time4 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Hyphen Partners Connecting the best talent with the most innovative firms in APAC | About the Company We are looking for a Senior Data Engineer to join a company that applies machine learning and AI techniques to...
-
Data Center Automation Engineer
1 week ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeAbout the RoleA technical specialist with experience in building management systems project management, managing large IT operations in data centers or equivalent structures. Strong technical skills around proactively responding to network, BMS designing, network designing, and IT infrastructure technical issues.Responsible for the day-to-day automation,...
-
Senior Data Engineer
6 days ago
Hong Kong, Central and Western District, Hong Kong SAR China Hermeneutic Investments Full timeWe are looking for a Senior Data Engineer to help us architect, implement and operate the complete data infrastructure pipeline for our Research and Trading operations. This role will be crucial in building a scalable, reliable, and cost-efficient system for handling vast amounts of market trading data, real-time news feeds and a variety of internal and...
-
Data Intelligence Specialist
13 hours ago
Hong Kong, Central and Western District, Hong Kong SAR China Data Intellect Full timeAt Data Intellect, we're dedicated to turning big data challenges into smart data solutions. Our team of experts is passionate about delivering innovative technology and financial market solutions that drive business success.Job Description:We're seeking a highly skilled Data Intelligence Specialist to join our team. As a key member of our development team,...
-
Technical Operations Engineer
1 week ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeGet AI-powered advice on this job and more exclusive features. Direct message the job poster from BDx Data Centers Global Data Center Hiring across APAC || Tech & Non-Tech Hiring || COMPANY OVERVIEW Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing and...
-
Senior Data Science Engineer
1 week ago
Hong Kong, Central and Western District, Hong Kong SAR China RAISOUND (HONGKONG) CO., LIMITED Full timeAbout the Role:We are looking for an experienced Senior Data Science Engineer to drive the development of intelligent speech technology. As a key member of our team, you will be responsible for researching and developing cutting-edge AI technologies, focusing on speaker recognition. You will also participate in strategic planning, undertake basic research...
-
Data Center Operations Manager
12 hours ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeAt BDx Data Centers, we are seeking a skilled Facilities and Technical Services Director to join our team. This is an exciting opportunity for a seasoned professional to lead our data center operations and technical services teams.About the RoleThe successful candidate will be responsible for managing all aspects of our data center facilities, including...
-
Data Center IT Specialist
1 day ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeJob Description\We are seeking an experienced Technical Operations Engineer to join our team at BDx Data Centers.The successful candidate will be responsible for maintaining and troubleshooting data center IT operations, including control systems and physical security controls.The role requires a strong track record in IT infrastructure and the ability to...
-
Data Center Operations Manager
2 weeks ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeAt Bdx Data Centers, we're seeking a skilled Technical Facilities Engineer to join our team. This role involves overseeing the day-to-day automation, maintenance, and troubleshooting of facilities.Manage and maintain Building Management Systems (BMS), Power Management Systems (PMS), Critical Equipment Monitoring Systems (CEMS), Life Safety and Security...
-
Data Center IT Strategist
2 weeks ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeAbout the Role:This is an exciting opportunity to join BDX Data Centers as a Technical Operations Engineer. The successful candidate will have a strong background in IT infrastructure and experience in maintaining and troubleshooting within Data Center IT Operations, IT Automation, and Compliance.In this role, you will be responsible for designing and...
-
Data Engineering Lead
2 weeks ago
Hong Kong, Central and Western District, Hong Kong SAR China Microsoft Corporation Full timeJob DescriptionThe Senior Consultant will implement technical solutions by completing assigned project tasks with defined quality standards and following Industry Solutions processes, and oversee aspects of implementation.You will proactively identify issues and risks and engage with customers/partners or internal stakeholders as appropriate to address and...
-
Data Center Automation Specialist
5 days ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeWe are seeking a skilled Data Center Automation Specialist to join our team at BDx Data Centers. This role will be responsible for the day-to-day automation, maintenance and troubleshooting of our data center facilities.The ideal candidate will have a strong background in automation systems, building management systems (BMS), and IT infrastructure. They will...
-
Building Management Systems Engineer
7 days ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full time3 days ago Be among the first 25 applicants Direct message the job poster from BDx Data Centers Global Data Center Hiring across APAC || Tech & Non -Tech Hiring || COMPANY OVERVIEW: Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and...
-
Data Engineer
6 days ago
Hong Kong, Central and Western District, Hong Kong SAR China Oliver James Associates Full timeOur client, a leading insurer, is seeking an experienced Data Engineer with strong expertise in Azure Databricks to join their team. This position focuses on building and optimizing scalable data pipelines, enhancing data workflows, and ensuring data reliability and performance. The ideal candidate will bring hands-on experience with Azure Databricks, Delta...
-
Senior Building Management Systems Engineer
5 days ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeJob SummaryWe are looking for a Senior Building Management Systems Engineer to lead our team in designing, implementing, and maintaining our Building Management Systems (BMS) across multiple sites.Responsible for the daily operation and maintenance of BMS systems, including monitoring and control of HVAC, lighting, security, and fire safety systems.Perform...
-
Data Engineering Manager
4 days ago
Hong Kong, Central and Western District, Hong Kong SAR China Viu Full timeWe are now looking for a professional to join our data management team for OTT service, Viu located in Hong Kong. With over 66 million monthly active users (MAU) and 12 million paid subscribers, Viu is a leading pan-regional OTT video service with presence across Asia, the Middle East, and South Africa.The role will be responsible for building up...
-
Senior Python Data Engineer
14 hours ago
Hong Kong, Central and Western District, Hong Kong SAR China Crypto Full timeSenior Python Data Engineer (Finance Digital Transformation) We are a team to design, develop, maintain, and improve software for various ventures projects, i.e., projects that are adjacent to our core businesses and are bootstrapped fast with a lean team. You will be actively involved in the design of various components behind scalable applications, from...
-
Data Center Operations Specialist
2 weeks ago
Hong Kong, Central and Western District, Hong Kong SAR China BDx Data Centers Full timeAt BDx Data Centers, we're looking for a seasoned professional to join our team as a Data Center Operations Specialist. This role involves overseeing the day-to-day operations of our facilities, ensuring that all systems are running smoothly and efficiently.The ideal candidate will have a strong background in automation systems, with experience in managing...