Python Data Engineer

Develop and implement data pipelines for ingesting and collecting data from various sources into a centralized data platform. Develop and maintain ETL jobs using AWS Glue services to process and transform data at scale. Optimize and troubleshoot AWS Glue jobs for performance and reliability. Utilize Python and PySpark to efficiently handle large volumes of...

about the company.The hiring company is looking for self-starter and passionate Data engineer to join their expanding team and for the Data science-powered solutions.about the job.Develop and implement data warehouse architecture on AWSDesign and build data pipeline from internal and external data sourcesOptimise the performance of data pipelines and...

KEY RESPONSIBILITIES:Perform daily data operations, data modelling and database related mattersImplement end to end data pipeline (real-time and batches) from collection, transformation, data mapping, data modelling to visualisationCollaborate with IT and marketing teams to identify opportunities to manage data and provide solutions for various projectsPut...

about the company.The hiring company is looking for self-starter and passionate Data engineer to join their expanding team and for the Data science-powered solutions.about the job.Develop and implement data warehouse architecture on AWSDesign and build data pipeline from internal and external data sourcesOptimise the performance of data pipelines and...

Job Responsibilities: Develop & maintain the ETL batch to manipulate the model result data (live logging by Kafka) on Hadoop platform (HDFS), the data is semi-structured and huge (~5TB daily), combine analytical data set with the logging data for model training, investigation & monitoring purpose.Support, trouble-shooting & educate the users to access the...

Job Responsibilities:Maintain project documentation, including technical specifications and data mappings to enhance the efficient use of data services Ensure the quality, integrity, and security of data throughout the entire data lifecycle, applying robust database concepts and data modelling expertise Investigate and analyze ETL pipeline, identifying and...

  • Unique opportunity to work with smart minds and cutting-edge technology. • Greenfields environment where innovation is fostered. • Limitless earning potential.   The Company Join the forefront of cryptocurrency trading and market making with our leading cryptocurrency market-making and high-frequency trading firm. Operating across all major...

Responsibilities Develop and enhance applications utilizing Java and Python, with a focus on performance and scalability. Implement and maintain event processing and messaging queues, with expertise in Kafka, Flink, and Complex Event Processing (CEP) technologies. Design, deploy, and manage cloud-based solutions on AWS, ensuring high availability and...

The Quant Trading team is responsible for trading and managing risks associated with different crypto products, including spots and derivatives. The team develops and implements trading strategies in fast-paced and complex trading environments. Responsibilities Develop and enhance applications utilizing Java and Python, with a focus on performance and...

  Exceptional company, Innovative, Collaborative, Early Adopters of new technology. Tech: Linux, Python/Golang, Networking, AWS/GCP, CI/CD, DevOps, SRE. Excellent Culture, Elite Engineers, Hybrid/WFH options, Generous bonuses. Company Our client is a unique proprietary trading firm with a people centric ethos in that they place a heavy emphasis on...

•Solid hands-on experience in AWS or GCP services, such as Redshift, Glue, BigQuery, Data Flow.•Good understanding of cloud infrastructure and big data technologies•Skilled in SQL, Python and other related scripting and programming languages Experience Required 5 - 7 Years Industry Type IT Employment Type Permanent Location ...

  Develop fast, reliable, and scalable systems in fast-paced crypto trading firm. Key tech: Python, Typescript, C++, Blockchain, Smart Contracts, Bitcoin, Ethereum. High calibre tech teams, hybrid role, excellent incentive programs.   Company Our client is a young force in the high-frequency trading sphere who is actively engaged in all the major...

Do you love finding a solution for a problem? Do you dream in spreadsheets? Looking for a career where you can share your impressive analytical thinking? Play a crucial role in managing companies’ most important digital assets Leverage your innate skills with cutting edge, specialised training Company culture committed to diversity,...

Amazon Web Services (AWS) is one of the fastest growing businesses within Amazon, with key focus on expanding its footprints in APAC in recent years. We are seeking talented engineers who can take ownership, eager to learn and self-motivated. The successful candidate shall follow Amazon Data Center processes and maintain high operational standards in...

Our HR team oversees and contributes at both hands-on and strategic levels to support leaders and our employees. While HR, at its core, focuses on the mindful management of the company's relationship with our employees, culture management focuses on the heartfelt aspects of the employees' relationships with the company. Our HR team consists of professionals...

:Ongoing About Mox Mox is built by and for the ones who aspire to live life to the fullest – we call them Generation Mox! The name Mox reflects the endless opportunities we can create, - Mobile eXperience; Money eXperience; Money X (multiplier), eXponential growth, eXploration… it’s all up for us to define together. Why Mox Mox helps you grow...

The West Kowloon Cultural District Authority welcomes exceptional talent with a passion to realise the vision and mission of making the West Kowloon Cultural District a prime local and international destination for arts, culture and entertainment.You will be responsible for:managing the transformation of the Enterprise System Integration Platform for the...

Johnson Electric is hiring a Senior Data Engineer/ Lead Data Engineer for our engineering team. This role will:  Support development on database for motor design and motor production line matching Collect and optimize data, and establish prediction models based on machine learning methods Participates as an active member of the development team. ...

Data Scientist / Analyst - Systematic Data Platform We are building a world class systematic data platform which will power the next generation of our systematic portfolio engines.  The systematic data group is looking for Data Scientists & Analysts to join our growing team. The team consists of content specialists, data scientists, analysts and engineers...

About Vantage Data Centers Vantage is committed to being a workplace of inclusion, equity, respect and acceptance. We celebrate diversity and intentionally seek out opportunities to learn from one another’s experience. Vantage Data Centers powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud...