Machine Learning Performance Optimization Specialist

4 weeks ago


Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

We are seeking a skilled engineer with expertise in low-level systems programming and optimization to contribute to our growing ML team at Jane Street.

As a critical component of our global business, machine learning serves as a unique platform for experimentation and innovation. Our trading environment provides a rapid-feedback loop, allowing us to incorporate new ideas with minimal friction.

Your role will focus on optimizing the performance of our models, encompassing both training and inference. This involves efficient large-scale training, low-latency inference in real-time systems, and high-throughput inference in research. You will work on improving CUDA performance, as well as adopting a whole-systems approach, including storage systems, networking, and host- and GPU-level considerations.

To ensure our platform is optimized at all levels, you will investigate whether throughput is actually goodput and whether loading vectors from the L2 cache takes a significant amount of time.

If you're new to the finance industry, you're in good company. Many of our team members were in the same position before joining Jane Street. If you have a curious mind and a passion for solving complex problems, we believe you'll fit right in.

We're looking for candidates with the following skills:

  • Knowledge of modern ML techniques and toolsets
  • Experience and systems knowledge required to debug a training run's performance end to end
  • Low-level GPU knowledge of PTX, SASS, warps, cooperative groups, Tensor Cores, and the memory hierarchy
  • Debugging and optimization experience using tools like CUDA GDB, NSight Systems, NSight Compute, and nsight-compute
  • Library knowledge of Triton, CUTLASS, CUB, Thrust, cuDNN, and cuBLAS
  • Intuition about the latency and throughput characteristics of CUDA graph launch, tensor core arithmetic, warp-level synchronization, and asynchronous memory loads
  • Background in Infiniband, RoCE, GPUDirect, PXN, rail optimization, and NVLink, and how to use these networking technologies to link up GPU clusters
  • Understanding of collective algorithms supporting distributed GPU training in NCCL or MPI
  • Inventive approach and willingness to ask hard questions about whether we're taking the right approaches and using the right tools
  • Fluency in English


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Important RoleWe are seeking an accomplished engineer with extensive experience in low-level systems programming and optimization to join our growing ML team at Jane Street.As a critical component of our global business, machine learning serves as a unique, rapid-feedback platform for experimentation, allowing us to incorporate new ideas with relatively...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a skilled engineer with expertise in low-level systems programming and optimization to contribute to our growing ML team at Jane Street.Our trading environment serves as a unique platform for ML experimentation, allowing us to incorporate new ideas with minimal friction.Your role will involve optimizing the performance of our models, focusing...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a skilled engineer with extensive experience in machine learning and a strong mathematical background to join our growing ML team at Jane Street.Our trading environment serves as a unique platform for ML experimentation, allowing us to incorporate new ideas quickly. Our ML team is comprised of software engineers who share a passion for...


  • Hong Kong, Central and Western District, Hong Kong SAR China HARBRIDGE PARTNERS Full time

    **Job Title:** Quantitative Developer - Machine Learning Engineer**Location:** Not SpecifiedJob Summary: We are seeking a highly skilled Quantitative Developer to join our team as a Machine Learning Engineer.Key Responsibilities:Design and implement machine learning pipelines for efficient data processing.Develop and optimize machine learning models for...


  • Hong Kong, Central and Western District, Hong Kong SAR China HARBRIDGE PARTNERS Full time

    At Harbridge Partners, we are seeking a highly skilled Quantitative Developer to join our team. This role is an exciting opportunity for individuals who are passionate about machine learning and data analysis.**Job Description:**We are looking for a talented developer to work on our proprietary machine learning pipeline, encompassing data sampling, model...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    About the PositionJane Street is a leading financial services company that leverages advanced machine learning techniques to drive business growth. As a Machine Learning Researcher, you will play a critical role in developing and implementing cutting-edge models that inform our trading strategies.Our team is responsible for processing vast amounts of data,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a highly skilled Machine Learning Engineer to join our growing team at Jane Street. The ideal candidate will have a strong background in machine learning and a passion for designing and implementing cutting-edge solutions.Key Responsibilities:Design and develop machine learning models to drive business decisionsCollaborate with...


  • Hong Kong, Central and Western District, Hong Kong SAR China TransPerfect Full time

    DataForce by TransPerfect seeks a skilled Machine Learning Specialist to work with language data and create, categorize, audit, and improve lexical data in Hong Kong Traditional Chinese.As a Machine Learning Specialist, your responsibilities include developing natural language processing code specific to the Hong Kong Traditional Chinese language and...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a highly skilled Machine Learning Engineer to join our growing team at Jane Street. As a key member of our ML team, you will play a critical role in driving the direction of our ML platform and contributing to the development of our trading environment.Key Responsibilities:Design and implement robust machine learning models to drive business...


  • Hong Kong, Central and Western District, Hong Kong SAR China Classy Wheeler Limited Full time

    About Us: Classy Wheeler Limited is a leading provider of cutting-edge technology solutions for mobile networks.Salary Range: HK$150,000 - HK$250,000 per annum (dependent on experience)About the Role:Job DescriptionDesign and implement data analytics solutions to ensure optimal network performanceDevelop and maintain performance management tools using...


  • Hong Kong, Central and Western District, Hong Kong SAR China Huawei Full time

    About the RoleAt Huawei, we are seeking an experienced High Performance Optimization Engineer to join our team. This is a critical role that will contribute to the improvement of our system's performance and overall efficiency.Job ResponsibilitiesWe are looking for a highly skilled individual who can work closely with our architects, application, software,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Intact Financial Corporation Full time

    At Intact Financial Corporation, we're on a mission to revolutionize the insurance industry through cutting-edge technology and innovative solutions.As a Data Scientist I, you'll play a crucial role in shaping the future of insurance by developing and implementing machine learning models that drive business growth and customer satisfaction.We're seeking a...

  • Data Scientist

    6 days ago


    Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    About the RoleJane Street is a global trading firm that utilizes advanced machine learning techniques to drive its business. We are seeking a highly skilled Machine Learning Researcher to join our team.The successful candidate will be responsible for building models, strategies, and systems that price and trade financial instruments algorithmically. This...


  • Hong Kong, Central and Western District, Hong Kong SAR China The Hong Kong University of Science and Technology Full time

    Job OverviewThe Hong Kong University of Science and Technology is seeking a highly motivated Research Assistant Professor to contribute to the Signal Processing and Computational Biology group. As a key member of the team, you will work on developing machine learning and/or deep learning models for various applications.About the PositionThis is a 1-2 year...


  • Hong Kong, Central and Western District, Hong Kong SAR China Lalamove Full time

    Lalamove is seeking a highly skilled Lead Data Scientist and Machine Learning Engineer to join our team in Data Science Team. As a key member of our leadership team, you will be responsible for driving the direction and architecture of artificial intelligence at Lalamove. This role requires a strong background in data science, machine learning, and software...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a skilled Machine Learning Engineer to collaborate with our dynamic team and contribute to the advancement of our ML platform.Jane Street's innovative trading environment provides a unique opportunity for ML experimentation and rapid feedback, allowing us to incorporate new ideas efficiently. Our ML team is comprised of software engineers who...

  • AI Specialist

    3 weeks ago


    Hong Kong, Central and Western District, Hong Kong SAR China GFT Technologies SE Full time

    About GFTGFT Technologies SE is a global leader in driving the digital transformation of the world's foremost financial institutions. With our expertise extending to other sectors such as industry and insurance, we leverage our robust consulting and implementation skills across pioneering technologies. Our scalable IT solutions enhance productivity in...


  • Hong Kong, Central and Western District, Hong Kong SAR China Intact Financial Corporation Full time

    We are seeking a talented Senior Data Scientist to join our team at Intact Financial Corporation, located in Hong Kong. As a key member of our AI lab, you will be responsible for developing innovative solutions using machine learning and advanced statistics.About the RoleThe successful candidate will have 5+ years of experience in predictive modeling,...

  • Data Scientist I

    4 weeks ago


    Hong Kong, Central and Western District, Hong Kong SAR China Intact Financial Corporation Full time

    Artificial intelligence is shaping the future of insurance. Our latest lab is located in the Hong Kong Science and Technology Park to turn this vision into a reality.As Canada's largest home, auto and business insurer, we're here to cultivate the next generation of technology and talent. Together, we're helping our customers protect what matters to them most...


  • Hong Kong, Central and Western District, Hong Kong SAR China Gravitas Recruitment Group Full time

    At Gravitas Recruitment Group, we are seeking a highly skilled Data Science Strategist to join our team as a Machine Learning Expert. This is an exciting opportunity for a professional with experience in developing AI/ML models and conducting advanced customer analytics to drive business outcomes.Key Responsibilities:Develop and implement data and analytics...