Machine Learning Performance Optimization Specialist

3 weeks ago


Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

We are seeking a skilled engineer with expertise in low-level systems programming and optimization to contribute to our growing ML team at Jane Street.

Our trading environment serves as a unique platform for ML experimentation, allowing us to incorporate new ideas with minimal friction.

Your role will involve optimizing the performance of our models, focusing on efficient large-scale training, low-latency inference in real-time systems, and high-throughput inference in research.

Key aspects of this position include improving CUDA performance, optimizing storage systems, networking, and host- and GPU-level considerations.

We aim to ensure our platform is efficient even at the lowest level, considering throughput and goodput.

While prior experience in finance is not required, a curious mind and passion for solving complex problems are essential.

Some of the skills we're looking for include:

  • Understanding of modern ML techniques and toolsets
  • Experience in debugging training run performance end to end
  • Low-level GPU knowledge of PTX, SASS, warps, cooperative groups, Tensor Cores, and memory hierarchy
  • Debugging and optimization experience using tools like CUDA GDB, NSight Systems, NSight Compute, and nsight-compute
  • Library knowledge of Triton, CUTLASS, CUB, Thrust, cuDNN, and cuBLAS
  • Intuition about latency and throughput characteristics of CUDA graph launch, tensor core arithmetic, warp-level synchronization, and asynchronous memory loads
  • Background in Infiniband, RoCE, GPUDirect, PXN, rail optimization, and NVLink, and how to use these networking technologies to link up GPU clusters
  • Understanding of collective algorithms supporting distributed GPU training in NCCL or MPI
  • Inventive approach and willingness to question current approaches and tools
  • Fluency in English


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Unlock the Potential of Machine Learning at Jane StreetWe're on the hunt for a skilled engineer to join our dynamic ML team. As a critical pillar of our global business, machine learning requires a unique blend of innovation and expertise. Our trading environment serves as a rapid-feedback platform for experimentation, allowing us to incorporate new ideas...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Unlock the Potential of Machine Learning at Jane StreetWe're on the hunt for a skilled engineer to join our dynamic ML team. As a critical pillar of our global business, machine learning requires a unique blend of innovation and expertise. Our trading environment serves as a rapid-feedback platform for experimentation, allowing us to incorporate new ideas...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Unlock the Potential of Machine Learning at Jane StreetWe're on the hunt for a skilled engineer to join our dynamic ML team. As a critical pillar of our global business, machine learning requires a unique blend of innovation and expertise. Our trading environment serves as a rapid-feedback platform for experimentation, allowing us to incorporate new ideas...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    About the RoleWe are seeking an experienced engineer to join our growing Machine Learning team at Jane Street. As a Machine Learning Performance Engineer, you will play a critical role in optimizing the performance of our models, both training and inference.Our trading environment is a unique, rapid-feedback platform for ML experimentation, allowing us to...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Unlock the Potential of Machine Learning at Jane StreetWe're seeking a skilled engineer to join our growing ML team, where you'll play a critical role in optimizing the performance of our models. With a unique, rapid-feedback platform for ML experimentation, we're constantly pushing the boundaries of what's possible.Your focus will be on optimizing the...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Job Title: Machine Learning Performance EngineerWe are seeking a skilled engineer to join our Machine Learning team at Jane Street. As a Machine Learning Performance Engineer, you will be responsible for optimizing the performance of our models, both training and inference.Key Responsibilities:Optimize model performance using modern ML techniques and...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a skilled engineer with expertise in low-level systems programming and optimization to contribute to our growing ML team at Jane Street.As a critical component of our global business, machine learning serves as a unique platform for experimentation and innovation. Our trading environment provides a rapid-feedback loop, allowing us to...


  • Hong Kong, Central and Western District, Hong Kong SAR China HARBRIDGE PARTNERS Full time

    {"h1": "Quantitative Developer for Machine Learning", "p": "At Harbridge Partners, we are seeking a highly skilled Quantitative Developer to join our team in Hong Kong. As a Quantitative Developer, you will be responsible for developing and implementing machine learning models, establishing proprietary pipelines, and optimizing algorithms to boost...


  • Hong Kong, Central and Western District, Hong Kong SAR China HARBRIDGE PARTNERS Full time

    Job Title: Machine Learning Quantitative DeveloperLocation: Hong KongAbout the Role:We are seeking a highly skilled Quantitative Developer to join our team in Hong Kong. The successful candidate will be responsible for developing and implementing machine learning models, as well as working on microstructures research, portfolio optimization, and data...


  • Hong Kong, Central and Western District, Hong Kong SAR China HARBRIDGE PARTNERS Full time

    Job Title: Machine Learning Quantitative DeveloperJob Summary:We are seeking a highly skilled Machine Learning Quantitative Developer to join our team at Harbridge Partners. The ideal candidate will have a strong background in machine learning and software development, with a passion for solving complex problems.Key Responsibilities:Machine Learning Pipeline...


  • Hong Kong, Central and Western District, Hong Kong SAR China Huawei Full time

    Job ResponsibilitiesYou will be responsible for evaluating the system application and benchmarks to identify performance bottlenecks. You will work closely with the architects, application, software, and modeling teams to propose solutions to improve the overall performance of the application.Key Responsibilities:Evaluate software performance and identify...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    About the PositionJane Street is a leading financial services company that leverages advanced machine learning techniques to drive business growth. As a Machine Learning Researcher, you will play a critical role in developing and implementing cutting-edge models that inform our trading strategies.Our team is responsible for processing vast amounts of data,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Machine Learning EngineerWe are seeking a highly skilled Machine Learning Engineer to join our growing team at Jane Street. As a key member of our ML team, you will play a critical role in driving the direction of our ML platform and contributing to the development of innovative solutions.With a strong background in machine learning and a passion for...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Machine Learning EngineerWe are seeking a highly skilled Machine Learning Engineer to join our team at Jane Street. As a key member of our ML team, you will play a critical role in driving the direction of our ML platform and contributing to the development of our trading environment.With a strong background in machine learning and mathematical foundations,...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    About the RoleJane Street is a leading global trading firm that leverages advanced machine learning techniques to drive its business. As a Machine Learning Researcher, you will play a critical role in building and deploying models that price and trade thousands of financial instruments algorithmically.Our team is responsible for processing petabytes of data,...


  • Hong Kong, Central and Western District, Hong Kong SAR China TransPerfect Full time

    DataForce by TransPerfect seeks a skilled Machine Learning Specialist to work with language data and create, categorize, audit, and improve lexical data in Hong Kong Traditional Chinese.As a Machine Learning Specialist, your responsibilities include developing natural language processing code specific to the Hong Kong Traditional Chinese language and...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Machine Learning EngineerWe are seeking a highly skilled Machine Learning Engineer to join our growing team at Jane Street. As a key member of our ML team, you will play a critical role in driving the direction of our ML platform and contributing to the development of innovative solutions.With a strong background in machine learning and a passion for...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a highly skilled Machine Learning Engineer to join our growing team at Jane Street. The ideal candidate will have a strong background in machine learning and a passion for designing and implementing cutting-edge solutions.Key Responsibilities:Design and develop machine learning models to drive business decisionsCollaborate with...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    We are seeking a highly skilled Machine Learning Engineer to join our growing team at Jane Street. As a key member of our ML team, you will play a critical role in driving the direction of our ML platform and contributing to the development of our trading environment.Key Responsibilities:Design and implement robust machine learning models to drive business...


  • Hong Kong, Central and Western District, Hong Kong SAR China Jane Street Full time

    Job Title: Machine Learning EngineerWe are seeking a highly skilled Machine Learning Engineer to join our team at Jane Street. As a key member of our ML team, you will play a critical role in driving the direction of our ML platform and contributing to the development of our trading environment.Our ML team is comprised of experienced engineers with a passion...