Distributed ML Optimization Engineer

New

Skills

C++ CUDA Python Pytorch Rust

Join AssemblyAI as a Senior Research Engineer, working fully remote within the United States. You will drive performance and scalability in large-scale distributed training and inference for cutting-edge Speech AI models. Collaborate closely with both Research and Engineering teams to turn innovative prototypes into robust production systems, leveraging state-of-the-art technologies and frameworks.

Key Responsibilities
  • Investigate and resolve performance bottlenecks in distributed training and inference systems.
  • Design and implement optimization strategies at both operator/kernel and system/architecture levels.
  • Translate research models into highly efficient, production-ready inference systems.
  • Integrate inference compilers such as TensorRT, ONNX Runtime, AWS Neuron, and similar tools.
  • Deploy scalable solutions for parallel workloads on heterogeneous hardware.
  • Facilitate knowledge transfer and alignment between Research and Engineering teams.
Required Skills & Qualifications
  • Advanced expertise in Python and major ML frameworks (PyTorch, JAX).
  • Proficiency in lower-level programming languages (C++ or Rust preferred).
  • Strong background in GPU acceleration (CUDA, kernel-level optimization); TPU experience is a plus.
  • Hands-on experience with compiler frameworks, graph optimizations, and parallelization techniques.
  • Deep understanding of the deep learning lifecycle, including model design, training, data pipelines, and inference deployment.
  • Exceptional debugging, profiling, and optimization skills in distributed environments.
  • Excellent communication and collaboration abilities to support cross-functional teams.

Job Type: Remote

Salary: Not Disclosed

Experience: Entry

Duration: 12 Months

Share this job:

Similar Jobs

Plaid Remote Gaming Project

New

Develop and enhance gaming experiences remotely

Collaborate with a team to design and implement gaming features

C# C++ Debugging Game development

C++ Data Recovery Engineer

Posted 3 days ago

Enhance data recovery tools

Analyze proprietary storage formats

C C++ Engineer Git

Senior C++ Database Developer

Posted 12 days ago

Design and implement robust database engine solutions

Maintain high code quality and performance standards

Bash Bash Scripting C++ Devops

Security Software Engineer Role

Posted 12 days ago

Drive product security and vulnerability management

Champion security best practices across teams

C C++ Engineer Java

Golang Engineer at Canonical

Posted 12 days ago

Hire skilled Golang engineers for remote teams

Develop secure and performant open-source software

Apis Architecture C C++

Rust Engineering Lead Role

Posted 13 days ago

Drive Rust adoption across Canonical products

Develop and maintain Rust-based Linux software

C C++ Cloud Computer science

Ubuntu Platform Engineering Manager

Posted 14 days ago

Lead distributed engineering teams for Ubuntu platform development

Optimize operating system for next-generation silicon hardware

Architecture C C++ Devops

Ubuntu Linux Systems Engineer

Posted 14 days ago

Optimize Ubuntu for latest hardware platforms

Collaborate with global engineering teams

C C++ Devops Docker

Linux Systems Engineer Optimisation

Posted 14 days ago

Optimise Ubuntu for new hardware platforms

Lead and deliver technical integration projects

C C++ Debian Devops

Core Zero-Knowledge Engineer

Posted 15 days ago

Advance zk-EVM scalability and performance

Design and implement zero-knowledge cryptographic solutions

C++ Computer science Engineer Go

JAX Research Engineer Role

Posted 16 days ago

Optimize and scale JAX frameworks for distributed training.

Enhance production inference systems for speech-to-text models.

C++ Python Rust

Graphics Systems Engineer Role

Posted 17 days ago

Develop and enhance Mir graphics stack

Enable seamless graphical environments across devices

C++ Engineer Flutter Linux

Bug Bounty Security Researcher

Posted 18 days ago

Identify and report security vulnerabilities

Participate in bug bounty programs

C++ Html Javascript Kali Linux

Embedded Linux Field Engineer

Posted 18 days ago

Support and engage enterprise customers in mission-critical sectors

Design and deliver embedded Linux solutions for IoT and devices

C C++ Devops Engineer

Embedded Linux Optimisation Engineer

Posted 19 days ago

Optimise Ubuntu for new hardware platforms

Collaborate with global partners on integration

C C++ Docker Engineer

Remote Quantitative Researcher Role

Posted 20 days ago

Develop alpha-generating HFT strategies

Analyze and model ultra-short-term market data

C++ Data Analytics Predictive Analytics Python

Linux Software Maintenance Engineer

Posted 25 days ago

Maintain and improve open source Linux infrastructure

Troubleshoot and resolve complex technical issues

C++ Ceph Devops Docker

Oracle Cloud Software Developer

Posted 28 days ago

Develop scalable cloud services for media production

Collaborate with cross-functional engineering teams

C# C++ Containerization Distributed systems

LLVM Compiler Developer

Posted 30 days ago

Develop and optimize compiler toolchains

Extend and adapt open source LLVM/Clang code

Back-end Bash C++ Communication

InnoDB Team Lead Role

Posted 30 days ago

Lead the InnoDB software development team.

Design and implement robust database solutions.

Agile Methodologies Algorithms C++ Computer science

iOS Browser Engineer Remote

Posted 30 days ago

Enhance privacy and security for iOS users

Develop and maintain Brave's iOS browser

C++ Engineer Javascript Software Engineering

LLVM Compiler Developer

Posted 30 days ago

Develop and optimize LLVM-based toolchains

Support cross-platform compilation and integration

Back-end Bash C C++

IoT Solutions Architecture Manager

Posted 32 days ago

Lead and mentor regional field engineering teams

Deliver secure IoT solutions for enterprise clients

Architecture C C++ Debian

C++ Data Recovery Engineer

Posted 35 days ago

Enhance proprietary data recovery tools

Analyze and reconstruct data from damaged storage

C C++ Engineer Python

Embedded Linux Engineering Manager

Posted 35 days ago

Lead and mentor regional field engineering teams

Deliver presales and professional services for embedded Linux solutions

C++ Debian Devops Embedded Linux

C++ Data Recovery Engineer

Posted 36 days ago

Enhance data recovery toolset

Analyze and interpret proprietary storage formats

C C++ Engineer Software Engineering

C/C++ Data Recovery Engineer

Posted 37 days ago

Enhance data recovery tools

Analyze proprietary storage formats

C C++ Engineer Git

Ubuntu Silicon Optimization Engineer

Posted 39 days ago

Optimize Ubuntu for emerging silicon architectures.

Collaborate globally in a remote-first environment.

C C++ Devops Docker

AI Full Stack Developer

Posted 41 days ago

Train and improve AI language models

Evaluate and critique AI-generated code

C# C++ Cloud Platforms Css

AI Back-End Developer Role

Posted 41 days ago

Support AI model training and development

Evaluate and optimize AI-generated code

AWS Azure C++ Flask

Rust Lead Engineer, Linux

Posted 45 days ago

Drive Rust adoption for system-level software

Develop and maintain open-source projects on Linux

C++ Devops Flutter Go

Ubuntu Linux Senior Engineer

Posted 46 days ago

Optimize Ubuntu for latest hardware platforms

Integrate Linux across desktop, server, and IoT environments

C C++ Devops Docker

Linux Systems Engineer Optimisation

Posted 46 days ago

Optimise Ubuntu for cutting-edge hardware platforms

Collaborate with global partners and engineering teams

C C++ Debian packaging Devops

Ubuntu Core Engineering Manager

Posted 47 days ago

Lead a distributed engineering team

Deliver secure and high-quality Ubuntu Core software

Agile Development C++ Containerization Debian

Symbotic Remote Robotics Jobs

Posted 47 days ago

Automate and optimize warehouse operations

Integrate AI-driven robotics solutions

C++ Cloud Computing Machine Learning Python

Graphics Systems Engineer Mir

Posted 49 days ago

Develop high-performance graphics and windowing system features

Advance open-source graphical solutions for diverse platforms

C++ Engineer Flutter Linux

Bug Bounty Security Researcher

Posted 50 days ago

Identify and responsibly report security vulnerabilities.

Conduct research and penetration testing on diverse systems.

C++ Html Javascript Kali Linux

Embedded Linux Optimisation Engineer

Posted 50 days ago

Optimise Ubuntu for latest hardware

Integrate next-generation features with silicon partners

C C++ Debian packaging Docker

Dropbox Software Engineer Intern

Posted 50 days ago

Recruit remote software engineering interns

Offer a flexible, Canada-wide internship

Agile Methodologies C++ Css Git

Graduate Software Engineer Role

Posted 50 days ago

Develop and deliver product features

Collaborate in a diverse, innovative engineering team

C++ Linux Python Software Engineering

Dropbox Software Engineer Internship

Posted 57 days ago

Offer remote engineering internship

Support Dropbox’s productivity mission

Agile Methodologies C++ Cloud Computing Git

Senior Device Software Engineer

Posted 58 days ago

Develop secure cross-platform device management applications

Integrate with OS and backend services for scalability

Android C# C++ Devops

Ads Software Engineer, Reddit

Posted 59 days ago

Develop new Ads product features

Enhance operational stability and code quality

C++ Dashboard Development Data Visualization Go

LLVM Compiler Developer

Posted 62 days ago

Enhance and extend LLVM and Clang toolchain components.

Support cross-platform code generation and optimization.

Back-end Bash C C++

LLVM Compiler Developer Role

Posted 62 days ago

Enhance and maintain LLVM/Clang-based toolchains

Support and optimize code for diverse platforms

Back-end Bash C++ Communication

iOS Browser Engineer

Posted 63 days ago

Develop and maintain Brave iOS browser

Ensure privacy and security for users

C++ Engineer Instrumentation Javascript

AI Code Reviewer Role

Posted 63 days ago

Review AI-generated code for quality

Provide feedback on code accuracy and style

Ai Systems C++ Code Review Engineer

Graduate C++ Engineer Remote

Posted 66 days ago

Recruit passionate graduate C++ engineers

Build high-performance, low-latency software

C++ Github Remote Collaboration Software Engineering

Embedded Linux Engineering Manager

Posted 68 days ago

Lead and develop regional engineering teams

Drive customer success through technical solutions

C C++ Debian Devops

Ubuntu Silicon Optimization Engineer

Posted 71 days ago

Optimize Ubuntu for new silicon architectures

Collaborate globally with distributed engineering teams

C C++ Devops Docker
overtime