Member of Technical Staff, ML Systems

True Talent Solutions Partners · Menlo Park, United States · Posted today

  • $180k–$260k a year
  • Full-time

About the job

About the Role

Join an AI team building training and inference systems for image, video, and world-model workloads. You will improve performance across the stack, from GPU kernels to distributed training and serving.

What You'll Do

  • Optimize training and inference performance for image, video, and world-model workloads.

  • Profile and resolve bottlenecks across kernels, memory, systems, and clusters using Nsight and related tools.

  • Implement low-level optimizations with CUDA and Triton.

  • Design and improve distributed training and inference engines for diffusion models.

  • Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, and RoCE.

  • Build benchmarking and regression systems to maintain performance gains in production.

  • Co-design kernels, runtimes, and models with hardware constraints in mind.

What We're Looking For

  • Two or more years of experience in deep learning training or inference systems, or distributed systems.

  • At least one year of recent, hands-on ML systems or GPU performance work.

  • Experience authoring core features in an inference or training framework, such as vLLM, SGLang, TensorRT-LLM, or Megatron.

  • Direct GPU kernel development with CUDA, CUTLASS, Triton, or PTX on NVIDIA GPUs.

  • Strong machine learning and computer science fundamentals, with a degree in computer science or a related quantitative field.

  • Experience optimizing inference or training performance, ideally for diffusion, video, image, or other multimodal workloads.

Compensation & Benefits

Base salary is $180,000 to $260,000 annually. Visa sponsorship is available.

Location

On-site in Menlo Park, California, United States.

Posted by True Talent Solutions Partners on its own job board and shown here as written.

More jobs at True Talent Solutions Partners

All True Talent Solutions Partners jobs

Similar jobs in United States