Scale Low-Latency ML Inference Engineer (GPU/CUDA)

Job description

AI Breaking Wire seeks a Machine Learning Engineer to join our Inference Infrastructure team. You will build and optimize the high-throughput, low-latency distributed systems that power models like GPT-4 and Sora for millions of users worldwide.

The role emphasizes C++ and Python proficiency, GPU optimization with CUDA and Triton, and collaboration with research teams to productionize new architectures. This hybrid position is based in San Francisco.

#J-18808-Ljbffr

Worksite address

san francisco, CA, 94199, US

Who can apply

Review the original listing for work authorization, qualifications and employer requirements.