About this opportunity
Hewlett Packard Enterprise Company lists this Senior Software Engineer - LLM Inference Runtime (Hybrid) opportunity in spring, Texas. Review the employer’s description below for duties, qualifications and application requirements.
Job description
Hewlett Packard Enterprise seeks a Senior Software Engineer to build and evolve the model runtime for the AI Essentials inference platform used by enterprises to operate large language models on customer-owned hardware, including air-gapped environments. Emphasis is on sustained execution efficiency, low tail latency, and high GPU utilization.
The role involves engine integration, batching, KV cache management, and distributed execution, with collaboration across inference teams and a Kubernetes
#J-18808-Ljbffr
Worksite address
spring, TX, 77391, US
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.