Job description
Position Overview
We are seeking a highly experienced Senior/Staff Software Engineer to help design and build next-generation AI-powered agent platforms for customer-facing applications. This role is ideal for engineers who thrive in fast-paced startup environments, enjoy solving complex technical challenges, and have hands-on experience shipping production-grade LLM or agentic AI systems.
The ideal candidate brings strong full-stack engineering capabilities with a backend-first mindset, deep familiarity with AI tooling and infrastructure, and the ability to lead high-impact cross-functional initiatives from concept through production.
This is a fully remote opportunity open to candidates located in the United States or Canada.
Key Responsibilities
Own and deliver AI agent experiences end-to-end, including backend orchestration, LLM integrations, conversational interfaces, tool execution, and evaluation systems
Design scalable architectures for agentic AI systems and contribute to platform-level AI infrastructure
Build and improve shared systems such as:
Tool abstractions
Retrieval pipelines / RAG systems
Conversation persistence
Evaluation frameworks
Permissioning and observability
Collaborate closely with Product, Design, and Engineering leadership to define technical direction and product strategy
Make thoughtful engineering tradeoffs balancing latency, reliability, scalability, and cost efficiency
Improve AI system quality through experimentation, evaluation frameworks, and continuous iteration
Lead or contribute to large-scale technical initiatives across multiple teams
Mentor engineers and promote engineering best practices across the organization
Required Qualifications
5+ years of professional software engineering experience
Proven experience building and shipping production-grade AI/LLM-powered applications or agentic systems
Strong expertise in backend development using Node.js and TypeScript
Experience designing scalable distributed systems, microservices, and backend infrastructure
Hands-on experience with:
Tool calling
Prompt engineering
Agent loops
AI orchestration frameworks
Familiarity with evaluation and observability tooling for non-deterministic AI systems such as:
LangSmith
Braintrust
Custom evaluation frameworks
Full-stack engineering experience with modern frontend frameworks such as React and TypeScript
Strong understanding of databases such as PostgreSQL and MongoDB
Excellent communication and collaboration skills with cross-functional teams
Demonstrated ownership mentality and ability to operate independently in ambiguous environments
Preferred Qualifications
Experience with Retrieval-Augmented Generation (RAG) systems at production scale
Prior experience building customer-facing AI products
Background working at high-growth or venture-backed startups
Contributions to open-source AI tooling, agent frameworks, or developer productivity systems
Experience mentoring engineers or leading technical initiatives
Familiarity with AI observability and evaluation workflows
Experience with cloud infrastructure and modern deployment practices
Compensation & Benefits
Competitive base salary ($210K – $230K DOE)
Competitive equity package
Fully remote work environment
Opportunity to work on cutting-edge AI products with significant technical ownership
High-impact role within a rapidly growing engineering organization
Originally posted on Himalayas
Who can apply
Eligible countries: United States. Accepted UTC offsets: UTC-10, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.