About this opportunity
Fluency lists this Software Engineer, AI Platform opportunity in san francisco, California. Review the employer’s description below for duties, qualifications and application requirements.
Job description
We are hiring a full-time Software Engineer, AI Platform to own the data platform, ETL pipelines, and agent infrastructure that everything else at the company runs on.
This is the platform layer that makes Fluency's AI work reliable, observable, and usable in production. It moves data through LLMs, transforms agent outputs into structured downstream data, runs jobs reliably, and keeps the system fast, cheap, and observable as we scale.
Because we are an early‑stage company moving fast, we are looking for an engineer who can build the platform, keep it running, and make trade‑offs while priorities shift. This is an in‑person role, 5 days a week in our office. The ability to balance reliability with iteration speed is essential.
Key Responsibilities
Own the data platform: maintain and evolve the platform that powers every job across the company.
Run the LLM ETL pipeline: ingestion, transformation, enrichment, and storage of LLM‑driven data.
Build agent transformation infrastructure: the systems that take agent outputs and turn them into structured, queryable data downstream.
Improve reliability, throughput, and cost of LLM‑driven jobs in production.
Build observability and tooling so the team can debug and iterate quickly.
Partner with AI Engineers: expose new capabilities through the platform and shape the interfaces they build on.
Operate the system: participate in on‑call rotation and incident response.
What We Are Looking For
Strong Python engineering experience supporting production systems (FastAPI or similar)
Experience building or maintaining production pipelines that handle non‑trivial volume, retries, backfills, and failure recovery
Hands‑on experience with a data orchestrator (Dagster, Airflow, Prefect, or Temporal) and dbt or similar transformation tooling
Comfort with PostgreSQL at scale: schema design, multi‑schema setups, and migrations
Comfort with AWS infrastructure (ECS, Lambda, SQS, Step Functions, RDS, S3) and IaC (Terraform / Terragrunt)
Familiarity with LLM APIs and the operational realities of LLM‑based systems (latency, cost, retries, structured output, failure modes)
Nice to Have
Experience with distributed compute for Python workloads: Anyscale Ray, Dask, or Spark
Experience with Polars and Pandas for data processing
Familiarity with Datadog for observability, metrics, and tracing
Cost optimization experience for LLM workloads
Familiarity with pgvector or other vector stores
Multi‑region AWS deployment experience
Some TypeScript/Node experience, since parts of the platform live there
Location
Full‑time, in‑person role based in San Francisco, CA.
We offer E‑3 sponsorship for Australians to relocate with stipend.
This role is not a fit if
You want hybrid or remote
You're not comfortable with rapid iteration
You haven't owned production systems
You've never operated production pipelines
You do not want to be on‑call
You dislike constraints (we have them: cost, latency, reliability tradeoffs are real)
Requirements need to be locked down before you can move
We strongly encourage applicants from underrepresented backgrounds to apply. Diverse teams build better products.
Compensation & Benefits
Base salary: US$180,000 to US$250,000
ESOP: Available
US$1,000 per month food and commuting allowance
Laptop of choice
#J-18808-Ljbffr
Worksite address
san francisco, CA, 94199, US
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.