Skip to content
Six Figure Jobs
True Talent Solutions Partners logo

True Talent Solutions Partners

Full-Stack Engineer, Agent Evaluation & Reliability

Salary

$120K - $180K

Listed in the posting

Pays more than 19% of 330 full stack engineer listings in USD.

This job
$120k–$180k
Typical
$188k
Most pay
$161k–$211k
Apply on company site

Requirements

  • At least 2 years of experience as a full-stack or backend engineer building and shipping production systems.
  • Production experience with TypeScript and Node.js or Bun, PostgreSQL, and job queues or worker systems.
  • Experience at a fast-paced startup, and ownership of projects from technical design through deployment and iteration.
  • Experience building enterprise integrations, including OAuth flows, webhooks, incremental syncs, backfills, and rate-limit handling.
  • Hands-on experience with agent infrastructure, LLM evaluation, tracing, or agent memory systems is valuable.
  • Early-stage engineering experience, including owning backend systems end-to-end, and AI side projects, open-source contributions, or hackathon participation are also relevant.

Benefits

  • Equity
  • Visa sponsorship

Skills

Nice to have

Full job description

Description

About the Role

Join an AI team building backend infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role offers ownership of architecture and product decisions while turning complex systems into useful customer-facing features.

What You'll Do

  • Build and maintain backend systems that power agent evaluation and continuous improvement.

  • Design data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.

  • Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.

  • Own features end to end, from technical design and implementation through deployment, observability, customer feedback, and iteration.

  • Work directly with customers to diagnose system failures and turn individual needs into reusable product capabilities.

  • Debug distributed workflows and improve system reliability.

Location

On-site in San Francisco, California, United States.

Requirements

What We're Looking For

  • Two to four years of experience in a full-stack or backend engineering role building and shipping production systems.

  • Production experience with TypeScript and Node.js or Bun, PostgreSQL schema design, and queues or worker systems.

  • Hands-on machine learning engineering experience, including model development, and familiarity with agent infrastructure, LLM evaluation, tracing, or agent memory systems.

  • Experience building backend systems and third-party integrations, and owning projects from design through deployment and iteration.

  • Understanding of how evaluating nondeterministic agent systems differs from conventional unit testing.

  • Experience in a fast-paced startup environment and a track record of building, such as through shipped AI projects or open-source contributions.

Benefits

Compensation & Benefits

Base salary is $120,000 to $180,000 USD annually. Visa sponsorship is available, including H-1B transfers, OPT, and O-1.

Apply on company site

Opens True Talent Solutions Partners’s own application page in a new tab.

OpenAI logo
OpenAI
San Francisco, USAHybrid

Dots for Companies helps organizations put AI to work. Our scope includes increasing adoption and retention in Business...

Posted 4d ago
OpenAI logo
OpenAI

Full Stack Software Engineer, Travel

$347k - $385k
Salary shown
San Francisco, USAHybrid

Within Travel, we’re exploring how AI can help people discover destinations, compare options, and plan trips around thei...

AIAPIChatgptOpenai
Posted 6d ago
Come Near logo
Come Near

Full Stack Engineer

$150k+
Salary shown
West Virginia, USAOnsite

Job Description Full Stack Software Engineer \n Remote (US-based) \n Salary: Starting at $150K \n \n Tech Stack: \n Fron...

Posted 7d ago
OpenAI logo
OpenAI
San Francisco, USAHybrid

We build AI systems that help people better understand and navigate their health while setting a high bar for safety, re...

AIChatgptOpenaiPrototyping
Posted 8d ago

Get jobs like this one by email

Full-stack Engineer jobs · USA

Only new matching jobs, nothing else. Confirm by email; unsubscribe in one click.

Explore more

Salary

$120K - $180K

Apply