Skip to content
Six Figure Jobs
Lavendo logo

Lavendo

Solutions Architect, AI Infrastructure (SF/NYC, Hybrid)

Salary

$250K - $300K

Listed in the posting

Pays more than 97% of 150 solutions architect listings in USD.

This job
$250k–$300k
Typical
$176k
Most pay
$154k–$212k
Apply on company site

Requirements

  • 5+ years in customer-facing technical roles, including at least 2 years in pre-sales, such as solutions architecture, solutions engineering, or sales engineering.
  • Experience personally building, running, and presenting technical proofs of concept, with an example of what you built or tuned and what changed as a result.
  • Hands-on benchmarking, bottleneck analysis, and performance tuning in inference, databases, or distributed systems.
  • Working knowledge of open-source LLMs across inference, fine-tuning, and deployment.
  • Direct experience working with digital-native or startup customers.
  • Ability to work four days per week in the San Francisco or New York City office.

Benefits

  • Generous PTO
  • 401(k) match
  • Parental leave
  • Retirement plan
  • Health insurance

Skills

AI
API
Cloud Computing
Distributed Systems
Fine Tuning
Generative AI
GPU
LLM
Pre-sales
Proof of Concept

Nice to have

Rag
Reinforcement Learning

Full job description

Description

Lavendo partners with startups and high‑growth companies to help them hire top‑tier sales, GTM, and technical talent. This role is with one of our clients; we’ll share full details about the company and interview process as we get to know you and confirm mutual fit.

About the Company

Our client builds cloud infrastructure that helps AI teams run open models in production. Developers can call models through a serverless API, deploy them on dedicated endpoints, or run their own inference containers on GPU infrastructure. The same platform supports fine-tuning, reinforcement learning, and large-scale pre-training when teams need to adapt a model or build one of their own.

That breadth matters when a customer has to decide whether an open model can handle a production workload. The platform gives engineering teams several ways to test and deploy a model, and the company’s AI systems researchers turn performance improvements into tools customers can use.

The Mission

Make it practical for engineering teams to run, adapt, and own the models behind their products. Help customers take an open-model workload from a technical idea to something they can deploy and operate at scale.

The Opportunity

As a Solutions Architect, you’ll own the technical side of pre-sales and stay involved as customers move toward production. Inference is the main focus, with opportunities to work on post-training and GPU infrastructure. One engagement might have you diagnosing a bottleneck on a dedicated endpoint; another might have you helping a customer move an application from a closed model to an open one.

You’ll work with a group of Account Executives across qualified opportunities. They lead the commercial process; you own technical discovery, architecture, proof-of-concept execution, and the technical recommendation.

What You'll Do

  • Work directly with customers’ technical and business stakeholders to understand their workloads and design solutions around open models.

  • Build and run hands-on proofs of concept across software and hardware. Benchmark workloads, find bottlenecks, tune deployments, and present the measured results.

  • Partner with Account Executives to qualify opportunities and guide customers through architecture, security, and deployment decisions.

  • Stay involved through early production. Lead some customers through launch and collaborate with Forward Deployed Engineers on larger accounts.

  • Bring customer feedback to Product, Engineering, and Research. Create useful technical content, demos, playbooks, and tooling.

Key Success Drivers

  • Technical ownership: You can take a customer problem from a first conversation to a working POC and explain which decisions and changes were yours.

  • Performance judgment: You know what to measure, how to isolate a bottleneck, and how to make a recommendation based on the results.

  • Customer communication: You can work through implementation details with engineers and explain the tradeoffs to the people making the decision.

Interviewing Process

  1. Recruiter screen (30 min)

  2. Hiring manager screen (30 min)

  3. Team interviews (60 min)

  4. Sales presentation / case study (45 min)

  5. Leadership interview (30 min)

We are proud to be an equal opportunity workplace and consider all qualified applicants without regard to race, color, religion, national origin, age, sex, marital status, ancestry, disability, genetic information, veteran or military status, gender identity or expression, sexual orientation, or any other characteristic protected by law.

Requirements

Must-Haves

  • 5+ years in customer-facing technical roles, including at least 2 years in pre-sales, such as solutions architecture, solutions engineering, or sales engineering.

  • Experience personally building, running, and presenting technical proofs of concept, with an example of what you built or tuned and what changed as a result.

  • Hands-on benchmarking, bottleneck analysis, and performance tuning in inference, databases, or distributed systems.

  • Working knowledge of open-source LLMs across inference, fine-tuning, and deployment.

  • Direct experience working with digital-native or startup customers.

  • Ability to work four days per week in the San Francisco or New York City office.

Nice to Have

  • Experience at an AI inference, GPU cloud, or data infrastructure company, or on a startup- or generative AI-focused team at a hyperscaler.

  • Experience building agents or tuning retrieval-augmented generation pipelines or coding harnesses, including model selection and deployment.

  • A technical degree in computer science, electrical engineering, or a related field, or equivalent work or technical bootcamp experience.

  • Technical writing or public speaking experience.

Benefits

Why Join?

  • Work directly on production inference problems with AI-native teams, from model migration to performance tuning.

  • Stay with customers beyond the technical win and see how your recommendations hold up in production.

  • Work alongside Product, Engineering, and Research, with a direct path to share what customers need.

  • Earn $175,000-$210,000 in base salary, with $250,000-$300,000 in on-target earnings and competitive equity. Final compensation depends on experience and interview performance.

  • Take advantage of employer benefits including health, dental and vision insurance, flexible time off, parental leave, pre-tax health and flexible spending accounts, 401(k) matching, and life and disability coverage. Benefits are subject to plan eligibility and terms.

Apply on company site

Opens Lavendo’s own application page in a new tab.

NEW
Deloitte LLP logo
Deloitte LLP

MarTech Multi-Solution Architect

$163k - $322k
Salary shown
Arizona, USAOnsite

As a MarTech Multi-Solution Architect, you will be the connective tissue across our clients' marketing and advertising t...

Posted 2d ago
Code Metal logo
Code Metal
USARemote

Code Metal is looking for a Solutions Architect to lead technical engagements with major U.S. banks and financial instit...

PythonJavaRustAICandidate Experience+7 more
Posted 3d ago
Intel logo
Intel

Physical AI Solutions Architect

$256k - $361k
Salary shown
US, USAOnsite

The Role and Impact Intel is seeking an experienced Physical AI Solutions Architect to help accelerate adoption of Intel...

Posted 9d ago

Get jobs like this one by email

Architect jobs · USA

Only new matching jobs, nothing else. Confirm by email; unsubscribe in one click.

Explore more

Salary

$250K - $300K

Apply