Skip to content
Six Figure Jobs
Stellar Cyber logo

Stellar Cyber

Machine Learning Infrastructure Engineer (LLM & Agentic AI)

  • Remote · United States
  • Posted 3d ago
  • Full-time
  • 2 yrs experience

Salary

$150K - $215K

Listed in the posting

Pays more than 19% of 173 machine learning engineer listings in USD.

This job
$150k–$215k
Typical
$210k
Most pay
$188k–$251k
Apply on company site

Benefits

  • Retirement plan
  • Health insurance

Skills

Agentic AI
AI
API
Autogen
Cloud Computing
Containerization
Distributed Systems
Docker
Generative AI
gRPC

Nice to have

Full job description

Description

  • We are looking for a highly skilled Machine Learning Infrastructure Engineer with a passion for building robust and scalable systems to power Stellar Cyber’s Autonomous SOC applications
  • In this role, you will be at the forefront of AI infrastructure innovation, responsible for developing the foundational components that enable intelligent agents to work like true SOC analysts to operate in dynamic SecOps environments
  • Design and build Agentic AI frameworks to orchestrate LLM-based agents capable of reasoning, planning, and executing SecOps tasks in Stellar Cyber’s Open XDR platform
  • Design and develop scalable LLM inference infrastructure that supports runtime- and cost-efficient serving and resource management across LLM hosting providers
  • Develop MCP servers that interact with Open XDR platform services and features, and integrate with LLM-based agents
  • Develop other supporting API services necessary for Autonomous SOC applications to provide reliable and extensible interface for agent operations
  • Collaborate closely with machine learning / security researchers, UI / backend / infrastructure engineers, and product management to align infrastructure with evolving product needs

Benefits

  • Pre-IPO Stock Options
  • Medical, Dental & Vision care
  • 401(k)
  • Employee Assistance Program
  • Employee Discount Program
  • Life Insurance
  • Paid time off
  • Referral Program
  • Rewards and Recognition Program
  • 2 years of experience with data structures or algorithms in either an academic or industry setting
  • Experience in one or more of the following programming languages: Python, Java, Go
  • Experience with cloud computing technologies, including containerization, orchestration, and deployment (Docker, Kubernetes, etc)
  • Bachelor’s or Master’s degree in Computer Science or a related field, or equivalent practical experience
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting
  • 2 years of experience with developing backend infrastructure, distributed systems, APIs (REST / gRPC), and microservices for MLOps related projects
  • Experience working on LLM applications in high-sensitivity domains (e.g., finance, defense, health)
  • Experience with Generative AI frameworks (e.g., LangChain, LangGraph, AutoGen, or other frameworks) and technologies (prompt engineering, vector databases, RAG, etc.)
  • Experience with observability practices in ML systems (e.g., metrics, cost tracking)
  • Experience working on ML platform teams and/or building tools for researchers
  • Experience deploying and scaling LLMs for inference using frameworks such as vLLM, llama.cpp, and etc
  • Knowledge of SecOps concepts, activities, workflows is a plus

Apply on company site

Opens Stellar Cyber’s own application page in a new tab.

Get jobs like this one by email

Machine Learning Engineer jobs · USA

Only new matching jobs, nothing else. Confirm by email; unsubscribe in one click.

Explore more

Salary

$150K - $215K

Apply