Skip to content
Six Figure Jobs
Clera logo

Clera

Research Engineer, Benchmarks

  • Singapore
  • Onsite
  • Posted 4d ago
  • Full-time

Salary

S$100K - S$170K

Listed in the posting

Pays more than 17% of 15,869 six-figure listings in USD.

This job
$100k–$170k
Typical
$175k
Most pay
$145k–$215k
Apply on company site

Requirements

  • Two or more years of experience in research engineering or machine learning engineering, building AI benchmarks, evaluation infrastructure, or agent environments.
  • Technical education or equivalent grounding, with strong first-principles reasoning about task design, scoring, and failure modes.
  • Proficiency in Python, Docker, and Linux, including experience operating infrastructure for AI models or agents.
  • Hands-on experience designing and running evaluations for AI agents or large language models, with relevant, focused experience in benchmarks or evaluation.
  • Experience developing metrics, statistical analyses, or validation studies, and translating workflows across domains into benchmark tasks.
  • Strong technical writing and communication skills. Published papers or technical writing on benchmarking, evaluation, or model failure modes are valued.

Benefits

  • Visa sponsorship

Skills

Agentic AI
AI
Docker
Linux
LLM
Machine Learning
Python
Reinforcement Learning
Technical Writing
["Python"

Nice to have

Full job description

Description

About the Role

Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.

What You'll Do

  • Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks.

  • Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.

  • Build reliable infrastructure for running models and agents against benchmark tasks at scale.

  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.

  • Validate whether benchmark results correlate with real-world evaluations and user needs.

  • Write clear documentation and reports for technical audiences.

Location

On-site in Singapore, Singapore.

Requirements

What We're Looking For

  • Two or more years of experience in research engineering or machine learning engineering, building AI benchmarks, evaluation infrastructure, or agent environments.

  • Technical education or equivalent grounding, with strong first-principles reasoning about task design, scoring, and failure modes.

  • Proficiency in Python, Docker, and Linux, including experience operating infrastructure for AI models or agents.

  • Hands-on experience designing and running evaluations for AI agents or large language models, with relevant, focused experience in benchmarks or evaluation.

  • Experience developing metrics, statistical analyses, or validation studies, and translating workflows across domains into benchmark tasks.

  • Strong technical writing and communication skills. Published papers or technical writing on benchmarking, evaluation, or model failure modes are valued.

  • Experience with reinforcement learning pipelines, data generation, or agent evaluation is a plus.

  • Comfort working independently in an early-stage, fast-paced environment and navigating open-ended problems.

Benefits

Compensation & Benefits

Base salary: $100,000 to $170,000 annually. Visa sponsorship is available.

Apply on company site

Opens Clera’s own application page in a new tab.

Similar six-figure roles

Clera logo
Clera

Research Engineer, QC Automation

S$100k - S$170k
Salary shown
SingaporeOnsite

Join an early-stage AI infrastructure team focused on reinforcement learning environments and model evaluation. You will...

PythonDockerAIAutomationData Quality+5 more
Posted 4d ago

Get jobs like this one by email

Research Engineer jobs · Singapore

Only new matching jobs, nothing else. Confirm by email; unsubscribe in one click.

Explore more

Salary

S$100K - S$170K

Apply