Logo Scale AI

LLM Eval Engineer

Scale AI· San Francisco, CA· Ref. EXP-2026-0014 4.1 (890 reviews)
Easy applyFull-timeHybrid
View without an account · free sign-in only to apply
Salary
$150k – $210k / year
Type
Full-time
Location
San Francisco, CA · San Francisco (California) · Hybrid
Valid through
1/1/2027

Additional details

Posted
Posted today
Applications
20
on Ganloss
Experience
Mid · 3+ years
Education
BS/MS CS, ML, or equivalent experience
Region
California
Team
Scale AI — AI team
Company size
1000+
Founded
2016

Job description

Scale AI is hiring a LLM Eval Engineer (Full-time) hybrid. This llm engineer role is part of the AI hiring market in San Francisco (California). Design eval suites and preference data for frontier customers — Scale AI SF. Listed compensation: $150k – $210k / year. Stack: LLM eval, RLHF, Python, Scale.

LLM Engineer profiles are in high demand in San Francisco: San Francisco and the Bay Area host the largest share of US AI hiring: LLM, MLOps, foundational research, and GenAI products. OpenAI partners, Databricks, Scale AI, and hundreds of…

The team

Scale AI — AI team

Responsibilities

  • Ship production AI features with clear quality, latency, and safety bars
  • Partner with product, research, and infra on roadmap priorities
  • Document evals, monitoring, and responsible AI practices

Requirements

  • 3+ years shipping ML, LLM, or data systems in production (or strong internship + portfolio)
  • Strong Python or TypeScript and clear written communication
  • Comfort with evals, observability, and cross-functional US teams

Tech stack

LLM evalRLHFPythonScale

Benefits

Health, dental, vision
401(k) match
Equity
Learning budget
Flexible PTO

Hiring process

  1. 1Recruiter screen
  2. 2Technical interview
  3. 3Team conversation
  4. 4Offer

Experience: Mid · 3+ years · Education: BS/MS CS, ML, or equivalent experience

Salary guide — LLM Engineer in San Francisco →

Go further

Prepare your application with our AI career guides — role sheets, resume, interview, and salary benchmarks.

FAQ — LLM Eval Engineer

What is the salary for LLM Eval Engineer at Scale AI?
Listed range: $150k – $210k / year (Full-time). Packages often include PTO, remote options, and equity depending on the company.
Where is the LLM Eval Engineer role based?
San Francisco, CA, San Francisco (California). Work mode: Hybrid.
How do I apply to Scale AI?
Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0014. Process: Recruiter screen → Technical interview → Team conversation → Offer.
Is Scale AI hiring other AI roles?
Scale AI (AI data & eval) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.

Apply in one click

Typical reply within 48h

Your profile is sent directly to Scale AI's hiring team.

Apply to this job

Create a free candidate account (30 sec) to send your profile to Scale AI. The job page stays public without signing up.