
LLM Eval Engineer
- Salary
- $150k – $210k / year
- Type
- Full-time
- Location
- San Francisco, CA · San Francisco (California) · Hybrid
- Valid through
- 1/1/2027
Additional details
- Posted
- Posted today
- Applications
- 20
- on Ganloss
- Experience
- Mid · 3+ years
- Education
- BS/MS CS, ML, or equivalent experience
- Region
- California
- Team
- Scale AI — AI team
- Company size
- 1000+
- Founded
- 2016
Job description
Scale AI is hiring a LLM Eval Engineer (Full-time) hybrid. This llm engineer role is part of the AI hiring market in San Francisco (California). Design eval suites and preference data for frontier customers — Scale AI SF. Listed compensation: $150k – $210k / year. Stack: LLM eval, RLHF, Python, Scale.
LLM Engineer profiles are in high demand in San Francisco: San Francisco and the Bay Area host the largest share of US AI hiring: LLM, MLOps, foundational research, and GenAI products. OpenAI partners, Databricks, Scale AI, and hundreds of…
The team
Scale AI — AI team
Responsibilities
- Ship production AI features with clear quality, latency, and safety bars
- Partner with product, research, and infra on roadmap priorities
- Document evals, monitoring, and responsible AI practices
Requirements
- 3+ years shipping ML, LLM, or data systems in production (or strong internship + portfolio)
- Strong Python or TypeScript and clear written communication
- Comfort with evals, observability, and cross-functional US teams
Tech stack
Benefits
Hiring process
- 1Recruiter screen
- 2Technical interview
- 3Team conversation
- 4Offer
Experience: Mid · 3+ years · Education: BS/MS CS, ML, or equivalent experience
Go further
Prepare your application with our AI career guides — role sheets, resume, interview, and salary benchmarks.
FAQ — LLM Eval Engineer
- What is the salary for LLM Eval Engineer at Scale AI?
- Listed range: $150k – $210k / year (Full-time). Packages often include PTO, remote options, and equity depending on the company.
- Where is the LLM Eval Engineer role based?
- San Francisco, CA, San Francisco (California). Work mode: Hybrid.
- How do I apply to Scale AI?
- Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0014. Process: Recruiter screen → Technical interview → Team conversation → Offer.
- Is Scale AI hiring other AI roles?
- Scale AI (AI data & eval) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.
Apply in one click
Typical reply within 48hYour profile is sent directly to Scale AI's hiring team.
Apply to this job
Create a free candidate account (30 sec) to send your profile to Scale AI. The job page stays public without signing up.