LLM Evaluation Intern

Job description

Scale AI is hiring a LLM Evaluation Intern (Internship) hybrid. This llm engineer role is part of the AI hiring market in San Francisco (California). Design rubrics, human-in-the-loop workflows, and automated evals for frontier model customers. Listed compensation: $76k – $90k / year. Stack: Internship, LLM eval, Python, RLHF.

LLM Engineer profiles are in high demand in San Francisco: San Francisco and the Bay Area host the largest share of US AI hiring: LLM, MLOps, foundational research, and GenAI products. OpenAI partners, Databricks, Scale AI, and hundreds of…

The team

Scale AI — early talent program

Responsibilities

• Ship scoped features with mentor review and production-quality tests
• Document experiments, metrics, and learnings for the broader team
• Partner with product and design on user-facing AI capabilities

Requirements

• Enrolled in or recently completed a CS, ML, data, or related program
• Portfolio or coursework in Python, SQL, or modern web stacks
• Clear communication and curiosity about responsible AI in production

Tech stack

Benefits

Hiring process

1. 1Recruiter screen (20 min)
2. 2Technical conversation or take-home (time-boxed)
3. 3Team fit with manager and mentor
4. 4Offer

Experience: Intern · student or new grad · Education: BS/MS in progress or completed (CS, ML, data, or equivalent projects)

Salary guide — LLM Engineer in San Francisco →

FAQ — LLM Evaluation Intern

What is the salary for LLM Evaluation Intern at Scale AI?

Listed range: $76k – $90k / year (Internship). Packages often include PTO, remote options, and equity depending on the company.

Where is the LLM Evaluation Intern role based?

550 Kearny St, San Francisco, CA, San Francisco (California). Work mode: Hybrid.

How do I apply to Scale AI?

Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0007. Process: Recruiter screen (20 min) → Technical conversation or take-home (time-boxed) → Team fit with manager and mentor → Offer.

Is Scale AI hiring other AI roles?

Scale AI (AI data & eval) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.

Your profile is sent directly to Scale AI's hiring team.