Logo Harvey

Legal RAG Engineer

Harvey· San Francisco, CA· Ref. EXP-2026-0020 4.5 (140 reviews)
Easy applyFull-timeHybrid
View without an account · free sign-in only to apply
Salary
$160k – $225k / year
Type
Full-time
Location
San Francisco, CA · San Francisco (California) · Hybrid
Valid through
1/1/2027

Additional details

Posted
Posted today
Applications
26
on Ganloss
Experience
Mid · 3+ years
Education
BS/MS CS, ML, or equivalent experience
Region
California
Team
Harvey — AI team
Company size
300+
Founded
2022

Job description

Harvey is hiring a Legal RAG Engineer (Full-time) hybrid. This llm engineer role is part of the AI hiring market in San Francisco (California). Domain-adapted retrieval and eval loops for elite law firm copilots — Harvey SF. Listed compensation: $160k – $225k / year. Stack: Legal AI, RAG, LLM, Evals.

LLM Engineer profiles are in high demand in San Francisco: San Francisco and the Bay Area host the largest share of US AI hiring: LLM, MLOps, foundational research, and GenAI products. OpenAI partners, Databricks, Scale AI, and hundreds of…

The team

Harvey — AI team

Responsibilities

  • Ship production AI features with clear quality, latency, and safety bars
  • Partner with product, research, and infra on roadmap priorities
  • Document evals, monitoring, and responsible AI practices

Requirements

  • 3+ years shipping ML, LLM, or data systems in production (or strong internship + portfolio)
  • Strong Python or TypeScript and clear written communication
  • Comfort with evals, observability, and cross-functional US teams

Tech stack

Legal AIRAGLLMEvals

Benefits

Health, dental, vision
401(k) match
Equity
Learning budget
Flexible PTO

Hiring process

  1. 1Recruiter screen
  2. 2Technical interview
  3. 3Team conversation
  4. 4Offer

Experience: Mid · 3+ years · Education: BS/MS CS, ML, or equivalent experience

Salary guide — LLM Engineer in San Francisco →

Go further

Prepare your application with our AI career guides — role sheets, resume, interview, and salary benchmarks.

FAQ — Legal RAG Engineer

What is the salary for Legal RAG Engineer at Harvey?
Listed range: $160k – $225k / year (Full-time). Packages often include PTO, remote options, and equity depending on the company.
Where is the Legal RAG Engineer role based?
San Francisco, CA, San Francisco (California). Work mode: Hybrid.
How do I apply to Harvey?
Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0020. Process: Recruiter screen → Technical interview → Team conversation → Offer.
Is Harvey hiring other AI roles?
Harvey (Legal AI) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.

Apply in one click

Typical reply within 48h

Your profile is sent directly to Harvey's hiring team.

Apply to this job

Create a free candidate account (30 sec) to send your profile to Harvey. The job page stays public without signing up.