LLM Inference Engineer

Job description

Groq is hiring a LLM Inference Engineer (Full-time) hybrid. This llm engineer role is part of the AI hiring market in San Francisco (California). Groq LLM inference engineer jobs — ultra-low-latency serving on LPUs, compiler tooling, and API performance in Mountain View. Listed compensation: $170k – $240k / year. Stack: Groq, LLM inference, LPU, Systems, Python.

LLM Engineer profiles are in high demand in San Francisco: San Francisco and the Bay Area host the largest share of US AI hiring: LLM, MLOps, foundational research, and GenAI products. OpenAI partners, Databricks, Scale AI, and hundreds of…

The team

Groq — AI team

Responsibilities

• Ship production AI features with clear quality, latency, and safety bars
• Partner with product, design, and infra on roadmap priorities
• Document evals, monitoring, and responsible AI practices

Requirements

• 3+ years shipping ML, LLM, or data systems in production (or strong internship + portfolio)
• Strong Python or TypeScript and clear written communication
• Comfort with evals, observability, and cross-functional US teams

Tech stack

Benefits

Hiring process

1. 1Recruiter screen
2. 2Technical interview
3. 3Team conversation
4. 4Offer

Experience: Mid · 3+ years · Education: BS/MS CS, ML, or equivalent experience

Salary guide — LLM Engineer in San Francisco →

FAQ — LLM Inference Engineer

What is the salary for LLM Inference Engineer at Groq?

Listed range: $170k – $240k / year (Full-time). Packages often include PTO, remote options, and equity depending on the company.

Where is the LLM Inference Engineer role based?

Mountain View, CA, San Francisco (California). Work mode: Hybrid.

How do I apply to Groq?

Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0019. Process: Recruiter screen → Technical interview → Team conversation → Offer.

Is Groq hiring other AI roles?

Groq (AI hardware & inference) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.

Your profile is sent directly to Groq's hiring team.