LLM Observability Engineer

Job description

Datadog is hiring a LLM Observability Engineer (Full-time) hybrid. This llm engineer role is part of the AI hiring market in New York (New York). Build LLM tracing, eval, and cost monitoring products for Datadog customers. Listed compensation: $155k – $210k / year. Stack: LLM eval, Observability, Go, Python.

LLM Engineer profiles are in high demand in New York: New York combines fintech, media, and enterprise AI with strong demand for applied ML, NLP, and MLOps at banks, ad tech, and product companies.…

The team

Datadog — AI team

Responsibilities

• Deliver production ML/LLM capabilities with measurable quality bars
• Partner with product and infra on roadmap and reliability
• Document evals, monitoring, and rollout practices

Requirements

• 3+ years shipping ML, LLM, or data systems in production
• Strong Python or TypeScript and clear written communication
• Comfort with responsible AI and operational excellence

Tech stack

Benefits

Hiring process

1. 1Recruiter screen
2. 2Technical interview
3. 3Team conversation
4. 4Offer

Experience: Mid · 3+ years · Education: BS/MS CS, ML, or equivalent experience

Salary guide — LLM Engineer in New York →

FAQ — LLM Observability Engineer

What is the salary for LLM Observability Engineer at Datadog?

Listed range: $155k – $210k / year (Full-time). Packages often include PTO, remote options, and equity depending on the company.

Where is the LLM Observability Engineer role based?

New York, NY, New York (New York). Work mode: Hybrid.

How do I apply to Datadog?

Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0009. Process: Recruiter screen → Technical interview → Team conversation → Offer.

Is Datadog hiring other AI roles?

Datadog (DevTools & AI) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.

Your profile is sent directly to Datadog's hiring team.