Logo Cohere

Enterprise RAG Engineer

Cohere· New York, NY· Ref. EXP-2026-0015 4.3 (420 reviews)
Easy applyFull-timeHybrid
View without an account · free sign-in only to apply
Salary
$150k – $205k / year
Type
Full-time
Location
New York, NY · New York (New York) · Hybrid
Valid through
1/1/2027

Additional details

Posted
Posted today
Applications
21
on Ganloss
Experience
Mid · 3+ years
Education
BS/MS CS, ML, or equivalent experience
Region
New York
Team
Cohere — AI team
Company size
500+
Founded
2019

Job description

Cohere is hiring a Enterprise RAG Engineer (Full-time) hybrid. This llm engineer role is part of the AI hiring market in New York (New York). Retrieval quality and agent tooling for Cohere enterprise Command deployments — NYC. Listed compensation: $150k – $205k / year. Stack: RAG, Command, Python, NYC.

LLM Engineer profiles are in high demand in New York: New York combines fintech, media, and enterprise AI with strong demand for applied ML, NLP, and MLOps at banks, ad tech, and product companies.…

The team

Cohere — AI team

Responsibilities

  • Ship production AI features with clear quality, latency, and safety bars
  • Partner with product, research, and infra on roadmap priorities
  • Document evals, monitoring, and responsible AI practices

Requirements

  • 3+ years shipping ML, LLM, or data systems in production (or strong internship + portfolio)
  • Strong Python or TypeScript and clear written communication
  • Comfort with evals, observability, and cross-functional US teams

Tech stack

RAGCommandPythonNYC

Benefits

Health, dental, vision
401(k) match
Equity
Learning budget
Flexible PTO

Hiring process

  1. 1Recruiter screen
  2. 2Technical interview
  3. 3Team conversation
  4. 4Offer

Experience: Mid · 3+ years · Education: BS/MS CS, ML, or equivalent experience

Salary guide — LLM Engineer in New York →

Go further

Prepare your application with our AI career guides — role sheets, resume, interview, and salary benchmarks.

FAQ — Enterprise RAG Engineer

What is the salary for Enterprise RAG Engineer at Cohere?
Listed range: $150k – $205k / year (Full-time). Packages often include PTO, remote options, and equity depending on the company.
Where is the Enterprise RAG Engineer role based?
New York, NY, New York (New York). Work mode: Hybrid.
How do I apply to Cohere?
Create a free Ganloss candidate account, then apply in one click. Job reference: EXP-2026-0015. Process: Recruiter screen → Technical interview → Team conversation → Offer.
Is Cohere hiring other AI roles?
Cohere (Enterprise LLM) hires across LLM, ML, data, and AI product. See all openings on the Ganloss company page.

Apply in one click

Typical reply within 48h

Your profile is sent directly to Cohere's hiring team.

Apply to this job

Create a free candidate account (30 sec) to send your profile to Cohere. The job page stays public without signing up.