Ir al contenido principal
Staff Software Engineer — LLM platform & APIs
Pacific Context AI
Este anuncio está pensado para talento nativo en IA : habilidades y herramientas claras para saber si encajas antes de aplicar — y para reducir descartes por desajuste.
3 habilidades 2 herramientas
Compartir este rol
Copiar enlace
Modalidad Hybrid
Ubicación San Francisco, CA, United States · Hybrid
Compensación $210k–$265k + equity Nivel de experiencia Beneficios Health, 401k match, meals. Cómo aplicar Architecture sketch for multi-tenant LLM routing.
Publicada 18 may 2026
Actualizada 3 jul 2026 Pacific Context AI is hiring a Staff Staff Software Engineer — LLM platform & APIs on the Core platform team (Hybrid · San Francisco, United States). This is a hands-on role in LLM & generative AI —not a generic “AI enthusiast” post.
You will own LLM features, retrieval, agents, and evaluation end to end: problem framing, offline evaluation, safe rollout, and iteration from production signals. Success is measured with clear metrics (quality, latency, cost, or business KPIs)—not slide decks alone.
Pacific Context AI provides APIs and SDKs for enterprises launching copilots on private data. Reliability, predictable cost, and safe defaults matter as much as model quality.
We are hiring a Staff Software Engineer in San Francisco (hybrid) to evolve our core LLM gateway, streaming layer, and multi-tenant controls.
What you will do
Design high-throughput request paths with caching, adaptive batching, token accounting, and backpressure strategies. Implement streaming (SSE/WebSocket) clients and server contracts with idempotency keys for long jobs. Partner with security for tenant isolation, key management, and abuse detection. Mentor engineers on performance profiling and production readiness checklists. Shape technical standards for new model integrations and evaluation hooks. What we look for
8+ years building distributed systems; strong Python and one systems language (Go/Rust) preferred. Experience operating APIs with strict SLOs and on-call culture. Working knowledge of LLM provider APIs, rate limits, and fallback routing. US work authorisation; willingness to be in SF several days per week. Nice to have
Prior startup experience from seed to Series C scale. Contributions to gateway or API gateway open-source projects. Python
Production Python for data pipelines, model code, APIs, and automated tests—not notebook-only workflows.
Kubernetes
Deploying and scaling model services with health checks, autoscaling, and rollout discipline.
AWS
Cloud primitives for training, storage, IAM, and cost-aware LLM & generative AI deployments.
Docker Tool
Containerized services and reproducible dev environments for ML and LLM workloads.
Redis Tool
Regular use of Redis in the LLM & generative AI stack—configuration, debugging, and team conventions.
✓ You can show evidence in your application: Architecture sketch for multi-tenant LLM routing. ✓ Several of these show up in recent shipped work—not only on your CV: Python, Kubernetes, AWS, Docker, and Redis. ✓ You have led LLM & generative AI initiatives across teams—setting technical direction, review standards, and rollout plans others could follow. ✓ You are comfortable with the hybrid rhythm (Hybrid · San Francisco, United States)—onsite collaboration when it matters, deep work when remote. ✓ You explain trade-offs (quality, cost, latency, safety) in plain language—with numbers or examples, not buzzwords. ✓ You read the full listing (comp: $210k–$265k + equity, benefits in At a glance) and your expectations align. Lo que pide la empresa
Architecture sketch for multi-tenant LLM routing.
Inicia sesión con cuenta candidato para aplicar
Regístrate, añade titular y bio; luego podrás adjuntar enlace o PDF de CV en Mi cuenta antes de aplicar. Así las candidaturas quedan ligadas a tu perfil.
Sugerencias
Talento IA que podría interesarte Perfiles ordenados por solape con habilidades y herramientas de este rol — útil si contratas equipo o comparas candidatos.
Ofertas similares Otros anuncios que comparten habilidades o herramientas — útil para stacks comparables o alternativas.
AI Developer — deep learning products InstaDeep
Tiempo completo Senior Applied research Hybrid Les Berges du Lac II, Tunis 1053, Tunisia · Hybrid Tunis, Tunisia EUR 32k–48k/year + bonus
Senior ML Platform Engineer Modal
Tiempo completo Senior Serverless ML Hybrid 169 Madison Avenue, New York, NY 10016, United States · Hybrid New York, United States $170k–$225k + equity
Lead ML Platform Engineer — core banking Thought Machine
Tiempo completo Lead ML platform Hybrid Quartermile One, 15 Lauriston Place, Edinburgh, Scotland EH3 9EN, United Kingdom · Hybrid Edinburgh, United Kingdom £95k–£125k + equity
ML Engineer — GPU cloud Lambda
Tiempo completo Senior Cloud ML Hybrid 1101 E 5th Street, Austin, TX 78702, United States · Hybrid Austin, United States $150k–$200k + equity
Senior ML Platform Engineer Weights & Biases
Tiempo completo Senior MLOps product Hybrid 400 Alabama Street, San Francisco, CA 94110, United States · Hybrid San Francisco, United States $165k–$220k + equity Ver todas las ofertas →
Título
Staff Software Engineer — LLM platform & APIs
Aplicar Pensado para equipos que contratan personas que trabajan con IA, no solo alrededor.
Los candidatos ven habilidades y herramientas al inicio; recibes candidaturas estructuradas en un solo panel.
Llega a profesionales de IA que buscan roles con expectativas basadas en pruebas.
Publicar oferta InstaDeep is an AI company founded in Tunis, now operating across London, Paris, Cape Town, and beyond — known for decision-making AI, bioinformatics, and large-scale deep learning.AI Developer (Tunis hybrid): productize research into client-facing systems — scheduling, routing, protein design…
Beneficios · GPU access, conference budget, hybrid Tunis / remote days.
Python PyTorch LangChain Docker
Herramientas Kubernetes AWS
Modal provides serverless GPU infrastructure for AI teams. Platform engineers make it trivial to run training, batch jobs, and inference at scale.Senior ML Platform Engineer (NYC): schedulers, cold-start optimisation, and developer experience for Python-first ML workflows.Hybrid NYC — equity and…
Beneficios · Equity, NYC hub, GPU credits.
Thought Machine builds Vault — cloud-native core banking used by Lloyds, Standard Chartered, and other tier-1 banks.Lead ML Platform Engineer (Edinburgh): feature stores, model registry, and batch inference for fraud, credit, and personalisation use cases inside regulated environments.Hybrid…
Beneficios · Equity, Edinburgh hub, flexible hybrid.
Herramientas Docker PostgreSQL
Lambda Cloud offers GPU infrastructure for training and inference-heavy workloads.ML Engineer — GPU platform (Austin): scheduling, observability, and customer-facing performance tooling.What you will doDeliver production-grade GPU cloud ML platform with measurable quality, latency, and cost…
Beneficios · GPU access, Austin hub.
Weights & Biases (W&B) provides experiment tracking and MLOps for ML teams worldwide.Senior ML Platform Engineer: model registry integrations, eval products, and scalable metadata services.What you will doDeliver production-grade MLOps product engineering with measurable quality, latency,…
Beneficios · Remote-friendly, equity.