Staff Software Engineer, Foundation Model Inference
About this role
Staff Software Engineer, Foundation Model Inference
Databricks is hiring across multiple teams in our AI Engineering org, including the FMAPI (Foundation Model APIs) team — the unified serving layer for large language models across real-time and batch inference, powering model inference at enterprise scale.
We are looking to hire high-agency engineers who bridge the gap between technical execution and product strategy.
The impact you will have:
- Build LLM infrastructure powering large-scale inference workloads for customers through partner models (OpenAI, Anthropic, Gemini) and self-hosted models (Qwen, GPT-OSS, Llama)
- Shape the direction of the FMAPI product — from roadmap to execution — by leveraging deep customer empathy and direct engagement with enterprise users and model providers
- Improve reliability, latency, and efficiency of distributed AI workloads
Read the full description on TalentApply
Create a free account to see the complete job description, how well your CV matches this role, and apply in one click.
AI rewrites and formats your CV so it reads well and gets past screeners.
Get your match percentage for this exact role before you spend time applying.
Send a polished application in one click — no retyping the same details.
Follow every application in one place instead of digging through your inbox.
Free account · No card required
Your next opportunity starts here
Prepare, apply, track, interview and get hired — all from one platform, with AI in your corner.