Principal Software Engineer
About this role
Principal Software Engineer
Microsoft is seeking a Principal Software Engineer to lead the evolution of the offline evaluation platform that gates Copilot’s quality. You will shape a vision for an AI-first, agentic-first evaluation platform where autonomous agents are not only measured but can operate, extend, and heal the system. You will tackle the hardest problem of delivering trustworthy results across deep dependencies—Copilot’s model, retrieval, and scoring services—driven far outside their normal operating envelope and under heavy and growing load. You will define end-to-end evaluation of agentic Copilot experiences, from multi-turn trajectories and tool selection to task outcomes and modalities such as UX and voice, and establish how the product defines and measures quality.
Read the full description on TalentApply
Create a free account to see the complete job description, how well your CV matches this role, and apply in one click.
AI rewrites and formats your CV so it reads well and gets past screeners.
Get your match percentage for this exact role before you spend time applying.
Send a polished application in one click — no retyping the same details.
Follow every application in one place instead of digging through your inbox.
Free account · No card required
Your next opportunity starts here
Prepare, apply, track, interview and get hired — all from one platform, with AI in your corner.