Software Engineer, Distributed Data Systems
About this role
About the Role Exa is building a scale-out AI-powered search platform and needs a Software Engineer, Distributed Data Systems to architect and build the data infrastructure that powers crawling, training embedding models, and serving real-time search at massive scale. You will design lakehouse architectures and large-scale pipelines that handle hundreds of petabytes of data with high reliability.
What You'll Do
- Design a lakehouse architecture that handles 100+ PB of web crawl data
- Build streaming pipelines that process billions of documents per day for real-time indexing
- Architect the data layer for embedding training infrastructure on Ray
- Scale our ClickHouse deployment to handle analytical queries across petabytes of search logs
What We're Looking For
- Deep understanding of lakehouse architectures (Delta Lake, Iceberg, Hudi) and when to use them
Read the full description on TalentApply
Create a free account to see the complete job description, how well your CV matches this role, and apply in one click.
AI rewrites and formats your CV so it reads well and gets past screeners.
Get your match percentage for this exact role before you spend time applying.
Send a polished application in one click — no retyping the same details.
Follow every application in one place instead of digging through your inbox.
Free account · No card required
Your next opportunity starts here
Prepare, apply, track, interview and get hired — all from one platform, with AI in your corner.