Full-time · On-site
Engineering Manager, Spark Connect
This is a high-impact leadership role at the heart of the data intelligence revolution, managing the critical Spark Connect component for Databricks' serverless offering. It uniquely combines internal product ownership with external open-source influence, allowing a manager to shape the global Apache Spark ecosystem. It is a perfect fit for a deeply technical leader who thrives on solving complex distributed systems challenges while building world-class engineering teams.
Databricks · Bellevue, Washington, United States · Posted 17 April 2026
The role
Overview
This is a high-impact leadership role at the heart of the data intelligence revolution, managing the critical Spark Connect component for Databricks' serverless offering. It uniquely combines internal product ownership with external open-source influence, allowing a manager to shape the global Apache Spark ecosystem. It is a perfect fit for a deeply technical leader who thrives on solving complex distributed systems challenges while building world-class engineering teams.
What they need
Requirements & Skills
Key Responsibilities
- Direct the development and operational health of the Spark Connect platform
- Define and execute the strategic roadmap for open-source Spark Connect within Apache Spark
- Recruit, mentor, and retain a premier team of distributed systems engineers
- Collaborate with stakeholders in Serverless and Runtime to align technical architectures
- Drive the adoption of Spark Connect across the broader developer ecosystem
Essential
- Over 10 years of professional experience in data platforms, infrastructure, or distributed systems
- Minimum of 3 years in a formal engineering management or leadership role
- Proven track record of managing and maintaining mission-critical production environments
- Experience leading complex, cross-functional technical initiatives
- Ability to influence technical direction across multiple departments
Preferred
- Active participation or leadership within the Open Source Software (OSS) community
- Experience specifically with Apache Spark or similar big data frameworks
- Background in developing or managing Serverless technologies
- Experience in high-growth, venture-backed or major tech environments
Key Skills
Distributed Systems ArchitectureEngineering LeadershipStrategic Roadmap PlanningOpen Source StrategyOperational ExcellenceTalent Acquisition and MentorshipScalability and Reliability EngineeringCross-functional Collaboration
Networking
People to Know
Sign up to discover hiring managers, team leads, and key people at Databricks.
Perks
Benefits & perks
- Competitive base salary
- Annual performance-based bonuses
- Equity awards and stock options
- Comprehensive health and wellness benefits
- Professional development and growth opportunities
- Flexible work environment
Next step
Apply now
Found via www.databricks.com