Senior Software Engineer, AI Runtime
$160k - $225kDatabricks
Senior Software Engineer For Ai Runtime
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
Training and customizing state-of-the-art AI models is one of the most demanding workloads in computing, and it sits at the heart of Databricks' Mosaic AI mission. AI Runtime (AIR) is our managed platform for large-scale GPU training and fine-tuning. It gives customers on-demand access to fleets of the latest accelerators and a serverless experience that hides the complexity of provisioning, scheduling, and orchestrating multi-node jobs, with the resilience to keep training running for days or weeks across thousands of GPUs. AIR powers the full spectrum of custom training, from fine-tuning open models to pre-training frontier-scale foundation models, for some of the most sophisticated AI teams in the world.
As a Senior Software Engineer for AI Runtime, you will play a critical role in building and scaling the systems that make large-scale training fast, reliable, and effortless. You will drive the architecture and evolution of the managed GPU training stack, spanning scheduling and capacity, distributed training performance, fault tolerance, and the developer experience of launching and operating jobs at scale. Beyond hands-on contributions to core systems, you will help shape the technical direction for AIR, mentor other engineers, partner across product, research, and platform teams, and contribute to the initiatives that expand the technical and business impact of custom training at Databricks.
The impact you will have:
- Drive the architecture and evolution of AIR's managed GPU training platform, delivering scalable, high-throughput, and resilient training across fleets that span thousands of accelerators.
- Solve the hardest problems in large-scale training, including multi-node orchestration, distributed parallelism strategies, GPU scheduling and dynamic routing, high-throughput data loading, and checkpoint and restore for very long-running jobs.
- Push GPU efficiency and training performance, raising utilization (such as model FLOPs utilization and end-to-end throughput) and lowering cost per training run across diverse model architectures and hardware generations.
- Build the resilience and observability foundations that keep multi-node jobs healthy, detecting and recovering from hardware and software failures with minimal disruption to customers.
- Partner with product, research, and platform teams to shape the APIs, CLI, and developer experience that make it easy to launch, monitor, and debug production training jobs.
- Lead end-to-end engineering efforts, from design through production rollout, holding a high bar for performance, correctness, and reliability.
- Make direct, high-impact contributions to the core systems behind AIR, and help bring up support for the latest accelerators and new regions as the fleet grows.
- Champion engineering excellence, mentor other engineers through design reviews and technical discussions, and contribute to Databricks' technical direction in AI training infrastructure.
What we look for:
- 5+ years of experience building and operating large-scale distributed systems, with experience in GPU training infrastructure, high-performance computing, or ML systems.
- Experience with distributed training frameworks (such as PyTorch, FSDP, DeepSpeed, or Megatron) and the parallelism strategies (data, tensor, pipeline, and sequence parallelism) used to train large models.
- Strong understanding of training resilience patterns, including checkpointing, failure detection, and automatic recovery for long-running, multi-node jobs.
- Solid grasp of GPU performance fundamentals, including accelerator architecture, high-speed interconnects (such as NVLink and InfiniBand or RoCE), collective communication, and the bottlenecks that govern training throughput and utilization.
- Experience building and operating managed, multi-tenant platform products in the cloud, with clear SLAs and SLOs for availability, performance, and reliability.
- Strong foundation in algorithms, data structures, and system design as applied to performance-sensitive, large-scale distributed systems.
- Proven ability to deliver technically complex, high-impact initiatives that create clear customer or business value.
- Strong communication skills and the ability to collaborate across product, research, and infrastructure teams in a fast-moving environment.
- Customer-focused mindset with the ability to align implementation details with product goals, and a passion for mentoring engineers and fostering technical excellence.
- BS in Computer Science or a related field (MS or PhD preferred).
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks anticipates utilizing the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
Local Pay Range $160,000 —$225,000 USD
About Databricks
Databricks is the Data and AI company. More than 20,000 organizations worldwide — including adidas, AT&T, Bayer, Block, Mastercard, Rivian, Unilever, and 70% of the Fortune 500 — rely on the Databricks Data + AI Platform to build and scale data and AI apps, analytics and agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog.
Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
$164k - $295k
...redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed... ...starts with you. About the Role: This is a Software Development Engineer role on the Cloud Runtime Protection team that builds the core of the...SeniorPermanent employmentWork experience placementWork at officeLocal area2 days per week3 days per week$160k - $225k
...we run the world's largest AI platform. We believe the next... ...That's why we built AI Runtime , a serverless product that... ...parameters. It takes a lot of engineering to make that work, and we've... ...training jobs 8x . As a Senior Software Engineer, you'll work on the...SeniorLocal areaWorldwide$184.16k - $276.24k
...Latitude AI ( lat.ai ) is building the future of Ford’s autonomy roadmap... ...operations, systems and safety engineering – all dedicated to redefining... ...the team: We're searching for a Senior Software Engineer to come and join the Runtime Services team at Latitude AI. As...SeniorRemote jobPermanent employmentFull timeWork at officeImmediate startVisa sponsorship$184.17k - $276.24k
...Latitude AI ( lat.ai ) is building the future of Ford’s autonomy roadmap... ...operations, systems and safety engineering – all dedicated to redefining... ...the team: We're searching for a Senior Software Engineer to come and join the Runtime Infrastructure Frameworks (RIF) team...SeniorRemote jobPermanent employmentFull timeWork at officeImmediate startVisa sponsorship- ...Senior Full-Stack Software Engineer Mountain View, CA What You'll Do • Build and operate features using... ...Go, and Java languages. • Improve AI agent workflows built with LangGraph,... ...across the agent, services, and runtime platform. • Develop and operate Kubernetes...Senior
$164k - $295k
...security with the world’s most advanced AI-native platform. We work on large... ...Our Fusion product is seeking a Senior-to-Principal (Level 7) backend software Engineer to build out a platform product... ...Platform. It also serves as a runtime engine of Foundry, a sibling...SeniorPermanent employmentWork experience placementWork at officeLocal area$172.43k - $209k
...only vertically integrated AI infrastructure company built... ...fueling the future of Crusoe's engineering muscle. We're responsible... ...safely, and efficiently. As a Senior Software Engineer you will contribute... ..., CI/CD pipelines, platform runtimes, and telemetry. Culture...SeniorFull timeTemporary workLocal area$165.2k - $223.6k
...AWS Neuron is the complete software stack for the AWS Inferentia... ...the Software Development Engineer for the Neuron Runtime Team, you will be responsible... ...learning applications and AI accelerators. You will work... ...executive leadership and other senior management and technical...Full timeInternshipLocal areaWork from homeFlexible hours$164k - $295k
...security with the world’s most advanced AI-native platform. We work on large scale... ...About the Role: This is a systems software role on the Core Libraries team, which owns... ...the overall sensor platform. As a Senior Engineer on this team, you will design, build, extend...SeniorPermanent employmentWork experience placementWork at officeLocal area$174k - $252k
...Develop LiteRT, Google's on-device AI framework for 1P and 3P,... ...the model conversion, on-device runtime and kernel implementation.... ...experience.5 years of experience with software development in one or more... ...execution.Google's software engineers develop the next-generation technologies...Senior$174k - $252k
...building agentic workflows that enable AI agents to discover, implement, and validate... ...Bachelor's degree in Computer Science, Software Engineering, Mathematics, or a related STEM field... ...workflows, multimodal pipelines, or AI runtime APIs (e.g., PyTorch, JAX, Triton, vLLM,...SeniorWork experience placementInternship$153.2k - $234.1k
...Job Description The Senior Robotics Software Engineer – AI-Enabled Manipulation & Industrial Automation designs, develops, integrates, validates, and... ...generalization, manipulation, task-level decision-making, and runtime reliability. Develop closed-loop robotic systems...SeniorFull timeLocal areaWork from homeFlexible hours- ...Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...decode on the Cerebras Wafer-Scale Engine.We are hiring a Senior Software Engineer to build and evolve the ML... ...closely with model enablement, compiler, runtime, cloud infrastructure, product, and...Senior
$160.36k - $240.54k
...and profound opportunity for AI to drive positive change in the... ...foundation of Nuro's onboard software for our sensor and compute platform... ...and pipelines, and device runtime APIs. Sensors and compute hardware... ...vehiclesMentor software engineers to bring them to their full potentialAbout...SeniorImmediate startFlexible hours$161.3k - $274.2k
...DescriptionWho we areMoveworks is the Agentic AI Assistant platform that empowers the... ...workflow automation with Moveworks’ Reasoning Engine and natural language capabilities, we... ...Job DescriptionThe RoleWe're building the runtime infrastructure that powers Moveworks' AI agents...SeniorWork at officeRemote workFlexible hours- ...Job Description Job Description Senior Swift Engineer - AI Platform About the Role We are... ...contract engagement you'll work across AI runtime, platform integrations, deterministic... ...need engineers who ship real desktop software and take ownership of their technical...SeniorContract work
- ...Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...Core Infrastructure team builds the software systems that power engineering workflows across Cerebras.Our infrastructure... ...’s strengths, limitations, and runtime behavior.Experience designing...SeniorRemote work
$130k - $220k
Santa Clara, CASoftware Engineering - Motion Planning /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered... ..., and optimize the production runtime pipeline for ML-based autonomous...SeniorFull time$128.37k - $185.86k
...CARIAD , an automotive software development team with... ...Summary: The Sr Software Engineer, Integration integrates... ...middleware, and AI inference components into... ...application software, inference runtimes, and embedded hardware... .... Operating as a senior individual contributor,...SeniorPermanent employmentTemporary workRemote work- ...DescriptionWho we areMoveworks is the Agentic AI Assistant platform that empowers the... ...workflow automation with Moveworks’ Reasoning Engine and natural language capabilities, we... ...Job DescriptionThe RoleWe're building the runtime infrastructure that powers Moveworks' AI agents...SeniorWork at officeRemote workFlexible hours
$164k - $295k
...security with the world’s most advanced AI-native platform. We work on large scale distributed... ...event processing Drive backend engineering and process automation across the... ...working in a global team ~ Commitment to software quality — unit tested, code reviewed, and...SeniorPermanent employmentWork experience placementWork at officeLocal areaWorldwide$179k - $223.8k
...Autonomy Eval Infrastructure team builds the software that helps engineers understand and improve the ML... ...they can trust. Within Autonomy's AI Platform organization, we connect model... ...real-world vehicle data. As a senior metrics-platform engineer, you will design...SeniorFull timeContract workLocal area$87.8k - $209.5k
...Infrastructure (OCI) is looking for a Senior Robotics Software Engineer to develop software for physical... ...into useful evidence, and integrate AI models into robotic applications.... ...software, sensors, controllers, and model runtimes using recorded evidence and supervised...SeniorTemporary workFlexible hours- ...Pebl puts a world of talent at your fingertips. With our AI-powered Global Work Platform™, companies can hire, pay, and... ...workplace. We are looking for a highly skilled and motivated Senior Software Engineer to join our Growth Engineering team. The ideal candidate...SeniorWork at officeLocal areaFlexible hours
$185k - $230k
...The Opportunity We are looking for a Senior Software Engineerto lead feature development and serve as a technical expert, collaborating... ...science or related fields is a nice to have About Otter.ai We are in the business of shaping the future of work. Our...SeniorPermanent employment$166k - $225k
...world’s toughest problems, from advancing AI research to powering next-generation... ...AI infrastructure platform. Founded by engineers and driven by customer obsession, we embrace... ...And we’re only getting started. As a Senior Software Engineer on the Application Traffic...SeniorLocal areaWorldwide$170k - $250k
...Senior Software Engineer We are Omnissa! Omnissa is the first AI-driven digital work platform, built to support flexible, secure, work-from anywhere experiences. We integrate industry-leading solutions—including Unified Endpoint Management, Virtual Apps and Desktops...SeniorWork experience placementLocal areaVisa sponsorshipFlexible hours- ...is building the next generation of data infrastructure for AI. Founded in 2017 by the creators of Milvus, one of the... ...You will work across both the cloud platform and database runtime, building cloud-and-engine integrated systems around Vector Lakebase so AI workloads...SeniorFull timeWorldwide
$145.18k - $270.99k
...Senior Software Engineer Stanford's Graduate School of Business (GSB) has built a global reputation based on its immersive and innovative management... ...users, and recommend whether and how to proceed. Develop AI-enabled applications and workflows using appropriate models,...SeniorFull timeTemporary workPart timeFixed term contractRemote work$2,000 per month
...Elastic, the Search AI Company, enables everyone to find the answers they need in real time, using all their data, at scale... ...the promise of AI. What is The Role: We're looking for a Senior Software Engineer to join our Streams UI team, where you'll have the chance to...SeniorLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer, AI Runtime. Be the first to apply!
- senior software design engineer Mountain View, CA
- software web developer Mountain View, CA
- senior software engineer Mountain View, CA
- software developer fintech Mountain View, CA
- scientific software engineer Mountain View, CA
- new graduate software engineer Mountain View, CA
- senior software engineer ruby on rails Mountain View, CA
- intel software engineer Mountain View, CA
- graduate software developer no experience Mountain View, CA
- software developer entry level Mountain View, CA





