Senior Backend Engineer (San Francisco)

Job Description:DataRobot delivers AI that maximizes impact and minimizes business risk. Our platform and applications integrate into core business processes so teams can develop, deliver, and govern AI at scale. DataRobot empowers practitioners to deliver predictive and generative AI, and enables leaders to secure their AI assets. Organizations worldwide rely on DataRobot for AI that makes sense for their business — today and in the future. Our AI Compute team is the engine at the heart of DataRobot. We have a mission to build and operate the foundational computing backbone that powers all of DataRobot's AI products and our customers' most demanding workloads. This team works backwards from the needs of data scientists, ML engineers, and application developers to provide the raw power and sophisticated orchestration required to train, deploy, and manage agentic AI at any scale. We are the internal equivalent of a hyperscale cloud provider's core compute service, obsessed with performance, efficiency, and enabling the future of AI.As a Senior Backend Engineer in our AI Compute team, your primary responsibilities of this team include developing and supporting new compute primitives, designing and supporting our APIs, and instrumenting DataRobot to integrate with enterprise IT infrastructure to run Agentic workloads. Our team leverages modern technologies to achieve our goals and innovate on our solutions. This role includes participation in an on-call rotation—we believe in shared ownership of our platform and aim to build systems that are resilient, observable, and require minimal intervention.Key Responsibilities:Develop, test, and support features of DataRobot.Create and maintain automated unit tests and functional tests.Design infrastructure for new features with the input of peers.Build a system that ensures micro-services are secure, performant, reliable, and can go from idea to production in hours.Build a system that continuously provides recommendations to right-size computing resources for Kubernetes to ensure efficient cloud spending for ourselves and our customers.Design and architect automated quality platforms to go from Enterprise-Grade releases from once-a-quarter to once-a-week to once-per-day to once-per-hour without sacrificing performance, security, or reliabilityWork with Product, Legal and Security to ensure the continuous delivery processes you build are compliant and secureWork with the team to ensure pipelines have clear playbooks and can operate 24/7 without youWork with a diverse group of architects and platform engineers across our R&D department to set continuous delivery and performance requirements for all production servicesWork with internal product managers to set roadmaps and define milestones to deliver innovative and simple solutions to our many teams’ continuous delivery and platform engineering issuesManage individual projects and milestones with abundant communication of progress.Knowledge, Skills and Abilities:Expert proficiency in Kubernetes architecture and operations including resource management/scheduling, auto-scaling, Gateway API/Ingress, Prometheus, and OpenTelemetry or experience with other orchestrators like nomad/slurmExperience with gpu clusters, either as a user or administrator or experience in multi-node AI/MLPassionate about developing products for your fellow internal developers.Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem-solving, and complexity analysis.An understanding of design for scalability, performance, and reliability.Deep experience with automated testing and test-driven developmentDemonstrable knowledge of software architecture for large systemsReal-world experience decoupling monolithic software into smaller reusable components Self-motivated and proactive, able to take ownership and deliver results.Ability and willingness to learn about new technologies.Personal drive to get things finished.Effective communication.Operational excellency to continuously define and improve SLA (Service Level Agreement) working backward from customer experience for all the software components this team manages.Requisite Education and Experience / Minimum Qualifications:5+ years of experienceExpert in developing a wide variety of software with Python (4+ years)Experience designing and operating diverse CI/CD pipelines with Harness.ioExperience designing and innovating large-scale horizontal and vertically-scaled build, testing, and deployment systems for Kubernetes environments and familiarity with Helm chartsPreferred:Golang, Terraform and TerragruntChronosphereMulti-cloud experience (AWS, Azure, GCP, and OpenShift)Nice to Have:Direct experience with modern distributed compute frameworks (e.g., Ray, Dask) and large-scale job schedulers (e.g., Slurm, Kueue).CKAD (Certified Kubernetes Application Developer) certificationPublicly reviewable contributions to interesting development projects.Agentic AI experienceExperience working with NVIDIA infrastructure in managing (NIM Operator, NVIDIA Dynamo Operator)The talent and dedication of our employees are at the core of DataRobot’s journey to be an iconic company. We strive to attract and retain the best talent by providing competitive pay and benefits with our employees’ well-being at the core. Here’s what your benefits package may include depending on your location and local legal requirements: Medical, Dental & Vision Insurance, Flexible Time Off Program, Paid Holidays, Paid Parental Leave, Global Employee Assistance Program (EAP) and more!DataRobot Operating Principles:Wow Our CustomersSet High StandardsBe Better Than YesterdayBe RigorousAssume Positive IntentHave the Tough ConversationsBe Better TogetherDebate, Decide, CommitDeliver ResultsOvercommunicateResearch shows that many women only apply to jobs when they meet 100% of the qualifications while many men apply to jobs when they meet 60%. At DataRobot we encourage ALL candidates, especially women, people of color, LGBTQ+ identifying people, differently abled, and other people from marginalized groups to apply to our jobs, even if you do not check every box. We’d love to have a conversation with you and see if you might be a great fit. DataRobot is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. DataRobot is committed to working with and providing reasonable accommodations to applicants with physical and mental disabilities. Please see the United States Department of Labor’s EEO poster and EEO poster supplement for additional information.All applicant data submitted is handled in accordance with our Applicant Privacy Policy.SummaryLocation: Remote Canada - ON; Boston, Massachusetts, US; Seattle, Washington, US; San Francisco, California, USType: