Senior Software Engineer, AI Platform

Senior Software Engineer The Crusoe Cloud Managed AI team seeks an ambitious and experienced Senior Software Engineer to join their team. You'll have a pivotal role in shaping the architecture and scalability of our next-generation managed AI services. You will lead the design and implementation of core systems for our AI offerings, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role offers the opportunity to build and scale critical infrastructure capable of handling millions of API requests per second across thousands of customers. This is an on-site role based in San Francisco, CA, or Sunnyvale, CA, requiring in-office presence. What You'll Be Working On: Design and Development: Lead the design and implementation of core AI services, including resilient fault-tolerant queues for efficient task distribution, model catalogs for managing and versioning AI models, and scheduling mechanisms optimized for cost and performance. Scalability and Reliability: Deep understanding of Kubernetes or other distributed cluster orchestration systems, architect and scale infrastructure to handle millions of API requests per second, implement robust monitoring and alerting to ensure system health and 24/7 availability. Collaboration and Innovation: Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap, influence the long-term vision and architectural decisions of the platform, contribute to open-source AI frameworks and actively participate in the AI community, prototype and rapidly iterate on emerging technologies and new features. What You'll Bring to the Team: Strong Engineering Fundamentals: Advanced degree in Computer Science/Engineering 4-5+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly. AI/ML Expertise: Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines). Software Engineering: Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD. Preferred Qualifications: Proficiency in Golang, Python or Rust for production services. Contributions to open-source AI projects (e.g., VLLM). Experience with performance optimizations on GPU systems and inference frameworks. Personal Attributes: Proactive, collaborative, and capable of working autonomously. Excellent communication and interpersonal skills. Passion for building cutting-edge AI products and solving complex technical problems Benefits: Competitive compensation and equity packages Restricted Stock Units Paid time off, paid holidays & leave of absence programs Comprehensive health, dental & vision insurance Employer contributions to HSA account Paid parental leave Paid life insurance, short-term and long-term disability Professional development & tuition reimbursement Mental health & wellness support Commuter benefits (parking & transit) Cell phone stipend 401(k) Retirement plan with company match up to 4% of salary Volunteer time off Global travel insurance & emergency assistance Daily meals allowance Additional perks & programs specific to location Compensation Range: Compensation will be paid in the range of up to $170,000 -$205,000 + Bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicant's knowledge, education, and abilities, as well as internal equity and alignment with market data. Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation. Crusoe