Senior Staff Engineer, AI Compute

Salary: $286,200 - 392,000 per year Requirements:

• Bachelors degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Masters degree in one of those fields plus at least 8 years of experience in the same area
• At least 10 years of programming experience with Python, Go, Scala, or Java
• Preferred: a Masters degree in Computer Science or Software Engineering
• Preferred: hands-on experience with the internals of Ray (Actors/GCS/Scheduling) or Spark (Query Optimizer/Memory Management)
• Preferred: experience building platforms that support LLM training, fine-tuning, or high-throughput inference
• Preferred: hands-on experience with AWS compute primitives such as EKS, EC2 UltraClusters, and Graviton, along with cost-optimization approaches
• Preferred: history of upstream contributions to major distributed systems projects

• Architect and develop the control plane and data plane components needed for a highly available, multi-tenant, large-scale, secure machine learning platform
• Build distributed compute engine solutions with Ray and Spark to accelerate workloads ranging from LLM pre-training and reinforcement learning to large-scale data processing while improving compute economics
• Drive operational excellence improvements, including automation of KTLO workflows
• Lead technical delivery across a varied project portfolio, partnering with developers working on areas from distributed microservices to large foundation models
• Collaborate with product, program management, stakeholders, and partners across Capital One to improve business outcomes and advance strong technical solutions
• Stay current with technology trends, experiment with emerging tools, participate in internal and external technical communities, and facilitate system design and code review sessions
• Help strengthen the Capital One Distinguished Engineering community and become a trusted expert on the technologies and capabilities in scope
• Mentor internal talent and actively recruit external talent to grow the Capital One technology organization

• AI
• AWS
• Architect
• Cloud
• EC2
• Fine-tuning
• Support
• Java
• LLM
• Machine Learning
• Model Training
• Python
• Scala
• Spark
• microservices
• Lambda
• Flink
• Golang
• Kubernetes
• Serverless

More:

We are Capital One, building responsible and reliable AI systems to help change banking for good. Our machine learning platform organization runs a cloud-based enterprise AI and ML system that supports high-scale developer and runtime environments for real-time and batch workloads. We are hiring a remote-eligible Senior Staff Engineer to help design and scale foundational compute capabilities across CPU and GPU substrates, supporting everything from notebooks and model training to inference, feature generation, transformer pre-training and fine-tuning, and generative AI applications. This role is remote eligible, with salary ranges varying by location, and is also eligible for performance-based incentive compensation and a comprehensive benefits package focused on health, financial, and overall well-being.

last updated 39 week of 2026