SR SOFTWARE ENGINEER

Job Title

Bridge the gap between high-scale system architecture and frontier AI.

Build Model & Agent Runtimes to govern model and autonomous agent execution across a hybrid-cloud footprint.

Adopt a platform-first mindset to ensure scalable, secure, and governed AI capabilities.

Architect the future of runtimes by designing and implementing high-performance hosting environments for specialized models and autonomous agents.

Scale hybrid-cloud infrastructure by building multi-tenant platform capabilities for seamless agent and model execution across diverse cloud and on-prem environments.

Drive operational excellence through robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production.

Participate in rotational platform operational team to ensure the reliability and uptime of critical AI services.

Collaborate with cross-functional AI teams to streamline workflows and accelerate the delivery of AI-driven value.

What You'll Bring

Deep systems expertise with proven experience building scalable back-end systems, focusing on containerization and orchestration (4 years of in-depth Kubernetes is a must).

AI/ML fluency with a strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures.

Operational rigor with a track record of implementing observability (logging, metrics, tracing) in complex, distributed environments.

Problem-solving mindset with the ability to turn abstract AI research into production-grade, hardened platform features.

In-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields.

Demonstrated problem-solving and time management skills.

Strong technical aptitude for designing and implementing software solutions.

Experience with modern application development frameworks.

Knowledge of professional software engineering practices and best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.

Deep hands-on technical expertise, excellent verbal and written communication skills.

Experience with Agile software development techniques.

Preferred Qualifications

Ability to use a wide variety of open-source technologies and cloud-based services.

Experience writing software for hybrid cloud (GCP, AWS, Azure).

Experience building high-performance, highly available, and scalable distributed systems.

Experience developing software for healthcare-related industries.