Principal Machine Learning Engineer

Oracle Cloud Infrastructure Ai Infrastructure Team Member

At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world.

Values are OCI's foundation and how we deliver excellence. We strive for equity, inclusion, and respect for all. We are committed to the greater good in our products and our actions. We are constantly learning and taking opportunities to grow our careers and ourselves. We challenge each other to stretch beyond our past to build our future.

You are the builder here. You will be part of a team of smart, motivated, and diverse people and given the autonomy and support to do your best work. It is a dynamic and flexible workplace where you'll belong and be encouraged.

In OCI AI Infrastructure org we are addressing exciting challenges at the intersection of artificial intelligence and cutting-edge cloud infrastructure. In this role, you will drive building state-of-the-art training infrastructure for massive GPU clusters, as well as designing agentic systems deployed on OCI infrastructure at enterprise-scale. You will be innovating on leading principles of agentic software development and driving the frontier on infrastructure that maximizes the potential of bleeding-edge GPU clusters.

We are working at the forefront of Generative AI (GenAI) landscape working with teams across Oracle on multi-modal data generation and leading the framework across Oracle.

Responsibilities

Design and develop AI software in Java, Python, and other languages.

Participate in the entire software lifecycle – development, testing, CI/CD and production operations

Participate in the entire model development cycle - training, fine-tuning, model serving, evaluation/benchmarking and human preference learning.

Apply engineering principles for defining robust and maintainable architectures and designs.

Build cloud service on top of the modern Infrastructure as Service (IaaS) building blocks at OCI

Design and build distributed, scalable, fault tolerant software systems to facilitate development of GenAI models.

Identify requirements, scope solutions, estimate work, schedule deliverables. Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture.

Contribute to publications, blogs and open-source ML performance submissions partnering with product managers

Balance between product feature development and production operational concerns like ops automation, structured logging, instrumentation for metrics and participating in on-call.

Qualifications

BS/MS in Computer Science or equivalent experience

6–10+ years building and shipping enterprise distributed or cloud-native systems

Experience scaling heterogeneous CPU/GPU training infrastructure for large multimodal frontier models

Strong foundation in system design, distributed systems, and cloud architecture best practices

Proficiency in Java, Python, or similar object-oriented languages

Experience building highly available services using service-oriented design patterns and service-to-service communication protocols

Proven ability to deliver impact in collaborative, fast-paced environments

Strong verbal and written communication skills, including technical design documentation

Hands-on experience with containers and orchestration technologies such as Kubernetes and Docker

Production experience with Cloud and ML technologies

Experience working in the below areas and algorithms will be ideal but not mandatory:

Generative AI Modeling: Customizing LLM's, build and deploy LLM's at scale for large scale data generation

Algorithms: Transformer models, Attention mechanism, Prompt tooling