Senior Principal Engineer - AI Networking

Salary: $135,200 - 306,400 per year Requirements:

• Bachelors degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field; an advanced degree is preferred.
• 10+ years of software engineering experience building distributed systems, networking software, or infrastructure platforms.
• Deep expertise in RDMA technologies, including RoCE, InfiniBand, or equivalent high-performance networking technologies.
• Strong experience developing networking software in C/C++.
• Experience designing and optimizing distributed communication frameworks and transport protocols.
• Solid understanding of operating systems, networking stacks, memory management, and performance optimization.
• Experience troubleshooting and optimizing large-scale production systems.
• Demonstrated technical leadership driving architecture and execution across multiple teams.
• Strong knowledge of Linux systems and low-level systems programming.
• Ability to solve complex technical challenges across networking, distributed systems, and AI infrastructure.
• Strong system design skills focused on scalability, performance, and reliability.
• Data-driven approach to performance analysis and optimization.
• Excellent communication and collaboration skills across engineering organizations.
• Preferred: Experience with collective communication libraries such as NCCL, RCCL, MPI, UCC, UCX, or similar technologies.
• Preferred: Experience building AI infrastructure for distributed training and inference workloads.
• Preferred: Expertise in GPU networking technologies, including GPUDirect RDMA and GPU-aware communication stacks.
• Preferred: Experience with congestion management, adaptive routing, traffic shaping, and network resiliency mechanisms.
• Preferred: Familiarity with large-scale GPU clusters containing hundreds to thousands of accelerators.
• Preferred: Experience developing services and platforms that operate directly over RDMA transports.
• Preferred: Knowledge of distributed training frameworks such as PyTorch, DeepSpeed, Megatron-LM, TensorFlow, or JAX.
• Preferred: Experience with cloud infrastructure and large-scale production service deployment.
• Preferred: Familiarity with Kubernetes, containerized environments, and cloud-native infrastructure.
• Preferred: Experience leading architecture for highly available, performance-critical systems.

• Architect and develop high-performance networking software for large-scale AI and HPC environments.
• Design and implement RDMA-based services and infrastructure for low-latency, high-throughput communication across GPU clusters.
• Advance collective communication frameworks and transport layers used by distributed AI training and inference workloads.
• Develop congestion management, traffic engineering, load balancing, and resiliency mechanisms for large-scale RDMA networks.
• Optimize end-to-end communication performance across networking, GPU, and software stacks.
• Collaborate with hardware, networking, distributed systems, and AI platform teams to deliver scalable infrastructure.
• Lead performance analysis, bottleneck identification, and system-wide optimization.
• Set architecture and technical direction for networking platforms supporting next-generation AI workloads.
• Build observability, monitoring, telemetry, and debugging capabilities for large-scale distributed systems.
• Drive reliability, fault tolerance, and recovery mechanisms for mission-critical AI infrastructure.
• Mentor engineers and provide technical leadership on complex cross-functional initiatives.
• Influence engineering practices, architecture reviews, and long-term technology strategy.

• AI
• Architect
• Cloud
• Hardware
• InfiniBand
• Kubernetes
• Linux
• Load Balancing
• Network
• Oracle
• PyTorch
• RDMA
• TensorFlow
• Support

More:

We are Oracle, partnering with hackajob to connect exceptional professionals with this opportunity. In this technical leadership role, you will work across distributed systems, networking, and AI infrastructure, influencing architecture across teams and helping shape our AI networking platform roadmap. The role is Career Level IC5. The stated U.S. hiring range is $135,200–$306,400 per year, with possible eligibility for bonus, equity, and deferred compensation; compensation varies by role-related factors and location. Our U.S. benefits include medical, dental, and vision coverage; disability and life insurance; flexible spending accounts; commuter and parking benefits; a 401(k) with company match; paid vacation, holidays, sick leave, and parental leave; adoption assistance; an employee stock purchase plan; financial planning and group legal services; and voluntary insurance options. Applications are generally accepted for at least three calendar days after posting or while the position remains listed.

last updated 40 week of 2026