Principal Engineer - AI Networking

Salary: $114,600 - 234,600 per year Requirements:

• We are looking for a seasoned software engineer with a strong foundation in systems programming and a solid interest in RDMA, high-performance networking, and distributed communication systems.
• We need someone who can troubleshoot and resolve complex performance and scalability challenges.
• We value strong collaboration and communication skills in cross-functional engineering settings.
• We seek an ownership mindset with the ability to independently take technical initiatives from design through production release.
• A passion for building infrastructure that supports next-generation AI systems is important.
• A bachelors degree in Computer Science, Computer Engineering, Electrical Engineering, or a related discipline is required; an advanced degree is preferred.
• We expect 7+ years of software engineering experience in systems software, networking, distributed systems, or infrastructure platforms.
• We require hands-on expertise with RDMA technologies, including RoCEv2 and/or InfiniBand.
• Experience developing RDMA-enabled software, communication libraries, networking services, or distributed infrastructure is required.
• Strong understanding of RDMA concepts such as queue pairs, completion queues, memory registration, verbs, and transport semantics is required.
• Proficiency in C/C++ and Linux systems programming is required.
• Experience debugging and tuning performance-critical software systems is required.
• A solid grasp of networking fundamentals, operating systems, and distributed systems concepts is required.
• Preferred experience includes collective communication frameworks and libraries such as NCCL, RCCL, MPI, UCX, UCC, or XCCL.
• Experience supporting AI/ML infrastructure and distributed training environments is preferred.
• Knowledge of GPUDirect RDMA and GPU-aware communication technologies is preferred.
• Experience with congestion management, traffic engineering, or network resiliency solutions is preferred.
• Familiarity with large-scale GPU clusters and high-performance computing environments is preferred.
• Experience building services and infrastructure that operate directly over RDMA transports is preferred.
• Familiarity with distributed training frameworks such as PyTorch, DeepSpeed, Megatron-LM, TensorFlow, or JAX is preferred.
• Experience with Kubernetes, containers, and cloud infrastructure platforms is preferred.
• Understanding of performance profiling and benchmarking tools for networking and distributed systems is preferred.

• We design, develop, and optimize RDMA-based software components and services for large-scale AI infrastructure.
• We build and improve collective communication frameworks, transport layers, and communication libraries used by distributed AI workloads.
• We develop congestion management, load balancing, resiliency, and failover capabilities for RDMA-based networks.
• We analyze and enhance communication performance across networking, GPU, and software stacks.
• We design and implement scalable distributed systems that support AI training and inference environments.
• We collaborate with networking, AI infrastructure, hardware, and cloud platform teams to deliver high-performance solutions.
• We investigate and resolve complex networking, performance, and reliability issues in production environments.
• We develop observability, telemetry, debugging, and performance analysis tools for distributed communication systems.
• We contribute to architectural design discussions and help shape the technical direction of networking platforms.
• We participate in code reviews and help maintain engineering excellence across the team.

• AI
• Cloud
• Hardware
• InfiniBand
• Support
• Kubernetes
• Linux
• Load Balancing
• Network
• Oracle
• PyTorch
• RDMA
• TensorFlow

More:

We are collaborating with Oracle to connect exceptional professionals for this hands-on engineering role. This position focuses on critical networking infrastructure that supports large-scale AI training and inference workloads, working closely with senior technical leaders in a highly technical environment. Oracle offers a comprehensive benefits package in the US, including medical, dental, and vision coverage; disability and life insurance; flexible spending accounts; commuter and parking benefits; a 401(k) with company match; paid time off, holidays, sick leave, and parental leave; adoption assistance; employee stock purchase plan; financial planning and legal support; and voluntary insurance options. The US hiring range is $114,600 to $234,600 per year, with potential eligibility for bonus, equity, and compensation deferral. The role is listed at career level IC4 and applications are generally accepted for at least three calendar days from the posting date or while the job remains open.

last updated 40 week of 2026