Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Developer, AI Infrastructure

$99.6k - $223.4k

Oracle

Job Description

OCI (Oracle Cloud Infrastructure) AI Infrastructure is at the forefront of building a cutting-edge, ultra-high-performance GPU platform designed to support AI/ML/HPC workloads. This is your chance to be part of the AI revolution, creating systems that allow customers to scale from tens to thousands of GPUs without compromising performance.

Our team is responsible for designing and developing fundamental architectural changes for GPU delivery, health monitoring, triage automation, and diagnostic services. These are essential for running distributed AI/ML/HPC workloads across thousands of GPUs, leveraging technologies like RoCE and Infiniband.

Why Join Us?

  • Innovative Projects: Build groundbreaking solutions for our customers from the ground up.

  • Exciting Times: Be part of a young, fast-growing team working on ambitious new initiatives.

  • Dynamic Environment: Collaborate in a vibrant, agile environment where learning and adaptability are key.

What We're Looking For:

  • Adaptable Engineers: Self-motivated individuals with a quick learning ability.

  • Technical Excellence: Rock-solid developers and distributed systems engineers with a deep understanding of distributed systems and algorithms. Comfortable diving deep into any part of the stack, as well as software debugging and low-level systems troubleshooting.

  • Passion for Simplicity and Scale: Value simplicity and scalability in design and implementation.

  • Collaborative Spirit: Comfortable working in a collaborative, agile environment and eager to learn. Ability to collaborate effectively with various dependencies, including Network and Data Center operations.

Join us and be a part of the team that's pushing the boundaries of AI technology!

Minimum Qualifications

  • BS or MS degree in Computer Science or relevant technical field involving coding or equivalent practical experience

  • Deep understanding of operating systems, computer networks, and high-performance applications

  • 6+ years' experience delivering and operating large-scale production systems (1000+ server instances)

  • Proficient in one programming language(java/python/c/c++/goLang/shell scripting)

  • Systematic problem-solving approach, strong communication skills, a sense of ownership, and drive.

  • Proven ability to deliver products and experience with the full software development lifecycle

Preferred Qualifications

  • Strong background in Linux systems

  • Familiarity with system-level architecture, data synchronization, fault tolerance, and state management.

  • General enterprise storage, networking, or computing experience

  • Experience with Server/GPU hardware architecture and system management.

  • Experience with Infiniband or RoCE networking

  • Hands-on experience designing, developing, and operating public cloud service data planes

  • Good understanding of databases and SQL (MySQL) and caching technologies (Redis, Memcache etc)

Responsibilities

As a member of the software engineering division, you will be

  • Designing, implementing, and delivering software, firmware for managing GPU based AI servers

  • Working closely with partner teams to deliver high quality software to manage, triage and repair GPU systems

  • Working closely with product teams to debug, resolve customer's issues.

Disclaimer:

Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $99,600 to $223,400 per annum. May be eligible for bonus and equity.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

  1. Medical, dental, and vision insurance, including expert medical opinion

  2. Short term disability and long term disability

  3. Life insurance and AD&D

  4. Supplemental life insurance (Employee/Spouse/Child)

  5. Health care and dependent care Flexible Spending Accounts

  6. Pre-tax commuter and parking benefits

  7. 401(k) Savings and Investment Plan with company match

  8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.

  9. 11 paid holidays

  10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.

  11. Paid parental leave

  12. Adoption assistance

  13. Employee Stock Purchase Plan

  14. Financial planning and group legal

  15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

Career Level - IC4

About Us

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

True innovation starts when everyone is empowered to contribute. That's why we're committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing View email address on click.appcast.io or by calling View phone number on click.appcast.io in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the Principal Software Developer, AI Infrastructure in Trenton, NJ vacancy
  • $99.6k - $223.4k

     ...Health & Application Infrastructure division pioneers’ innovation...  ...in healthcare through AI. Our mission is to...  .... We are developing a next-generation platform...  ...and clinicians. As Principal Member of Technical Staff...  ...6+ years of relevant software development experience... 
    Suggested
    Temporary work
    Worldwide
    Flexible hours

    Oracle

    Trenton, NJ
    4 days ago
  • $99.6k - $223.4k

     ...are looking for smart systems software engineers with BS/MS/PhD in...  ...leading edge technology like AI vector Database. As a member...  ...software failures Develop algorithms and distributed systems...  ...Oracle brings together the data, infrastructure, applications, and expertise... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Trenton, NJ
    16 hours ago
  • $99.6k - $223.4k

     ...passion for mentoring and elevating other developers. Experience with Python is also...  ...of distributed systems, cloud infrastructure, and applied AI to deliver intelligent, scalable, and...  ...holders. Responsibilities Senior Principal Engineer - Cloud, AI & Healthcare Platforms... 
    Suggested
    Full time
    Temporary work
    Remote work
    Flexible hours

    Oracle

    Trenton, NJ
    16 hours ago
  • $96.8k - $251.6k

     ...Why OCI At OCI, you will work on infrastructure that powers mission-critical, high-throughput...  .... Qualifications ~10+ years of software engineering experience with deep expertise...  ...innovations to life-saving care. And with AI embedded across our products and... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Trenton, NJ
    23 hours ago
  • $96.8k - $251.6k

     ...operational maturity. Why OCI OCI is building cloud infrastructure for demanding media, creative, AI, and high-performance workloads where scale,...  ...using or introducing AI-assisted engineering workflows, developer-productivity automation, reporting automation, or... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Trenton, NJ
    23 hours ago
  •  ...scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI. What You’ll Do We are seeking a Staff Software Engineer to lead the design, development, and evolution of networking software for our massively parallel... 
    Permanent employment
    Flexible hours

    Teradata

    Trenton, NJ
    2 days ago
  • $140k - $170k

     ...within the Cloud Platform Engineering team. Infrastructure as Code (IaC): Design, build, and...  ...technologies). CI/CD & Deployment Automation: Develop advanced pipelines (Azure DevOps, GitHub...  ...Knowledge Base Understanding of any AI Agents,preferrably AWS based agents such... 
    Full time
    Local area
    Remote work

    SitusAMC

    Ewing, NJ
    3 days ago
  • $186.07k - $218.9k

     ...SRE, security, compliance, and infrastructure teams to deliver robust and...  ...least 5 years of experience in software engineering. Designed,...  ...Experienced architecting and developing solutions to ambiguous problems...  ...to responsibly use generative AI tools and copilots (e.g.,... 
    Local area

    Coinbase

    Trenton, NJ
    4 days ago
  •  ...Senior DevOps Engineer (AI/Cloud Modernization) Fully Remote...  ...pipelines, and secure cloud infrastructure. This role collaborates closely...  ...Responsibilities Design, develop, and maintain CI/CD pipelines...  ...GitLab, or Azure DevOps for software development, DevOps, and ML Ops... 
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    St. George Tanaq Corporation

    Trenton, NJ
    3 days ago
  • $132.23k - $176.31k

     ...Lumen is the trusted network for AI. We're transforming how businesses connect, secure, and scale in an AI-driven world.By connecting people, data, and applications quickly, securely, and effortlessly, we help organizations move faster and unlock what's next.At Lumen,... 
    Temporary work
    Work from home

    Lumen Inc

    Ewing, NJ
    3 days ago
  • $140k - $160k

     ...supporting internal innovation projects to develop new AWS capabilities. Key...  ...outcomes. Leverage and encourage the use of AI-powered tools and solutions in daily work...  ...Hub, App2Container). Proficiency with infrastructure as code and automation tools (CloudFormation... 
    Full time
    Temporary work
    Remote work
    Work from home
    Flexible hours
    Shift work

    Ensono

    Trenton, NJ
    4 days ago
  • $139.4k - $291.8k

     ...community. Continually developing our architects is of critical...  ...area. 12 or more years of software engineering or related...  ...Oracle brings together the data, infrastructure, applications, and expertise...  ...to life-saving care. And with AI embedded across our products... 
    Temporary work
    Work at office
    Remote work
    Flexible hours

    Oracle

    Trenton, NJ
    1 day ago
  • $24 per hour

     ...Software Engineer Intern Company: Norstella Location: Remote, United States Date...  ...and critical global life sciences data and AI solutions provider dedicated to improving...  ...assigned project work Work with fellow developers to help ensure code quality and... 
    Hourly pay
    Internship
    Local area
    Remote work

    Norstella

    Trenton, NJ
    3 days ago
  • $84.63k - $112.84k

     ...Lumen is the trusted network for AI. We’re transforming how...  ...serve as a Linux and virtual infrastructure system administrator, for both...  ...operational standards, automation, developing/implementing code, etc.)...  ...degree (Computer Science, MIS, Software Engineering or related) or... 
    Temporary work
    Work from home

    Lumen Inc

    Trenton, NJ
    4 days ago
  • $186.07k - $218.9k

     ...automation, and deliver impact at scale through AI/ML-based technologies. What you’ll be doing...  ...you You have at least 5 years of experience in software engineering and at least 5 years of experience in developing large scale systems with Golang and cloud technologies... 
    Local area

    Coinbase

    Trenton, NJ
    1 day ago
  • $286.2k - $326.7k

     ...OverviewSr. Distinguished Software Engineer - AML (Remote - Eligible...  ...our talented team of developers, machine learning experts, product...  ...flexibilityUtilize AWS cloud Infrastructure across the entire stack (IaaS...  ...professional experience implementing AI/ML strategies for anomaly... 
    Full time
    Part time
    Local area
    Remote work

    Capital One

    Ewing, NJ
    2 days ago
  •  ...Software Engineer (PAGA) Job Location: Lawrence Township, New Jersey Job duration: 12 months...  ...and applications that leverage data and AI. The role requires: A mission-...  ...mind when discussing new ideas. Principal Role Responsibilities: Collaborate... 
    Full time
    Immediate start

    TriOptus LLC

    Lawrence, NJ
    3 days ago
  • $180k - $220k

     ...medical records to powering the AI revolution in healthcare,...  ...change in healthcare. Senior Software Engineer The Role As a...  .... Partner with Product, Infrastructure, and Security teams to set technical...  ...of professional experience developing and scaling distributed... 

    Datavant

    Trenton, NJ
    8 days ago
  • $186.07k - $218.9k

     ...central nervous system for our infrastructure spend, bridging the gap...  ...Strong proficiency in backend software engineering (e.g., Go, Python...  ...experience building internal developer tools, dashboards, or portals...  ...disputes as outlined here. AI Disclosure For select roles... 
    Local area
    Immediate start

    Coinbase

    Trenton, NJ
    1 day ago
  • $99.6k - $223.4k

     ...OCI Enterprise Engineering IC4 Principal Developer - Enterprise AI Platforms Team Description Oracle...  ...on Agent AI , AI-assisted software engineering , and Harness-based engineering...  ...Oracle brings together the data, infrastructure, applications, and expertise to... 
    Temporary work
    Flexible hours

    Oracle

    Trenton, NJ
    3 days ago
  • $95.3k - $158.8k

     ...Job title: Senior Software Engineer II - Retrieval-Augmented Generation...  ...services, rollback plans Developing robust data pipelines and...  ...reproducibility) ~ Proficiency with cloud infrastructure and modern software practices...  ...optimization for low-latency AI services (MLflow)... 
    Local area

    RELX

    Trenton, NJ
    16 hours ago
  • $79.2k - $178.1k

     ...equivalent. • 5+ years of relevant software engineering experience. •...  ...multiple functional areas to develop components that are part of a...  ...with smart adoption of AI-driven solutions to rapidly prototype...  ...brings together the data, infrastructure, applications, and expertise... 
    Temporary work
    Flexible hours

    Oracle

    Trenton, NJ
    16 hours ago
  • $76.8k - $95.9k

     ...Software Engineer I As a Software Engineer I within Honeywell's Sparta Systems organization...  ...Management platforms. You will design, develop, and optimize features using Salesforce...  ...customers. Design, develop, and maintain AI applications and components using... 
    Permanent employment
    Temporary work
    Work experience placement
    Flexible hours

    Honeywell

    Robbinsville, NJ
    4 days ago
  • $99.6k - $223.4k

     ...Description Job Title: Senior Software Engineer and CMTS - Exadata...  ...platform that runs Oracle AI Database workloads of any...  ...enterprise data centers, Oracle Cloud Infrastructure (OCI), and multicloud...  ...-throughput data paths Develop and optimize software for distributed... 
    Temporary work
    Work at office
    Flexible hours

    Oracle

    Trenton, NJ
    4 days ago
  • $55 - $65 per hour

     ...Software Developer CAI is a global services firm with over 9,000 associates worldwide and a yearly revenue of $1.3 billion+. We have over 4...  ...using AWS CodePipeline and native AWS DevOps tools Integrate AI/ML capabilities using AWS services such as SageMaker,... 
    Hourly pay
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Worldwide

    Computer Aid

    Trenton, NJ
    3 days ago
  • $186.07k - $225k

     ...on how to build high quality software, and take their skills to the...  ...latency for our ML inference infrastructure that runs both predictive ML...  ...to responsibly use generative AI tools and copilots (e.g., LibreChat...  ...platform team, and building developer tooling. Experience with... 
    Local area

    Coinbase

    Trenton, NJ
    16 hours ago
  • $142.6k - $261.5k

     ...all over the world. We develop outstanding leaders...  ...Using our product-driven, AI-centric approach, we...  ...scientists, designers, and software engineers enable our...  ...and operating cloud infrastructure and Kubernetes...  ...being able to work by its principals Strong analytical and... 
    Summer holiday
    Flexible hours

    EY

    Trenton, NJ
    1 day ago
  •  ...collaborating across teams to ensure robust solutions. With extensive experience in software engineering and cloud technologies, you will help build the future of banking in the cloud, specializing in Backend-for-Frontend patterns and AI implementations. #J-18808-Ljbffr
    Remote work

    Comfort Systems USA

    Ewing, NJ
    1 day ago
  • $186.07k - $218.9k

     ...What we look for in you: ~5+ years of software development experience with experience writing...  ...objectives ~ Ability to mentor junior developers and lead the team technically on new...  ...the ability to responsibly use generative AI tools and copilots (e.g., LibreChat, Gemini... 
    Local area

    Coinbase

    Trenton, NJ
    2 days ago
  • $209k - $238.5k

     ...Senior Lead Software Engineer, Full Stack - Shopping (Remote-Eligible) Do you love building and pioneering in the technology space? Do you...  ...) Preferred Qualifications: Expert‑level proficiency in MCP, AI Tooling, and/or LLMs Startup experience with a history of shipping... 
    Internship
    Local area
    Remote work

    Comfort Systems USA

    Ewing, NJ
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Developer, AI Infrastructure. Be the first to apply!