Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Developer, AI Infrastructure

$114.6k - $234.6k

Oracle

Job Description

OCI (Oracle Cloud Infrastructure) AI Infrastructure is at the forefront of building a cutting-edge, ultra-high-performance GPU platform designed to support AI/ML/HPC workloads. This is your chance to be part of the AI revolution, creating systems that allow customers to scale from tens to thousands of GPUs without compromising performance.

Our team is responsible for designing and developing fundamental architectural changes for GPU delivery, health monitoring, triage automation, and diagnostic services. These are essential for running distributed AI/ML/HPC workloads across thousands of GPUs, leveraging technologies like RoCE and Infiniband.

Why Join Us?

  • Innovative Projects: Build groundbreaking solutions for our customers from the ground up.

  • Exciting Times: Be part of a young, fast-growing team working on ambitious new initiatives.

  • Dynamic Environment: Collaborate in a vibrant, agile environment where learning and adaptability are key.

What We're Looking For:

  • Adaptable Engineers: Self-motivated individuals with a quick learning ability.

  • Technical Excellence: Rock-solid developers and distributed systems engineers with a deep understanding of distributed systems and algorithms. Comfortable diving deep into any part of the stack, as well as software debugging and low-level systems troubleshooting.

  • Passion for Simplicity and Scale: Value simplicity and scalability in design and implementation.

  • Collaborative Spirit: Comfortable working in a collaborative, agile environment and eager to learn. Ability to collaborate effectively with various dependencies, including Network and Data Center operations.

Join us and be a part of the team that's pushing the boundaries of AI technology!

Minimum Qualifications

  • BS or MS degree in Computer Science or relevant technical field involving coding or equivalent practical experience

  • Deep understanding of operating systems, computer networks, and high-performance applications

  • 6+ years' experience delivering and operating large-scale production systems (1000+ server instances)

  • Proficient in one programming language(java/python/c/c++/goLang/shell scripting)

  • Systematic problem-solving approach, strong communication skills, a sense of ownership, and drive.

  • Proven ability to deliver products and experience with the full software development lifecycle

Preferred Qualifications

  • Strong background in Linux systems

  • Familiarity with system-level architecture, data synchronization, fault tolerance, and state management.

  • General enterprise storage, networking, or computing experience

  • Experience with Server/GPU hardware architecture and system management.

  • Experience with Infiniband or RoCE networking

  • Hands-on experience designing, developing, and operating public cloud service data planes

  • Good understanding of databases and SQL (MySQL) and caching technologies (Redis, Memcache etc)

Responsibilities

As a member of the software engineering division, you will be

  • Designing, implementing, and delivering software, firmware for managing GPU based AI servers

  • Working closely with partner teams to deliver high quality software to manage, triage and repair GPU systems

  • Working closely with product teams to debug, resolve customer's issues.

Disclaimer:

Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $114,600 to $234,600 per annum. May be eligible for bonus, equity, and compensation deferral.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

  1. Medical, dental, and vision insurance, including expert medical opinion

  2. Short term disability and long term disability

  3. Life insurance and AD&D

  4. Supplemental life insurance (Employee/Spouse/Child)

  5. Health care and dependent care Flexible Spending Accounts

  6. Pre-tax commuter and parking benefits

  7. 401(k) Savings and Investment Plan with company match

  8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.

  9. 11 paid holidays

  10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.

  11. Paid parental leave

  12. Adoption assistance

  13. Employee Stock Purchase Plan

  14. Financial planning and group legal

  15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

Career Level - IC4

About Us

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

True innovation starts when everyone is empowered to contribute. That's why we're committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing View email address on click.appcast.io or by calling View phone number on click.appcast.io in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Principal Software Developer, AI Infrastructure in Boston, MA vacancy
  • $135.2k - $306.4k

     ...Description Oracle Cloud Infrastructure (OCI) delivers mission-critical...  ...and frameworks to empower developers and support groundbreaking cloud...  ...for investment and drive the software design and development for...  ...to life-saving care. And with AI embedded across our products... 
    Suggested
    Temporary work
    Work experience placement
    Worldwide
    Flexible hours

    Oracle

    Boston, MA
    20 hours ago
  • $114.6k - $234.6k

     ...product delivery at scale. We are an AI-first engineering organization, using...  ...and operability. We are seeking a Principal Software Developer (IC4) to lead design and delivery for...  ...Only Oracle brings together the data, infrastructure, applications, and expertise to power... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    1 day ago
  • $135.2k - $306.4k

     ...data-plane runtime framework, developing a remote persistent storage...  ...for investment and drive the software design and development for new...  ...components of Oracle’s Cloud Infrastructure. You will define the foundations...  ...life-saving care. And with AI embedded across our products... 
    Suggested
    Temporary work
    Work experience placement
    Local area
    Remote work
    Flexible hours

    Oracle

    Boston, MA
    4 days ago
  • $114.6k - $234.6k

     ...are looking for smart systems software engineers with BS/MS/PhD in...  ...leading edge technology like AI vector Database. As a member...  ...software failures Develop algorithms and distributed systems...  ...Oracle brings together the data, infrastructure, applications, and expertise... 
    Suggested
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    4 days ago
  • $104.5k - $234.6k

     ...Description We’re looking for software engineers with strong SRE...  ...platform at scale. This role is for developers who care about reliable...  ...brings together the data, infrastructure, applications, and expertise...  ...to life-saving care. And with AI embedded across our products... 
    Suggested
    Temporary work
    Flexible hours
    Shift work

    Oracle

    Boston, MA
    5 days ago
  • $142.5k - $256.5k

     ...for a hands-on, impact-driven Principal Software Engineer, Platform...  ...enable application teams to develop, deploy, and operate software...  ...Cybersecurity, Architecture, AI platform teams, and broader...  ...hands-on implementation, cloud infrastructure, CI/CD, production operations... 
    Permanent employment
    Work at office
    Immediate start
    Work from home

    Moderna

    Cambridge, MA
    4 days ago
  • $147k - $237.5k

     ...Integrity, and Inclusion. We weave AI into the fabric of everything...  ...84% on average while saving developers thousands of hours....  ...leverage observability for their infrastructure and services architecture...  ...Claude) as part of day-to-day software development Experience building... 
    Remote work

    Palo Alto Networks

    Boston, MA
    1 day ago
  •  ...part of a team of full-stack developers taking on new initiatives which...  ...! Be a part of a dynamic software development group at Verisk Catastrophe...  ...to testing, CI, and DevOps infrastructure • Focus on performance,...  ...• Evolve the use of AI to improve development outcomes... 

    Verisk

    Boston, MA
    13 days ago
  • $114.6k - $234.6k

     ...about building usable, reliable software that helps engineering and...  ...reason about complex physical infrastructure. You can learn and model...  ..., validated system state. Develop validation frameworks and tools...  ...to life-saving care. And with AI embedded across our products... 
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    9 days ago
  • $300k

     ...Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize...  ...ups. The Role We are hiring a Principal Engineer to take full, hands-on...  ...the full stack : frontend, backend, infrastructure, and AI systems You materially increase... 
    Work at office
    Work from home
    Flexible hours

    Blitzy

    Cambridge, MA
    4 days ago
  •  ...MISSION: New Balance is seeking an experienced Principal Software Engineer to join our Enterprise AI Solutions team. This team is responsible for...  ...encourage our associates to grow personally as they develop professionally. You'll also enjoy a yearly $1,000 lifestyle... 
    Temporary work
    Part time
    Work at office
    Flexible hours
    3 days per week

    New Balance

    Brighton, MA
    4 days ago
  • $160k - $190k

     ...Vestmark is building the AI-native future of wealth management technology. We are looking for a Principal Engineer who thinks in systems, cares about business outcomes...  ...the technical depth to define how AI-native software gets built at scale. If you have a clear point... 
    Work experience placement

    Vestmark

    Boston, MA
    1 day ago
  • $313.8k

     ...correctness, clarity, and predictability matter. We’re creating an AI‑first commerce platform that’s deeply integrated with HubSpot’...  ...and buyer experience. About the Role We’re looking for a Principal Software Engineer to help shape the technical future of Commerce Hub. This... 
    Contract work

    Dormont Manufacturing Company

    Cambridge, MA
    4 days ago
  • $250k - $310k

     ...Snyk is the leader in secure AI software development, helping millions of developers develop fast and stay secure as AI transforms how software is built. Our...  ...ahead as AI reshapes our world. Why this role? As a Principal Software Engineer at Snyk, you’ll be a key leader in... 
    Work at office
    Work from home
    Flexible hours

    Dormont Manufacturing Company

    Boston, MA
    20 hours ago
  •  ...Snyk is the leader in secure AI software development, helping millions of developers develop fast and stay secure as AI transforms how software is built. Our...  ...ahead as AI reshapes our world. Why this role? As a Principal Software Engineer at Snyk, you'll be a key leader in... 

    Clutch Canada

    Boston, MA
    1 day ago
  • $114.6k - $234.6k

     ...Broomfield, CO Overview Oracle Cloud Infrastructure (OCI) is building Oracle Video @ Edge (...  ...for live and linear streaming Develop server-side and client-side ad insertion...  ...innovations to life-saving care. And with AI embedded across our products and services... 
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    20 hours ago
  • $144.2k - $288.4k

     ...Principal Software Engineer We're building a world of health around every individual — shaping...  ...lifecycle management of models on Vertex AI, including feature pipelines, model...  ...retraining, deployment pipelines) ~3+ years developing LLM-powered applications in production,... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Oak St. Health

    Waban, MA
    3 days ago
  • $114.6k - $234.6k

     ...operate at the intersection of distributed systems, cloud infrastructure, and applied AI—designing intelligent, scalable, and resilient healthcare...  ...Identify risks and implement mitigation strategies. Develop SOPs and operational automation. Maintain knowledge bases... 
    Full time
    Temporary work
    Remote work
    Flexible hours

    Oracle

    Boston, MA
    4 days ago
  • $152.07k - $202.76k

     ...the trusted network for the AI‑powered world, connecting...  ...At Lumen, you’ll work on infrastructure customers rely on today and...  ...today. The Role The Principal Software Engineer serves as a senior...  ...modern engineering practices, developer tooling, automation frameworks... 
    Full time
    Temporary work
    Remote work

    Lumen

    Cambridge, MA
    4 days ago
  • $167.2k - $209k

     ...Principal Software Engineer, Backend Cambridge Mobile Telematics is the world's largest telematics...  ...and drivers safer. The company's AI-driven platform, DriveWell Fusion®,...  ...will design architecture and backend infrastructure, and build features and applications that... 
    Temporary work
    Work from home
    Flexible hours

    Softbank Investment Advisers

    Cambridge, MA
    3 days ago
  • $145.4k - $242.5k

     ...Job Description Summary As a Principal AI Software Engineer, you will drive technical vision and architect enterprise AI applications for multiple initiatives across the company. You’ll integrate LLMs, agent workflows, NLP, computer vision, and predictive analytics... 
    Contract work
    Work at office
    Relocation package

    GE Vernova

    Cambridge, MA
    8 hours ago
  •  ...scale on premises, in the cloud, or through a hybrid approach. Teradata delivers real business value with AI. What You’ll Do We are seeking a Staff Software Engineer to lead the design, development, and evolution of networking software for our massively parallel... 
    Permanent employment
    Flexible hours

    Teradata

    Boston, MA
    1 day ago
  • $245k - $275k

     ...weaving together advances in cloud infrastructure, automation and analytics, and software delivery, we help enterprises...  ...technical and business requirements Develop relationships with account managers...  ...benefits for additional details. Use of AI We may use artificial intelligence... 
    Work at office

    Medium

    Boston, MA
    20 hours ago
  • $204k - $348k

     ...Sr Principal/ Principal Software Engineer, AI Lab Execution System Cambridge, MA USA; San Francisco, CA USA Your Impact at LILA We are seeking...  ...tolerance, and operational excellence Cloud and Infrastructure: Guide the use of AWS services, Kubernetes, and... 
    Full time
    Work at office
    Local area
    Flexible hours

    Lila Sciences

    Cambridge, MA
    20 hours ago
  •  ...Description We are hiring a Senior Software Engineer with deep expertise in AI/ML engineering and data-intensive...  ...architect scalable ML-serving infrastructure on AWS. This role is office-based...  ...of large, complex datasets Develop model-serving infrastructure using... 
    Work at office
    Flexible hours

    Verisk

    Boston, MA
    12 days ago
  • $100k - $130k

     ...single patient's request for their medical records to powering the AI revolution in healthcare, Datavanters are building the future...  ...We're Looking For We are seeking a network-focused Cloud Infrastructure Engineer to play a key role in designing, optimizing, and securing... 
    Flexible hours

    Datavant

    Boston, MA
    4 days ago
  • $132.5k - $338.3k

     ...of integrated cloud capabilities across data, edge, integrated infrastructure and applications, deep ecosystem skills, culture of change along...  ...Google Cloud technologies—including Gemini Enterprise, Data & AI, CES, Security, and Gen AI—that empower our clients to thrive.... 
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    6 days ago
  •  ...Senior Backend Software Engineer We are seeking a Senior Backend Software Engineer to join our core team. You will help design, implement...  ...ship the core data pipeline and processing platform within our AI-native cloud platform. Your role involves building robust,... 

    Seven AI

    Boston, MA
    1 day ago
  •  ...proper segregation, permissions, and resource allocation. o Develop and maintain document classification projects, extraction rules,...  ...document processing and content management. • Experience with AI/ML-based document classification and extraction model training... 

    3B Staffing LLC

    Dorchester, MA
    1 day ago
  •  ...containerization, and refactoring. Build and manage CI/CD pipelines, Infrastructure-as-Code (Terraform, Ansible),and automated workflows via GitHub...  ..., Bash, or Python). Baseline familiarity with modern AI technologies, including Generative AI, Large Language Models (... 
    Remote work
    Shift work
    1 day per week

    Mindlance

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Developer, AI Infrastructure. Be the first to apply!