Principal Site Reliability Engineer

Job Description

As a Principal Site Reliability Engineer (IC4), you will be responsible for designing, building, and operating highly available, scalable, secure, and resilient cloud services. You will combine software engineering with infrastructure expertise to improve service reliability, operational efficiency, and developer productivity across large-scale distributed systems.

You will lead complex reliability initiatives, drive automation-first operational practices, and develop software solutions that eliminate manual toil. You will partner closely with software engineering, cloud infrastructure, security, and product teams to architect resilient platforms that meet aggressive availability, scalability, and performance objectives.

Success in this role requires deep expertise in distributed systems, cloud infrastructure, coding, automation, observability, incident management, and operational excellence. You will leverage modern AI technologies, machine learning, and intelligent automation to streamline operations, accelerate incident response, improve troubleshooting, and enable autonomous system management.

You are expected to be a technical leader who influences architecture, establishes engineering best practices, mentors other engineers, and drives continuous improvements across multiple services and organizations.

Responsibilities

Reliability Engineering & Service Ownership

• Design, build, and operate highly available, scalable, and fault-tolerant cloud services that meet defined Service Level Objectives (SLOs) and Service Level Agreements (SLAs).

• Lead architecture reviews to improve resiliency, scalability, observability, and operational readiness.

• Forecast infrastructure growth, capacity requirements, and resource utilization while proactively mitigating operational risks.

• Continuously improve platform reliability through engineering solutions rather than manual operational processes.

• Define reliability standards, operational best practices, and service readiness criteria across multiple engineering teams.

Software Engineering, Automation & AI

• Design and develop production-quality software, automation frameworks, and internal platforms using Python, Java, Go, or similar programming languages .

• Build scalable automation to eliminate repetitive operational work, reduce manual intervention, and improve engineering productivity.

• Develop APIs, microservices, and tooling that simplify infrastructure management, deployment, monitoring, and operational workflows.

• Leverage Generative AI, Large Language Models (LLMs), AI agents, and intelligent automation to:

• Automate routine operational tasks and runbooks.

• Accelerate incident triage and root cause analysis.

• Improve log analysis and anomaly detection.

• Generate operational insights and recommendations.

• Automate knowledge management and operational documentation.

• Enhance developer productivity and self-service capabilities.

• Identify opportunities to incorporate AI-driven operational intelligence into existing systems to improve efficiency, reliability, and scalability.

Infrastructure Engineering

• Design and optimize cloud infrastructure supporting distributed services across multiple regions and availability domains.

• Improve system resiliency through redundancy, automation, and infrastructure-as-code.

• Build and maintain deployment pipelines, provisioning frameworks, and configuration management solutions.

• Drive infrastructure standardization and platform modernization initiatives.

Observability & Operational Excellence

• Design comprehensive monitoring, logging, tracing, and alerting strategies.

• Build meaningful dashboards, health reporting, and service performance metrics.

• Improve alert quality, reduce operational noise, and enhance system visibility.

• Define and measure Service Level Indicators (SLIs), SLOs, and error budgets.

• Continuously optimize operational processes using data-driven insights.

Incident Management & Reliability

• Lead critical production incident response and act as a senior escalation point during major service events.

• Drive root cause analysis, corrective actions, and post-incident reviews with a focus on long-term engineering improvements.

• Develop automated remediation solutions to reduce Mean Time to Detect (MTTD) and Mean Time to Recover (MTTR).

• Continuously improve operational readiness through disaster recovery testing, game days, and failure injection exercises.

Performance & Scalability

• Identify performance bottlenecks across applications, infrastructure, storage, databases, and networking.

• Drive optimization initiatives to improve system throughput, latency, efficiency, and cost.

• Perform capacity planning and predictive scaling using historical trends and telemetry data.

• Optimize resource utilization while maintaining service reliability and customer experience.

Technical Leadership

• Serve as the technical leader for reliability engineering initiatives spanning multiple services and organizations.

• Establish engineering standards, architectural patterns, and operational best practices.

• Review system designs and influence technical decisions across engineering organizations.

• Mentor engineers on software engineering, distributed systems, cloud technologies, operational excellence, and automation.

• Drive engineering excellence through code reviews, design reviews, technical guidance, and knowledge sharing.

Innovation & Continuous Improvement

• Evaluate emerging cloud technologies, AI capabilities, automation frameworks, and observability platforms.

• Drive adoption of modern engineering practices including GitOps, Infrastructure as Code, continuous delivery, and policy-as-code.

• Identify opportunities to simplify architecture, eliminate operational complexity, and improve platform reliability.

• Champion engineering initiatives that increase service scalability, operational efficiency, and customer satisfaction.

Core Competencies

Planning & Execution

• Lead complex, cross-functional technical initiatives from design through production deployment.

• Balance reliability, scalability, performance, cost, and delivery priorities across multiple concurrent projects.

• Drive execution with minimal direction while effectively managing technical risk and dependencies.

Collaboration & Influence

• Partner with software engineering, cloud infrastructure, security, networking, and product organizations to deliver reliable services.

• Influence technical direction across organizations through strong communication and technical leadership.

• Build consensus among stakeholders with differing priorities and technical perspectives.

Problem Solving

• Solve highly ambiguous and complex technical problems involving distributed systems at cloud scale.

• Apply systematic debugging and data-driven analysis to identify root causes and implement long-term engineering solutions.

• Make sound technical decisions using engineering judgment and operational experience.

Continuous Learning

• Stay current with advances in cloud computing, distributed systems, AI, software engineering, cybersecurity, and Site Reliability Engineering.

• Evaluate emerging technologies and drive adoption where they provide measurable operational value.

• Foster a culture of continuous learning, experimentation, and technical excellence.

Talent Development

• Mentor engineers and contribute to their technical growth through coaching and knowledge sharing.

• Participate in hiring, interviewing, and technical assessments to build high-performing engineering teams.

• Lead by example through engineering excellence, ownership, and customer-focused decision making.

Preferred Technical Skills

• Strong software engineering experience with Python and/or Java (Go is a plus).

• Experience building production automation, APIs, services, and developer tooling.

• Cloud platforms (OCI, AWS, Azure, or GCP).

• Kubernetes, Docker, container orchestration, and service mesh technologies.

• Infrastructure as Code (Terraform, Ansible, Helm, Pulumi).

• CI/CD platforms and DevOps practices.

• Observability platforms such as Prometheus, Grafana, OpenTelemetry, ELK, Splunk, or Datadog.

• Distributed systems, networking, Linux, storage, databases, and performance tuning.

• AI-assisted operations, LLM integrations, automation frameworks, and intelligent operational tooling.

• Experience operating mission-critical, internet-scale production systems with stringent availability and reliability requirements.

Disclaimer:

Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range in USD from: $84,900 to $209,500 per annum. May be eligible for bonus and equity.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

1. Medical, dental, and vision insurance, including expert medical opinion

2. Short term disability and long term disability

3. Life insurance and AD&D

4. Supplemental life insurance (Employee/Spouse/Child)

5. Health care and dependent care Flexible Spending Accounts

6. Pre-tax commuter and parking benefits

7. 401(k) Savings and Investment Plan with company match

8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.

9. 11 paid holidays

10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.

11. Paid parental leave

12. Adoption assistance

13. Employee Stock Purchase Plan

14. Financial planning and group legal

15. Voluntary benefits including auto, homeowner and pet insurance

The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted.

Career Level - IC4

About Us

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

True innovation starts when everyone is empowered to contribute. That's why we're committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We're committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing View email address on click.appcast.io or by calling View phone number on click.appcast.io in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans' status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.