Principal Software Engineer - Observability
$184.3k - $258.9kThe Walt Disney Company
Job Posting Title:Principal Software Engineer - Observability
Req ID:
10157430Job Description:
Disney Entertainment and ESPN Product & Technology
Technology is at the heart of Disney’s past, present, and future. Disney Entertainment and ESPN Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance the technological backbone for Disney’s media business globally.
The team marries technology with creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability for our businesses. We are Storytellers and Innovators. Creators and Builders. Entertainers and Engineers. We work with every part of The Walt Disney Company’s media portfolio to advance the technological foundation and consumer media touch points serving millions of people around the world.
Here are a few reasons why we think you’d love working here:
- Building the future of Disney’s media: Our Technologists are designing and building the products and platforms that will power our media, advertising, and distribution businesses for years to come.
- Reach, Scale & Impact: More than ever, Disney’s technology and products serve as a signature doorway for fans’ connections with the company’s brands and stories. Disney+. Hulu. ESPN. ABC. ABC News…and many more. These products and brands matter to millions of people globally.
- Innovation: We develop and implement groundbreaking products and techniques that shape industry norms and solve complex and distinctive technical problems.
Product Engineering is a unified team responsible for the engineering of Disney Entertainment & ESPN digital and streaming products and platforms. This includes product engineering, media engineering, quality assurance, and the engineering behind personalization, commerce, lifecycle, and identity.
The Observability & Insights group ensures that Disney Streaming’s distributed systems are reliable, performant, and transparent. We build the telemetry, dashboards, alerting, insights pipelines, and developer experience tooling that enable engineers across the organization to understand system health and take action quickly.
Job Summary
As a Principal Software Engineer, you are a forward-thinking, highly technical, hands-on-keyboard builder. You work across unfamiliar codebases, teams, and subject matters to accelerate software engineering velocity with AI, shipping production code for our products and applications across the enterprise in a fast-paced, AI-native engineering environment, with a strong understanding of application observability.
You will design and build intelligent systems that improve the reliability and performance of Disney’s large-scale streaming ecosystem, including fully autonomous agentic systems and real-time pipelines that turn telemetry, logs, and user signals into automated detection, root cause analysis, and proactive insights across Disney+, Hulu, and ESPN.
You operate with independence and a strong innovation bias, scoping your own work, making sound tradeoff decisions, and tying everything you build to clear business value and security approvals. You use frontier AI models as a force multiplier to deliver well above typical engineering velocity while keeping token and compute costs rational through optimization and smart model routing. You have a strong desire to work as a technical thought leader setting technical direction and raising the engineering bar through design and code reviews.
Responsibilities
- Design and operate intelligent, production-grade systems that use real-time signals and AI-driven detection to improve the health of streaming platforms, critical services, and customer experience.
- Build and scale fully autonomous agentic systems powered by modern frontier models (e.g. Anthropic, OpenAI, Google, Meta) that reason over complex system behavior, decide and act with minimal human intervention, and drive faster detection and resolution.
- Design intelligent harnesses, memory, and multi-agent orchestration patterns – including prompting and context strategies, task decomposition, retrieval, tool routing, and error recovery – that maximize model performance and accuracy and reduce hallucinations across AI-generated context and actions.
- Develop end-to-end systems across front end and back end, including data and decisioning pipelines, and scalable APIs that deliver predictive signals, explainability, and insights to engineering teams and product stakeholders.
- Keep AI usage cost-effective through prompt and context optimization, caching, batching, and smart model routing across frontier APIs and self-hosted open-source models.
- Apply software engineering best practices end to end: clean, well-tested code, thorough code reviews, and mature CI/CD, owning components of production systems.
- Drop into brand-new or unfamiliar codebases, rapidly build a working mental model, and modernize them with AI, partnering cross-functionally to embed intelligence into workflows such as incident response, release validation, and customer insights and to drive innovation in observability, reliability, and developer productivity.
Basic Qualifications
- Bachelor’s degree in computer science, Engineering, or equivalent experience.
- 10+ years of software engineering experience, including building AI-powered or data-driven applications and scalable APIs (e.g. FastAPI, Flask) and deploying production systems at scale.
- Proven ability to ramp quickly on unfamiliar codebases and rebuild or modernize systems with AI at significantly higher productivity than a typical engineer, while maintaining quality. Tangible examples where your application of AI has led to 2x to 4x times productivity gains are a strong plus.
- Demonstrated expertise in model prompting, context engineering and harnessing, and the design of orchestration patterns and fully autonomous agentic workflows.
- Strong AI/ML engineering experience, including orchestrating foundation models (e.g. Claude, OpenAI, Qwen) using frameworks like LangChain or LangGraph.
- Track record building and deploying high-quality systems across both front end and back end on hyperscaler cloud platforms (AWS, Azure, or GCP), and integrating frontier model APIs (Anthropic, OpenAI).
- Fluency with AI-assisted development tools (e.g., Cursor, Claude Code) to accelerate engineering velocity, and demonstrated experience optimizing AI usage for cost and performance through prompt optimization, caching, and smart model routing.
- Experience with modern development practices, including version control (GitHub), containerization (Docker), cloud-native deployments (AWS/EKS), and mature CI/CD pipelines.
- Strong understanding of API design, microservices architecture, and standard SDLC workflows.
- Track record of working with extreme independence and innovation, scoping and delivering high-impact work that maps directly to business outcomes, and the ability to set technical direction and mentor other engineers.
- Strong analytical and technical skills to troubleshoot issues, iterate rapidly, and quickly arrive at viable solutions.
- Strong collaboration and communication skills, with the ability to work cross-functionally and clearly explain complex technical concepts to technical and non-technical stakeholders.
Preferred Qualifications
- Experience building SaaS solutions in the observability space and handling high-volume telemetry data (e.g., Datadog, Grafana, Conviva). Familiarity with OpenTelemetry (OTel) is a bonus.
- Experience integrating with enterprise AI services such as AWS Bedrock, including model invocation, routing, and governance integration.
- Experience deploying and serving open-source models hosted locally or in private infrastructure, including inference optimization and cost/performance tuning.
- Familiarity with large-scale data platforms and distributed data processing tools (e.g., PySpark, Pandas, Databricks, Snowflake).
- Knowledge of prompt design, model evaluation, and fine-tuning foundation models (e.g., Claude, GPT).
- Experience implementing production-grade systems at scale within a fast-paced, distributed environment.
About Disney Entertainment and ESPN Product & Technology
At Disney Entertainment and ESPN Product & Technology, we’re blending imagination and innovation to reimagine the ways people experience and engage with the world’s most beloved stories and products. We create amazing experiences, transform the future of media, and build products and platforms that enable the connection between people everywhere and the stories and sports they love.
The hiring range for this position in Glendale, CA is $184,300 to $247,100 per year and in New York, NY is $193,100 to $258,900 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.Job Posting Segment:
PE - Sports, News & Entertainment, Tech EnablementJob Posting Primary Business:
PE - Sports, News & Entertainment, Enablement - Insights & ObservabilityPrimary Job Posting Category:
Software EngineerEmployment Type:
Full timePrimary City, State, Region, Postal Code:
New York, NY, USAAlternate City, State, Region, Postal Code:
USA - CA - 1200 Grand Central AveDate Posted:
2026-08-13$197.4k - $264.7k
...Technology is a global organization of engineers, product developers, designers,... ...available to all ad tier users.As our team's Principal Software Engineer, you will apply your battle-... ...environment.Enhancing systems’ observability with proper metrics, monitors, and alerts...SuggestedWork at officeShift work$180k - $205k
...partners, and fans worldwide. The Role We are seeking a Principal Software Engineer to be the technical leader of back end engineering for CD... ...uphold engineering standards — CI/CD, automated testing, observability, performance, security — across the back end. Set the bar...SuggestedApprenticeshipWork experience placementRemote workWorldwide$75 - $82 per hour
...Principal Software Engineer Location: Los Angeles, CA (Hybrid) Contract: 8+ Month This position is open only to candidates who currently... ...Lead technical initiatives to improve CI/CD workflows, observability, and platform reliability. Implement monitoring and...SuggestedHourly payFull timeContract workWork experience placementLocal area- ...Description: On-site in Los Angeles, CA Our client seeks a Principal Software Engineer to lead backend services and APIs for a payment... ...leadership across release engineering, DevOps pipelines, observability, reliability, and secure SDLC in an AI-enabled environment...SuggestedContract workWork experience placementLocal area
$142.79k - $189.75k
...Required: Other Job Family: Software Engineering Job Qualifications: Skills:... ...Required: Yes Job Description: PRINCIPAL SOFTWARE DEVELOPER SENIOR What You... ..., data modeling, testing strategies, observability patterns, security standards, and code...SuggestedFull timeContract workTemporary workPart timeWork experience placementImmediate startRemote workWorldwideFlexible hours$246.5k - $395.6k
...consumer or enterprise use. Were looking for 10+ years in senior engineering roles, with experience designing APIs, abstractions, and... ..., and crash-free rates. We need experience with mobile observability and monitoring tools such as Firebase Crashlytics, Datadog, New...Full timeTemporary workFlexible hours- ...Description Job Description Exclusive Cloud Engineering Opportunity Reshaping Human-Computer... ...team that has created mature software, hardware, and designs impacting millions... ...powered AI agents at scale Implement observability, monitoring, and optimization strategies...Worldwide
$200k - $260k
.... You will serve as the technical lead working with a team of engineers to oversee the design and implementation of these interconnected... ...language. ~12+ years of professional experience in the software industry. ~ Experience with web services, microservices, or...Full timeWork experience placementLocal area$200k - $240k
...new era demands a fundamentally different class of spacecraft. Engineered to survive the harshest radiation environments and to fully... ...space startup, we’d love for you to apply. The Role The software team at K2 strives to blur the lines between the various types...Permanent employmentFull timeShift work$142.2k - $213.4k
...of mission-enabling solutions for global security. Our Engineering and Sciences (E&S) organization pushes the boundaries of... ...Grumman Mission Systems is searching for a Sr. Principal Engineer Embedded Software to support our Software and Test Equipment Software department...Full timeRelocation packageShift work$229.2k - $319.5k
Riot engineers bring deep knowledge of specific technical areas but also value the opportunity to work in a variety of broader domains... ...opportunity to work in a variety of broader domains. As a Principal Software Engineer, you’ll work alongside other engineers to implement...Local areaFlexible hours$229.2k - $319.5k
Riot engineers bring deep knowledge of specific technical areas but also value the opportunity... ...in a variety of broader domains. As a software engineer, you’ll work with both new and... ...and to deliver player value.As a Principal Software Engineer on the Live Experiences...Local areaFlexible hours$276k - $414k
...addition to Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically sophisticated products that... ...execute with privacy at the forefront.We’re looking for a Principal Software Engineer to join the Ads Format team at Snap.What you’ll do...Full timeTemporary workLive inWork at officeLocal area$229.2k - $319.5k
Riot engineers bring deep knowledge of specific technical areas but also value the chance to work in many broader domains. Riot engineers... ..., large-scale challenges and deliver player value. As a Principal Software Engineer on Wild Rift, you’ll lead the development of key...Local areaWorldwideFlexible hoursShift work$229.2k - $319.5k
Riot engineers bring deep knowledge of specific technical areas but also value the opportunity to work in a variety of broader domains... ..., large-scale challenges and deliver player value. As a Principal Software Engineer, you’ll lead the development of key features and model...Local areaFlexible hours- ...asymmetric advantage.About The Role:The Mission Systems Engineering team develops the Mission Management System—the software platform connecting mission subsystems,... ...aircraft and ground systems. As a Senior/Principal Mission Software Engineer, you will architect,...Weekly payPermanent employmentFull timeWork at office
- AnoSys Technologies, Inc is seeking a Solutions Engineer to serve as a primary technical interface with engineering organizations adopting their AI observability platform. In this role, you will collaborate with engineering leaders and implement tailored integrations for...
$276k - $414k
...addition to Bitmoji, Saturn, and other digital services. Snap Engineering teams build fun and technically sophisticated products that... ...with privacy at the forefront. We're looking for a Principal Software Engineer to join Snap Inc! What you'll do: Design,...Temporary workLive inWork at officeLocal area- ...Title- Principal Software Engineer Location- Los Angeles, CA Job Information Job Taxonomy: Sr. Software Engineer Job Title: Principal Software Engineer Job Description: Location Requirement This position is open only to candidates who currently reside in one...Local area
$200k - $400k
...Job Description Job Description PRINCIPAL SOFTWARE ENGINEER Freeform builds AI-native manufacturing systems that unify software, hardware, and physics to produce industrial-scale parts at the speed of human ideation. By treating manufacturing as a single integrated...Full timeCasual workRelocation packageFlexible hours$165.26 per hour
...Job Description Job Description Engineer the Future of Navigation. Advance Mission-Critical Innovation with PDS Tech... ...in the aerospace and defense industry to hire a Principal or Senior Principal Software Engineer – Navigation . In this role, you'll develop cutting...Hourly payPermanent employmentTemporary workLocal area$114k - $171k
...of mission-enabling solutions for global security. Our Engineering and Sciences (E&S) organization pushes the boundaries... ...mission! We are looking for you to join our team as a Principal or Senior Principal Software Engineer in Guidance Navigation Control (GNC) based...Full timeRelocation packageShift work$175k - $205.9k
Are you ready to make an impact?West Monroe is searching for a Principal AI Software Engineer, to join our team in our Technology & Experience (TechEx) practice. You will partner with our clients and other West Monroe team members on transformational AI projects. On client...Local areaImmediate startFlexible hours$190k - $230k
...era demands a fundamentally different class of spacecraft. Engineered to survive the harshest radiation environments and to... ...startup, we'd love for you to apply. The Role As a Principal Application Software Engineer on our Enterprise Team, you will design and build...Permanent employmentWork experience placementShift work$276k - $414k
...Principal Software Engineer Snap Inc is a technology company. We believe the camera presents the greatest opportunity to improve the way people live and communicate. Snap contributes to human progress by empowering people to express themselves, live in the moment, learn...Temporary workLive inLocal area$276k - $414k
...to Bitmoji ( , Saturn, and other digital services. Snap Engineering ( teams build fun and technically sophisticated products that... ...with privacy at the forefront. We’re looking for a Principal Software Engineer to join Snap Inc! What you’ll do: Own highly...Temporary workLive inWork at officeLocal area$229.2k - $319.5k
Riot engineers bring deep knowledge of specific technical areas but also value the opportunity... ...in a variety of broader domains. As a Software Engineer, you’ll work with both new and... ...and to deliver player value.As a Principal Software Engineer on the League of Legends...Local areaFlexible hours$114k - $171k
Northrop Grumman is actively seeking a Principal Software Engineer in Los Angeles, CA, to lead technical initiatives and develop software using C/C++. You will interface closely with software leads and architects to ensure project success. The role requires a bachelor's...$114k - $213.4k
Northrop Grumman seeks a Principal/Sr. Principal Software Engineer in Los Angeles, CA. The role involves leading software projects utilizing C/C+, developing CI/CD pipelines, and ensuring software systems meet performance requirements. Candidates should possess a Bachelor...- ...Description: On-site in Los Angeles, CA Our client seeks a Principal Software Engineer to lead backend services and APIs for a payment... ...leadership across release engineering, DevOps pipelines, observability, reliability, and secure SDLC in an AI-enabled environment...Hourly payContract workWork experience placementLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Engineer - Observability. Be the first to apply!
- senior principal cloud computing engineer Glendale, CA
- principal Glendale, CA
- bank software Glendale, CA
- software asset management analyst Glendale, CA
- ultimate software Glendale, CA
- embedded software Glendale, CA
- software Glendale, CA
- internship software Glendale, CA
- software sales representative Glendale, CA
- software implementation project manager Glendale, CA



