Staff Software Engineer - Streaming Data Platform
$232kUber
- *Staff Software Engineer – Streaming Data Platform**
- *About the role and team**
- Define and drive the technical vision and architecture for Uber's streaming data platform, ensuring its long-term scalability, reliability, performance, and extensibility as business and infrastructure requirements evolve.
- Lead the design and evolution of large-scale distributed streaming systems, solving fundamental challenges in data delivery, distributed coordination, consistency, fault tolerance, resource management, and high availability.
- Drive architectural innovation and modernization across streaming infrastructure, identifying opportunities to simplify complex systems, eliminate scalability bottlenecks, and improve overall platform efficiency.
- Establish technical strategies for performance, reliability, and cost efficiency, leveraging deep systems expertise, benchmarking, and workload analysis to optimize compute, storage, memory, and network utilization.
- Architect highly resilient, multi-tenant infrastructure that supports diverse workloads with demanding throughput, latency, durability, and availability requirements.
- Build and champion foundational platform capabilities, including automation, observability, capacity management, and self-service tooling, that improve developer productivity and reduce operational complexity across engineering organizations.
- Anticipate emerging technical challenges and opportunities, evaluating new technologies and architectural approaches to inform strategic investments and long-term platform roadmaps.
- Provide technical leadership for complex, cross-organizational initiatives, driving alignment among stakeholders and ensuring successful execution from initial strategy through production adoption.
- Establish engineering excellence and operational best practices for mission-critical infrastructure, including architecture reviews, reliability standards, incident prevention, and systematic root-cause analysis.
- Mentor and elevate senior engineers, fostering technical depth, sound architectural judgment, and a culture of continuous learning, innovation, and engineering excellence.
- Collaborate with infrastructure, storage, data engineering, and product engineering organizations to align platform capabilities with Uber's evolving real-time data needs and broader technical strategy.
- 10+ years of professional software engineering experience, with significant expertise in designing, building, and operating large-scale distributed systems, infrastructure platforms, or data-intensive services.
- Deep understanding of distributed systems principles, including consistency, replication, consensus, fault tolerance, concurrency, distributed coordination, and failure recovery.
- Proven experience architecting high-performance, highly available systems that operate at significant scale with stringent throughput, latency, reliability, and durability requirements.
- Strong proficiency in one or more systems or backend programming languages, such as Java, Go, C++, Scala, Python, or Rust, with demonstrated ability to design and implement complex production systems.
- Experience with large-scale data infrastructure, distributed messaging systems, stream processing platforms, or related technologies, including the ability to reason about their architectural tradeoffs.
- Demonstrated track record of providing technical leadership for complex, multi-team engineering initiatives, from architecture and technical strategy through implementation and production adoption.
- Strong expertise in system performance analysis, scalability engineering, and troubleshooting complex distributed infrastructure under production workloads.
- Proven ability to identify fundamental architectural challenges, evaluate alternative solutions, and make sound technical and business tradeoffs with long-term organizational impact.
- Experience influencing technical direction, establishing engineering standards, and driving alignment across teams and organizational boundaries.
- Ability to mentor senior engineers, communicate complex technical concepts clearly, and raise the technical bar across an engineering organization.
- Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.
- Deep experience architecting or developing large-scale streaming, messaging, or real-time data processing infrastructure using technologies such as Apache Kafka, Apache Pulsar, Apache Flink, Apache Spark, or equivalent distributed systems.
- Expertise in the internals of distributed data systems, including partitioning, replication, log-based storage, metadata management, state management, backpressure, and end-to-end delivery guarantees.
- Experience leading architectural evolution or significant modernization of foundational distributed infrastructure serving large numbers of applications and engineering teams.
- Strong understanding of systems-level performance optimization, including Linux internals, multithreading, memory management, network protocols, storage I/O, and resource scheduling.
- Experience designing multi-region or geographically distributed infrastructure, including cross-region data replication, disaster recovery, and availability strategies.
- Expertise in building scalable multi-tenant platforms, including workload isolation, capacity management, resource allocation, and infrastructure cost optimization.
- Experience with cloud-native infrastructure, container orchestration, and large-scale automation frameworks.
- Familiarity with modern data architectures, including change data capture (CDC), event-driven systems, stream processing, real-time analytics, and data lake integration.
- Experience designing or contributing to open-source distributed systems, infrastructure frameworks, or technologies adopted by the broader engineering community.
- Demonstrated success in driving major architectural transformations, influencing organization-wide technology strategy, and balancing short-term delivery with long-term infrastructure investments.
- Advanced degree (Master's or PhD) in Computer Science or a related field, with a focus on distributed computing, storage systems, or system performance.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer - Streaming Data Platform in San Francisco, CA vacancy
$160k - $280k
...About the Role We're looking for a software engineer to build the Kubernetes-native control... ...decoupling the people building on top of the platform from the operational and runtime... ...software around message queues, event streams, or pub/sub (e.g., Kafka, NATS, SQS) rather...PlatformFull time$184k - $314.08k
...myGwork – the largest global platform for the LGBTQ+ business... ...DO We’re looking for a Staff Software Engineer to join the User Targeting... ...the segmentation engine and data pipelines through the APIs... ...systems at scale: whether streaming, real-time pipelines, or large...PlatformFull timePart timeWork at officeFlexible hours$197.3k - $313.7k
...efforts. Job Category Software Engineering Job Details About Salesforce... ...Slack is looking for a Staff Software Engineer to join the Data Infrastructure team... ...operate the core data platforms that enable data... ...workflows — from batch and streaming ingestion to real-time...PlatformFull time$192k - $260k
...obsessed with enabling data teams to solve the... ...and AI infrastructure platform, so our customers can... ...companies in the world. Our engineering teams build highly... ...of the largest scale software platforms. The fleet consists... ...the low latency of streaming. Its higher level...PlatformFull timeWork at officeLocal areaWorldwide$252k - $315k
...Software is eating the world, but AI is eating software. We live... ...to this new reality, leading platform companies are scrambling to... ...products include the Generative AI Data Engine, SGP, Donovan, and others... ...of core data storage, streaming, caching, and indexing platforms...PlatformFull timeLive in$228.6k - $314.25k
...builds the world's leading data and AI platform, used by tens of thousands... ...that matter. The Lakeflow Engineering team owns the entirety of the... ...Materialized Views, Structured Streaming, and Flows. We run what is... ...We're looking for a Senior Staff Engineer to serve as a...PlatformFull timeLocal areaWorldwide$215k - $260k
...energy, manufacturing, data center construction,... ...Crusoe Energy as a Staff Data Engineer, an early and pivotal... ...the foundational data platform infrastructure that powers... ...Teams: Partner with software engineers, data... ...warehouses, data lakes, streaming systems, and ETL/ELT...PlatformFull timeTemporary workWork at officeRemote work$149.8k - $262.2k
...Description It all started when engineer Fred Luddy wrote code... .... Our ServiceNow AI platform brings together any AI, any data, and any workflow—... ...We are seeking a Senior Staff Software Engineer (IC5 Level) to... ...services — Postgres, queueing/streaming, and key-value stores —...PlatformPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$215k - $260k
...of experts across energy, manufacturing, data center construction, and cloud services.... ...About the Role: We're looking for a Staff Software Engineer to help make Crusoe Cloud's container registry fast and reliable as the platform grows. The registry sits on the critical...PlatformFull timeTemporary work$181.2k
...Company Description It all started when engineer Fred Luddy wrote code that... ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of... .... About the team As a Senior Staff Software Engineer with the Data Platform organization...PlatformPermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$275k - $400k
...capital markets - combining modern software systems, AI-native workflows,... ...transactions happen. Our platform sits at the intersection of financial infrastructure, data systems, and applied AI. We... ...environment. This is a place for engineers who want to operate at maximum...PlatformWork at officeLocal area2 days per week3 days per week- ...growing group of committed researchers, engineers, policy experts, and business leaders... ...the role Anthropic is looking for a Staff+ Software Engineer to work on the vector search infrastructure... ...and works day to day with the Search Platform team, which owns web search indexing,...Platform
- ...Binti builds software for state and county government agencies, focusing... ...We're looking for a Staff Engineer who combines deep technical judgment... ...technical strategy for major platform areas - setting direction on... ...nationwide Design the data model and engineering plan for...PlatformWork at officeFlexible hours
$150k - $175k
...Staff Full Stack Software Engineer SS&C is a leading provider of mission-critical, AI-powered technology... ...portfolio management and accounting platform used by investment firms around the... ...solutions that help clients manage data, automate processes, and scale their...PlatformOngoing contractWorldwide- ...crossroads of FinTech and healthcare, PayZen is transforming one of the industry’s toughest challenges: patient financing. Our AI-powered platform offers zero-interest payment plans that ease financial stress for patients while boosting cash flow for providers. By rethinking...PlatformWork at officeRemote work
- ...strategy for new products and platform capabilities. Build and scale... ...problems, and mentor engineers while raising quality standards... ...experience and at least 8 years of software design and development... ...projects, building AI-powered or data-driven products, and communicating...PlatformRemote workFlexible hours
- ...committed researchers, engineers, policy experts, and business... ...We are looking for software engineers to help build... ...role focuses on the data foundations that make that... ...and operate the data platform that powers Safeguards,... ...Currently, we expect all staff to be in one of our...PlatformFull timeWork at officeVisa sponsorshipFlexible hours
- ...committed researchers, engineers, policy experts, and business... .... About the role Data Infrastructure designs,... ...recovery. Data Platform & Tooling: Scale data... ...ops) of experience in a Software Engineer role, building... ...Currently, we expect all staff to be in one of our offices...PlatformFull timeContract workFor contractorsFor subcontractorInternshipWork at officeVisa sponsorshipFlexible hours
$238k - $290k
...frontier agentic AI, an enterprise-grade platform, and deep domain expertise, we’re... ...getting started. Role Overview As a Staff Software Engineer, Frontend at Harvey, you will own and... ...APIs and UX for long-running jobs, streaming results, and tool-calling workflows....PlatformFull timeRelocation package$231k - $314.35k
...agentic AI, an enterprise-grade platform, and deep domain expertise,... .... Role Overview As a Software Engineer on the Product Engineering... ...6 months Design massive data collection from over 50+ legal... ...UX and robust APIs for streaming results, long-running processes...PlatformFull timeRelocation package$320k
...committed researchers, engineers, policy experts,... ...'s research. As a Software Engineer on the... ...creating the reliable data layer that lets... ...the core database platform (data plane and... ...data migration, or streaming data infrastructure... ...Currently, we expect all staff to be in one of...PlatformFull timeWork at officeLocal areaVisa sponsorshipFlexible hours- ...directly or through our platform partners, to run... ...impact Growth Engineering at Airwallex is... ...outcomes. As a Staff Backend Engineer,... ...architectures, and real-time data processing systems... ...of professional software engineering... ...data pipelines, streaming technologies, or large...PlatformFull timeWork at office3 days per week
- ...message the job poster from Fruition Group Embedded Software Engineer - Robotics (Senior/Staff Level) We’re partnered with a pioneering robotics company... ...to lead firmware development across multiple robotic platforms. This role is perfect for someone who loves building...Platform
- ...committed researchers, engineers, policy experts, and... ...Systems team within our Platform organization. Agentic... ...sandbox orchestration, streaming, scheduling, and multi... ...part of how you build software, and have opinions... ...Currently, we expect all staff to be in one of our offices...PlatformFull timeWork at officeVisa sponsorshipFlexible hours
- ...people (fans! Star Wars, Twin Peaks, RPG games). As a Staff Software Engineer on the Data Platform team, you will be responsible for solving engineering... ...Familiarity and/or experience with Big data or Streaming data technologies like Cassandra, MongoDB, Dynomodb,...Platform
- ...Millions of people around the world come to our platform to find creative ideas, dream about new... ...recruiting process here . We are looking for a Staff Software Engineer to help improve the quality and velocity of data science at Pinterest. You will shape the future...PlatformFull time
$281k - $374k
...Opportunity Alerts. Monetization Engineering builds the platforms and experiences that power, scale, and grow these revenue streams. We are seeking a Senior Staff Software Engineer, reporting to the... ...with Product, Machine Learning, Data Science, and Engineering to...PlatformWork at officeLocal areaWork from home- ...committed researchers, engineers, policy experts,... ..., from the data plane to the developer... ...Significant experience as a software engineer building... ...infrastructure platforms or internal... ...Debezium or similar) or streaming data... ...Currently, we expect all staff to be in one of our...PlatformFull timeWork at officeVisa sponsorshipFlexible hours
$192k - $260k
...radically simplify the data lifecycle with a unified Lakehouse platform for data engineering, analytics, and AI.... ...customers build and operate streaming and batch ETL... ...region outages. As a Staff Engineer on the part... ...engineering ~ Strong software engineering skills in...PlatformFull timeLocal areaWorldwide$185.81k - $260.13k
...the future through technology, data, AI, and continuous... ...continued transformation. Our Engineering teams are helping shape the future... ...of less experienced software engineers Design, build, evaluate... ...) Experience with AI agent platforms and frameworks (Amazon Bedrock...PlatformContract workWork experience placementWork at officeLocal areaWork from homeRelocation3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer - Streaming Data Platform. Be the first to apply!
Related searches
- data engineer contract San Francisco, CA
- entry level big data engineer San Francisco, CA
- big data engineer San Francisco, CA
- entry level data engineer San Francisco, CA
- senior data engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- senior data center engineer San Francisco, CA
- junior data engineer remote San Francisco, CA
- data engineer machine learning San Francisco, CA
- etl data engineer San Francisco, CA






