Senior Data Infra Engineer Real-Time Petabyte Pipelines
Judgment Labs
Judgment Labs, based in San Francisco, is seeking a Senior Data Infrastructure Engineer to design and scale real-time data pipelines critical for agent behavior analysis. The ideal candidate should have over 6 years of experience managing high-throughput, petabyte-scale data systems and possess deep expertise with OLAP databases like ClickHouse. You’ll work closely with cross-functional teams to ensure system design and data governance, while promoting high-quality software engineering practices. Enjoy full benefits in a dynamic, fast-paced environment. #J-18808-Ljbffr
Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Infra Engineer Real-Time Petabyte Pipelines in San Francisco, CA vacancy
- ...Arena Intelligence, Inc. in San Francisco, CA, is seeking a Senior Software Engineer (Infrastructure) to lead the design of scalable data and API systems. The role involves architecting real-time data pipelines, ensuring performance and reliability, and mentoring...PipelineSenior
Arena Intelligence, Inc.
San Francisco, CA4 hours ago - ...and others. The Role: We are looking for a Senior Data Infrastructure Engineer to build and scale the real-time data pipelines that power agent behavior analysis at production... ...it happens. We need someone who has built petabyte-scale data systems, knows how to squeeze...PipelineSenior
Judgment Labs Inc.
San Francisco, CA3 hours ago - ...Group in San Francisco is seeking a Senior Software Engineer to build core infrastructure for petabyte-scale data collection for leading robotics... ...will design distributed systems for real-time sensor data and own critical data pipeline systems. The ideal candidate has...PipelineSenior
Gerra Group
San Francisco, CA1 day ago $140k - $210k
...Dormont Manufacturing Co is seeking a Senior/Staff Data Platform Engineer to build and scale the data... ...workflows. This role involves designing pipelines from diverse data sources and ensuring... ...Python and SQL, and experience in real-time data systems. Join us for a...PipelineSeniorDormont Manufacturing Company
San Francisco, CA4 hours ago$183k - $276k
...Amplitude is seeking a Senior Software Engineer to join their Data Pipeline team in San Francisco. You will tackle complex infrastructure challenges and collaborate... ...include comprehensive insurance coverage, flexible time off, and generous stipends for personal development....PipelineSeniorFlexible hoursAmplitude
San Francisco, CA3 hours ago- ...Decagon AI, Inc. is looking for a Senior Data Infrastructure Engineer to design and operate the data systems that power its AI products. The successful candidate will own critical data pipelines and storage layers, improving reliability and creating clear data pathways...PipelineSenior
Decagon AI, Inc.
San Francisco, CA4 hours ago - ...Salesforce is seeking a skilled Data Engineer to join our dynamic team in San Francisco. You will design, build, and scale data pipelines that power our analytics efforts, ensuring high-quality data alignments that enable actionable insights. With a minimum of 5 years...PipelineSenior
Salesforce
San Francisco, CA3 hours ago $172.5k - $260.1k
100 Salesforce, Inc. is seeking a skilled Data Engineer for the Enterprise team in San Francisco. The role involves designing and building scalable data pipelines to support significant enterprise clients and initiatives like GovSlack. Applicants should have strong data...PipelineSenior100 Salesforce, Inc.
San Francisco, CA1 day ago- ...driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing,... ...engineering, a strong background in building scalable data pipelines, and proficiency in technologies such as Kafka and Spark. This...PipelineSenior
- The Walt Disney Company is seeking a Senior Data Engineer in Glendale, California, to build and scale data foundations that power AI adoption... ...across Ad Technology. This role focuses on designing data pipelines, leading engineering initiatives, and optimizing data...PipelineSenior
- TRIUMPH is seeking its first dedicated Data Engineer to own the full data stack at our rapidly growing gaming platform. You will be responsible... ...optimizing our data warehouse using BigQuery, managing data pipelines, and ensuring data quality and reliability. This is a unique...PipelineSenior
$204.5k - $267k
...Senior Data Engineer Locations: New York, NY; Boston, MA; San Francisco,... ...because of the high cost and time of clinical trials. Recognizing... ...Bio to help transform Real World Data (RWD)—spanning electronic... ...building reliable, scalable pipelines is essential, you'll be...PipelineSeniorWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
San Francisco, CA3 days ago$160k - $225k
...company based in California is looking for a Data Infrastructure Engineer. This role focuses on designing and maintaining scalable data pipelines and infrastructure, ensuring data... ...data infrastructure, a strong grasp of real-time and batch processing, and familiarity with...PipelineFlexible hoursFable Security LLP
San Francisco, CA4 hours ago$230k - $290k
...our sellers are building real businesses across... ...updates on our news and engineering blogs and join us as we... ...through commerce. Role The Data team at Whatnot creates... ...machine learning, real-time analytics, stream... ...manage real-time processing pipelines at scale. Strong experience...PipelineWork at officeLocal areaRemote workWork from homeWhatnot
San Francisco, CA4 hours ago- RZR Global Inc. is seeking an experienced Data Engineer in San Francisco. This role involves designing and maintaining large-scale data pipelines for their programmatic Demand-Side Platform. Candidates should have over 6 years in data engineering, expertise in Kafka, Spark...PipelineSenior
- ...A technology company in California is seeking a Staff Data Engineer / Data Architect to define and build the architecture of critical data systems, including real-time streaming pipelines and telemetry ingestion. The role requires over 10 years’ experience in Data Engineering...Pipeline
Gridware
San Francisco, CA4 hours ago - ...technology company in San Francisco is seeking an ML Infrastructure Engineer to build and scale machine learning systems for real-time perception and inference. This role involves designing scalable training pipelines for computer vision models, optimizing them for edge devices...Pipeline
Specter Services LLC
San Francisco, CA5 hours ago $190.8k - $286.8k
...Amsterdam. Making data‑driven... ...to teams across engineering, product, and business... ...data pipelines and define workflows... ...practices at the right time. Own core SQL... ...of 500TB to petabytes). Comfortable... ...batch and real‑time pipelines... ...while balancing infra and business needs...PipelineSeniorLocal areaFlexible hours$180k - $260k
...health technology company based in the US is looking for an experienced backend engineer to develop and maintain cutting-edge AI solutions. This role involves building real-time voice pipelines and requires strong expertise in Python, AWS, and concurrency. Candidates...PipelineSeniorRemote workFlexible hoursEllipsis Health
San Francisco, CA1 day ago- ...About the Role As a Staff Data Engineer, you will be a technical leader on the... ...data infrastructure that powers real-time member experiences, analytics, and... ...AI across Hinge Health. Where a Senior Data Engineer owns individual pipelines and systems, you own the patterns...PipelineWork at officeLocal areaImmediate startRemote workWorldwide3 days per week
Hinge Health
San Francisco, CA1 day ago - ...Ellipsis Health, Inc. is seeking a full-time engineer to enhance our voice pipeline by implementing and maintaining Python micro-services that orchestrate... ...experience in building production back-ends, proficient in real-time streaming systems and modern Python frameworks....PipelineSeniorFull timeFlexible hours
Ellipsis Health
San Francisco, CA5 hours ago - ...Phonely in San Francisco is seeking an experienced DevOps Engineer to join our engineering team and help build reliable cloud infrastructure... ...knowledge of AWS and Kubernetes, and strong skills in CI/CD pipelines. If you're ready to roll up your sleeves and contribute to a...PipelineSenior
Phonely
San Francisco, CA4 hours ago - ...company is seeking a Distinguished Architect to drive the architecture of its data platform. This role involves designing real-time streaming data pipelines and collaborating with various engineering teams to shape the overall engineering roadmap. The ideal candidate will...PipelineSeniorRemote work
CloudZero
San Francisco, CA11 days ago - ...Braintrust Data, Inc. is seeking a backend engineer to develop infrastructure for cutting-edge AI tools. You will design features for LLM performance insights, build real-time data pipelines, and collaborate with product teams. The ideal candidate has over 5 years of backend...PipelineSeniorFlexible hours
Braintrust Data, Inc.
San Francisco, CA1 day ago - ...Kindredventures in San Francisco is looking for a talented engineer to develop full-stack solutions with intuitive user... ...and design to ensure seamless integration, architect real-time APIs, and optimize data pipelines for low-latency applications. This is an opportunity...PipelineSeniorFull time
Kindredventures
San Francisco, CA4 hours ago $244k - $320k
...powered personalization engine delivers bespoke... ...revenue, and loyalty through real-time behavioral insights. Recognized... ...of brands. As a Senior Machine Learning... ...projects end-to-end, from data exploration and modeling... ...experience building automated pipelines for data processing,...PipelineSeniorFull timeMetaProp.vc
San Francisco, CA4 hours ago$197.8k - $257.2k
...Director - Real-Time Data Services Engineering Full time Two Folsom, San Francisco, CA, US 94105 At Gap Inc., we create culture as much as we... ...transactions Experience operationalizing data quality, pipeline observability, and SLA enforcement for streaming...PipelineMinimum wageFull timeShift workGap Inc.
San Francisco, CA5 days ago- ...Our robots operate in real production environments... ...and a demo. As a Senior Controls Engineer, you'll work directly... ...Design and implement real-time supervisory control systems... ...Develop sensor fusion pipelines (IMU, odometry, vision... ...human in the loop data collection framework....PipelineSeniorInternship
Deft AI, Inc.
San Francisco, CA4 hours ago - ...A technology company in San Francisco is seeking a Senior Software Engineer to design and build APIs for delivering real-time data to customers. The role involves hands-on collaboration with engineering teams and utility partners, requiring expertise in API development...Senior
Gridware Technologies Inc.
San Francisco, CA4 hours ago $160k - $240k
...Senior Data Engineer San Francisco About the Role Together AI is... ...usage-based billing system, real-time customer-facing analytics product... ..., stream processing pipelines, ETLs, etc ~ Expert-level... ...well-tested, and maintainable infra-as-code and software for...PipelineSeniorFull timeTogether AI
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Infra Engineer Real-Time Petabyte Pipelines. Be the first to apply!
Related searches
- senior data center engineer San Francisco, CA
- data engineer manager San Francisco, CA
- data science developer San Francisco, CA
- etl data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- data engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- remote data engineer San Francisco, CA
- senior data engineer San Francisco, CA