Senior Data Engineer
Full-time
Next Ventures
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
- ...A leading technology solutions provider is seeking an experienced CommVault Systems Engineer in San Francisco, California. The role involves designing, developing, and supporting data protection and recovery solutions for a federal government enterprise's environment....SeniorFull time
CGS Federal (Contact Government Services)
San Francisco, CA1 day ago $156k - $196k
...DataSF (City & County of San Francisco) | Senior Data Engineer | Hybrid (in San Francisco) | Full-time | $156k-$196k DataSF is looking for a Senior Data Engineer to help us build out the city's central Snowflake platform, which will ultimately power the majority of SF...SeniorFull timeApplyMint
San Francisco, CA2 days ago- ...We're looking for a data guru to build product features and run analyses on top of our massive data set (7,000+ companies first-party... ...data enrichment & tagging. Requirements 6+ years of analytics engineering, data engineering, data science, or other highly analytical,...Senior
Varos Research
San Francisco, CA1 day ago $180k - $220k
...truth for operational metrics, customer-facing reports, billing, actionable insights, and a host of business-critical KPIs. As a Data Engineer in the Data Engineering team, you will own the tooling, frameworks, data pipelines, integrations, databases, schemas and the...SeniorFinix
San Francisco, CA5 days ago$160k - $260k
...relationships. Yes, you can build an exciting business AND have real-life real-customer impact. Responsibilities We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and...SeniorWork experience placementLocal areaKikoff
San Francisco, CA2 days ago$154k - $186k
...real growth. How we work at Aircall: We’re customer-obsessed, data-driven, and focused on delivering meaningful outcomes. We value... ...impact matter, you’ll feel at home here. About the role The Data Engineering team at Aircall works on providing high-quality, reliable, and...SeniorWorldwideAircall
San Francisco, CA3 days ago$160k - $240k
...About The Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together’s mission‑critical systems. As a Senior Data Engineer, you will work with our Data and...SeniorFull timeTogether AI
San Francisco, CA4 days ago$300 per month
...Employment Type Full time Location Type On-site Department Cloud Engineering Crusoe's mission is to accelerate the abundance of energy and... ...infrastructure. About This Role: Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing central Data...SeniorFull timeTemporary workEpoch Biodesign
San Francisco, CA3 days ago$106.9k - $176.5k
...your career wherever you want it to go. Join EY and help to build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client...SeniorSummer holidayFlexible hoursEY
San Francisco, CA1 day ago$186k - $233k
...pathway. Role Overview We are building a modern, scalable data and AI engineering foundation to accelerate insight generation across the enterprise... ...operations, and future digital product capabilities. As a Senior Data Engineer, you will play a key role in designing,...SeniorFull timeLocal areaREVOLUTION Medicines
San Francisco, CA1 day ago$170k - $190k
...Americans build financial resilience. Our Data team sits at the center of every product,... ..., and promotion decision — and Analytics Engineering is the foundation that makes trustworthy,... ...data possible across the company. As our Senior Analytics Engineer, you'll own the...SeniorContract workLocal areaFlexible hoursFlourish Ventures
San Francisco, CA3 days ago- RZR Global Inc. is seeking a talented Data Engineer to join our engineering team in San Francisco, CA. In this role, you will architect and maintain data infrastructure crucial for our programmatic Demand-Side Platform. You will handle large-scale data processing, collaborate...Senior
$166k - $224k
...The Role Pilot is hiring a Senior Analytics Engineer to own our data foundation: the warehouse, the semantic layer, and the ingestion that every team at Pilot runs on. Pilot launched in 2017 to bring the back office into the modern era. Today, with 3,000+ customers and...SeniorFull timeTemporary workPart timeWork at office3 days per weekPilothq
San Francisco, CA3 days ago- Checkr is seeking a Senior Data Engineer in San Francisco to lead design and delivery of our centralized People Data platform. You will own data pipelines, including batch and streaming, ensuring fast, accurate identity and people records across Checkr’s products. You...Senior
$132k - $182k
...mission. If you are too, let’s talk. The Global Data & Insights Team Okta’s Enterprise Data & Insights... ...data architecture, efficient data movement, and the engineering foundations that make data trustworthy at scale. Senior Analytics Engineer, Enterprise Opportunity We are...SeniorImmediate startFlexible hoursOkta, Inc.
San Francisco, CA1 day ago$175k - $200k
...product, you’ll find a home at Fieldguide. About The Role The Data Science team at Fieldguide builds Fieldguide Insights , a... ...and advisory execution and performance. We are hiring a Senior Analytics Engineer to own the foundation that Insights runs on: the semantic layer...SeniorWork from homeFlexible hoursFieldguide.ai
San Francisco, CA1 day ago- ...redefine computing. About the Role We're seeking our first data analytics hire to establish and own the data foundation for our... ...in AI infrastructure or related technical domains Data engineering skills or familiarity with data pipeline development Experience...Senior
Hyperbolic Labs
San Francisco, CA4 days ago - Checkr, Inc. is seeking a Senior Data Engineer to lead the People Data platform initiatives in San Francisco. You will design and ship data pipelines, scale core services, and ensure data accuracy across identity records powering Checkr products. You will collaborate with...Senior
- Federal Home Loan Bank of San Francisco is seeking a senior data management engineer to join the data and digital solutions engineering team. You will provide hands-on development for data models, data integration, and data access across custom apps, vendor apps, and SaaS...Senior
- TRIUMPH is seeking its first dedicated Data Engineer to own the full data stack at our rapidly growing gaming platform. You will be responsible for architecting and optimizing our data warehouse using BigQuery, managing data pipelines, and ensuring data quality and reliability...Senior
- City and County of San Francisco's DataSF seeks a Senior Data Engineer to design, build, and maintain the City’s data infrastructure, enabling robust data pipelines and reliable access for analytics and operations. Reporting to the Principal Data Engineer, you will manage...Senior
$176k - $220k
...people with fire in their belly, it’s a game‑changing, career‑defining, soul‑lifting move. We are looking for a Senior Analytics Engineer with experience building data modeling systems within a modern data stack, supported by intelligent data warehousing and adaptable...SeniorWork experience placementSummer holidayLocal areaFlexible hoursSupportFinity
San Francisco, CA5 days ago- An innovative AI-driven mobile advertising company in San Francisco is seeking a Data Engineer to join its engineering team. This role involves designing, developing, and maintaining data infrastructure for a programmatic Demand-Side Platform. Candidates should have over...Senior
- Drata is looking for a Senior Data Engineer in San Francisco to join its fast-growing data team. You will help build and optimize data products, contribute to data governance, and work with cutting-edge technologies to ensure data accuracy across the organization. The...Senior
- The Walt Disney Company is seeking a Senior Data Engineer in Glendale, California, to build and scale data foundations that power AI adoption across Ad Technology. This role focuses on designing data pipelines, leading engineering initiatives, and optimizing data models...Senior
- ChatGPT Jobs is seeking a Data Engineer to design and maintain production-grade data pipelines for complex supply chain operations. The ideal candidate has 5+ years in data engineering, proficient in Python and SQL, and familiar with orchestration tools like Apache Airflow...SeniorRemote job
- Drata is seeking a Senior Data Engineer to support its growing data team. The ideal candidate will have over 5 years of experience in data engineering, with fluency in SQL and Python. Your role will involve building data products, optimizing data processes, and creating...Senior
$225k - $285k
A technology company in California is seeking a Senior Data Engineer to build the enrichment platform for contact datasets. This role requires over 5 years of data engineering experience, expertise in SQL, modern tooling, and knowledge of contact data economics. Responsibilities...Senior$240k - $300k
EliseAI in San Francisco is seeking a skilled Senior Data Engineer to join our Engineering team. In this pivotal role, you will oversee the data pipeline, focusing on the design, implementation, and maintenance of our data infrastructure. This position plays a critical...Senior- eightsleep is looking for a world-class Data Engineer to revolutionize sleep optimization technology. In this role, you will architect and build the data infrastructure that influences decisions for millions of users, driving our next phase of hypergrowth. You’ll need over...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data engineer analytics San Francisco, CA
- data engineer manager San Francisco, CA
- remote data engineer San Francisco, CA
- junior data engineer remote San Francisco, CA
- senior cloud data engineer San Francisco, CA
- data platform engineer San Francisco, CA
- data infrastructure engineer San Francisco, CA
- aws data engineer San Francisco, CA
- director data engineering San Francisco, CA
- big data developer San Francisco, CA