Senior Data Engineer
Full-time
Next Ventures
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
- ...Insight Global is seeking a Senior Data Engineer to support their Data Strategy & Operations function. This fully remote role focuses on building and managing data integration patterns into Data 360, ensuring reliable data ingestion, and collaborating with cross-functional...SeniorRemote work
Insight Global
San Francisco, CA4 days ago - ...Job Description Description: We're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product...SeniorFlexible hours
Serene Healthcare Staffing
San Francisco, CA5 days ago - ...Title: Senior Snowflake Data Engineer Location: Santa Clara, CA -95054 (5 days onsite) Duration: Longterm Contract Note: Need only local resource as in person interview required. Senior Snowflake Data Engineer - Key Requirements: • Strong hands...SeniorContract workLocal area
E-Solutions
San Francisco, CA19 hours ago - ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating...Senior
RZR Global Inc.
San Francisco, CA1 day ago - ...Senior Data Engineer SAN FRANCISCO, CA / ENGINEERING / FULL-TIME What Will You Be Doing? Building fast, reliable, scalable data pipelines that process over billions of historical data points collected from tens of thousands of retail stores across the US which...SeniorFull timeWork experience placement
1872 Consulting
San Francisco, CA1 day ago $226k - $254k
...and work relationships. Yes, you can build an exciting business AND have real-life real-customer impact. We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and...SeniorWork experience placementLocal areaKikoff
San Francisco, CA4 days ago- ...About the job Senior Data Engineer Role: Senior Data Engineer We are seeking a Sr Data Engineer for our Data feeds team to provide batch data processing, real-time streaming, and pipeline orchestration capabilities. You'll be part of the Data Technology...SeniorWork experience placement
Inizio Partners
San Francisco, CA2 days ago $233.6k - $292k
...capability into reliable systems that improve real workflows and deliver measurable business value. We are hiring a Senior Forward Deployed Data Scientist / Engineer to work directly with customers on ambiguous, high-impact problems at the intersection of data science,...SeniorScale AI
San Francisco, CA1 day ago- ...Senior Data Engineer Tessera Labs is redefining how enterprises adopt and operationalize Artificial Intelligence. Backed by Foundation Capital and led by a world-class founding team, we build multi-agent AI systems that automate complex business workflows across platforms...Senior
Tessera Labs
San Francisco, CA4 days ago $160k - $240k
...Senior Data Engineer San Francisco About the Role Together AI is looking for a Senior Data Engineer to help define, build, and operate the data infrastructure that handles millions of events every day to power Together's mission-critical systems. As a Senior...SeniorFull timeTogether AI
San Francisco, CA19 hours ago- ...Roofr is looking for a Senior Analytics Engineer to transform raw data into actionable insights. In this critical role, you will redesign analytics frameworks and build scalable models to drive business growth. Your work will directly impact customer experience and the...SeniorRemote work
Roofr
San Francisco, CA2 days ago $130k - $200k
...real growth. How we work at Aircall: We're customer-obsessed, data-driven, and focused on delivering meaningful outcomes. We value... ..., you'll feel at home here. About the role The Data Engineering team at Aircall works on providing high-quality, reliable, and...SeniorWorldwideAircall
San Francisco, CA19 hours ago- ..., General Catalyst, GV, and Accel and enjoy a multi-year runway. About The Role: We're looking for an entrepreneurial Data Engineer with interest in agentic AI and at least 5 years of general engineering experience who wants to make an impact as one of the founding...SeniorTemporary workWork at officeFlexible hours
Sprinter Health
San Francisco, CA19 hours ago $147.4k - $272.1k
...Senior Data Engineer Work Locations (3) Submit Resume Imagine what you could do here. At Apple, new ideas have a way of becoming great products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what...SeniorRelocationApple
San Francisco, CA1 day ago$204.5k - $267k
...Senior Data Engineer Locations: New York, NY; Boston, MA; San Francisco, CA; Raleigh-Durham, NC About Formation Bio Formation Bio is a tech and AI driven pharma company differentiated by radically more efficient drug development. Advancements in AI and drug discovery...SeniorWork at officeLocal areaRelocation3 days per weekFormation Bio (Formerly TrailSpark)
San Francisco, CA1 day ago$125k - $165k
...Role We are looking for an experienced Data Scientist to join the Data Science &... ...from ideation through delivery. This is an engineering-forward DS role - you'll partner closely... ...without waiting to be unblocked. Leveling (Senior or Staff) and compensation will be...SeniorWorldwideSimbe Robotics Inc
San Francisco, CA1 day ago$240k - $300k
...Senior Data Engineer At EliseAI, we're improving the industries that matter most: housing and healthcare. Everyone needs a place to live and access to quality healthcare, yet both are often harder to secure than they should be. By integrating AI agents deeply into...SeniorWork at officeLocal areaRelocationEliseAI
San Francisco, CA1 day ago$15 per hour
...200,000+ volunteer contributors. The Wikimedia Foundation’s Data Platform team enables this global knowledge ecosystem through... ...access to data for research, feature development, and . As a Senior Data Engineer for our Data Platform, you will shape the future of how...SeniorFor contractorsLocal areaRemote workCloudDevs
San Francisco, CA9 days ago- ...You're driven. You're an xScioneer. Location: Los Angeles, San Francisco, Salt Lake City, Portland, Seattle As a Senior Data Engineer, You Will: Design, develop, and operationalize large-scale enterprise data solutions using AWS services such as S3, Glue...SeniorRemote workFlexible hoursShift work
xScion Solutions
San Francisco, CA3 days ago $151.7k - $205.3k
...Socials: LinkedIn - follow us for company updates, employee stories, and career news. Job Summary: Drata is looking for a Senior Data Engineer! This person will be a key member of the growing data team, supporting one of the fastest growing B2B SaaS startups to...SeniorWork at officeImmediate startWorldwideMonday to FridayFlexible hoursDrata Inc
San Francisco, CA1 day ago- A leading technology solutions provider is seeking an experienced CommVault Systems Engineer in San Francisco, California. The role involves designing, developing, and supporting data protection and recovery solutions for a federal government enterprise's environment. The...SeniorFull time
$175.5k - $180k
Tech & AI Senior Data Engineer I - QuantumBlack, AI by McKinsey Job ID: 109245 Atlanta Boston Chicago New Jersey New York City Raleigh San Francisco Toronto Washington DC Apply NowApply Later Do you want to do work that matters, alongside...SeniorApprenticeshipWork at officeLocal areaEasy workMcKinsey & Company
San Francisco, CA1 day ago- Quartermaster in San Francisco is seeking a Senior Data Engineer with over 7 years of experience to design and maintain resilient data systems for mission-critical applications. This role demands strong expertise in AWS, Azure, and database management, alongside collaborative...Senior
- A cutting-edge biotech company in San Francisco is seeking a Data Engineer to build AI-powered data ingestion pipelines from various sources. The role demands strong expertise in data engineering and Python, with a focus on data normalization and quality control. As part...Senior
- The Walt Disney Company is seeking a Senior Data Engineer in Glendale, California, to build and scale data foundations that power AI adoption across Ad Technology. This role focuses on designing data pipelines, leading engineering initiatives, and optimizing data models...Senior
$127.5k - $172.5k
Tend in San Francisco is seeking a Senior Data Engineer to work within the Engineering team. You will ingest, transform, and warehouse healthcare-related data while collaborating with Data Scientists and Machine Learning Engineers. Requirements include 5+ years of data...Senior- Judgment Labs, based in San Francisco, is seeking a Senior Data Infrastructure Engineer to design and scale real-time data pipelines critical for agent behavior analysis. The ideal candidate should have over 6 years of experience managing high-throughput, petabyte-scale...Senior
$125k - $165k
Simbe-Robotics is seeking an experienced Data Scientist in San Francisco, California, to own and drive reliable data science pipelines. You will work closely with Engineering and Product Management to translate complex retail data into actionable insights, impacting operations...Senior- ...a skilled candidate for a unique role at the intersection of data engineering and investment analytics. This position demands the ability to... ...data pipelines and provide insightful portfolio analytics to senior clients. The firm offers direct mentorship, a modern tech...Senior
$179.4k - $263.12k
6Sense in San Francisco is looking for a skilled Data Engineer to design and build reliable big data systems. The ideal candidate will have a BS/MS degree in Computer Science and experience with Big Data technologies such as Hadoop and Spark. The position offers a competitive...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- staff data engineer San Francisco, CA
- data visualization developer San Francisco, CA
- data science developer San Francisco, CA
- senior data center engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- aws data engineer San Francisco, CA
- data engineer manager San Francisco, CA