Senior Data Engineer
Next Ventures
I am partnered with a Real Time Intelligence Company, who have built a platform that uses AI to transform publicly available data into real time operational insights.
With a huge part of their business growing, they are now looking to hire a Senior Data Engineer, who will be an integral part of the team, working on new and exciting projects, building new pipelines, migrating from one service to another service and building a data and analytics infrastructure.
Responsibilities
- Build and maintain data pipelines for large scale data ingestion, real time analytics and Machine Learning Services
- Develop and optimize NLP, LLMs and other AI powered applications
- Write CI/CD pipelines and have the ability to do code reviews
- Design and build a data analytics infrastructure
Qualifications
- Professional Experience in using Apache Storm, Kafka or Flink for real time data or streaming
- 5+ years experience in Data Engineering and building pipelines using Databricks and Spark
- Can demonstrate experience in building CI/CD pipelines and DevOps best practises
- Experience with real time data streaming
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Francisco, CA vacancy
$164k - $227k
...Chime is seeking a Data Engineer in San Francisco to design and develop scalable data pipelines and frameworks. The ideal candidate has 5+ years of experience with data transformation, pipeline deployment, and data governance. A competitive salary range between $164,00...SeniorChime
San Francisco, CA3 days ago- ...A leading data solutions company in San Francisco seeks an experienced Engineer to develop innovative data products that solve critical customer issues. You will collaborate with cross-functional teams, deal with complex data challenges, and have a direct impact on customer...Senior
Enigma Corporation
San Francisco, CA3 days ago - ...A rapidly growing tech start-up in San Francisco is seeking a Senior Data Engineer to enhance their cloud infrastructure and develop PB scale data pipelines. The role requires over 7 years of experience in data engineering, particularly in start-ups, with skills in Snowflake...Senior
Evolve Group, Inc.
San Francisco, CA3 days ago $180k - $225k
...fal is seeking a Senior Data Engineer to build the data infrastructure that enhances internal systems and vendor relationships. Located in San Francisco, you'll focus on creating ingestion pipelines and optimizing data analytics. This position offers a competitive compensation...SeniorRemote workFal
San Francisco, CA3 days ago$180k - $240k
...Senior Data Engineer San Francisco, CA $180-240K base + equity We're partnered with one of the most recognised developer platforms in the world, trusted by engineering teams at OpenAI, Meta, Netflix, and Adobe, who are scaling their data platform and looking to...SeniorHarnham
San Francisco, CA18 minutes ago- ...DoorDash is seeking a Senior Data Engineer to enhance its data infrastructure and automate scaling operations. This hybrid role requires candidates to be based in Sunnyvale, San Francisco, or Seattle. The successful candidate will have significant experience in data engineering...Senior
Fairygodboss
San Francisco, CA3 days ago - ...Block is seeking a senior data engineer to design and build scalable data ingestion pipelines. The successful candidate will have over 8 years of software engineering experience, proficiency in Java, Python, or Go, and experience with technologies like Apache Kafka and...SeniorLocal area
Block Inc
San Francisco, CA3 days ago $164k
...Chime Financial, Inc is looking for a Senior Software Engineer specializing in Data Engineering located in San Francisco, CA. As a core member of the team, you will architect scalable data pipelines and frameworks that empower data-driven decision-making. The role requires...SeniorChime Financial, Inc
San Francisco, CA3 days ago- ...A leading analytics firm in San Francisco seeks a Senior Data Engineer to enhance data capabilities and modernize systems. You will design scalable solutions and work with various AWS services. Ideal candidates have a Bachelor’s degree in a related field and significant...Senior3 days per week
Gallup
San Francisco, CA3 days ago - ...A leading data solutions company in San Francisco is seeking a Senior Data Engineer to design and maintain ETL/ELT pipelines and manage data architecture using cloud tools. The ideal candidate will have 1-3 years of data engineering experience, with expertise in Python...SeniorFull timeFlexible hours
BASELAYER
San Francisco, CA3 days ago - ...Equilibrium Energy in San Francisco is seeking a Senior Data Engineer to lead the design and implementation of our data architecture. The role involves building scalable ETL/ELT pipelines and collaborating with cross-functional teams to support energy trading and AI initiatives...Senior
Equilibrium Energy
San Francisco, CA3 days ago $180k - $220k
.../yr We're currently working on behalf of an early stage start-up who are leveraging AI to modernize the data engineering industry. They're looking for a Senior Data Engineer to join their team in San Francisco and work on PB scale data pipelines, scaling their cloud...SeniorEvolve Group, Inc.
San Francisco, CA4 days ago- ...A leading data technology organization in California seeks a Sr Data Engineer to create and maintain optimal data pipeline architecture. The role requires 6+ years of experience, expertise in distributed systems, and strong coding skills in Java, Scala, and Python. This...Senior
Inizio Partners Corp
San Francisco, CA3 days ago $160k - $210k
...A data intelligence firm in San Francisco is looking for a Senior Data Engineer to design and maintain their core small business data product. The role requires extensive experience in data systems, strong collaboration skills, and an ability to deliver customer impact...SeniorEnigma Corporation
San Francisco, CA3 days ago- ...Job Description Description: We're seeking a Senior Data Engineer to build and own our data platform and infrastructure. You will design systems that power transaction processing, analytics, reporting, and real-time insights across our global financial product...SeniorFlexible hours
Serene Healthcare Staffing
San Francisco, CA10 days ago - ...A leading tech staffing firm in San Francisco is seeking a Senior Data Engineer/Back-end Engineer. This role requires extensive experience with big data and strong backend service skills. The candidate will work on innovative projects, collaborating with cross-functional...Senior
Techlink Resources
San Francisco, CA3 days ago - ...Join a leading company as a Sr. Data Engineer, where you'll develop data pipelines and collaborate within Agile teams to enhance data analytics. Seeking a critical thinker with over 7 years of experience in IT and expertise in Python, SQL, and big data technologies. Competitive...SeniorFlexible hours
Contact Government Services, LLC
San Francisco, CA3 days ago - ...Francisco, CA, with a global presence across the United States, EMEA, and APAC. Role Overview RZR Global is seeking a talented Data Engineer to join our growing engineering team. This role is ideal for an engineer with a strong background in building and operating...Senior
RZR Global Inc.
San Francisco, CA1 day ago - ...Chime is hiring a Senior Software Engineer in Data Engineering based in San Francisco, CA. This position involves building scalable data pipelines and frameworks to support data-driven decision-making. The ideal candidate will have 5+ years of experience in data transformation...Senior
Chime
San Francisco, CA3 days ago $160k - $210k
...generation of small business intelligence products built on years of learnings in the space. We are seeking an experienced Senior Data Engineer to join our team and help shape the trajectory of these products. Your work will directly impact the accuracy, scalability,...SeniorEnigma Corporation
San Francisco, CA3 days ago$196k - $220.5k
...A leading platform for gaming communication in San Francisco is seeking a Senior Data Engineer to enhance data pipelines and support analytics across the organization. You'll be integral in building robust data systems and collaborating closely with data science and engineering...SeniorFull timeDiscord
San Francisco, CA3 days ago$226k - $254k
...and work relationships. Yes, you can build an exciting business AND have real-life real-customer impact. We are looking for a Data Engineer or Analytics Engineer to join our Data team. You will collaborate with the data scientist and engineers to design, build, and...SeniorWork experience placementLocal areaKikoff
San Francisco, CA4 days ago- ...Data Engineering Role at Triumph Triumph is a skill-based real-money gaming platform in a period of rapid growth. Real money flows through every game, every matchmaking decision, and every payout, which means the data infrastructure powering those systems has to be...Senior
Triumph
San Francisco, CA1 day ago - ...handling millions of real-time requests per second , Deep data management knowledge in one or more of the following... ...foundation behind every experience on the platform , As a Senior Software Engineer for Data Access, you will architect and build the next‑generation...SeniorWorldwide
Roblox
San Francisco, CA3 days ago - ...Omada Health, Inc. is seeking a Senior Software Engineer specializing in Data Engineering, responsible for designing and building data architectures and engineering reliable data pipelines. The role focuses on creating scalable data solutions that inform healthcare decisions...SeniorRemote work
Omada Health
San Francisco, CA3 days ago $160k - $180k
...company is backed by climate‑tech and Silicon Valley investors. For more information, please visit Role Description As a Senior Data Engineer at Gridware, you will design and scale the data infrastructure that powers our real‑time grid monitoring platform. You’ll...SeniorFull timeGridware
San Francisco, CA3 days ago$170k - $220k
...Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you...SeniorWindfall
San Francisco, CA1 day ago- ...We are seeking a Sr Data Engineer for our Data feeds team to provide batch data processing, real-time streaming, and pipeline orchestration capabilities. You'll be part of the Data Technology organization that helps drive business decisions using data. You will have the...SeniorWork experience placement
Inizio Partners Corp
San Francisco, CA3 days ago $25 per hour
...Data Engineer Point is building a modern and aspirational banking experience by bringing rewards and benefits to the everyday debit card. We are looking for a data engineer to pioneer the data team at Point and be responsible for building out the data pipelines and...SeniorWork experience placementWork at officeWork from homeFlexible hoursPoint Defunct
San Francisco, CA1 day ago- ...Senior Forward Deployed Data Scientist/Engineer At Scale AI, we are accelerating the development of artificial intelligence by providing the essential, data-centric infrastructure for building and deploying advanced AI systems. We are looking for a Forward Deployed...Senior
SCALE INC
San Francisco, CA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- senior data center engineer San Francisco, CA
- data engineer manager San Francisco, CA
- data science developer San Francisco, CA
- etl data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- data engineer San Francisco, CA
- big data cloud engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- remote data engineer San Francisco, CA
- senior data engineer San Francisco, CA