Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Data Engineer: Real-Time Vector Pipelines & RAG

1000 Kyndryl, Inc.

Kyndryl is seeking an AI Data Engineer to architect high-performance data infrastructure for autonomous systems, building real-time pipelines that transform massive IT logs into optimized embeddings. You will scale vector infrastructure for sub-second retrieval speeds, develop semantic layers, and automate data guardrails to protect privacy and quality. This role also involves CI/CD for data pipelines and collaboration with cross-functional teams to deliver production-ready solutions. #J-18808-Ljbffr 1000 Kyndryl, Inc.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Data Engineer: Real-Time Vector Pipelines & RAG in San Francisco, CA vacancy
  •  ...Industries in San Francisco Bay Area is building an AI-first data platform from the ground up. You will own and operate telemetry pipelines for reliability and observability, and...  ...into workflows. The role focuses on real-time monitoring, data quality, and scalable identity... 
    Pipeline

    MrBeast

    San Francisco, CA
    2 days ago
  • Stealth AI Infrastructure Startup in the United States is seeking a Founding Engineer to architect real-time AI systems that run locally inside clinical environments, enabling AI...  ..., influencing hardware, software, and data pipelines. Hybrid role with options in Los... 
    Pipeline

    Stealth AI Infrastructure Startup

    San Francisco, CA
    15 hours ago
  • GSPANN Technologies, Inc. is seeking a MarTech Data Engineer to lead end-to-end engineering initiatives...  ...orchestration, data processing, and activation pipelines. You will architect event-driven systems powering real-time marketing experiences and automated customer journeys... 
    Pipeline

    GSPANN Technologies

    San Francisco, CA
    3 days ago
  •  ...leading compensation platform, blending real-time data with AI. The Data Team supports thousands of...  ...’ll own data models, build scalable pipelines, and ensure trust in our growing...  ...data science, product, and software engineering. Equity, top-tier health coverage, and... 
    Pipeline
    Remote job

    Trov

    San Francisco, CA
    3 days ago
  •  ...Mercator is building AI agents that...  ...Mercator’s first AI/Data Systems engineer, you’ll build the core pipelines that transform messy...  ...reasoning workflows, build RAG pipelines, and...  ...quickly, iterate with real customer inputs,...  ...sponsorships at this time. #J-18808-Ljbffr... 
    Pipeline
    H1b

    Mercator Inc

    San Francisco, CA
    1 day ago
  •  ...company in San Francisco is seeking a Data Engineer to join their Data Team. In this...  ...maintain data architecture and pipelines while ensuring data quality for AI and Robotics initiatives. You will...  ...Google Cloud Platform. This full-time position offers a unique opportunity... 
    Pipeline
    Full time

    Kiwibot

    San Francisco, CA
    3 days ago
  •  ...is looking for a detail-oriented Software Engineer to strengthen data collection, interfaces, and infrastructure for real-time manufacturing metrics. You will work with scientists...  ...tasks, and ensure secure, scalable data pipelines. The ideal candidate has 3+ years of... 
    Pipeline

    Diamond Foundry

    San Francisco, CA
    1 day ago
  • Auth21 is seeking a skilled software engineer to design and operate a self-service streaming platform powering ingestion pipelines and real-time data processing in a distributed environment. You will build resilient, high-throughput systems and scalable automation to manage... 
    Pipeline

    Auth21

    San Francisco, CA
    3 days ago
  •  ...funded startup in the AI Healthtech space....  ...advocates in real time. Build the...  ...reinforcement learning pipeline. Set up the...  ...Capture the right data from product usage...  ...build with the next engineer in mind. What...  ...Background in RAG systems, vector databases, and knowledge... 
    Pipeline
    Full time
    Work at office
    Remote work

    Drh Search Llc

    San Francisco, CA
    15 hours ago
  •  ...is building AI agents for the...  ...a Senior AI Engineer, Quality , you...  ..., automated pipelines, and...  ...improve over time Work with...  ...engineering Data-driven rigor:...  ...must work on real production behavior...  ...Worked with vector databases, embedding...  ...models, and RAG architectures... 
    Pipeline
    Remote job
    Full time
    Work at office
    Work from home
    Flexible hours

    Field Guide Inc

    San Francisco, CA
    15 hours ago
  • $155k - $180k

     ...the two biggest data companies of...  .... Arbital AI allows users to...  ...looking for an AI Engineer to help build...  ...and evaluation pipelines and the knowledge...  ..., delivering real-time analytics and visualizations...  ...pipelines (RAG, memory,...  ..., Databricks Vector Search ● Core... 
    Pipeline
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours
    2 days per week

    Arbital Health

    San Francisco, CA
    15 hours ago
  •  ...uniquely combining data, AI, and community,...  ...Learning Engineers to lead the development...  ...Generation (RAG) Create robust data pipelines for validation,...  ...Familiarity with vector databases and efficient...  ...that make a real-world impact in...  ...Unlimited paid time off, including a... 
    Pipeline
    Full time
    Flexible hours

    Citizen Health

    San Francisco, CA
    15 hours ago
  •  ...looking for a Staff AI Engineer to join the GenAI +...  ..., orchestration, data access, search and...  ...more than half your time on-site in our San...  ...management systems, RAG pipelines, search and retrieval services (vector, hybrid and structured...  ...to apply them to real product problems.... 
    Pipeline
    Full time
    Work at office
    Worldwide
    Flexible hours
    3 days per week

    Strava

    San Francisco, CA
    15 hours ago
  •  ...Business Analytics, Engineering, Mathematics,...  ...experience in data engineering,...  ...production-grade pipelines, with strong...  ...Kinesis, Pulsar) for real-time and batch...  ...SageMaker, Vertex AI), MLOps best...  ...embeddings and vector databases to enable...  ...generation (RAG) for a global defense... 
    Pipeline
    Apprenticeship
    Easy work

    McKinsey & Company

    San Francisco, CA
    3 days ago
  • $150k - $210k

    AI Engineer - Agentic AutomationLocation: RemoteCompensation...  ..., or sell has spent time on a truck. Local...  ...are solving complex, real-world problems every...  ...Integrate LLMs, APIs, and data pipelines into reliable...  ...trails- Familiarity with RAG and vector databases- Experience... 
    Pipeline
    Local area
    Immediate start

    Cargomatic

    San Francisco, CA
    7 days ago
  • $156.06k - $211.14k

    Afresh, the AI platform for grocery...  ...is no better time to join us....  ...Senior AI Software Engineer, you build the AI and data platform that...  ...systems (vector, graph, and structured...  ....Build the pipelines, data products...  ...: retrieval/RAG, agents and...  ...high trust, and real ownership at a... 
    Pipeline
    Full time
    Live in
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours
    3 days per week

    Afresh

    San Francisco, CA
    3 days ago
  • $110.7k - $372.9k

     ...Deloitte has a new AI-first effort,...  ...an Agentic AI Engineer, you will...  ...systems behind real healthcare decisioning...  ...Generation (RAG) pipelines: ingestion, chunking...  ..., embeddings, vector and hybrid...  ...information at the right time. Reliability,...  .../HIPAA-aware data handling.... 
    Pipeline
    Local area
    Visa sponsorship

    Deloitte

    San Francisco, CA
    7 days ago
  • $180k - $250k

     ...A cutting-edge AI company in San Francisco seeks a talented engineer to build infrastructure for voice AI conversations. The role involves creating distributed data pipelines and optimizing systems for large datasets. Ideal candidates should have experience with AI/ML... 
    Pipeline

    Metavoice

    San Francisco, CA
    1 day ago
  • $117.2k - $176.7k

     ...SalesforceSalesforce is the #1 AI CRM, where...  ...Success Engineering team within...  ...Salesforce CRM, and Data Cloud.What You’...  ...& Data Pipelines: Build robust integrations...  ...agents with real-time context.Model...  ...Models (LLMs), RAG architectures,...  ..., and vector databases.Salesforce... 
    Pipeline
    Full time

    Salesforce

    San Francisco, CA
    4 days ago
  • $150k - $280k

     ...are needed to build the data infrastructure that...  ...dashboards. We are building pipelines that ingest, process,...  ...is looking for an AI Data Engineer to design and build the...  ...that handles messy, real-world signals: screenshots...  ...query patterns for time-series behavioral data... 
    Pipeline
    Full time
    Remote work
    Relocation

    SupportFinity

    San Francisco, CA
    4 days ago
  • $203.5k

     ...Title Lead, AI Engineering Job ID 10...  ...Analytics, Data & Research, Management...  ...Permanent Full-Time Location(s)...  ...prototype to real adoption. The result...  ...-component AI pipelines, including:...  ...Augmented Generation (RAG) Fine-tuning...  ...strategies (vector, graph, keyword... 
    Pipeline
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    3 days ago
  • RB Labs is building a real-time generative AI system where latency is the core challenge. We’re seeking a model distillation specialist to shrink large models into fast, deployment-ready versions without sacrificing quality. This is a hands-on role: you’ll design and run... 

    RB Labs

    San Francisco, CA
    3 days ago
  • Your AI Department in the San Francisco Bay Area is seeking a Senior Data Engineer to architect scalable data platforms, design production pipelines, and enable AI readiness across complex data landscapes...  ...disparate systems, and build real-time data foundations that empower... 
    Pipeline
    Remote job
    Flexible hours

    Your AI Department

    San Francisco, CA
    15 hours ago
  • Stepping Up Solutions is seeking a skilled Data Engineer to join their Data Technology team. The successful candidate will design and implement...  .... The role involves optimizing a data processing portal for real-time analytics and maintaining data in both MySQL and NoSQL... 

    Stepping Up Solutions

    San Francisco, CA
    1 day ago
  • $293.5k

     ...Senior Manager, AI Engineering Job ID 10...  ...Analytics, Data & Research, Management...  ...Permanent Full-Time Location(s)...  ...prototype to real adoption. The...  ...multi-component pipelines, including:Retrieval...  ...Generation (RAG)Fine-tuning and...  ...strategies (vector, graph, keyword... 
    Pipeline
    Permanent employment
    Full time
    Apprenticeship
    Work at office
    Local area
    Work from home
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    4 days ago
  • $150k - $225k

     ...modern families. Most AI tools are designed...  ...life is its own full-time job filled with...  ...for an Founding AI Engineer to design, build, and...  ...large language models, vector databases, and real-world data into a seamless, adaptive...  ...Build and maintain RAG pipelines that combine... 
    Pipeline
    Full time
    Work from home
    Flexible hours

    Hellobabs

    San Francisco, CA
    4 days ago
  • $63.36k - $114.12k

     ...a continuous flow of AI-powered insight, enabling...  ...Your role As an AI Data Engineer at Kyndryl, you’ll be...  ...tables; we’re building the real-time pipelines that allow agentic AI...  ...will do Architect for RAG: You’ll design and...  ...documentation into optimized Vector Embeddings. Scale... 
    Pipeline
    Minimum wage
    Full time
    Part time
    Local area
    Flexible hours

    1000 Kyndryl, Inc.

    San Francisco, CA
    15 hours ago
  • $200k - $210k

     ...Global (NYSE: ZETA) is the AI-Powered Marketing Cloud that...  ...looking for a Lead Software Engineer to join Real-Time Events (RTE). This is a highly...  ...the ZMP real-time events pipeline: ingesting, processing, and...  ...delivering high-volume event data that powers Zeta Marketing Platform... 
    Pipeline

    Zeta Global

    San Francisco, CA
    3 days ago
  • AI-Native Data Engineer @ TrueMeter SF Bay Area | Hybrid (3 days onsite, 2 remote...  ...infrastructure end-to-end: pipelines, databases, APIs, and the foundations...  ...raw energy telemetry to real-world business impact. This...  ...and ingestion systems for time-series energy data, billing,... 
    Pipeline
    Immediate start
    Remote work

    Praxis

    San Francisco, CA
    2 days ago
  •  ...generative media ecosystem powering the next generation of AI products. As a Senior Data Engineer at fal, you will build the data infrastructure that...  ...signals into analytics stores. You will design low-latency pipelines, implement ingestion to BigQuery and ClickHouse, and... 
    Pipeline

    The Consensus

    San Francisco, CA
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Data Engineer: Real-Time Vector Pipelines & RAG. Be the first to apply!