Head of Real-Time Semantic Data Engineering
$143k - $286kWalmart Supercenter
Overview Position Summary... What you'll do...The Mission At Sam’s Club, we are no longer just building dashboards or static pipelines; we are building the "brain" of the retail experience. As the Senior Engineering Manager for Agentic Data, you will be at the forefront of the AI revolution. Your mission is to evolve our massive data ecosystem into a Semantic & Contextual Layer—the foundational intelligence that allows AI Agents to reason, plan, and act autonomously for millions of members. You aren\'t just managing a team; you are architecting the bridge between raw data and autonomous action. You will lead the transition from traditional data structures to agent-ready environments, where data is not just stored, but understood in real-time. What You’ll Do Architect the Semantic Future: Define the technical vision for a unified semantic layer that transforms structured, semi-structured, and unstructured data into context-aware representations (Embeddings, Knowledge Graphs, and Metadata) consumable by LLMs and multi-agent workflows. Real-Time Agentic Intelligence: Own the streaming architecture that feeds our agents. You will leverage Kafka to build low-latency event-driven pipelines, ensuring agents have access to "up-to-the-second" member context and environmental state. Champion Data Fundamentals: Ensure the bedrock of our AI strategy is built on elite Data Engineering principles. You will oversee the design of scalable schemas, partitioning strategies, and high-performance indexing that make petabyte-scale data accessible to reasoning models. Build Agent-Ready Ecosystems: Lead the design of "Agentic Data" pipelines—ensuring that data provided to AI agents is high-fidelity, optimized for retrieval, and enriched with the necessary business logic to prevent hallucinations. Strategic Leadership: Manage and mentor a high-performing team of engineers. You will bridge the gap between AI/ML Research, Product, and Platform Engineering to align data roadmaps with long-term autonomous decision-making goals. Innovate Retrieval Systems: Own the strategy for Retrieval-Augmented Generation (RAG) at scale, optimizing how our agents discover and interact with Sam\'s Club’s vast proprietary knowledge base across both batch and streaming sources. Establish Operational Excellence: Define standards for "Agentic Observability"—implementing telemetry, lineage, and auditability patterns specifically for autonomous and regulated AI workflows. What You’ll Bring Experience: 7–10+ years in Data Engineering, building and operating large-scale, distributed, fault-tolerant data platforms, with at least 3+ years in a leadership role. Data Engineering Mastery: Deep-rooted expertise in Data Fundamentals. You must be an expert in data modeling (Star/Snowflake, Data Vault), storage formats (Parquet, Avro), and distributed computing concepts (sharding, replication, and CAP theorem). Real-Time Expertise: Deep experience with Kafka and event-driven architectures. You understand how to manage state, schema evolution, and consistency in streaming environments (Kafka Streams, Flink, or Spark Streaming). Semantic & AI Mastery: Deep familiarity with the modern AI stack—specifically Vector Databases (Pinecone, Milvus), Knowledge Graphs, and framework orchestration (LangChain, LlamaIndex, CrewAI). Cloud Scale Mastery: Proven track record in GCP or Azure, utilizing BigQuery, Dataflow, and Pub/Sub to handle petabyte-scale workloads. Data Modeling for LLMs: Expert-level understanding of how schema choices, latency, and context window management impact AI reasoning and retrieval quality. Engineering Rigor: Fluency in Python, Java, or Scala, with a deep engineering mindset around testability, maintainability, and high-performance system design. Benefits & Perks Beyond competitive pay, you can receive incentive awards for your performance. Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more. Equal Opportunity Employer We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people. About Global Tech Imagine working in an environment where one line of code can make life easier for hundreds of millions of people and put a smile on their face. That\'s what we do at Walmart Global Tech. We\'re a team of 15,000+ software engineers, data scientists and service professionals within Walmart, the world\'s largest retailer, delivering innovations that improve how our customers shop and empower our 2.2 million associates. To others, innovation looks like an app, service or some code, but Walmart has always been about people. People are why we innovate, and people power our innovations. Being human-led is our true disruption. We\’re virtual. Working virtually this year has helped us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives and spend less time commuting. Today, we are reimagining the tech workplace of the future by making a permanent transition to virtual work for most of our team. Of course, being together in person is an important part of our culture and shared success. We\’ll collaborate in person at a regular cadence and with purpose. At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more. You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable. For information about PTO, see Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam\'s Club facilities. Programs range from high school completion to bachelor\'s degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For Information About Benefits And Eligibility, See One.Walmart. The annual salary range for this position is $143,000.00 - $286,000.00 Additional compensation includes annual or quarterly performance bonuses. Additional compensation for certain positions may also include : Stock Minimum Qualifications:Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications. Option 1: Bachelor’s degree in Computer Science and 5 years\' experience in software engineering or related field. Option 2: 7 years’ experience in software engineering or related field. Option 3: Master\'s degree in Computer Science and 3 years\' experience in software engineering or related field. 4 years\' experience in data engineering, database engineering, business intelligence, or business analytics. 1 year’s supervisory experience. Preferred Qualifications:Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications. Data engineering, database engineering, business intelligence, or business analytics, ETL tools and working with large data sets in the cloud, Master’s degree in Computer Science or related field and 5 years\' experience in software engineering or related field, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture. Primary Location: 809 11th Ave, Sunnyvale, CA 94089-4731, United States of America Walmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment. #J-18808-Ljbffr Walmart
- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...Suggested
- ...seeking a backend expert in Mountain View, California for its Ads data platform team. The role involves building scalable, low-latency... ...high-throughput data processing pipelines critical to real-time ad delivery. Minimum qualifications include a Bachelor’s degree...Suggested
$217.57k - $260k
ID.me is seeking a Staff Software Engineer - Integrations in Mountain View, California. The role involves designing and implementing a real-time, fault-tolerant data pipeline for identity verification. Candidates should possess 10+ years of software development experience...Suggested$248k - $379.5k
...their GeForce NOW cloud team in California. You will oversee the development of advanced diagnostic and AI/ML solutions necessary for real-time analytics, leading and mentoring teams. The ideal candidate will possess extensive experience in AI/ML, along with strong...Suggested- ...and deployment of AI/ML-based solutions. You will guide Data Scientists and Engineers in delivering high-quality outcomes for global GPU Compute... ...and advanced degrees in relevant fields, you will oversee real-time analytics, user diagnostics, and data-driven improvements...Suggested
$170k - $210k
Samsung Ads is seeking a Sr Data Engineer in Mountain View, CA. In this role, you will design and implement scalable, high-performance data pipelines for advertising datasets. You'll ensure data quality and contribute to various systems. The ideal candidate has a degree...- A major technology company based in Mountain View is looking for experienced Data Engineers to optimize data infrastructures for machine learning and analytics. Candidates should have a strong foundation in algorithms, a background in data engineering or machine learning...
- Decisive Point is looking for a Software Engineer - Telematics in Sunnyvale, California. In... ...develop cutting-edge telematics platforms for real-time communication between devices and cloud... ...well as knowledge of cloud platforms and data processing technologies. Join us to drive...
- Sulekha.com New Media Pvt Ltd is looking for a Software Engineer in Sunnyvale, CA. This role involves building reliable backend systems, solving infrastructure problems, and working with real-time data. The ideal candidate has a post-graduate degree and strong skills in...
$147.4k - $272.1k
Apple Inc. is seeking a Computer Vision & Machine Learning Engineer in Sunnyvale, California. This role involves developing cutting-edge... ...and machine learning algorithms for human interaction and real-time systems. You will work on core perception technologies, human...- Intuitive in Sunnyvale is looking for a Senior AI/ML Research Engineer specialized in Computer Vision. You will design and evaluate perception... .... This role involves enhancing AI/ML algorithms and driving real-time applications while working closely with a diverse team. A...
$181.1k - $318.4k
Apple Inc. is looking for a Machine Learning Engineer to innovate ML-driven signal platforms for advertising. You'll build systems that power retrieval and relevance across services like the App Store and Apple News. The ideal candidate has at least 4 years of experience...$143k - $286k
...ll do... Join Walmart’s Global Tech Data Engineering team to build and scale the data platforms... ...Engineer, you’ll design and optimize real-time data pipelines, enable AI-driven... ...agent-consumable data patterns, including semantic modeling, embeddings, knowledge graphs,...Full timeTemporary workPart time- ...robotics innovation company focused on home robotics seeks a Software Engineer to develop machine learning infrastructure. You will own training systems, optimize data pipelines, and work on real-time robot control systems. Ideal candidates have a strong software...
- ...An innovative AI startup is seeking an experienced Machine Learning Engineer to design and deploy production-grade ML systems. This role involves using AI to enhance sales data insights through real-time audio understanding. Candidates should have a relevant degree and 1...
$181.1k - $272.1k
Apple Inc. is looking for a Machine Learning Engineer specialized in Computer Vision to join their Strategic Data Solutions team in Sunnyvale, California. The ideal... ...for fraud patterns, and deploying models for real-time analytics. The role requires an advanced degree...- A data analytics technology firm is seeking a skilled Back-End Engineer to design and maintain data pipelines. Key responsibilities include developing robust ETL processes using Spark, Python, and SQL while leveraging cloud technologies like AWS and GCP. Ideal candidates...
$170k - $210k
Samsung Electronics America is looking for a Sr Data Engineer to join their Samsung Ads team in Mountain View, CA. This role involves developing scalable data solutions, optimizing data models, and working closely with cross-functional teams. The ideal candidate should...$110k - $180k
Rhombus Power Inc. in Palo Alto, CA is seeking a skilled Data Engineer to design and implement data engineering activities for national security projects. Candidates should have strong programming skills, especially in Python, along with experience in ETL processes and...- A leader in AI testing is looking for a skilled Data Engineer (AI Pipelines) for a 12-month remote contract. You will build scalable ETL/ELT pipelines, ensuring clean and transformed datasets for AI applications. Candidates should have over 4 years of Data Engineering experience...Remote jobContract work
- x.ai is seeking a Data Engineer to lead its data strategy and implement ETL patterns. You will support internal applications and improve processes while maintaining a healthy application environment. The ideal candidate will have a BA/BS in a related field, a minimum of...
- Illumio is hiring a Senior Software Engineer in Sunnyvale, California, to architect high-scale distributed systems, focusing on data processing and real-time analytics. The role requires expertise in backend engineering with Java, Python, or Go, and strong knowledge in...
$170k - $190k
...continuously evolve through curiosity, data, and craftsmanship.We’re seeking technologists... ...as speech-to-text, text-to-speech, and real-time streaming audio pipelines. This role... ...technical leadership within the team, mentoring engineers and promoting best practices in ML...Remote work- ...Sunnyvale, California, is looking for an ambitious Applied AI Engineer to build and maintain AI integrated backend services. You'll collaborate... ..., product managers, and AI researchers to design scalable real-time systems. Ideal candidates will have a background in computer...
- Tensec in Palo Alto is looking for a Principal Machine Learning Engineer to lead the design and implementation of Machine Learning infrastructures... ...skills, and expertise in ML deployment. Knowledge of audio data and Voice AI is a plus. Join a forward-thinking team shaping the...
$80k - $140k
...and implement enterprise-grade data pipelines using Snowflake,... ...Expertise in both core and semantic aspects of Snowflake Develop... ...dynamic tables to enable near real-time and batch processing Implement... ...data marketplace integrations Engineer Snowpipe and Kafka-to-...$135k - $260k
Pantera Capital is hiring for an IT Data Engineering role in Palo Alto. The position involves implementing data strategies, collaborating with multiple teams, and maintaining application environments. Ideal candidates will have at least 5 years of relevant experience,...- ...searching for a Senior Machine Learning Engineer specializing in Perception to manage the... ...role involves everything from research and data curation to deployment on vehicles. The successful... ...specific locations must report in three times a week. A competitive salary package and...Remote work
- ...major automotive company is seeking a Senior Machine Learning Engineer for Perception. The role includes owning the end-to-end pipeline... ...work is available, with a requirement to report in-person three times per week if within a specified radius. Competitive salary and...Remote work
- ...experienced individual to build end-to-end ML model deployment infrastructure for low-latency real-time advertising systems. Responsibilities include handling large volumes of data and productionizing models for campaign effectiveness. Salary ranges from $466,000 to $750,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Head of Real-Time Semantic Data Engineering. Be the first to apply!
- chief data officer Sunnyvale, CA
- senior cloud data engineer Sunnyvale, CA
- principal data engineer Sunnyvale, CA
- finance data engineer Sunnyvale, CA
- aws data engineer Sunnyvale, CA
- data engineer Sunnyvale, CA
- sr data engineer Sunnyvale, CA
- software data engineer Sunnyvale, CA
- junior data engineer remote Sunnyvale, CA
- remote data engineer Sunnyvale, CA

