Senior AI Data Infrastructure/Pipeline Engineer

$174.72k - $295.68k

Full-time

XPENG

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.
As a core member of our AI Infrastructure team , you will be responsible for building the end-to-end data pipeline for autonomous driving, covering the entire chain from onboard data upload → cloud-based preprocessing → dataset production → model training / simulation input. In autonomous driving systems, the stability and efficiency of the pipeline directly determine the speed of algorithm iteration. We look forward to building a reliable, observable, and cost-effective data pipeline that supports the daily flow of petabyte-scale sensor data.
Key Responsibilities
Responsible for the design and construction of core data closed loop pipelines. Develop toolchains for data cleaning, annotation quality inspection, and data mining to support the algorithm team in quickly locating model error cases and driving iterative model optimization.
Data Support for Production and R&D Processes. This includes log event tracking, connected vehicle data, internal and external data collection, data synchronization, data cleaning and standardization, data modeling, offline and real-time data processing, data as a service, and data visualization. Support business operations such as autonomous driving, smart cockpits, overseas data collection, and robotics data collection.
Responsible for optimizing the performance of the entire data pipeline (collection, cleaning, conversion). Solve bottlenecks in large-scale data transmission, memory management, I/O, etc., and build a distributed data processing system with high throughput and low latency.
Responsible for building a data management platform covering the entire process from data collection to data lake ingestion to model training. Implement capabilities for data version control, data lineage tracing, metadata management, and fast data retrieval to support unified data access and collaboration across multiple teams.
Collaborate with the large model team and other technical teams to deeply understand business requirements, respond quickly, and ensure successful implementation.
Basic Qualifications
Bachelor's degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or related fields.
3-5+ years of experience in large-scale data processing or data platform development.
Proficiency in at least one programming language among Python / Go / Java. Solid software engineering foundation, good coding standards, and a strong sense of code quality.
Hands-on project experience in at least two of the following areas:
Design and development of large-scale data pipelines / ETL systems, with end-to-end experience in data cleaning, transformation, and loading.
Production-level experience with distributed message queues (Kafka / Pulsar / RabbitMQ), familiar with stream processing paradigms.
Experience with distributed data lake systems (e.g., Apache Iceberg), familiar with Iceberg's table format, partition evolution, snapshot isolation, etc., with practical performance tuning and deployment experience.
Experience with columnar storage formats (e.g., Lance) and related query engines, with practical application in large model training.
Hands-on experience using and optimizing relational databases (MySQL / PostgreSQL) and NoSQL databases (Redis / MongoDB). Understand metadata management and caching strategies.
Experience in performance optimization and troubleshooting for large-scale distributed systems, able to quickly locate and resolve complex performance bottlenecks. Experience with Kubernetes / Docker containerization deployment.
Strong cross-team communication and collaboration skills, high sense of responsibility, and proactive problem-solving attitude.
Preferred Qualifications
Familiarity with closed-loop data in the embodied AI industry will be a huge plus.
Some understanding of the autonomous driving industry, awareness of data closed loop and data flywheel concepts, and enthusiasm for this field.
Experience with AI infrastructure or model training workflows (e.g., data loading, feature engineering, data preparation for model evaluation).
Familiarity with data lake / data warehouse systems, with practical experience implementing data version control and data lineage tracing.
Open-source contributions on GitHub or a technical blog, with continuous attention to the latest technological trends in big data / AI infrastructure.
What Do We Provide
A fun, supportive and engaging environment.
Infrastructures and computational resources to support your work.
Opportunity to work on cutting edge technologies with the top talents in the field.
Opportunity to make significant impact on the transportation revolution by the means of advancing autonomous driving.
Competitive compensation package.
Snacks, lunches, dinners, and fun activities.
The base salary range for this full-time position is $174,720 - $295,680, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.

Apply

Vacancy posted 29 days ago

Similar jobs that could be interesting for youBased on the Senior AI Data Infrastructure/Pipeline Engineer in California vacancy

Senior Software Engineer, Pipeline Engineering
$180k - $270k
...evolved from storage pioneer to data platform, closing fiscal 202... ...technology - hyperscalers, AI labs, the AI hardware supply... ...join us. The Role Pipeline Engineering builds the systems that help... ...workflows, or related engineering infrastructure. Proficiency in one or...
Data
Senior
Full time
Flexible hours
Everpure, Inc.
Santa Clara, CA
3 days ago
Senior Platform Networking Software Engineer, Systems Engineering
$175k - $263k
...: P) has evolved from storage pioneer to data platform, closing fiscal 2026 with $3.7 billion... ...next era of technology - hyperscalers, AI labs, the AI hardware supply chain, data... ...capabilities. Availability-Focused Engineering: Understanding of non-disruptive upgrade...
Data
Senior
Work at office
Flexible hours
Everpure, Inc.
Santa Clara, CA
2 days ago
Senior Associate, Salesforce Health Cloud & Agentforce Forward Deployed Engineer
$118.28k - $212.87k
...KPMG is currently seeking a Senior Associate in Technology for our... ...such as care plans, clinical data models, and provider/patient relationship... ...activities using CI/CD pipelines Design and configure... ...Builder templates and grounded AI experiences using Salesforce data...
Data
Senior
Full time
H1b
Local area
KPMG
San Francisco, CA
10 days ago
Senior software engineer, AI platform
...Watershed to manage climate and ESG data, produce audit-ready metrics... ...Watershed is building the AI suite for companies to... .... We're looking for software engineers to help build the AI platform... ...Design and build the agent infrastructure that powers Watershed's products...
Data
Senior
Full time
Work at office
Remote work
Watershed
San Francisco, CA
8 hours ago
Senior Software Engineer, Platform
$240k - $265k
...Unify is building the first AI-native outbound platform... ..., enrich accounts with data from 40+ sources, and execute... ...-the-art AI. As an early Senior Backend Software Engineer. This role is focused on... ...Establish coding standards, CI/CD pipelines, testing strategy,...
Data
Senior
Full time
Unify
San Francisco, CA
8 hours ago
Senior Full-Stack Engineer, Platform (EST)
$170k - $200k
...it even better. Our Workflow AI platform automatically captures... ...are looking for a full stack engineer for our Enterprise Scale team... ...Frontend: NextJS Infrastructure: Terraform + AWS Our... ...compensation using trusted market data and apply a tiered geographic...
Data
Senior
Full time
Scribe
San Francisco, CA
8 hours ago
Senior Software Engineer, Streaming Platform
$155k - $400k
...standard and our team is building its AI-native future. About the... ...the next generation of infrastructure that powers our ingestion pipelines and real-time data processing systems. Our platform... ...that makes it easy for Sentry engineers to deploy and run Streaming Applications...
Data
Senior
Full time
Sentry
San Francisco, CA
8 hours ago
Senior Software Engineer, Platform
...We ingest large-scale data—weather, prices, load... ...We're looking for a Senior Software Engineer to join our Platform... ...build the foundational infrastructure that powers Gridmatic... ...or training pipelines Experience with workflow... ...artificial intelligence (AI) tools to support...
Data
Senior
Full time
Gridmatic
Cupertino, CA
8 hours ago
Senior Software Engineer, Enterprise AI Platform
...OpenArt OpenArt is an AI storytelling and visual... ...levers, and most of the infrastructure behind them hasn't been... .... You'll be the first engineer on it. - Small team, massive surface area — senior engineers own whole systems... ...posture — SSO, data controls, compliance groundwork...
Data
Senior
Full time
Live in
Worldwide
Visa sponsorship
Embedding Vc
San Francisco, CA
8 hours ago
Senior/Staff Software Engineer (Platform)
$160k - $250k
...Role Join a seed-funded AI and supply chain automation... ...US manufacturers. As a Senior/Staff Platform Engineer, you will build the software... ...services, intelligent data pipelines, and deep integrations with... ...LLM-based agents, AI/ML infrastructure, and RAG patterns for...
Data
Senior
Full time
Visa sponsorship
Clera
San Francisco, CA
8 hours ago
Senior+ Software Engineer - Integrations Platform
$160k - $220k
...specialists to build cutting-edge AI tools that help care teams... ...passionate and experienced Senior+ Software Engineer to join our growing team... ...with external partners, data sources, and internal services... ...including robust APIs, data pipelines, and partner integrations, while...
Data
Senior
Full time
Work at office
Local area
Frontera Health, Inc.
San Francisco, CA
8 hours ago
Senior Software Engineer - Platform Infrastructure
$196k - $220.5k
...games. Our Platform Infrastructure teams are responsible for... ...and scalable. As a Senior Software Engineer on these teams, you... ...services to establish robust data collection and monitoring pipelines. Coach and mentor... ...Experience utilizing AI tools like Claude Code...
Data
Senior
Full time
Relocation
Relocation package
Discord
San Francisco, CA
52 minutes ago
Senior Infrastructure Engineer
$61k - $101k
...training or certification in infrastructure engineering, along with at least 5 years... ...using enterprise-approved AI capabilities in infrastructure... ...practices and awareness of data sensitivity. We need the... ...and asset management. This Senior Lead Infrastructure Engineer...
Data
Senior
Full time
J.P. Morgan
San Francisco, CA
16 days ago
Senior Infrastructure Engineer
...decades-old legacy systems with AI-native technology that... ...Overview We're looking for a Senior Infrastructure Engineer to own and evolve the... ...cloud infrastructure, CI/CD pipelines, deployment automation, and... ...dashboards, and used telemetry data to diagnose production...
Data
Senior
Cascading AI Inc
San Francisco, CA
6 days ago
Senior Software Engineer, Cloud Infrastructure
$200k - $400k
...leading conversational AI platform empowering... ...About the Team The Infrastructure team builds and operates... ...Decagon: networking, data, ML serving, developer... ...networking that let engineers ship without becoming... ...serve environments, CI/CD pipeline design, deployment...
Data
Senior
Full time
Work at office
Local area
Shift work
Decagon
San Francisco, CA
52 minutes ago
Senior+ Software Engineer - Research Platform, Consumer Devices
...humanity. As a Software Engineer on the Future of... ...and services that enable AI research, evaluation, and data generation workflows.... ...synthetic data generation pipelines, review tools, and supporting... ...deployments, and compute infrastructure, and improve reliability...
Data
Senior
Full time
Work at office
Relocation package
OpenAI
San Francisco, CA
8 hours ago
Senior Software Engineer, Product Data Platform
$192k - $240k
...effortlessly. Brex’s AI-native automation and... ...grow your career. Engineering at Brex Engineering... ...teams span Software, Data, Security, and IT, and... ...data, query, and search infrastructure that powers critical Brex... ...systems. As a Senior Software Engineer, you...
Data
Senior
Full time
Work at office
Remote work
Work from home
Brex Inc.
San Francisco, CA
8 hours ago
Senior Infrastructure Engineer
$200k
...building the financial infrastructure that makes it easier... ...we build. As a Senior Infrastructure Engineer, you will shape the... ...platforms, deployment pipelines, infrastructure automation... ...intelligence (AI) tools to support parts... ...about how your data is processed, please...
Data
Senior
Work at office
2 days per week
AngelList
San Francisco, CA
9 days ago
Senior Software Engineer - Together Cloud Platform
$160k - $230k
...the Role Together AI is building the AI... ...fastest LLM inference engine with state-of-the-art AI cloud infrastructure. As a Senior Backend Engineer, you... ...customers, spanning dozens of data centers across the... ...integrating IaC with CI/CD pipelines. ~ Experience with...
Data
Senior
Full time
Remote work
Together Ai
San Francisco, CA
8 hours ago
Senior Network Engineer (US Remote) - Technology Vendor
$200k - $250k
...development? Join a fast-growing infrastructure software company backed by... ...automation platform for AI clouds, with 35+ live GPU... ...a great opportunity for a Senior Network Engineer to move beyond traditional... ...designing and implementing data center networking solutions...
Data
Senior
Full time
Remote work
Santa Clara, CA
9 days ago
Senior Software Engineer, Platform
...About David AI David AI is the first audio data research company. We bring... ...of former Scale AI engineers and operators. In less... ...build the pipelines, platforms, and models... ...product engineers, infrastructure specialists, and machine... ...this role As a Senior Software...
Data
Senior
Full time
Work at office
David AI
San Francisco, CA
8 hours ago
Senior IT Infrastructure Engineer
$130k - $160k
...read every application. No AI screening. A real person reviews... ...PayJunction is seeking a Senior IT Infrastructure Engineer to bring site reliability... ...runs on, and building the data platform we owe the business... .... Build and operate the pipelines that land MySQL, Salesforce...
Data
Senior
Full time
Temporary work
Work at office
Remote work
Home office
Flexible hours
PayJunction
Santa Barbara, CA
17 days ago
Senior Software Engineer, Developer Platform
$200k - $400k
...leading conversational AI platform empowering... ...About the Team The Infrastructure team builds and... ...Decagon: networking, data, ML serving, developer... ...We’re looking for a Senior Software Engineer to help build and evolve... ...Design reusable CI pipelines and deployment workflows...
Data
Senior
Full time
Work at office
Local area
Decagon
San Francisco, CA
8 hours ago
Senior Technical Marketing Engineer - Datacenter Networking
$128k - $201.25k
...Senior Technical Marketing Engineer For Datacenter NetworkingNVIDIA has been transforming... ...unlimited potential of AI to define the next era of... ...co-innovation working on data center networking products... ...deploying and automating network infrastructure in public/private clouds,...
Data
Senior
Work at office
NVIDIA
Santa Clara, CA
1 day ago
Senior Factory Infrastructure Engineer
$140k - $200k
...Job Description Job Description SENIOR FACTORY INFRASTRUCTURE ENGINEER Freeform builds AI-native manufacturing systems that unify software, hardware, and physics... ...monitoring systems leveraging sensors and data acquisition. This work is critical to the ultimate...
Data
Senior
Full time
For contractors
Casual work
Relocation package
Flexible hours
Freeform
Los Angeles, CA
24 days ago
Senior Software Engineer, AI Platform
...foundation for physical AI — a unified platform... ...We are looking for a Senior AI Engineer to design, build, and... ...— from the agentic infrastructure that powers our robot... ...multi-step reasoning pipelines, tool-calling workflows... ...internal APIs, robot data streams — enabling...
Data
Senior
Full time
Dexmate
Santa Clara, CA
8 hours ago
Senior Software Engineer - Platform Engineering
...Health combines software, data, and service into a... ...integrated, AI-driven platform that... ...We're looking for a Senior Platform Engineer to help design, scale... ...build scalable, reliable infrastructure that supports long-term... ...dashboards, and testing pipelines that surface...
Data
Senior
Full time
Remote work
Flexible hours
Pivotal Health
Los Angeles, CA
8 hours ago
Senior Software Engineer, Cloud Monitoring Service
$175k - $210k
.... As the only vertically integrated AI infrastructure company built from the ground up, we... ...experts across energy, manufacturing, data center construction, and cloud services... ...About the Role: We are seeking a Senior Software Engineer to build and own customer-facing observability...
Data
Senior
Full time
Temporary work
Crusoe
San Francisco, CA
8 hours ago
Senior Software Engineer - Core Cloud Platform
...Superintelligence Cloud, is a leader in AI cloud infrastructure serving tens of thousands of... ...Tuesday. About the Role As a Senior Software Engineer on Lambda’s Core Cloud Platform team... ...position has been set based on market data and other factors. However, a salary...
Data
Senior
Full time
Work experience placement
Work at office
Local area
Work from home
Flexible hours
Lambda
San Francisco, CA
8 hours ago
Senior Network Engineer
$180k - $240k
Get AI-powered advice on this job and more exclusive... ...Services - Network Engineering Employment Type: Full... ...and highly skilled Senior Network Engineer to join... ...enterprise network infrastructure. In this position, you... ...Protection, File Blocking, Data Filtering DNS...
Data
Senior
Full time
Tenth Revolution Group
Menlo Park, CA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Data Infrastructure/Pipeline Engineer. Be the first to apply!