Senior Data Engineer

Full-time

Tech pillars Technologies

Job Title: Senior Data Engineer Databricks / PySpark

Location: Los Angeles / Irvine, CA, USA

Experience: 8+ Years

Work Mode: Day 1 Onsite 3 Days per Week at Client Office

Important: Billing starts once the candidate joins at the client office.

Must-Have Technical Skills

Databricks: Strong hands-on production experience with Databricks.
Apache Spark: Spark, PySpark, distributed data processing.
Delta Lake: Delta Tables, Data Management, Data Optimization.
Data Pipelines: Design, develop, and maintain production-grade data pipelines.
Databricks Workflows: Jobs, Workflows, Scheduling, Monitoring, and Troubleshooting.
Data Engineering: Data Ingestion, Transformation, ETL/ELT, and Pipeline Optimization.

AI-Assisted Development (Important)

Candidates must demonstrate practical experience using AI coding agents and measurable productivity improvements.

Experience with Claude Code, GitHub Copilot, or similar AI coding tools.
Writing context files, specifications, and instructions for AI agents.
Setting up repositories with agent-friendly documentation and coding conventions.
Reviewing AI-generated code for correctness, security, and performance.
Building or reusing AI prompts, skills, and development workflows.
Demonstrating measurable productivity improvements through AI-assisted development.

Key Responsibilities

Build and maintain production-grade data pipelines using Databricks.
Develop scalable data processing solutions using Spark and PySpark.
Work with Delta Tables, Databricks Jobs, and Workflows.
Optimize pipeline performance and troubleshoot production issues.
Leverage AI coding agents to improve development productivity and code quality.
Collaborate with engineering teams to deliver reliable data solutions.

Apply

Vacancy posted 6 days ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Irvine, CA vacancy

Senior Data Engineer
$183k - $243k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...military in months, not years. ABOUT THE TEAM As a Data Engineer on the Analytics Team, you will be collaborating with stakeholders...
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
2 days ago
Senior Architect-Data Engineer
...Job Description Job Description Job Description Senior Architect Data Engineering Role Overview We are seeking a visionary and hands-on Senior Data Engineering Architect to design, scale, and optimize our enterprise data platform. In this role, you will define...
Senior
ClifyX, INC
Irvine, CA
17 days ago
Senior Specialist - Data Engineering
Job Role : L3 Support IDMC (Informatica Intelligent Data Management)Job Location : Irvine,CaliforniaJob description :Provide L2 L3 production support for Informatica MDM platformMaintain high availability of MDM CDIPC and associated integrationsPerform root cause analysis...
Senior
LTM
Irvine, CA
3 days ago
Senior Analytics Engineer, Product Development Data & Analytics
$135.1k - $168.9k
...desire to protect it for future generations. Role Summary We are seeking a highly skilled Senior Analytics Engineer to join our Product Development Data & Analytics team. Our team partners with groups across Product Development, Supply Chain, and Manufacturing...
Senior
Full time
Contract work
Temporary work
Part time
Local area
Shift work
Rivian
Irvine, CA
3 days ago
Senior Analytics Engineer
$166k - $220k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...for our data platformPartner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure...
Senior
Full time
Work experience placement
Immediate start
Shift work
Anduril Industries
Costa Mesa, CA
3 days ago
Senior Analytics Engineer
$150k - $180k
Senior Analytics EngineerLocation: Orange County, CA (Hybrid)Salary: $150-180k baseWe are partnered with... ...continues to scale, they are investing heavily in their data platform and are looking to hire a Senior Analytics Engineer to help build and expand the company's core data...
Senior
Harnham
Orange, CA
5 days ago
BAU/L3 - Data Engineer - L3 Support Engineer (Sr)
...Job Description Job Description Qualification Job Description BAU/L3 - Data Engineer - L3 Support Engineer (Sr) This role requires coordination between onshore, nearshore, and offshore teams Required Skills Strong experience with Databricks, Apache Spark...
Senior
ClifyX, INC
Irvine, CA
19 days ago
Sr. Analytics Engineer
$150k - $225k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...in an analytics focused role – Analytics Engineer, Data Engineer or Analyst / Consultant... ...at Anduril Industries by 2x Seniority level ~ Mid‑Senior level Employment...
Senior
Full time
Work experience placement
Local area
Relocation package
Weekend work
Anduril Industries
Costa Mesa, CA
1 day ago
Senior Robotics Engineer, Data & Perception
$180k - $230k
...automating this work is how we help bring complex manufacturing back to the U.S. We're looking for a Senior Engineer to own the technical implementation of the data and perception layer in our Automation Program: the cameras, sensors, pipelines, and models that turn...
Senior
Permanent employment
Work at office
Local area
Flexible hours
Senra Systems
Irvine, CA
18 days ago
Early Career - Durability Analytics Engineer
$96.7k - $120.9k
...Role Summary No Visa Sponsorship The Durability Attribute engineers predict and test the range of loads and stresses Rivian... ...problem with many unknowns. With access to large-scale vehicle fleet data and software-defined vehicles that offer greater scope for control...
Full time
Contract work
Temporary work
Part time
Local area
Visa sponsorship
Shift work
Rivian
Irvine, CA
2 days ago
Principal Data Engineer
$124.4k - $235.7k
...Skyworks Solutions, Inc. is seeking a talented Principal Data Engineer to lead our Databricks and data development initiatives working closely with the business and the data architect to implement solutions. As a Principal Data Engineer, you will collaborate with Skyworks...
Flexible hours
Skyworks Solutions
Irvine, CA
3 days ago
Senior Data Engineer
...Description:What You'll DoDesign, build, and maintain scalable data pipelines and integration solutions using Snowflake, DBT, Matillion... ...with business stakeholders, product owners, architects, and engineers to deliver scalable, reliable, and high-performing data...
Senior
Full time
Flexible hours
Pacific Life Insurance Company
Newport Beach, CA
3 days ago
Sr Databricks Data Engineer
$116.2k - $229.1k
Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform... ...technology platforms, modernize data environments, and unlock value through innovation... ...From entry-level employees to senior leaders, we believe there’s always room to...
Senior
Local area
Visa sponsorship
Deloitte
Costa Mesa, CA
2 days ago
Senior Marketing Systems Engineer - Data & Automation
...event pipelines, and refine attribution models to drive lead quality and revenue insights. The role emphasizes server-side tracking, data cleanliness, and cross-channel dashboards to support growth and performance analysis in a fast-paced environment. #J-18808-Ljbffr...
Senior
Full time
Five Star Tax Resolution, INC
Costa Mesa, CA
3 days ago
Senior Thermal Engineer, Expeditionary AI / HPC Data Centers
$161k - $212k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...years. About the Team The Thermal Engineering team's work is essential to support our... ...About the Role We are looking for a Senior Thermal Engineer in Costa Mesa, CA to own...
Senior
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
6 days ago
Data Engineer - 100% onsite
Data Engineer III We have an excellent opportunity for a full-time Data Engineer III in the I.T. department in our Irvine, CA office. This role operates in a highly collaborative environment where Data Engineers work across data integration, development, data platform...
Full time
Work at office
Remote work
Calance
Irvine, CA
4 days ago
Senior Product Engineer, Data
$183k - $243k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... .... For this role, that’s where the work begins.As a Product Engineer on the Data team, you’ll build internal products on top of Anduril...
Senior
Full time
Work experience placement
Immediate start
Anduril Industries
Costa Mesa, CA
3 days ago
Senior Power Engineer - Data Center Electrical Systems
$82.5k - $137.5k
...customers experience continuous intelligence during design and engineering and into operations and maintenance using a unified... ...is proud to be an Equal Opportunity Employer.Job Title: Senior Staff Engineer - Data Center Electrical SystemsLocation: Irvine, CAEmployment Type...
Senior
Full time
Local area
Worldwide
ETAP
Irvine, CA
3 days ago
Data & Analytics Engineer
...Primary Objective of Position The data and analytics capabilities supporting Revelyst positioned in our Irvine, California office... ...analytics. The successful candidate will combine strong data engineering fundamentals, including hands-on Databricks and Spark experience...
Work at office
Revelyst Operations
Irvine, CA
2 days ago
Senior Data Platform Engineer
...hardware, and improve through real deployments, Irvine is the place. We go beyond typical data-driven approaches or pure transformer-only architectures, combining rigorous engineering with learning systems proven in globally deployed solutions that deliver results today...
Senior
Full time
field-ai
Irvine, CA
2 days ago
Lead Data Engineer
$180k - $190k
...Location: Tustin, CA Salary: $180,000.00 USD Annually - $190,000.00 USD Annually Description: Lead Data Engineer (EDO Platform Engineering Lead) Location: Irvine, CA Salary: $180,000-$190,000 About the Role We are seeking an experienced Lead Data...
Work at office
Immediate start
Judge Group, Inc.
Tustin, CA
3 days ago
Data Ops Engineer, Product Lifecycle Analytics
Anduril Industries is seeking a Data Operations Engineer to architect, build, and deploy critical tooling across its product portfolio. You will bridge the CEO Office and product teams, designing analytics that consolidate diverse datasets for executive reporting. You...
Work at office
Anduril Industries
Costa Mesa, CA
4 days ago
Associate Principal - MDM Data Engineering
...Overseas Contractor with 11 to 15 years of expertise in Informatica MDM and Informatica Cloud MDM to lead and optimize enterprise Master Data Management solutions. Job Description: Lead the architecture design and implementation of Informatica MDM solutions including both...
For contractors
Overseas
LTM
Irvine, CA
14 hours ago
Lead Data Scientist (Context Engineering)
$154k - $192.5k
...Marketing, Sales, and Market Intelligence-and is building the semantic and data infrastructure that makes intelligent agents possible at scale. As a Staff/Lead Data Scientist focused on Context Engineering, you will design the knowledge layer that AI agents reason from-...
Full time
Contract work
Temporary work
Part time
Work at office
Local area
Shift work
Rivian
Irvine, CA
4 days ago
Senior Data Platform Engineer
...hardware, and improve through real deployments, Irvine is the place. We go beyond typical data-driven approaches or pure transformer-only architectures, combining rigorous engineering with learning systems proven in globally deployed solutions that deliver results today...
Senior
Local area
FieldAI
Irvine, CA
24 days ago
Summer 2027 Data Engineering Internship
$25 per hour
...fresh perspectives to help us innovate and build meaningful relationships for years to come. We are currently looking to add Data Engineering Interns to our team for Summer 2027 at a Fortune 500 company in the financial services industry. As a Data Engineering Intern...
Hourly pay
Full time
Summer work
Internship
Summer internship
Work at office
Relocation
Flexible hours
Pacific Life Insurance
Newport Beach, CA
4 days ago
Supply Chain Master Data Engineer — Data Quality
Anduril Industries, Inc. is seeking a Supply Chain Master Data Engineer to govern and improve master data across supplier records, part information, and contractual data. The role partners with operations, product, and engineering to implement data governance and supporting...
Anduril Industries, Inc.
Costa Mesa, CA
3 days ago
Workday PSA & Financials Data Engineer
$118.8k - $161.9k
...passionate about, in industries you care about.Workday PSA & Financials Data EngineerArmanino is proud to be among the top 20 Largest... ...investigation and escalation by partnering with cross team engineers on Workday design decisions.Collaborate with Workday Security Team...
Full time
Contract work
Local area
Armanino
Irvine, CA
3 days ago
Data Engineer
The Data & AI Engineer is part of the Group Data division within the IT team and will provide data management solutions while helping evolve the organization's AI capabilities to support business growth, particularly in the U.S. This role will help architect, build, and...
Real Staffing Group
Irvine, CA
4 days ago
Data Engineer II
$91.1k - $179.5k
...Recruiting for this role ends on 10/30/2026. Work you'll do The Data Engineer Consultant will support data architecture and engineering... ...Professional development From entry-level employees to senior leaders, we believe there’s always room to learn. We offer opportunities...
Local area
Deloitte
Costa Mesa, CA
14 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!