Senior Data Engineer
New York Technology Partners
We're looking for a hands-on Senior Data Engineer to build and support enterprise-scale data solutions using Databricks and modern cloud data technologies. This role will focus on developing scalable data pipelines, optimizing Spark workloads, orchestrating workflows, and supporting reliable production data environments. Key Responsibilities Build and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, and SQL Develop and optimize batch and streaming data workflows Create and manage Airflow DAGs and workflows using Astronomer Optimize Spark workloads and troubleshoot production pipeline issues Implement data quality, monitoring, and reliability standards Support CI/CD, infrastructure automation, and production deployments Partner with technical and business teams to deliver scalable data solutions Required Experience 7+ years of Data Engineering experience Strong hands-on Databricks and Apache Spark experience Advanced PySpark and SQL skills Strong Apache Airflow and Astronomer experience Experience with Terraform, Pulumi, or similar infrastructure-as-code tools Experience building production-grade ETL/ELT pipelines Cloud experience with AWS, Azure, or GCP Experience with Git, CI/CD, monitoring, and production support Nice to Have Delta Lake and Unity Catalog dbt Kafka or Structured Streaming Financial services or other regulated industry experience #J-18808-Ljbffr
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Irvine, CA vacancy
- Job Role : L3 Support IDMC (Informatica Intelligent Data Management)Job Location : Irvine,CaliforniaJob description : Provide L2 L3 production support for Informatica MDM platformMaintain high availability of MDM CDIPC and associated integrationsPerform root cause analysis...Senior
$166k - $220k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...to the military in months, not years.ABOUT THE TEAMAs a Data Engineer on the Analytics Team, you will be collaborating with stakeholders...SeniorFull timeWork experience placementImmediate startShift work- ...Edwards Lifesciences in Irvine, CA is seeking a Senior Data Engineer to design and deliver enterprise data products on the Databricks Lakehouse Platform. You will build scalable, production-grade pipelines and analytics assets spanning batch and near-real-time processing...Senior
Edwards Lifesciences
Irvine, CA7 hours ago - ...Job Title: Sr Data Engineer *** or RV Tech: RV Tech Worksite location: Remote with Bill rate*** please keep in mind location of the candidate. Submit at market rate*** Would prefer someone in Pacific, Mountain or Central time zone in that order, if possible....SeniorRemote workShift work
BayOne Solutions
Irvine, CA2 days ago - ...Senior Data EngineerLocation: Irvine, CA (Onsite)Fulltime – PermanentWe are seeking a hands-on Senior Data Engineer to design, build, optimize, and support enterprise-scale data solutions on the Databricks Lakehouse Platform. The role will develop reliable batch and streaming...SeniorFull time
AceStack LLC
Irvine, CA2 days ago $175k - $220k
...developers rely on every day. We're looking for people who care deeply, build with urgency, and want to matter at scale. As a Senior Data Engineer, you will be tasked with designing and implementing robust data solutions that support scalable analytics and data-driven...SeniorRemote workHome officeVisa sponsorshipWork visaFlexible hoursGrabJobs
Irvine, CA1 day ago$166k - $220k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...for our data platformPartner with operations, product, and engineering to advocate best practices and build supporting systems and infrastructure...SeniorFull timeWork experience placementImmediate startShift work$108k - $153k
...driving force to help patients live longer and healthier lives. Join us and be part of our inspiring journey. We’re seeking a Senior Data Engineer with strong enterprise experience delivering data product solutions on the Databricks Lakehouse Platform. The ideal...SeniorRelocation packageJobCubby
Irvine, CA5 days ago- ...We are looking for a Senior Data Engineer to help design, build, and scale the data systems that power how Foley operates and grows. In this role, you will build reliable data pipelines, contribute to our enterprise data architecture, and help improve how data is modeled...SeniorContract workRemote work
GrabJobs
Costa Mesa, CA4 days ago $166k - $220k
...OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As... ...Classified Systems from the ground up.ABOUT THE JOBAs a Senior Data Protection Engineer on our Classified Systems team, you'll own how sensitive data...SeniorFull timeFor contractorsWork experience placementImmediate startRemote work- ...Java/ Webservices Engineer Seeking an experienced hands-on Java / Webservices engineer with experience across all aspects of the Software... ..., and support for complex business applications that involve data management and utilization heavily. You will be responsible for...Senior
InterSources
Irvine, CA2 days ago - Anduril Industries, based in Costa Mesa, California, is looking for a Data Engineer to join their People Data & Analytics team. This role involves designing, building, and optimizing data pipelines to enhance decision-making through strategic insights from HR data. The...Senior
- Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines...Senior
$191k - $253k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...think data applications rather than just dashboards. As a Staff Engineer, you should be a player-coach; your role is to set an example...SeniorFull timeWork experience placementWork at officeImmediate startShift workAnduril Industries
Costa Mesa, CA4 days ago- Harnham in the United States (CA) is seeking an experienced Analytics/Data Engineer to design scalable data models, build production-grade data products, and drive data-driven decision making across manufacturing, supply chain, and finance. You will work with analytics...Senior
$150k - $180k
...global performance and enable consumers to enjoy a seamless, effortless lifestyle. Key Responsibilities Develop and maintain the Big Data Platform by performing data cleansing, data warehouse modeling, and report development on large datasets. Collaborate with cross‑...SeniorLocal areaWorldwide$124k - $280k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions... ...that meet current and future business needs. As a Senior Manager you lead large projects, innovate processes, and maintain...SeniorH1bPwC
Irvine, CA3 days ago- ...software-defined systems to support national security and operational readiness. This is a senior seat on a ~30-person data organization, joining a team of analytics and data engineers embedded directly within business domains. Work is project-based (6-8 week cycles) and...SeniorVisa sponsorship
- Harnham is recruiting for a senior analytics engineer to join a fast-growing defense technology company building autonomous systems and hardware... ...allied governments. You will be embedded within a 30-person data organization, owning end-to-end data modeling and data...Senior
$166k - $220k
...Lattice OS, an AI‑powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...of our people data platform and tooling, advocating for engineering best practices, automation, and a scalable analytics ecosystem...SeniorFull timeWork experience placementFlexible hours$96.55k - $138.06k
...Job Description Job Description 10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai AutoEver America (HAEA) is the dynamic IT powerhouse behind Hyundai Motor Corporation, a Fortune 500 global leader in the automotive industry. As...SeniorLocal areaHyundai Autoever America
Irvine, CA16 days ago$123k - $163k
...year Requirements: Over 6 years of experience in analytics engineering, data analytics, or business intelligence roles Proficiency in... ...AI DevOps Support LESS More: We are seeking a Senior Analytics Engineer for a contract-to-hire opportunity based in...SeniorFull timeContract workRemote workFlexible hoursKforce Technology Staffing
Irvine, CA7 days ago$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...(UAS) threats. Working across product, engineering, sales, logistics, operations, and... ...worldwide.ABOUT THE JOBWe are seeking a Senior Mission Data Platform Engineer to design,...SeniorFull timeWork experience placementImmediate startWorldwide- ...Sr. Data EngineerLocation: Hybrid, 3x onsite in Costa Mesa, CA Duration: Long Term ContractTop Skills:Must be able to use personal... ...rent. They are a Microsoft shop.10+ years of experience in data engineering or a related role.Proficiency in AWS services, specifically S3,...Senior
Group Nine LLC
Costa Mesa, CA4 days ago $150k - $220k
...platform integrates heterogeneous real-world data sources and generates evidence with the... ...and collaborative, bringing together engineering, product, design, QA, and clinical domain... ...inconsistent, and constantly changing. We need a Senior Data Engineer who knows how to build...SeniorRemote workGrabJobs
Santa Ana, CA4 days ago$145k - $165k
...Megazone Cloud is looking for a Senior Data Engineer to help lead and define our data-driven culture. You are a "builder" at heart, a seasoned expert who thrives on solving complex problems. You have a startup mentality, a thirst for knowledge, and the ability to lead...SeniorImmediate startFlexible hoursMegazoneCloud US
Irvine, CA3 days ago- ...Senior Data EngineerLocation: Newport Beach, CA or Charlotte, NCKey Responsibilities:Work with technology and business stakeholders to... ..., QA, and other team members.Qualifications:5+ years of data engineering experience.BS Degree: IT or Computer Science or Engineering.Minimum...SeniorContract workInterim role
Platinum Resource Group
Newport Coast, CA4 days ago $130k - $150k
..., we take care of you. Would you like to be part of our story? Don't hesitate, come and join us! About this opportunity – Sr Data & AI Engineer - ON-SITE: IRVINE, CA Description The Data & AI Engineer at Balt is part of the Group Data division within the IT team and will...SeniorWork at officeRemote workBalt USA
Irvine, CA3 days ago$150k - $200k
...Senior Data Engineer Gibson Dunn is a leading global law firm, advising clients on significant transactions and disputes. Our exceptional teams craft and deploy creative legal strategies that are meticulously tailored to every matter, however complex or high-stakes...SeniorLocal areaFlexible hoursGibson Dunn
Orange, CA2 days ago$82.5k - $137.5k
...customers experience continuous intelligence during design and engineering and into operations and maintenance using a unified... ...is proud to be an Equal Opportunity Employer.Job Title: Senior Staff Engineer - Data Center Electrical SystemsLocation: Irvine, CAEmployment Type...SeniorFull timeLocal areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- aws data engineer Irvine, CA
- data science developer Irvine, CA
- sr information security engineer Irvine, CA
- senior data engineer Irvine, CA
- data engineer machine learning Irvine, CA
- junior data engineer remote Irvine, CA
- data center engineer Irvine, CA
- data developer Irvine, CA
- senior data center engineer Irvine, CA
- senior data quality engineer Irvine, CA