Senior Data Engineer
United IT Solutions
Role : Senior Data Engineer - GCP
Location : Mountain View CA (Onsite)
What you'll do
Location : Mountain View CA (Onsite)
What you'll do
- Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine learning operations.
- Design, build, and maintain scalable and efficient data pipelines on GCP.
- Implement robust monitoring, logging, and alerting systems to ensure the reliability and stability of data infrastructure.
- Build scalable batch pipelines leveraging Big query, Dataflow and Airflow/Composer scheduler/executor framework on Google Cloud Platform
- Building data pipelines, leveraging Scala, Pub Sub, Akka, Dataflow on Google Cloud Platform
- Design our data models for optimal storage and retrieval and to meet machine learning modeling using technologies like Bigtable and Vertex Feature Store
- Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company
- Python Expertise: Write and maintain Python frameworks and libraries to support data processing and integration tasks.
- Code Management: Use Git and GitHub for source control, code reviews, and version management.
- GCP Proficiency: Extensive experience working with GCP services (e.g., BigQuery, Cloud Dataflow, Pub/Sub, Cloud Storage).
- Python Mastery: Proficient in Python with experience in writing, maintaining, and optimizing data processing frameworks and libraries.
- Software Engineering: Strong understanding of software engineering best practices, including version control (Git), collaborative development (GitHub), code reviews, and CI/CD.
- Data Management: Deep knowledge of data modeling, ETL/ELT, and data warehousing concepts.
- Problem-Solving: Excellent problem-solving skills with the ability to tackle complex data engineering challenges.
- Communication: Strong communication skills, including the ability to explain complex technical details to non-technical stakeholders.
- Data Science Stack: Proficiency in data analysis and familiarity with tools such as Jupyter Notebook, pandas, NumPy, and other Python data analysis libraries.
- Frameworks/Tools: Familiarity with machine learning and data processing tools and frameworks such as TensorFlow, Apache Spark, and scikit-learn.
- Bachelor's or master's degree in computer science, Engineering, Computer Information Systems, Mathematics, Physics, or a related field or software development training program
- Experience in Scala, Java, and/or any functional language. We code primarily in Scala, so you'll be excited to either ramp or continue with such
- Experience in microservices architecture, messaging patterns, and deployment models
- Experience in API design and building robust and extendable client/server contracts
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Mountain View, CA vacancy
$185k - $230k
The OpportunityWe are looking for a Senior Data Engineer to join our Data Platform team and build the core data foundations that power analytics, experimentation, and decision-making across the company. In this role, you will design and own foundational data models, pipelines...SeniorPermanent employmentOtter.ai
Mountain View, CA1 day ago$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...SeniorFull timeLocal areaWork from homeNews Break
Mountain View, CA5 days ago- ...country where we have a legal entity. Responsibilities ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be responsible for designing premier data architecture and solutions...SeniorWork at officeLocal area
Atlassian
Mountain View, CA5 days ago $117k - $234k
...you'll do:Design, build, test, and deploy scalable, intelligent data solutions that support millions of Sam’s Club customers—while... ...Agentic AI systems that consume and act on this data. Partner with engineering, AI/ML, and product teams to ensure data services are...SeniorWalmart
Sunnyvale, CA2 days ago$164k - $261k
...using AI and robotics, to make recycling more affordable and scalable.About the RoleWe are looking for a SeniorMachine Learning Data Engineer (DataOps) to build and unify the data infrastructure that powers our model training pipelines. In this role, you will lead the effort...SeniorFull timeRemote workX Company
Mountain View, CA2 days ago$180k - $258.75k
...project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development...SeniorFull timeLocal areaShift workToyota Research Institute
Los Altos, CA1 day ago$128k - $249k
...our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shiftK&L Gates
Palo Alto, CA3 days ago- ...Sterling B2B Developer Role: Senior Data Engineer Location: Dallas, TX or Mountain View, CA Duration: Long Term Contract As part of the Mail Analytics Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse,...SeniorLong term contract
Hermitage Infotech
Mountain View, CA5 days ago $175k - $221k
...Senior Data Infra Engineer Mountain View, California, United States NewsBreak reaches tens of millions of users every day. Every feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We...SeniorFull timeNewsBreak
Mountain View, CA4 days ago$251k - $310k
...Waymo Data Engineer Position Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced...SeniorFull timeRemote workLatent Logic
Mountain View, CA5 days ago- ...Sr. Data Engineer Mountain View, CA / Denver, CO / Remote Full-Time Position Summary: We are looking for a Sr. Data Engineer to join our growing Data Platform and Engineering teams. The ideal candidate has significant experience in building scalable data platforms...SeniorFull timeRemote work
1872 Consulting
Mountain View, CA4 days ago $182k - $242k
...Senior Data Engineer Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA4 days ago$180k - $220k
...our Palo Alto office to support collaborative team dynamics and innovative problem-solving. BitGo is seeking a skilled Senior Data Engineer to join our Data Engineering team and help build, scale, and optimize our data platform, reporting infrastructure, and data-...SeniorFull timeWork experience placementWork at officeWorldwideBitGo, Inc.
Palo Alto, CA4 days ago$150k - $200k
...Senior Data Engineer Gibson Dunn is a leading global law firm, advising clients on significant transactions and disputes. Our exceptional teams craft and deploy creative legal strategies that are meticulously tailored to every matter, however complex or high-stakes...SeniorLocal areaFlexible hoursGibson Dunn
Palo Alto, CA1 day ago- ...Anvilogic Inc. in Palo Alto, CA, seeks a Senior Data Operations Engineer to optimize Snowflake environments for customers, manage onboarding, and monitor data platforms for reliability and cost efficiency. You will collaborate with Customer Success and Sales Engineering...Senior
$117k - $234k
...PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary:The Senior Software Engineer will lead the delivery of scoped features and models through... ...’s mission and operational goals.About the team:The MarTech Data Engineering team develops scalable, multi-tenant engineering...SeniorFull timeTemporary workPart timeWalmart
Sunnyvale, CA4 days ago- We are looking for a highly experienced Senior Data Engineer to join our growing AI technology team. In this role, you will design, build, and scale the data infrastructure that powers our AI/ML platforms, products, analytics, and intelligent applications . The ideal candidate...SeniorVisa sponsorship
- ...Role: Data Engineer Location: Charlotte, NC/ Boston, Qunicy, MA/ Atlanta, GA/ OWING MILLS MD/ Blue Bell, PA/ Jacksonville, FL/ Seattle, WA/ Eden Prairie, MN/ Detroit, MI/ Irvine, Sunnyvale, CA/ Irving, TX/ Jersey City, NJ Term: Full Time Job Description...SeniorFull time
SFE
Sunnyvale, CA2 days ago - ...Job Description Job Description Description: TSW Core is looking for a highly motivated Data Engineer. In this role, you will be responsible for designing and implementing robust data warehouse architectures, enabling data-driven decision-making through scalable...Senior
TSW Core LLC
Palo Alto, CAa month ago $83.98 - $111.27 per hour
...to be discovered. Day - 08 Hour (United States of America) Stanford Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical to our mission of leveraging data to drive clinical innovation...SeniorHourly payLE0010 Stanford Health Care
Palo Alto, CA5 days ago- ...GRAIL seeks a Senior/Staff Data Integrity Engineer to ensure compliance with data integrity standards across the organization's data lifecycle. This role functions as a subject matter expert within the Data Integrity Office, managing regulatory compliance, quality assurance...SeniorWork at office
GRAIL
Sunnyvale, CA5 days ago - ...Google is seeking a senior Technical Design, Engineering and Construction leader in Sunnyvale, CA to oversee complex facilities such as data centers and heavy labs. You will manage the full technical lifecycle, providing guidance and developing business cases to secure...Senior
- Unity Technologies SF is seeking a Senior Machine Learning Engineer, Data Infrastructure, to design and evolve the offline data platform that enables model training and experimentation at scale. You will build reliable pipelines for training data generation and orchestrate...Senior
- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...SeniorRemote work
Tredence
San Jose, CA1 day ago $240k - $320k
...autonomous driving platforms, and we are looking for senior electrical and system integration engineers to define, build, and scale our vehicle platform hardware... ...the Senior Principal Engineer - ADAS & AV Data Loop & AI Flywheel, you will spearhead the architectural...SeniorFull timeWork experience placementLocal areaFlexible hoursRobert Bosch
Sunnyvale, CA3 days ago- ...4-06-04Company Name:HITACHI ENERGY USA INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote:NoJob Description:General information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities...SeniorFull time
Hitachi
Santa Clara, CA1 day ago - ...Improving patient outcomes. As a market leader in AI-driven, data-powered, and privacy-compliant healthcare engagement, we connect... ...brands connect with patients and HCPs. About the roleAs a Senior Data Engineer, you will own NimbleRx’s data platform — the layer that every...SeniorTemporary workLive out
Nimble Rx
Redwood City, CA4 days ago - ...has access to healthcare today and for generations to come. Join Roche, where every voice matters.The PositionAs a Senior Data Scientist - ML Engineering, you will join the Global Analytics and Technology Center of Excellence (GATE) in San José, Costa Rica. In this role...SeniorFull timeRelocation package
Roche
San Jose, CA1 day ago $184k - $287.5k
...autonomous-driving simulation. NuRec converts real-world sensor data into high-fidelity, simulation-ready driving environments.... ...variations beyond the original sensor path. We seek a Senior Synthetic Data Engineer to join the NVIDIA DRIVE team and contribute to automotive...SeniorFull timeRemote workNvidia
Santa Clara, CA1 day ago$138k - $189.75k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...SeniorFull timeASML Holding
San Jose, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer Mountain View, CA
- entry level big data engineer Mountain View, CA
- senior data quality engineer Mountain View, CA
- senior cloud data engineer Mountain View, CA
- software data engineer Mountain View, CA
- data infrastructure engineer Mountain View, CA
- senior data center engineer Mountain View, CA
- data center engineer Mountain View, CA
- senior data engineer Mountain View, CA
- finance data engineer Mountain View, CA