Senior Data Engineer
United IT Solutions
Role : Senior Data Engineer - GCP
Location : Mountain View CA (Onsite)
What you'll do
Location : Mountain View CA (Onsite)
What you'll do
- Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine learning operations.
- Design, build, and maintain scalable and efficient data pipelines on GCP.
- Implement robust monitoring, logging, and alerting systems to ensure the reliability and stability of data infrastructure.
- Build scalable batch pipelines leveraging Big query, Dataflow and Airflow/Composer scheduler/executor framework on Google Cloud Platform
- Building data pipelines, leveraging Scala, Pub Sub, Akka, Dataflow on Google Cloud Platform
- Design our data models for optimal storage and retrieval and to meet machine learning modeling using technologies like Bigtable and Vertex Feature Store
- Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company
- Python Expertise: Write and maintain Python frameworks and libraries to support data processing and integration tasks.
- Code Management: Use Git and GitHub for source control, code reviews, and version management.
- GCP Proficiency: Extensive experience working with GCP services (e.g., BigQuery, Cloud Dataflow, Pub/Sub, Cloud Storage).
- Python Mastery: Proficient in Python with experience in writing, maintaining, and optimizing data processing frameworks and libraries.
- Software Engineering: Strong understanding of software engineering best practices, including version control (Git), collaborative development (GitHub), code reviews, and CI/CD.
- Data Management: Deep knowledge of data modeling, ETL/ELT, and data warehousing concepts.
- Problem-Solving: Excellent problem-solving skills with the ability to tackle complex data engineering challenges.
- Communication: Strong communication skills, including the ability to explain complex technical details to non-technical stakeholders.
- Data Science Stack: Proficiency in data analysis and familiarity with tools such as Jupyter Notebook, pandas, NumPy, and other Python data analysis libraries.
- Frameworks/Tools: Familiarity with machine learning and data processing tools and frameworks such as TensorFlow, Apache Spark, and scikit-learn.
- Bachelor's or master's degree in computer science, Engineering, Computer Information Systems, Mathematics, Physics, or a related field or software development training program
- Experience in Scala, Java, and/or any functional language. We code primarily in Scala, so you'll be excited to either ramp or continue with such
- Experience in microservices architecture, messaging patterns, and deployment models
- Experience in API design and building robust and extendable client/server contracts
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Mountain View, CA vacancy
$185k - $230k
The OpportunityWe are looking for a Senior Data Engineer to join our Data Platform team and build the core data foundations that power analytics, experimentation, and decision-making across the company. In this role, you will design and own foundational data models, pipelines...SeniorPermanent employment$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...SeniorFull timeLocal areaWork from home$164k - $261k
...plastics using AI and robotics, to make recycling more affordable and scalable.About the RoleWe are looking for a Machine Learning Data Engineer (DataOps) to build and unify the data infrastructure that powers our model training pipelines. In this role, you will lead the...SeniorFull timeRemote work$180k - $258.75k
...project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development...SeniorFull timeLocal areaShift work$128k - $249k
...our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift- ...Granica is seeking a Senior Software Engineer to build distributed compute systems for enterprise-scale data and AI workloads in Mountain View, CA. You will work on Spark, Spark SQL, Trino, Presto, Flink, and lakehouse formats to optimize performance and cost across petabyte...Senior
Granica Computing, Inc.
Mountain View, CA3 days ago - ...Cerebras Systems is seeking a Senior/Staff Data Engineer to own and evolve the data platform serving CBDA in Sunnyvale, CA. You will design and operate the warehouse, ingestion, and transformation systems that turn data into reliable analytics and product datasets....Senior
Engg
Sunnyvale, CA3 days ago - ...Senior CockroachDB Database Engineer / Site Reliability Engineer (SRE)Location: Sunnyvale, CAWe are seeking a highly skilled CockroachDB Database Engineer with strong Site Reliability Engineering (SRE) experience to design, implement, manage, and optimize large-scale...Senior
Resource Logistics
Sunnyvale, CA3 days ago - ...Job Title: Senior Data Engineer (High Priority) Location: Preferably Mountain View, CA; Hybrid Start Date: Immediate Duration: 6+ months Openings: 4 Senior Engineers About the Role We are seeking Senior Data Engineers to join an experienced...SeniorImmediate start
Info Way Solutions
Mountain View, CA3 days ago - ...Sr. Data EngineerMountain View, CA / Denver, CO / RemoteFull-TimePosition Summary:We are looking for a Sr. Data Engineer to join our growing Data Platform and Engineering teams. The ideal candidate has significant experience in building scalable data platforms that enable...Senior
1872 Consulting
Mountain View, CA3 days ago $251k - $310k
...Waymo Data Engineer PositionWaymo is an autonomous driving technology company with the mission to be the world's most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced...SeniorFull timeRemote workLatent Logic
Mountain View, CA2 hours ago- ...Senior Data EngineerLocation: Sunnyvale CA (Onsite)Duration: Long TermJob Description:GCP Experience • 4+ years of recent GCP experience... ...Bamboo, Jenkins, or TFSRoles and Responsibilities:As a Senior Data Engineer, you will • Design and develop big data applications using the...Senior
JConnect Infotech
Sunnyvale, CA3 days ago - ...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery... ...with a heavy focus on using cutting-edge technologies to build data intensive systems, designing and optimizing data models, and collaborating...Senior
Apple
Sunnyvale, CA1 day ago $182k - $242k
...CRWV) in March 2025. Learn more at What You’ll Do The Data Engineering Team builds and operates the foundational data infrastructure... ...and actionable at scale. About The Role We’re seeking a Senior Data Engineer to design and build the foundational datasets that...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA2 days ago$150k - $200k
...Senior Data EngineerGibson Dunn is a leading global law firm, advising clients on significant transactions and disputes. Our exceptional... ...combination of precision and vision.Based in the US, the Senior Data Engineer will be responsible for designing, building, and operating the...SeniorLocal areaFlexible hoursGibson Dunn
Palo Alto, CA2 days ago$119.8k - $234.7k
...Overview Microsoft Silicon Cloud Hardware Infrastructure Engineering (SCHIE) is the team behind Microsoft's expanding Cloud... ...and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization...SeniorOngoing contractPermanent employmentWork at officeLocal areaWorldwideMicrosoft Corporation
Mountain View, CA4 days ago- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and...Senior
- Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights, while leveraging internal tools and systems, databases and industry data Roles & Responsibilities Ability to document requirements, data lineage, subject...SeniorContract work
- ...Role Our products rely on management and semantic projection of data like Provider (doctor) information, Referrals, Patient charts and... ...Provider Matching, Scheduling, Referral Recommendation engine and AI voice agents. In this role, you will own the full lifecycle...SeniorFlexible hours
$150.4k - $277.6k
...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery... ...with a heavy focus on using cutting‑edge technologies to build data intensive systems, designing and optimizing data models, and collaborating...Senior- ...millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one... ...in robotic surgery requires high-quality data across the robotic platform, the surgical... ...and the operating room environment. The Senior AI/Data Science Engineer will advance the...SeniorLocal areaWorldwideFlexible hours
- ...Job Description Job Description Description: TSW Core is looking for a highly motivated Data Engineer. In this role, you will be responsible for designing and implementing robust data warehouse architectures, enabling data-driven decision-making through scalable...Senior
TSW Core LLC
Palo Alto, CA20 days ago $175k - $200k
Overview East West Bank is looking for a motivated Senior Data Engineer to contribute towards the success of our Data and Analytics Technology initiatives. This is a hands‑on technical role and this person will be responsible for the development and build of scalable solutions...SeniorWork experience placement$117k - $234k
...OfficePosition Summary...What you'll do...Role summary:The Senior Software Engineer will lead the delivery of scoped features and models through... ...’s mission and operational goals.About the team:The MarTech Data Engineering team develops scalable, multi-tenant engineering...SeniorFull timeTemporary workPart time$157k - $210k
...CoreWeave plans, sources, builds, and delivers data center capacity for our customers. We partner closely with Supply Chain, Product Engineering, Data Center Operations, and the... ...analytical findings and recommendations to senior leadership in a clear, actionable format....SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA12 days ago$130.6k - $285k
...About the Team Data is at the foundation of DoorDash success. The Data Engineering team builds database solutions for various use cases including reporting, product... ...About the Role DoorDash is looking for a Senior Data Engineer to be a technical powerhouse to...SeniorHourly payFull timeWork at officeLocal areaRemote workFlexible hours- ...JPMorganChase is seeking a Senior Director of Software Engineering to lead Data and AI platforms within the Commercial and Investment Bank Operations group. You will oversee multiple departments, set technical strategy, and drive enterprise-wide AI-enabled engineering...Senior
- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...SeniorRemote work
$184k - $287.5k
...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all the... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our...SeniorFull time- ...4-06-04Company Name:HITACHI ENERGY USA INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote:NoJob Description:General information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- aws data engineer Mountain View, CA
- data science developer Mountain View, CA
- sr information security engineer Mountain View, CA
- senior data engineer Mountain View, CA
- data engineer machine learning Mountain View, CA
- junior data engineer remote Mountain View, CA
- data center engineer Mountain View, CA
- data developer Mountain View, CA
- senior data center engineer Mountain View, CA
- senior data quality engineer Mountain View, CA