Senior Data Engineer
United IT Solutions
Role : Senior Data Engineer - GCP
Location : Mountain View CA (Onsite)
What you'll do
Location : Mountain View CA (Onsite)
What you'll do
- Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine learning operations.
- Design, build, and maintain scalable and efficient data pipelines on GCP.
- Implement robust monitoring, logging, and alerting systems to ensure the reliability and stability of data infrastructure.
- Build scalable batch pipelines leveraging Big query, Dataflow and Airflow/Composer scheduler/executor framework on Google Cloud Platform
- Building data pipelines, leveraging Scala, Pub Sub, Akka, Dataflow on Google Cloud Platform
- Design our data models for optimal storage and retrieval and to meet machine learning modeling using technologies like Bigtable and Vertex Feature Store
- Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company
- Python Expertise: Write and maintain Python frameworks and libraries to support data processing and integration tasks.
- Code Management: Use Git and GitHub for source control, code reviews, and version management.
- GCP Proficiency: Extensive experience working with GCP services (e.g., BigQuery, Cloud Dataflow, Pub/Sub, Cloud Storage).
- Python Mastery: Proficient in Python with experience in writing, maintaining, and optimizing data processing frameworks and libraries.
- Software Engineering: Strong understanding of software engineering best practices, including version control (Git), collaborative development (GitHub), code reviews, and CI/CD.
- Data Management: Deep knowledge of data modeling, ETL/ELT, and data warehousing concepts.
- Problem-Solving: Excellent problem-solving skills with the ability to tackle complex data engineering challenges.
- Communication: Strong communication skills, including the ability to explain complex technical details to non-technical stakeholders.
- Data Science Stack: Proficiency in data analysis and familiarity with tools such as Jupyter Notebook, pandas, NumPy, and other Python data analysis libraries.
- Frameworks/Tools: Familiarity with machine learning and data processing tools and frameworks such as TensorFlow, Apache Spark, and scikit-learn.
- Bachelor's or master's degree in computer science, Engineering, Computer Information Systems, Mathematics, Physics, or a related field or software development training program
- Experience in Scala, Java, and/or any functional language. We code primarily in Scala, so you'll be excited to either ramp or continue with such
- Experience in microservices architecture, messaging patterns, and deployment models
- Experience in API design and building robust and extendable client/server contracts
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Mountain View, CA vacancy
$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...SeniorFull timeLocal areaWork from home$117k - $234k
...time / Regular/PermanentCompany: WalmartBusiness Segment: Home OfficePosition Summary...What you'll do...Role summary: As a Senior Data Engineer, you will design, develop, and maintain scalable data pipelines and models that support critical business decisions....SeniorFull timeTemporary workPart time$117k - $234k
...OfficePosition Summary...What you'll do...About the TeamInternational Data Management (IDM) team powers enterprise-scale data platforms... ...smart design and optimization strategiesDevelop AI-driven engineering solutionsBuild internal tools, utilities, and AI agents to accelerate...SeniorFull timeTemporary workPart time$180k - $258.75k
...project is harmonious with TRI’s robotics divisions' efforts in Diffusion Policy and Large Behavior Models.We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development...SeniorFull timeLocal areaShift work$128k - $249k
...our search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group,...SeniorFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$117k - $234k
...You have a passion to drive critical business initiatives with Data. You love writing and owning codes and enjoy working with people... ...AI systems that consume and act on this data. Partner with engineering, AI/ML, and product teams to ensure data services are discoverable...SeniorFull timeTemporary workPart time- ...Job Title: Senior Data Engineer (High Priority) Location: Preferably Mountain View, CA; Hybrid Start Date: Immediate Duration: 6+ months Openings: 4 Senior Engineers About the Role We are seeking Senior Data Engineers to join an experienced...SeniorImmediate start
Info Way Solutions
Mountain View, CA20 hours ago - ...ID.me is seeking a Senior Analytics Engineer to support the data infrastructure in Mountain View, CA. This role involves leading efforts to develop analytics and dashboards using Snowflake and dbt. The ideal candidate has 5+ years of experience in data analytics and SQL...Senior
ID.me Inc
Mountain View, CA1 day ago - ...Sterling B2B Developer Role: Senior Data Engineer Location: Dallas, TX or Mountain View, CA Duration: Long Term Contract As part of the Mail Analytics Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse,...SeniorLong term contract
Hermitage Infotech
Mountain View, CA4 days ago - ...for your reference. Recent update from client for this data engineer role / Request-ID: 13145-1 _ Bentonville, AR position is no... ...reference, which has closed with client UST. Looking for Senior Data Engineer with Spark, Scala, GCP experience. Location...Senior
Texas State Library and Archives Commision
Sunnyvale, CA1 day ago - ...Senior Data Engineer Location: Sunnyvale CA (Onsite) Duration: Long Term Job Description: GCP Experience • 4+ years of recent GCP experience • Experience building data pipelines in GCP • GCP Dataproc, GCS & BIGQuery experience • 10+ years of hands-on experience...Senior
JConnect Infotech
Sunnyvale, CA4 days ago - ...Sr. Data Engineer Mountain View, CA / Denver, CO / Remote Full-Time Position Summary: We are looking for a Sr. Data Engineer to join our growing Data Platform and Engineering teams. The ideal candidate has significant experience in building scalable data platforms...SeniorFull timeRemote work
1872 Consulting
Mountain View, CA3 days ago - ...Job Description Job Description Description: TSW Core is looking for a highly motivated Data Engineer. In this role, you will be responsible for designing and implementing robust data warehouse architectures, enabling data-driven decision-making through scalable...Senior
TSW Core LLC
Palo Alto, CAmore than 2 months ago $182k - $242k
...: CRWV) in March 2025. Learn more at What You'll Do: The Data Engineering Team builds and operates the foundational data infrastructure... ...and actionable at scale. About the role: We're seeking a Senior Data Engineer to design and build the foundational datasets that...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hoursCoreWeave
Sunnyvale, CA17 days ago- ...39 delivery centers worldwide, gaining exposure to complex engineering challenges that redefine industrial standards. If you are a... ...this is where you belong. We are currently searching for a Senior AWS Data Engineer: The Challenge (Responsibilities) Design,...SeniorRemote workWorldwide
Sequoia Connect
Mountain View, CA2 days ago $119.8k - $234.7k
...Overview Microsoft Silicon Cloud Hardware Infrastructure Engineering (SCHIE) is the team behind Microsoft's expanding Cloud... ...and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization...SeniorOngoing contractPermanent employmentWork at officeLocal areaWorldwideMicrosoft Corporation
Mountain View, CA2 days ago- ...millions of patients worldwide.We’re a team of engineers, clinicians, and innovators united by one... ...in robotic surgery requires high-quality data across the robotic platform, the surgical... ...and the operating room environment. The Senior AI/Data Science Engineer will advance the...SeniorLocal areaWorldwideFlexible hours
$117k - $234k
...OfficePosition Summary...What you'll do...Role summary:The Senior Software Engineer will lead the delivery of scoped features and models through... ...’s mission and operational goals.About the team:The MarTech Data Engineering team develops scalable, multi-tenant engineering...SeniorFull timeTemporary workPart time- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and...Senior
- Senior Data Engineer We are looking for a Senior Data Engineer to work with a leading generative AI company in healthcare. Location: Palo Alto, CA office. This role is expected to be in our Palo Alto office five days a week. Benefits include 401k, equity, and on-site...SeniorWork at office
$90k - $180k
Overview International Data Management (IDM) team powers enterprise‑scale data platforms across multiple global markets including Canada... ...smart design and optimization strategies. Develop AI‑driven engineering solutions : Build internal tools, utilities, and AI agents to...SeniorTemporary work$128.25k - $266.88k
Senior Data Engineer (Finance) Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It's the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes...SeniorWork at officeFlexible hours$175k - $200k
Overview East West Bank is looking for a motivated Senior Data Engineer to contribute towards the success of our Data and Analytics Technology initiatives. This is a hands‑on technical role and this person will be responsible for the development and build of scalable solutions...SeniorWork experience placement$83.98 - $111.27 per hour
...discovered. Day - 08 Hour (United States of America) Stanford Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical to our mission of leveraging data to drive clinical innovation...SeniorHourly payStanford Health Care
Palo Alto, CA4 days ago$225k
...application and interviews which can be found here. Position TITLE: Senior Analytics Engineer EMPLOYER: ID.me, LLC (formerly known as: ID.me, Inc.) LOCATION: Mountain View, CA Responsibilities Support our data infrastructure which includes Snowflake, dbt, Sigma, and GCP...SeniorFull timeWork at officeRemote work$179k - $218k
...alongside a team of experts across energy, manufacturing, data center construction, and cloud services. If you... ..."Silicon Reality" must be bridged. We are seeking a Senior Staff Data Center Operations Engineer, GPU Hardware Architecture to be the definitive technical...SeniorTemporary workCrusoe
Sunnyvale, CA20 days ago$133k - $254k
...where everything is connected and moves autonomously through a self-managing urban transportation operating system. Our AI Data Pipeline Engineers build up the core data processing pipelines and datasets readiness for autonomous driving cutting edge algorithms. We...SeniorWork experience placement42dot
Sunnyvale, CA2 days ago- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...SeniorRemote work
$184k - $287.5k
...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all the... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our...SeniorFull time$152k - $253k
...deepen our efforts in the autonomous driving field and strive to bring sustained growth to our customers.We're looking for a Senior Data Analysis Engineer, AD critical metrics with strong technical ability to deeply understand architectures and strong scripting experience to...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- aws data engineer Mountain View, CA
- big data devops engineer Mountain View, CA
- big data developer Mountain View, CA
- software data engineer Mountain View, CA
- data center engineer Mountain View, CA
- big data cloud engineer Mountain View, CA
- big data engineer Mountain View, CA
- senior data integration developer Mountain View, CA
- data developer Mountain View, CA
- data science developer Mountain View, CA