Senior GCP Data Engineer
Software Technology Inc
Senior GCP Data Engineer
Location: Sunnyvale, CA/Bentonville, AR - onsite
Duration: 12-month engagement
Must have: Walmart ex-employees / ecommerce / retail exp
GCP, Python / scala, pyspark Requirements:
GCP Experience • 4+ years of recent GCP experience • Experience building data pipelines in GCP • GCP Dataproc, GCS & BIGQuery experience • 10+ years of hands-on experience with developing data warehouse solutions and data products. • 6+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution are required • 5+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms. • Experience with programming languages: Python, Java, Scala, etc. • Experience with scripting languages: Perl, Shell, etc. • Practice working with, processing, and managing large data sets (multi TB/PB scale). • Exposure to test driven development and automated testing frameworks. • Background in Scrum/Agile development methodologies. • Capable of delivering on multiple competing priorities with little supervision. • Excellent verbal and written communication skills. • Bachelor's Degree in computer science or equivalent experience. The most successful candidates will also have experience in the following: • Gitflow • Atlassian products – BitBucket, JIRA, Confluence etc. • Continuous Integration tools such as Bamboo, Jenkins, or TFS
Responsibilities: As a Senior GCP Data Engineer, you will
- Design and develop big data applications using the latest open source technologies.
- Desired working in offshore model and Managed outcome
- Develop logical and physical data models for big data platforms.
- Automate workflows using Apache Airflow.
- Create data pipelines using Apache Hive, Apache Spark, Apache Kafka.
- Provide ongoing maintenance and enhancements to existing systems and participate in rotational on-call support.
- Learn our business domain and technology infrastructure quickly and share your knowledge freely and actively with others in the team.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior GCP Data Engineer in Sunnyvale, CA vacancy
$184k - $287.5k
Senior Data Center Performance Engineer - Benchmarking and Optimization page is loaded## Senior Data Center Performance Engineer - Benchmarking and Optimizationlocations: US, CA, Santa Clara: US, Remotetime type: Full timeposted on: Posted Yesterdayjob requisition id: JR...SeniorNVIDIA Corporation
Santa Clara, CA4 days ago- ...ID.me is seeking a Senior Analytics Engineer to support the data infrastructure in Mountain View, CA. This role involves leading efforts to develop analytics and dashboards using Snowflake and dbt. The ideal candidate has 5+ years of experience in data analytics and SQL...Senior
ID.me Inc
Mountain View, CA23 hours ago - ...Job Title: Senior Data Engineer (High Priority) Location: Preferably Mountain View, CA; Hybrid Start Date: Immediate Duration: 6+ months Openings: 4 Senior Engineers About the Role We are seeking Senior Data Engineers to join an experienced...SeniorImmediate start
Info Way Solutions
Mountain View, CA1 day ago - ...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery... ...with a heavy focus on using cutting-edge technologies to build data intensive systems, designing and optimizing data models, and collaborating...Senior
Apple
Sunnyvale, CA4 days ago - ...Role : Senior Data Engineer - GCP Location : Mountain View CA (Onsite) What you'll do Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine learning operations....Senior
United IT Solutions
Mountain View, CA3 days ago - ...Role: GCP Data Engineer Location: Santa Clara, CA (3 Days onsite/week) Contract Job Requirements Highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining...Contract workFlexible hours3 days per week
AceStack LLC
Santa Clara, CA5 hours ago $180k - $258.75k
...Senior Data Engineer At Toyota Research Institute (TRI), we're on a mission to improve the quality of human life. We're developing new tools and capabilities to amplify the human experience. To lead this transformative shift in mobility, we've built a world-class team...SeniorLocal areaShift workToyota Research Institute
Los Altos, CA1 day ago- A leading technology firm is looking for a Remote Data Engineer with at least 10 years of experience, particularly in Google Cloud Platform. The role includes designing and optimizing analytical datasets, building robust data pipelines, and collaborating with product managers...SeniorRemote job
- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML. Key Responsibilities Design, develop, and...Senior
- Design, develop, and maintain scalable data processing pipelines and workflows using frameworks such as Apache Spark, PySpark, and... ..., and privacy. Collaborate with data scientists, analysts, and engineers to support analytics and ML workflows. Lead complex migration initiatives...Senior
$150.4k - $277.6k
...telling what you can accomplish. We are seeking an exceptional engineer with a background in large scale software development and delivery... ...with a heavy focus on using cutting‑edge technologies to build data intensive systems, designing and optimizing data models, and collaborating...Senior$181.1k - $272.1k
...believe we are just getting started. Do you have a strong passion for using data to drive business decisions, generate ideas, and inspire collaborators? We are seeking for a Senior Data Engineer to join our App Store Data team and play an integral role in helping the...SeniorRelocation- ...digital platform. The Architect will collaborate across product and engineering teams to define scalable architectures ensure robust... ...offer visa transfer or sponsorship now or in the future Role: GCP data engg Location: Sunnyvale, CA Experience: 10+ Years The annual...Temporary workDay shift
$90k - $180k
Overview International Data Management (IDM) team powers enterprise‑scale data platforms... ...strategies. Develop AI‑driven engineering solutions : Build internal tools, utilities... ...(Scala/PySpark), Airflow, BigQuery, and GCP ecosystem. Strong knowledge of GCP services...SeniorTemporary work$182k - $242k
...Nasdaq: CRWV) in March 2025. Learn more at . What You’ll Do The Data Engineering Team builds and operates the foundational data infrastructure... ..., and actionable at scale. About The Role We're seeking a Senior Data Engineer to design and build the foundational datasets...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- ...exciting area of tech and are fundamentally reshaping the data storage industry. Here, you lead with innovative thinking,... ...workflows that help surface insights with less manual effort. As a Senior Analytics Engineer, you will help drive that journey end-to-end, building...SeniorFlexible hours
$148.75k - $361k
...ABOUT THE TEAM The mission of Roku's Data Engineering team is to develop a world-class big data... ...Roku Devices. ABOUT THE ROLE As a Senior Data Engineer on the Viewer Product Data... ...preferred * Experience with AWS, GCP, or Looker * AI literacy and an AI growth...SeniorFull timeWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$225k
...interviews which can be found here. Position TITLE: Senior Analytics Engineer EMPLOYER: ID.me, LLC (formerly known as: ID... ...View, CA Responsibilities Support our data infrastructure which includes Snowflake, dbt, Sigma, and GCP services. Educate the organization on...SeniorFull timeWork at officeRemote work$157k - $210k
...Nasdaq: CRWV) in March 2025. Learn more at We’re hiring a Senior Analytics Engineer to own analytics for the Machine Infrastructure Supply... ...and evolve our enterprise semantic layer—transforming raw data into trusted models, metrics, and analytics‑ready datasets...SeniorPermanent employmentTemporary workCasual workWork at officeFlexible hours- ...-class leadership team: Our Heads of AI, Engineering, and Product bring extensive experience from... ...T HE ROLE Kai is hiring a Sr. Data Engineer to join our data infrastructure... ...agnostic deployment across Azure, AWS, and GCP ~ Integrate and manage cloud data...Senior
Kai Cyber, Inc.
San Jose, CA1 day ago $170k - $210k
...Sr Data Engineer – Samsung Ads Samsung Ads is a fast-growing, advanced advertising technology business that helps brands connect with... ...: Solid experience with data systems and data engineering • Senior Level (5+ years): Proven track record of building and operating...SeniorHourly payFull timeInternshipSamsung
Mountain View, CA5 hours ago- ...research to revolutionizing grant and investment strategies, every decision is purposeful. This firm is seeking a Senior Data Engineer to architect and build cloud-native pipelines, batch, streaming, and GenAI-enabled that turn structured and unstructured data...Senior
Eleven Recruiting
Menlo Park, CA3 days ago $133.1k - $236.4k
...Senior Data Engineer Firefly is Adobe's family of creative generative AI products — and it's growing fast. Our data team sits at the center of that growth, powering the analytics, modeling, and product decisions that build what Firefly becomes. We're hiring a Senior...SeniorTemporary workLocal areaImmediate startWorldwideAdobe
San Jose, CA4 days ago$138.7k - $206.95k
...developing, and supporting Databricks-based pipelines, medallion-layer data products, and enterprise integrations that enable analytics,... ...You will partner closely with product owners, architects, data engineers, report and analytics teams, and source-system teams to define...Full timeH1bLocal areaWork from homeRelocation packageFlexible hours$204k - $259k
...efficient autonomous operation. In this hybrid role, you will report to the Senior Engineering Manager of Semantics. You Will: Develop and implement new features in the VLM data infra and validate the changes for the model platform to support the continuing...SeniorFull timeWork at officeRemote workWaymo
Mountain View, CA12 hours ago- Responsibilities Design, build, and own the key data infrastructure to manage data and usage across our Snowflake account Interface... ...pipelines sourcing data from application apis Collaborate closely with Engineering, Product Management, IT, Finance, and Compliance to inform...SeniorRemote workWork from homeFlexible hours
- ...solutions that help companies drive digital transformation and use data to gain a competitive advantage. With analytics solutions that... ...Required Qualifications: 7+ years of experience in Data Engineering roles Extensive hands-on experience with Databricks (Delta Lake...SeniorLocal area
- Senior Data Engineer We are looking for a Senior Data Engineer to work with a leading generative AI company in healthcare. Location: Palo Alto, CA office. This role is expected to be in our Palo Alto office five days a week. Benefits include 401k, equity, and on-site...SeniorWork at office
- One of my Client is Hiring for GCP Data Engineering & GenAI at San Jose , CA Location: San Jose , CA Type : Contract Exp - 12+ Years Job Description: 8+ years of data engineering or software engineering experience, ideally with large-scale financial or transactional data...Contract workShift work
- ...Intelliswift one of the most reliable partners in IT and Talent solutions. We specialize in delivering world-class Digital Product Engineering, Data Management and Analytics, and Staffing Solutions services to Fortune companies, SMBs, ISVs, and fast-growing startups. Job...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior GCP Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer Sunnyvale, CA
- big data engineer Sunnyvale, CA
- big data developer Sunnyvale, CA
- big data devops engineer Sunnyvale, CA
- finance data engineer Sunnyvale, CA
- sr information security engineer Sunnyvale, CA
- junior big data engineer Sunnyvale, CA
- entry level big data engineer Sunnyvale, CA
- senior data engineer Sunnyvale, CA
- data developer Sunnyvale, CA