GCP Data Engineer (Python/PySpark)
Aumnitech LLC
GCP Data Engineer (Python/PySpark) .
Location: 100% Remote (EST preferred, CST okay, no PST)
Duration: 6 months contract-to-hire
Visa: Candidate must directly work on Apolis W2.
Start Date: ASAP (must be able to start within 2-3 weeks of offer)
Must Haves:
- 3+ years of hands-on GCP Engineering experience
- Strong experience with:
- Dataproc
- BigQuery
- Cloud Composer
- PySpark and Python
- ETL development experience with large datasets
- Experience using Python to call APIs
- Healthcare or Insurance industry experience (REQUIRED)
- Strong communication, critical thinking, and problem-solving skills
Job Description:
This consultant will support CVS Health's Provider Roster Bulk Upload initiative within the Aetna Technology organization. The team is migrating large volumes of provider data into GCP and building scalable data processing solutions. The engineer will receive data from upstream teams, transform and validate the data, leverage PySpark and Python-based API integrations, and deliver processed datasets to downstream consumers.
Key Responsibilities:
- Design and develop ETL pipelines in GCP
- Process and transform large-scale datasets using PySpark
- Utilize Dataproc, BigQuery, and Cloud Composer
- Develop Python-based API integrations
- Support data migration and modernization initiatives
- Collaborate with upstream and downstream data teams
Important Interview Notes:
The hiring manager is focused on candidates who can clearly articulate their hands-on experience, technical contributions, and thought process. Candidates should be prepared to discuss:
- Their specific contributions to projects, not just team accomplishments
- Technical decision-making and problem-solving approaches
- Real-world experience with GCP, PySpark, and Python
Sample topics may include:
- Removing duplicate rows from a PySpark DataFrame while retaining the latest record
- Grouping and transforming datasets in PySpark
- ETL design decisions and data processing methodologies
Please send your 2 strongest candidates. We are prioritizing candidates with recent healthcare/insurance experience
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GCP Data Engineer (Python/PySpark) in California vacancy
- ...Data EngineerSam's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts.The role will be responsible for expanding... ...Architecture.Programming experience on Python, Shell scripting, PySpark, and other data programming language....Suggested
Samprasoft
Sunnyvale, CA4 days ago - ...Sr GCP Data Engineer with Spark, PythonThis position will be based in Sunnyvale, CA (Onsite)Long TermMust Have Skills –• 2+ years of recent... ...for RDBMS platforms.• Experience with programming languages: Python, Java, Scala, etc.• Experience with scripting languages: Perl...Suggested
InterSources
Sunnyvale, CA4 days ago - ...Data EngineerWe are actively looking for a Data Engineer in Sunnyvale CA or Remote. Duration: 6+ Months Rate: DOE Key skills - Apache Spark, Python, GCP, BigQuery, Dataflw, Airflow.7+ years of experience in data engineering build, and maintain robust data pipelines using...SuggestedRemote work
Redolent
Sunnyvale, CA4 days ago - Job ID: 29303661Reference Number: 26-00950Title: DATA ENGINEER PYSPARK AND SQLPosted Date: 2026-09-15Contact: Vishika ChaudharyContact Email:... ...San Francisco office 3 days per weekNice-to-Have SkillsStrong Python developmentCloud data platformsETL/ELT pipelinesData...SuggestedWork at office3 days per week
HAN Staffing
San Francisco, CA5 days ago - ...Data EngineerBachelor or master’s degree in computer science, Software Engineering, or a related field.Proven experience (7+... ...technologies including SQL, Python, Spark, Scala, Hadoop... ...such as Google GCP and Microsoft Azure,... ...Required? GCP, Airflow, Pyspark, Tableau.Build and...SuggestedWork at office2 days per week
Samprasoft
Sunnyvale, CA4 days ago - ...Qualcomm Incorporated in San Diego, CA is seeking a Staff Data Engineer / Full-Stack Data Developer to design, build, and operate data... ...solutions enabling enterprise analytics, BI, and AI/ML with strong PySpark, Python, and SQL skills. In this onsite role, you will...
Qualcomm
San Diego, CA20 hours ago $96.55k - $138.06k
...Senior Data EngineerHyundai AutoEver America (HAEA) is the... ...-oriented Senior Data Engineer to join our growing data engineering... ...have strong experience in Python-based data engineering,... ...Azure Data Lake, AWS, or GCP.Familiarity with Spark/PySpark and distributed data...Local areaHyundai AutoEver America
Irvine, CA4 days ago- ...Meghana GorusuCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and... ...for a highly skilled and motivated Data Engineer to join our team. The ideal candidate... .../Beam, or Pub/SubProgramming & Querying:Python:Expert-level programming proficiency in...Full time
SRI Tech
San Jose, CA8 days ago - ...platform brings together device events, operational data, analytics, and customer-facing applications across... ...platform on Google Cloud and is seeking a hands-on engineer with strong BigQuery, PostgreSQL, GCP, Python, backend development, and data warehousing experience...
Motion Recruitment
Lake Forest, CA6 days ago $130k - $150k
...combines device events, operational data, analytics, and customer-facing... ...is looking for a hands-on Data Engineer with strong experience in BigQuery, PostgreSQL, Python, backend development, and data... ...foundation in Google Cloud Platform (GCP), BigQuery, and PostgreSQL....Motion Recruitment
Irvine, CA7 days ago- ~ Irvine, CA Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big data) | Contract to Hire | Irvine, CA (Hybrid) | Title: Principal Data Engineer (Python, AWS, Redshift, EMR, Airflow, Databricks, Big-data) Location: Irvine, CA (Hybrid)...Contract work
Central Business Solutions, Inc
Irvine, CA4 days ago - ...Senior Data Engineer (Spark, Python, AWS)Location: Mountain View California (100% Onsite)Duration: 6+ MonthsJob Description:Skills:Spark, Python, SQL, DWH / ETL Concepts, AWSResponsibilities:Design, build and maintain data infrastructure that supports both batch and real...
Zortech Solutions
Mountain View, CA4 days ago - ...Technology Solutions in New York, NY is seeking a talented Junior Data Engineer/Data Analysts/Data Scientists to join our growing data team.... ...with BI and data modeling, and hands-on work with SQL, Python, ETL concepts, and cloud platforms. Visa eligibility is required...Full time
Sulekha.com New Media Pvt Ltd
Sunnyvale, CA3 days ago - ...Lead Eligible to workP Data EngineerWe are seeking an experienced Lead Eligible to workP Data Engineer to design, build, and Eligible to workimize scalable cloud-native... ...Dataflow, Dataproc, Pub/Sub, Cloud Composer)Python, SQL, Spark/PySparkETL/ELT Pipeline DevelopmentData...
Diverse Lynx
Santa Clara, CA18 hours ago - ...Data EngineerClient's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and... ...systems.Qualifications for Data Engineer:• Strong python programming skills, expert level on using...Work at office2 days per week3 days per week
Samprasoft
Sunnyvale, CA4 days ago - ...Central Business Solutions, Inc is seeking a Principal Data Engineer for Irvine, CA in a contract-to-hire arrangement with a hybrid work model. The role emphasizes Python, AWS, Redshift, EMR and Airflow to build scalable data platforms. You will lead data engineering efforts...Contract work
Central Business Solutions
Irvine, CA4 days ago - ...descriptionBuild reusable platform capabilities and data products that let quantitative... ...business stakeholders, product managers, and engineering teams to translate business objectives... ...experience.Advanced proficiency in Python, including experience building scalable backend...
Luxoft
Irvine, CA2 days ago - ...Job Description We are looking for an experienced Senior GCP Engineer who is a hands‑on developer with deep expertise in Google Cloud Platform and modern data engineering practices. The role requires working onsite from Pleasanton and contributing to the design, development...
TechDigital Group
Pleasanton, CA4 days ago - ...implementation, and support of solutions big data solution in Hadoop using Hive, Spark,... ...candidate?Experience working with Java, Scala, Python programing languagesExperience working... ...?There are three tech leads with Senior engineers and a couple of junior engineersDoes the...Work at officeRemote work
Samprasoft
Sunnyvale, CA4 days ago - ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases....
Samprasoft
Sunnyvale, CA4 days ago - Job Title: GCP Data Engineer 2 B2 Canada Work Site: Toronto, Canada (Onsite) Employment Type: Contract with a possible 3-month... ...concepts, and basic to intermediate proficiency in Python for scripting and automation. A strong understanding of...Contract work
Querentia
Ontario, CA3 days ago - Job Title : GCP Data Engineer Location : Mountain View, CA [Needs to be onsite for 1 week once in a quarter on your own expenses] Job Type :... ...Processing systems at scale. • Strong Programming skills in Java, Python. • Experience in Public Cloud is a must. Experience with GCP...Contract work
$60 - $65 per hour
...seeking a highly skilled and experienced Data Engineer with a strong background in AI/ML to... ...infrastructure on the Google Cloud Platform (GCP). The candidate will be passionate about... ...in programming languages such as Python (essential), and experience with Scala or...- ...Meghana GorusuCompany: SRI Tech SolutionsRole:Data EngineerLocation: Torrance, California (Day 1 Onsite)Job Description:Data Engineer :· 3-5 years of experience in data... ...pipelines into Amazon Redshift· Proficiency in Python, PySpark and SQL; familiarity with Iceberg tables...
SRI Tech
Torrance, CA8 days ago $7,316 per month
...GorusuCompany: SRI Tech SolutionsRole:AWS Data EngineerLocation: Torrance, CA (Day... ...etc.7+ years of experience in data engineering, database design, ETL processes, and... ...RedshiftDemonstrate proficiency in Pyspark, Apache Spark and Python for data processing large...Hourly paySRI Tech
Torrance, CA8 days ago- ...Fractal Analytics is seeking a seasoned Data Engineering Leader with deep GCP expertise to architect and deliver large-scale data platforms and AI/ML solutions. You will own architecture, drive delivery, and act as a trusted technical anchor for clients with high stakes...
Fractal Analytics
Sacramento, CA4 days ago - ...% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary... ...orchestration (e.g., PySpark, notebooks). Proficiency in a... ...for data engineering (e.g., Python). Experience working with cloud... ...platforms (e.g., AWS, Azure, GCP) where Snowflake and Databricks...Contract workRemote work
Mindlance
Sunnyvale, CA6 days ago $63 - $68 per hour
...GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (... ...Software Engineer with strong SQL and Python skills to develop reliable data... ...Advanced proficiency in Python (Pandas, PySpark, or similar frameworks).Strong SQL expertise...Hourly payFull timeSRI Tech
Cupertino, CA8 days ago$97k - $140k
...Instagram, and YouTube. Job Description:Shield AI is seeking a Data Engineer to build the reliable, governed data foundation for Finance... ...-on production data engineering experience with SQL and Python or PySpark.Experience with cloud data platforms, orchestration, data...Full timeTemporary workPart timeWorldwideShield AI
San Diego, CA5 days ago$243.29k - $295.25k
...journey, and the quality of our data determines how well we can... ...the funnel.As a Senior Data Engineer embedded in Growth Org, you will... ...streaming pipelines (SQL and Python, PySpark or Scala).Experience with... ...one major cloud platform (AWS, GCP or Azure) and modern warehouse...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Data Engineer (Python/PySpark). Be the first to apply!
Related searches
- finance data engineer California
- big data devops engineer California
- sr data engineer California
- senior data engineer California
- entry level big data engineer California
- etl data engineer California
- director data engineering California
- data engineer machine learning California
- data infrastructure engineer California
- data engineering intern summer California