GCP Data Engineer (Python/PySpark)
Aumnitech LLC
GCP Data Engineer (Python/PySpark) .
Location: 100% Remote (EST preferred, CST okay, no PST)
Duration: 6 months contract-to-hire
Visa: Candidate must directly work on Apolis W2.
Start Date: ASAP (must be able to start within 2-3 weeks of offer)
Must Haves:
- 3+ years of hands-on GCP Engineering experience
- Strong experience with:
- Dataproc
- BigQuery
- Cloud Composer
- PySpark and Python
- ETL development experience with large datasets
- Experience using Python to call APIs
- Healthcare or Insurance industry experience (REQUIRED)
- Strong communication, critical thinking, and problem-solving skills
Job Description:
This consultant will support CVS Health's Provider Roster Bulk Upload initiative within the Aetna Technology organization. The team is migrating large volumes of provider data into GCP and building scalable data processing solutions. The engineer will receive data from upstream teams, transform and validate the data, leverage PySpark and Python-based API integrations, and deliver processed datasets to downstream consumers.
Key Responsibilities:
- Design and develop ETL pipelines in GCP
- Process and transform large-scale datasets using PySpark
- Utilize Dataproc, BigQuery, and Cloud Composer
- Develop Python-based API integrations
- Support data migration and modernization initiatives
- Collaborate with upstream and downstream data teams
Important Interview Notes:
The hiring manager is focused on candidates who can clearly articulate their hands-on experience, technical contributions, and thought process. Candidates should be prepared to discuss:
- Their specific contributions to projects, not just team accomplishments
- Technical decision-making and problem-solving approaches
- Real-world experience with GCP, PySpark, and Python
Sample topics may include:
- Removing duplicate rows from a PySpark DataFrame while retaining the latest record
- Grouping and transforming datasets in PySpark
- ETL design decisions and data processing methodologies
Please send your 2 strongest candidates. We are prioritizing candidates with recent healthcare/insurance experience
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GCP Data Engineer (Python/PySpark) in California vacancy
- Job ID: 29303661Reference Number: 26-00950Title: DATA ENGINEER PYSPARK AND SQLPosted Date: 2026-09-15Contact: Vishika ChaudharyContact Email:... ...San Francisco office 3 days per weekNice-to-Have SkillsStrong Python developmentCloud data platformsETL/ELT pipelinesData...SuggestedWork at office3 days per week
HAN Staffing
San Francisco, CA5 days ago $96.55k - $138.06k
10607 – Senior Data Engineer Location: Irvine, CA Company Overview Hyundai... ...will have strong experience in Python-based data engineering, workflow orchestration... ...such as Azure Data Lake, AWS, or GCP. Familiarity with Spark/PySpark and distributed data processing...SuggestedLocal areaHyundai Autoever America
Irvine, CAmore than 2 months ago- ...Job Title: DataOps/Cloud Data Engineer Senior (Databricks/Oracle/Pyspark) Location: Toronto, ON Work Model: Hybrid Duration: 6 months... ...troubleshooting, performance tuning, failover and recovery. Scripting languages (Python, Unix shell, Scala)....Suggested
Innosystech Inc
Ontario, CA3 days ago - ...platform brings together device events, operational data, analytics, and customer-facing applications across... ...platform on Google Cloud and is seeking a hands-on engineer with strong BigQuery, PostgreSQL, GCP, Python, backend development, and data warehousing experience...Suggested
Motion Recruitment
Lake Forest, CA1 day ago - ...Meghana GorusuCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and... ...for a highly skilled and motivated Data Engineer to join our team. The ideal candidate... .../Beam, or Pub/SubProgramming & Querying:Python:Expert-level programming proficiency in...SuggestedFull time
SRI Tech
San Jose, CA3 days ago $130k - $150k
...combines device events, operational data, analytics, and customer-facing... ...is looking for a hands-on Data Engineer with strong experience in BigQuery, PostgreSQL, Python, backend development, and data... ...foundation in Google Cloud Platform (GCP), BigQuery, and PostgreSQL....Motion Recruitment
Irvine, CA2 days ago$60 - $65 per hour
...seeking a highly skilled and experienced Data Engineer with a strong background in AI/ML to... ...infrastructure on the Google Cloud Platform (GCP). The candidate will be passionate about... ...in programming languages such as Python (essential), and experience with Scala or...Cynet Systems
San Jose, CA5 days ago- ...Francisco is seeking a production-focused software engineer for the Suspensions team. You will work with real-time data and production systems to support market... ...include 4+ years in production software, 2+ years Python (data extraction/analysis), 1+ year Rust, and strong...
$160k - $180k
...Senior Data Engineer Location: Orange County, CA Salary: $160-180... ...Strong programming skills in Python or a comparable language ~... ...Hands on experience with Spark, PySpark, SQL, and dbt ~ Experience... ...environments such as AWS, Azure, or GCP ~ Familiarity with...Full timeHarnham
Orange County, CA2 days ago- ...New fulltime position open for a seasoned Data Engineer in the Lancaster, PA area! This is an onsite role and not a remote based... ..., scenario analysis, or AI/ML. ~ Advanced SQL and strong Python/PySpark skills, including experience developing maintainable, tested...Permanent employmentFull timeRelocation
Career Connections, LLC.
Lancaster, CA8 hours ago - ...Meghana GorusuCompany: SRI Tech SolutionsRole:Data EngineerLocation: Torrance, California (Day 1 Onsite)Job Description:Data Engineer :· 3-5 years of experience in data... ...pipelines into Amazon Redshift· Proficiency in Python, PySpark and SQL; familiarity with Iceberg tables...
SRI Tech
Torrance, CA3 days ago $7,316 per month
...GorusuCompany: SRI Tech SolutionsRole:AWS Data EngineerLocation: Torrance, CA (Day... ...etc.7+ years of experience in data engineering, database design, ETL processes, and... ...RedshiftDemonstrate proficiency in Pyspark, Apache Spark and Python for data processing large...Hourly paySRI Tech
Torrance, CA3 days ago$63 - $68 per hour
...GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (... ...Software Engineer with strong SQL and Python skills to develop reliable data... ...Advanced proficiency in Python (Pandas, PySpark, or similar frameworks).Strong SQL expertise...Hourly payFull timeSRI Tech
Cupertino, CA3 days ago- ...% Remote Job Title: Contract Data Engineer (API & Database Focus) Role Summary... ...orchestration (e.g., PySpark, notebooks). Proficiency in a... ...for data engineering (e.g., Python). Experience working with cloud... ...platforms (e.g., AWS, Azure, GCP) where Snowflake and Databricks...Contract workRemote work
Mindlance
Sunnyvale, CA1 day ago - ...a market leader in AI-driven, data-powered, and privacy-compliant... ...About the roleAs a Senior Data Engineer, you will own NimbleRx’s data... ...batch and streaming pipelines on PySpark/EMR, Kinesis, Lambda, and Step... ...pipelines and platformsDeep Python (PySpark) and SQL fluency,...Temporary workLive out
Nimble Rx
Redwood City, CA2 days ago $243.29k - $295.25k
...journey, and the quality of our data determines how well we can... ...the funnel.As a Senior Data Engineer embedded in Growth Org, you will... ...streaming pipelines (SQL and Python, PySpark or Scala).Experience with... ...one major cloud platform (AWS, GCP or Azure) and modern warehouse...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA4 days ago$117k - $234k
...deploy scalable, intelligent data solutions that support... ...this data. Partner with engineering, AI/ML, and product teams... ...cloud platforms such as GCP or Azure, including services... ...clean, testable code in Python, Java, or Scala; experience with PySpark/Spark for distributed...Walmart
Sunnyvale, CA5 days ago$166k - $220k
...that turns thousands of data streams into a realtime,... ...ABOUT THE TEAMAs a Data Engineer on the Analytics Team, you... ...foundations in Python or another languageExperience with Spark, PySpark, SQL and dbtExperience with... ...productsExperience with AWS, Azure, or GCP security ecosystem,...Full timeWork experience placementImmediate startShift workAnduril Industries
Costa Mesa, CA1 day ago$135k - $141.75k
...Role:We are seeking a Senior Data Engineer with deep expertise in data engineering... ...unstructured datasets Strong Python and SQL skills; fluency in... ...engineering libraries (e.g., PySpark, Apache Airflow) and... ...major cloud platform (e.g., AWS, GCP); familiarity with on-prem...Permanent employmentH1bLocal areaWorldwideHome officeL.E.K. Consulting
Los Angeles, CA2 days ago$104.04k - $137.84k
...pivot from a “job” opportunity to an authentic experience!The Data Engineer II assists in the implementation of methods to improve data reliability... ...SSIS), Azure Data Factory, Synapse Analytics, Az Data Bricks, PySpark ETL. Develop and implement data collection processes in...Temporary workWork experience placementRemote workMonday to FridayFlexible hoursInland Empire Health Plan
Rancho Cucamonga, CA3 days ago$243.29k - $295.25k
...shared experiences for everyone.As a Senior Data Engineer, you will work to define the data... ...Composer, etc.) with deep expertise in SQL, PySpark, or scala.3+ years leading data... ...major cloud's suite of offerings (AWS, GCP, Azure).Developed or enhanced ETL orchestrations...Full timeWork experience placementH1bWork at officeLocal areaVisa sponsorshipMonday to FridayRoblox
San Mateo, CA2 days ago- ...Personas con Discapacidad" El puesto de Data Engineering es responsable de diseñar, construir,... ...por el área.Skills técnicos requeridos:Python para desarrollo de procesos, automatizaci... ...ón, consumo de APIs y manejo de datos.PySpark y Apache Spark para procesamiento distribuido...Full time
BBVA
San Bernardino, CA5 days ago $65 - $70 per hour
...GorusuCompany: SRI Tech SolutionsRole: Lead Data Engineer (Priority 1)Location: San Diego( Onsite... ...cloud platforms such as AWS, Azure, or GCP.Key ResponsibilitiesDesign, build, and... ...data solutions using Databricks, PySpark, Python, and SQL.Perform core refactoring to modernize...Hourly payFull timeSRI Tech
San Diego, CA3 days ago$143k - $224k
Wells Fargo is seeking a Lead Data Engineer - Automation for the Data... ...operational support experience with GCP BigQuery, MongoDB, Neo4J,... ...virtualization environment with python and ETL processing2+ years of... ...working with Big Data in Pyspark, GCP Bigquery, Hive/Hadoop ecosystem...Full timeWork experience placementRelocationRelocation packageShift workWells Fargo
Concord, CA4 days ago$146k - $194k
...that turns thousands of data streams into a realtime... ...’s Infrastructure Engineering organization provides the... ...programming proficiency in Python.Hands-on expertise with... ...cloud environment (GCP, AWS, Azure), including... ...transformation tools like Spark, PySpark, and dbt.Experience...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA1 day ago$146k - $194k
...system that turns thousands of data streams into a realtime, 3D... ...modeled, and how it reaches the engineers, managers, and leaders who act... ...leadershipWrite small production services (Python or Go) when integrations... ...-based transforms (Pandas, PySpark, Polars, or similar)Experience...Full timeWork experience placementImmediate startAnduril Industries
Costa Mesa, CA4 days ago$159.42k - $215.69k
...while transforming your career.Principal Data Engineer What you will doLet’s do this. Let’s... ...leveraging cloud platforms (AWS, Azure, GCP) for data engineering solutions. Strong... ...strategies. Proficient on experience in Python, PySpark, SQL. Handon experience with bid data...Full timeFlexible hoursAmgen
Thousand Oaks, CA4 days ago$50 per hour
...DescriptionJoin Lockheed Martin’s Data & AI Enablement organization and accelerate... ...AI transformation. As a lead data engineer, you will design, build, and... ....Strong programming skills in Python and SQL; proficient with Spark (PySpark/Scala) and deep experience with AI...Full timeTemporary workWork experience placementCasual workFlexible hoursLockheed Martin
San Francisco, CA5 days ago- GCP Data Pipeline Integration EngineerCandidate should have experience in migrating data from on prem to cloud using Google Cloud - Dataproc... ...using tools like HDFS, HBase, Hive, Spark etc. Should be GCP Data Engineer Certified. Retail experience is a big plus. ClifyX
$170k - $200k
...Senior Data Engineer San Francisco, California, United States Tatari is on a mission to revolutionize... ...at scale ~ Strong programming skills in Python (or a similar language) and SQL; deep hands-on experience with Spark/PySpark. We use Databricks and Delta Lake here ~...Work at office2 days per weekTatari
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to GCP Data Engineer (Python/PySpark). Be the first to apply!
Related searches
- finance data engineer California
- data engineer contract California
- sr data engineer California
- senior data engineer California
- etl data engineer California
- data engineer machine learning California
- data infrastructure engineer California
- data engineering intern summer California
- senior data quality engineer California
- senior data integration developer California