Lead GCP Data Engineer - Spark, Python & ML Pipelines
Euclid Innovations
Euclid Innovations is seeking experienced Data Engineers in Charlotte, NC, to support a large-scale data platform transformation for a leading banking client. The role emphasizes building Spark-based data pipelines and managing data movement for ML applications on GCP. Qualifications include strong proficiency in Spark and Python, along with experience in GCP, BigQuery, and Cloud Storage. The position is focused on data migration and pipeline modernization, and GCP exposure is essential. #J-18808-Ljbffr Euclid Innovations
- Position Title : GCP Python Lead Data Engineer Location : Charlotte, NC/ New York City... ...batch and real‑time data pipelines, working with large‑scale... ...enabling analytics and AI/ML use cases. Key Responsibilities... ...Experience with Dataproc (Spark/PySpark) for large‑scale...PipelineFull time
- ...Innovations in Charlotte, NC seeks a data engineer to drive data migration and modernize pipelines for ML training and inference on Google... ...role emphasizes hands-on work with Spark and Python, and requires active experience with GCP services such as BigQuery and Cloud...Pipeline
- ...seeking experienced Data Engineers to support a... ...transformation for a leading banking client.... ...focuses on building Spark-based data pipelines and enabling data... ...to support ML training and inference on GCP Charlotte, NC 1... ...Strong Spark + Python (MANDATORY) Experience...Pipeline
- Capgemini is looking for a GCP Python Lead Data Engineer in Charlotte or New York City. The ideal candidate will utilize their Python and GCP expertise... ...data solutions. Responsibilities include developing data pipelines and ETL workflows, collaborating with analytics and AI...PipelineFull time
- Capgemini is looking for a GCP Python Lead Data Engineer in Charlotte, NC. This role involves designing and optimizing scalable data... ...expertise, along with hands-on experience in building data pipelines for analytics and AI/ML applications. Capgemini offers a comprehensive...Pipeline
- ...Hybrid Day 1 Job Description: GCP Python Lead Data Engineer We are seeking a highly... ...developing batch and real-time data pipelines, working with large-scale... ...enabling analytics and AI/ML use cases. Key... ...Experience with Dataproc (Spark/PySpark) for large-scale processing...PipelineFull timeLocal area
- A global consulting firm is seeking a Big Data Engineer to design, develop, and optimize large-scale data processing... ...big data technologies such as Apache Hadoop, Spark, and Hive. Responsibilities include maintaining ETL pipelines, collaborating with teams to solve data...Pipeline
$111.6k - $212k
...deliver end-to-end data solutions for... ...deliver value; lead products with significant... ...advise other engineers; execute with... ...of data pipelines and extract, transform... ...pipelines within GCP (Google Cloud Platform) using Spark Expert-level proficiency in Python and SQL for...PipelineLocal areaFlexible hours- ...40573 Job Description: Big Data Engineer Location: Charlotte, North Carolina... ...-real-time and batch data pipelines. The position requires a self... ...and optimize solutions using Spark Structured Streaming. Conduct... ...one of the following: Scala, Python, PHP, or Shell Scripting....Pipeline
$62 per hour
...Python Developer Location: Sunrise, FL / Charlotte, NC - onsite... ...role involves building robust data processing solutions, optimizing... ...and develop data processing pipelines and utilities using Python.... ...Jenkins, CI/CD Python, AI/ML, Tensorflow, LLM, GenAI Implement...Pipeline- ...seeking a highly skilled Generative AI Engineer with a strong Python background to design, develop, and... ...Strong proficiency in Python and AI/ML frameworks (PyTorch, TensorFlow). Hands... ...services (AWS SageMaker, Azure OpenAI, GCP Vertex AI). Knowledge and experience...Full timeContract workWork experience placementWork at office3 days per week
$76.2k - $174.1k
...Organization - AI and Data - Service... ...technology Leading and managing... ...-grade ML and DL models... ...workflows, and pipelines Helping clients... ...(Hadoop, Spark, etc.) to ingest... ...in AI/ML engineering or MLE/ML Ops... ...Proficiency in Python programming and... ...Platform (GCP) for deploying...PipelineWork experience placementSummer holidayFlexible hours- Cliff Services Inc is seeking a Senior Data Engineer with strong expertise in Scala and Apache Spark for a long-term contract in Charlotte, NC. Candidates should... ...will have experience in developing ETL/data pipelines and SQL proficiency. Please note, candidates with...PipelineLong term contract
$51.78 - $56.78 per hour
...Responsibilities Design, build, and maintain high-performance ETL/ELT data pipelines using Python and PySpark. Apply expert-level coding skills to develop... ...by exploring and increasing the adoption of AI/ML, including using tools like Copilot and Claude for...PipelineHourly payContract workTemporary workWork experience placement- Job Title: GCP Data Engineer Location: Charlotte, NC What’s the Job? Our Financial... ...with GCP, BigQuery, and Python to align successfully in the... ...Key Focus Areas AI & data pipelines Framework and pipeline development... ...migration of: Legacy AI/ML models → GCP Not full app...Pipeline
- ...Job Description Python Developer Onsite... ...maintain large-scale data processing pipelines using Apache Spark for batch and streaming... ...Design and implement ML training and... ...Data Scientists and ML Engineers to productize models... ...cloud platforms (AWS/GCP/Azure). • Familiarity...Pipeline
- ...professionals for this role. Leads and executes deep dive... ...analytics to support data-driven business... ...Expertise in programming with Python, R, or SQL; hands-on... ...understanding of data pipelines, data wrangling, and... ...big data environments (Spark/Hadoop); familiarity with...PipelineWork experience placement
- ...262 (100% Onsite) Role: AI Engineer - Generative AI, GCP Employment Type: W2 (Local... ...Design, develop, and optimize AI/ML solutions leveraging... ...and LLMs . Build scalable data pipelines and manage transformation using SQL, Python, Spark, and Vertica SQL. Integrate...PipelineLocal area
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...PipelineFull timeLocal areaImmediate startRemote work
- Ginas Tech Jobs is seeking an AI Engineer to build GPU‑accelerated video analytics for real... ...and Blob Storage, delivering scalable ML pipelines on‑prem or cloud‑connected systems. The... ...of CV/ML production experience, strong Python expertise, and hands-on use of OpenCV, PyTorch...Pipeline
- Job Title: Lead - API Vulnerability Data Engineer Location: Charlotte, NC or Mt. Laurel Township, NJ Work Arrangement: Hybrid (3 days onsite per week... ...security strategy. Strong understanding of CI/CD pipeline integration and security infrastructure. Position Overview...PipelineContract work3 days per week
- Skills Skill: GCP; CI/CD; Maven; Jenkins;... ...Springboot, Kafka, AI/ML(Sarima/Prophet),... ...Good understanding of data structures,... ...solutions leveraging leading cloud and enterprise... ...and maintain data pipelines, models, and datasets... ...SARIMA, Prophet, prompt engineering, and TensorFlow...Pipeline
$70.23 per hour
...BCforward BCforward is a leading global IT consulting... ...Position Summary Data Engineers provide businesses with... ...Hadoop, SQL database, Spark, and IoT. Data engineers... ...develop programs using Python and Scala to clean and... ...Build data systems and pipelines Evaluate business...PipelineContract workImmediate start- ...maintaining scalable data pipeline and ETL process using... ...The Azure Cloud Data Engineer is responsible for strategizing... ...notebooks using Python and SQL Configure... ...of data platforms. • Lead end-to-end project... ...Big Data : Apache Spark Version Control :...PipelineWeekend work
$60 - $65 per hour
...Senior Full Stack Software Engineer (Python, React, SQL Server) Title:... ...and optimization. Ensure data integrity, security, and compliance... ...activities. Support CI/CD pipelines and operational readiness.... ...authorization frameworks and AI/ML solutions. Qualified...PipelineFull timeContract workTemporary workWork experience placementImmediate startWorldwideFlexible hours- # Data EngineerApply**Job#: 3039969****Job Description:**Data Engineer**Location:** Charlotte, North Carolina (Onsite... ...data systems and pipelines.* Evaluate business needs... ...such as Java and Python.* Experience with big... ...technologies like Hadoop or Spark.* Proficiency in SQL...PipelineHourly payContract work
- Compunnel, Inc. is seeking a Senior Data Engineer to design, develop, and... ...intelligence. The ideal candidate will lead the development of high-performance ETL/ELT pipelines and ensure compliance with... ...position requires expertise in Python, SQL, and cloud platforms like...Pipeline
$69k
...and self‑motivated CCaaS Data‑Engineer to join it in advancing... ...Key Skills Required GCP CI/CD Maven Jenkins... ...IVA solutions leveraging leading cloud and enterprise... ...develop, and maintain data pipelines, models, and datasets... ...building and integrating AI/ML solutions such as...PipelineFull timeLocal area- ...Developer to join our dynamic data engineering team. This role is ideal for... ..., and optimizing data pipelines and analytics solutions that... ...pipelines using PySpark and Spark SQL. Collaborate with data... ...Strong proficiency in PySpark, Python, and Spark SQL. ~ Solid...Pipeline
- ...Agency seeks an Artificial Intelligence (AI) Engineer for onsite work in Charlotte, NC. You... ...develop GPU-accelerated video inference pipelines and optimize YOLO-based models for real-time... ...dataset curation, and help productionize ML pipelines with Docker and cloud...Pipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead GCP Data Engineer - Spark, Python & ML Pipelines. Be the first to apply!
- python engineer Charlotte, NC
- python developer Charlotte, NC
- python developer data analytics Charlotte, NC
- python developer remote Charlotte, NC
- full stack / python developer (remote) Charlotte, NC
- python programmer Charlotte, NC
- data operator Charlotte, NC
- ntt data Charlotte, NC
- alliance data Charlotte, NC
- data officer Charlotte, NC



