Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

GCP Data Engineer

Fixity Technologies

Design, develop, and optimize scalable data pipelines for large-scale data processing and transformation. Develop cloud-based data engineering solutions using GCP services , including BigQuery, DataProc, Airflow, and Pub/Sub . Design and optimize data models, databases, and SQL queries for performance and scalability. Build batch and real-time/event-driven data processing pipelines using Apache Kafka and/or GCP Pub/Sub . Develop data processing solutions using Apache Spark, Hadoop, and Hive . Write efficient and maintainable code using Python and Shell Scripting . Apply strong Object-Oriented Programming concepts and software design patterns. Design and develop solutions for distributed and multi-tiered systems. Build and maintain CI/CD pipelines using Jenkins, Git, and GitHub . Implement automated testing frameworks and quality practices for data engineering solutions. Follow software development lifecycle processes and Agile/Scrum methodologies. Collaborate effectively with product teams, architects, developers, and other cross-functional teams. Analyze complex data engineering problems and develop effective, scalable solutions. Identify opportunities for automation, process improvement, and continuous improvement. Learn and adopt enterprise frameworks and emerging technologies to build modern Big Data solutions. Required Skills 8+ years of experience in software development and/or Big Data Engineering. Strong hands‑on experience with Google Cloud Platform (GCP) . Strong experience with BigQuery . Experience with Apache Airflow / Cloud Composer . Experience with Google Cloud DataProc . Experience with GCP Pub/Sub and/or Apache Kafka . Strong knowledge of Apache Spark, Hadoop, and Hive . Strong programming experience in Python . Experience with Shell Scripting . Strong SQL and relational database experience. Experience designing and optimizing data models and data pipelines . Experience with Jenkins, Git, and GitHub . Knowledge of CI/CD pipelines and automated testing frameworks . Strong understanding of distributed systems, algorithms, and software design patterns. Good understanding of Object-Oriented Programming concepts. Experience working in Agile/Scrum environments and understanding of SDLC processes. Strong analytical, communication, and problem-solving skills. Preferred Qualifications Google Cloud Professional Data Engineer Certification is a plus. Experience with enterprise Big Data frameworks and architecture. Knowledge of infrastructure automation and configuration management. Experience with continuous integration and deployment practices. Strong curiosity and willingness to learn new technologies. #J-18808-Ljbffr Fixity Technologies

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the GCP Data Engineer in Charlotte, NC vacancy
  •  ...Our Financial Services client is seeking a GCP Data Engineer to join their team. As a GCP Data Engineer, the ideal candidate will have GCP, BigQuery and Python which will align successfully in the organization. Job Title: GCP Data Engineer Location: Charlotte, NC... 
    Suggested

    Experis/Manpower Group

    Charlotte, NC
    6 hours ago
  •  ...Job is located in Charlotte, NC - Onsite Hybrid Day 1 Job Description: GCP Python Lead Data Engineer We are seeking a highly skilled GCP Data Engineer with strong Python expertise to design, build, and optimize scalable data solutions on Google Cloud Platform (GCP). The... 
    Suggested
    Full time
    Local area

    Capgemini

    Charlotte, NC
    19 hours ago
  •  ...opportunity! A well-known Financial Services Company is looking for a GCP Data Engineerin Charlotte, NC (Hybrid). Work with the brightest...  ...: 12 Months Required Skills & Experience 5+ years of Software Engineering experience, or equivalent demonstrated through one or a... 
    Suggested
    Long term contract
    Contract work
    Work experience placement

    Motion Recruitment Partners LLC

    Charlotte, NC
    2 days ago
  •  ...Handle data migration and pipeline modernization to support ML training and inference on GCP. MUST-HAVE Strong Spark + Python (MANDATORY) Experience with: Hands-on with: GCP exposure: BigQuery + Cloud Storage GOOD TO HAVE Dataplex / governance tools Experience supporting... 
    Suggested

    Euclid Innovations

    Charlotte, NC
    3 days ago
  •  ...Job Title: GCP Data Engineer Location: Charlotte, NC (onsite) Fulltime Job Description Skill: GCP Data Engineer ~5+ years of hands-on software development experience with Big Data & Analytics solutions Cloud - Big Query, Airflow, Daturic... 
    Suggested
    Full time

    AceStack LLC

    Charlotte, NC
    1 day ago
  • A technology solutions provider is seeking a highly experienced GCP Data Engineer for a hybrid role in Charlotte, NC. The ideal candidate will have over 10 years of experience in software or cloud engineering and expertise in Google Cloud Platform, Python, and Django. You... 
    Long term contract

    CDI Solutions

    Charlotte, NC
    2 days ago
  •  ...opportunity! A well-known Financial Services Company is looking for a GCP Data Engineerin Charlotte, NC (Hybrid). Work with the brightest...  ...12 Months Required Skills & Experience 5+ years of Software Engineering experience, or equivalent demonstrated through one or a... 
    Long term contract
    Contract work
    Work experience placement

    Motion Recruitment Partners LLC

    Charlotte, NC
    3 days ago
  •  .... Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus...  ...enterprise-level data platforms (e.g., AWS, Azure, GCP). Designing, developing, and deploying advanced... 
    Full time
    Visa sponsorship
    Work visa

    Captech Consulting

    Charlotte, NC
    19 hours ago
  •  ...professional to provide technical support for their Fortune 100 client's Data Centers in Charlotte, NC. This full-time role requires...  ...medium projects. Candidates must have an Associate's Degree in Engineering and relevant experience in critical environments. The role is... 
    Full time

    Brooksource

    Charlotte, NC
    19 hours ago
  •  ...continuous operations and availability of our Fortune 100 client’s Data Centers. Provide basic to intermediate technical support to...  ...within existing critical facilities. Support project management, engineering, and design support for new construction and facility... 
    Contract work
    Work experience placement
    Work at office
    Local area

    Brooksource

    Charlotte, NC
    19 hours ago
  • $100k - $115k

     ...At Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their digital transformation...  ...organizations that drive true change. Our Data Architecture & Engineering team sees data as the foundation for decision-making,... 
    Temporary work
    Local area

    Slalom

    Charlotte, NC
    2 days ago
  •  ...IDR is seeking a Sr Data Engineer to join one of our top clients in Charlotte, NC as a long term opportunity. If you are looking for an opportunity to join an organization who has invested in bleeding edge technology - Apply today! At this time, we are only able to consider... 

    IDR, Inc.

    Charlotte, NC
    4 days ago
  • $108.8k - $136k

     ...Denver, CO and Charlotte, NC area) Position Summary Join our mission to transform pharmacy benefits and healthcare navigation as a Data Engineer II (Analytics Engineer). You will build and maintain reliable data models within Snowflake with dbt, and improve data quality... 
    Local area

    Capital Rx

    Charlotte, NC
    4 days ago
  •  ...Responsibilities Design and build scalable ETL/data pipelines using Spark and Python...  ...data routing logic to direct data to: GCP (BigQuery, Dataflow, Dataproc) On-prem...  ...Proficiency in Python for data engineering (ETL pipelines) Experience designing and... 

    Euclid

    Charlotte, NC
    2 days ago
  •  ...Data Engineering Specialist 8+ years of overall experience in data engineering – primarily within data including experience with data modelling, ETL/ELT, data integration, master data management/entity management, data quality, data warehousing, analytics (prescriptive... 
    Temporary work
    Flexible hours

    Saxon Global

    Charlotte, NC
    1 day ago
  •  ...Overview: We are seeking a highly skilled Data Engineer to join a dynamic team in the Charlotte, NC area. This role focuses on the collection...  ...-scale cloud-based data architectures using platforms such as GCP, AWS, or Azure. ~ Strong skills in ETL/ELT design and... 
    Work experience placement

    True North Consultants

    Charlotte, NC
    7 hours ago
  •  ...Position: Data Engineer Location: Charlotte, NC or Denver, CO ~4x/week onsite Contract Length: 12+ months Top Requirements...  ...across cloud services. • Leverage Google Cloud Platform (GCP) for data solutions and integration with existing AWS infrastructure... 
    Contract work
    Local area

    My3Tech Inc

    Charlotte, NC
    1 day ago
  • $65 per hour

     ...Data Engineer Rate:$65.00 Location: Durham, NC client:Fidelity Investments - Raleigh Durham The client, Fidelity, is initiating a migration project to enhance and update their current reporting infrastructure, aiming to move away from the existing ecosystem of Oracle... 

    Argyle Infotech

    Belmont, NC
    3 days ago
  •  ...description below. If you're interested, could you send me your updated resume? Looking forward to hearing from you! Job Title: Data engineer Location: Charlotte, NC ( Hybrid - 3days Office - 2 days WFH) Full-time role Job Summary:... 
    Full time
    Work at office
    Work from home

    ACI Infotech

    Charlotte, NC
    1 day ago
  •  ...Data Engineer Our client, a leading financial services organization, is seeking a Data Engineer to join their team. As a Data Engineer, you will be part of the Data Strategy team supporting the development of a strategic data platform. The ideal candidate will demonstrate... 

    Experis

    Charlotte, NC
    1 day ago
  •  ...Job Title: Senior Data Engineer Location: West Des Moines, IA OR Charlotte, NC - hybrid Wells Fargo - W2 ONLY!!!!! Rate: $50.00/hr on W2 Duration: 12+-month Contract ONLY W2 CANDIDATES ELIGIBLE FOR THIS PROJECT Key... 
    Contract work

    3B Staffing LLC

    Charlotte, NC
    2 days ago
  • $69.5 - $76.16 per hour

     ...Data Engineer Charlotte, North Carolina Hybrid Contract $69.5/hr - $76.16/hr Outstanding long-term contract opportunity! A well...  ...and data pipelines for batch and real-time processing. (GCP or any other cloud platforms are fine I.E. PYSPARK) ~ Build and... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Flexible hours

    Motion Recruitment

    Charlotte, NC
    3 days ago
  • $128k - $249k

     ...Job Summary We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable Microsoft Fabric data platforms. Responsibilities include establishing engineering... 
    Temporary work
    Local area
    Remote work
    Relocation
    Flexible hours
    Afternoon shift

    K&L Gates LLP

    Charlotte, NC
    4 days ago
  • $60 per hour

     ...MDM Data Engineer Location: Remote, working EST hours Duration: 6-12-month contract-to-hire Pay: $60+/hour JOB DESCRIPTION Our global Fortune 500 client, with U.S. headquarters in Charlotte, NC, is a world class food service provider with a strong... 
    Contract work
    Remote work
    Flexible hours

    CRG

    Charlotte, NC
    7 hours ago
  •  ...Insight Global is looking for an AWS Data Engineer to join one of our financial clients and help with an ongoing project. This resource will be responsible to helping unify store data in order to unify legacy systems across various lines of businesses. This resource should... 

    Insight Global

    Charlotte, NC
    4 days ago
  •  ...Advice and Wealth Management through cutting-edge technology and data science. As part of our team, you'll: Design, validate, and...  ...financial advice and portfolio management. Collaborate closely with engineers and cross-functional teams to improve LLM prompting, accuracy,... 

    Insight Global

    Charlotte, NC
    3 days ago
  • ## Senior Data EngineerApplyremote type: On-sitelocations: LC11013 - 13024 Ballantyne Corporate Place, Charlotte, NC: LC10530 - 2160...  ...program, and a wellness program.**Position Overview:**The Senior Data Engineer is responsible for leading the design, administration,... 
    Temporary work

    CrossCountry Mortgage

    Charlotte, NC
    3 days ago
  • $93.69k - $114.51k

     ...support, balance, and resources to make a positive impact on the future - including your own. Pacific Life is actively seeking a Data Engineer II to join our Customer Data team onsite in Charlotte, North Carolina. As a Data Engineer II, you will contribute to... 
    Flexible hours

    Pacific Life

    Charlotte, NC
    2 days ago
  • ## Data EngineerApplyremote type: On-sitelocations: LC11013 - 13024 Ballantyne Corporate...  ...wellness program.**Position Overview:**The Data Engineer works with the Data Platform team to...  ...preferred.* Experience working with Azure or GCP cloud platforms, preferred.* Experience... 
    Temporary work

    CrossCountry Mortgage

    Charlotte, NC
    4 days ago
  •  ...Cloud Data Engineer This position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise... 

    Euclid

    Charlotte, NC
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to GCP Data Engineer. Be the first to apply!