Data Engineer - GCP

Prophecy Technologies

Job Summary

The Senior Data Engineer will design, build, optimize, and support enterprise-scale data pipelines within a hybrid big data architecture , primarily on Google Cloud Platform (GCP) . This role focuses on data ingestion, transformation, governance, and curation while ensuring performance, cost efficiency, security, and compliance with enterprise standards.

Role Descriptions / Responsibilities

Re-write and enhance existing data pipelines to meet evolving business needs.
Design and build production-grade data pipelines from ingestion to consumption in a hybrid big data environment.
Develop pipelines using Java, Python, GCP Dataflow, and Apache Airflow .
Design and implement Collibra workflows using Java .
Design and implement data ingestion, transformation, and curation solutions using GCP-native and custom frameworks.
Optimize data pipelines for performance, scalability, and cost efficiency across large-scale data lakes.
Ensure technical specifications align with business requirements and enterprise architecture standards.
Partner with external consultants, solution providers, and managed services teams to deliver compliant and scalable solutions.
Collaborate across multiple teams to track project progress, identify risks, and communicate status and impacts to leadership.
Proactively propose process, platform, and technical improvements .
Ensure platforms and tools meet data security, audit, and compliance requirements .
Apply best practices for frameworks, naming conventions, scripting, and coding standards.
Communicate technical concepts clearly to non-technical stakeholders.

Essential Skills & Qualifications

Bachelor's degree or equivalent work experience.
8+ years of engineering experience in Big Data, Data Analytics, and Data Integration .
2+ years of hands-on experience in GCP Data Engineering and Cloud Analytics solutions.
5+ years of programming experience with:
Python
Java
Spring Boot, Spring MVC
REST API development
Hands-on experience with CI/CD pipelines (Concourse, Jenkins).
Experience with GCP Data Ingestion technologies :
Dataflow
Fusion
Airflow
Experience designing and optimizing data models using BigQuery .
Experience integrating KMS / HSM solutions with GCP data services.
Experience implementing metadata management solutions on GCP.
Strong verbal and written communication skills

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Data Engineer - GCP in Dublin, OH vacancy

Data Engineer (IAM Data Lake - GCP) - OH, TX
$53 - $57 per hour
...Information Security Engineer 3 / Data Engineer (IAM Data Lake – GCP) Client: Financial Services Team: TBA Location: Columbus, OH / Irving (Las Colinas), TX – Hybrid Contract Length: 12mo Pay Rate: $53 - $57 Top Requirements: #4+ years of data engineering...
Suggested
Contract work
Apex Systems Inc Defunct
Columbus, OH
5 days ago
Senior Data Engineer (AWS, Azure, GCP)
...that spans across the country. Job Description CapTech Data Engineering consultants enable clients to build and maintain advanced data... ...using at least one cloud-based solution/platform (AWS, Azure, GCP) ~ Advanced level proficiency with at least one ETL / Data...
Suggested
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech Consulting
Columbus, OH
4 days ago
Data Engineer (AWS, Azure, GCP)
...Data Engineer (AWS, Azure, GCP) CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From...
Suggested
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech Consulting
Columbus, OH
2 days ago
Analytics Engineer
...details are as follows: As an Analytics Engineer, you will be responsible for designing,... ...developing, and testing software and scalable data solutions. You will collaborate with team... ...Desired Skills Cloud platforms (AWS, GCP, Azure), CI/CD, Testing frameworks (...
Suggested
Work experience placement
Work at office
Local area
Worldwide
3 days per week
OCLC
Dublin, OH
4 days ago
Lead data Engineer
...Title : Lead data Engineer Location: Dublin, Ohio Duration: 6 Months C2H Description : Seeking a Lead Data Engineer is responsible for the design and construction of data flows that assemble and refine complex data sets into usable information...
Suggested
Surya Systems
Dublin, OH
4 days ago
Cloud Data Engineer (AWS/Azure/GCP) - Remote
A consulting firm in Columbus, OH seeks an experienced Cloud Data Engineer to design and implement data solutions using the latest cloud technologies. The ideal candidate has over 5 years of experience in data engineering and a strong proficiency in at least one ETL technology...
Remote job
Full time
CapTech
Columbus, OH
5 days ago
Data Engineer
$43.59 - $51.59 per hour
...Data Engineer Genesis10 is currently seeking a Data Engineer for a contract position with a Global Financial Institution located in Columbus... ...-on experience building a Data Lake in Google Cloud Platform (GCP) using big data tools and technologies. Responsibilities:...
Hourly pay
Contract work
Genesis10
Columbus, OH
2 days ago
Sr. Data Engineer
$150k - $190k
...for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of... ...Public cloud expertise and/or certifications - Azure, AWS, GCP Hands-on experience with DevOps methodologies and concepts including...
Work experience placement
Worldwide
Flexible hours
Shift work
SHI GmbH
Columbus, OH
5 days ago
Data Engineer
$65k
Position Overview We are seeking a motivated Data Engineer to join our Data Engineering team. The ideal candidate will have exposure in Python... ...initiatives, including cloud-based solutions (AWS, Azure, GCP). Automate repetitive data engineering tasks and contribute to...
Hourly pay
Temporary work
Work at office
Relocation
Cognizant
Columbus, OH
3 days ago
Data Engineer
JOB SUMMARY: We are seeking a skilled Data Engineer to join our Analytics & Automation team and serve as the primary architect and builder of our data pipelines. This role will be responsible for designing, implementing, and maintaining scalable, cost-effective data solutions...
Work at office
Flexible hours
EASE Logistics Services LLC
Dublin, OH
5 days ago
Lead Machine Learning / Data Science Engineer
...Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus... ...enterprise-level data platforms (e.g., AWS, Azure, GCP). Designing, developing, and deploying advanced...
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech Consulting
Columbus, OH
26 days ago
Senior Data Engineer - Analytics
...Job Title: Senior Data Engineer - Analytics Essential Functions: Collaborate with other internal teams to design data pipelines... ...Redshift. Experience with cloud services such as AWS, Azure, GCP. Experience in developing large scale data models and...
Contract work
Work experience placement
RevSpring
Columbus, OH
4 days ago
US Data Engineering P5
...innovators come together to shape what’s next. Whether you're engineering advanced materials, transforming manufacturing technologies, or... ...platform that integrates operational technology (OT), industrial data, advanced analytics, AI, and digital twin technologies to drive...
Remote work
Worldwide
Hexion
Worthington, OH
2 days ago
Data Engineer (Palantir Foundry)
...Job summary: We are seeking two US-based senior-level software or data engineers to support application development and data engineering initiatives using Palantir Foundry. The role focuses on transforming data and building application dashboards using Foundry's...
Prophecy Technologies
Dublin, OH
3 days ago
Lead Data Engineer - Primary Care
$142.3k - $195.7k
...Become a part of our caring community The Lead Data Engineer oversees data processing architectures and solutions ensuring the efficient... ...cloud or AI platform such as Snowflake, Azure, Databricks, AWS, or GCP. Travel: While this is a remote position, occasional travel...
Full time
Temporary work
Apprenticeship
Remote work
CenterWell
Columbus, OH
4 days ago
Consultant, Data Engineering
...A Little About Us EDB provides a data and AI platform that enables organizations to harness... ...role is ideal for a high-performing Data Engineer or Analytics Consultant who thrives in a... ...one major cloud provider (AWS, Azure, or GCP) and core modern data stack tools (e.g.,...
Remote work
EDB
Columbus, OH
8 days ago
Enterprise Payments IS Programmer/Analyst SR - GCP
$55 - $68 per hour
...Senior Programmer/Analyst (GCP) Genesis10 is currently seeking a Senior Programmer/Analyst (GCP) for a contract to hire position with... ...APIs using Apigee or GCP API Gateway Design and manage data solutions using Cloud SQL, BigQuery, and Firestore Write clean...
Hourly pay
Contract work
Genesis10
Columbus, OH
3 days ago
Data Architect (AWS, Azure, GCP)
...businesses. We unite diverse skills and perspectives to transform how data, systems, and ingenuity enable each client to advance what's... ...architectures and concepts such as cloud services (e.g., AWS, Azure, GCP), real-time data distribution (e.g., Kafka, Kinesis, DataFlow,...
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech Consulting
Columbus, OH
17 days ago
AVP, AI Data Engineering, Customer Data Ecosystem
$182k - $273k
...AVP Data Engineering - GE05AE We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages... ...next-generation cloud technology stack across AWS or GCP Cloud and Snowflake. Exceptional presentation and verbal/written...
Temporary work
Work at office
Remote work
3 days per week
The Hartford
Columbus, OH
4 days ago
Principal Engineer I - Senior Data Engineer
...Job Title: Principal Engineer I - Senior Data Engineer Location: Block 23 What you'll do: As the Principal Data Engineer, you... ...certifications with any major cloud provides (Azure, AWS, GCP) is preferred. Banking or financial services industry experience...
Western Alliance Bank
Columbus, OH
1 day ago
Data Engineer - Senior Associate
$77k - $202k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...Engineer, Google Professional Cloud Architect, GCP Data Engineer Microsoft Azure Solutions...
Full time
H1b
PwC
Columbus, OH
4 days ago
Senior Staff AI Data Engineer - Hybrid
$135.04k - $202.56k
...Sr Staff Data Engineer - GE07DE We're determined to make a difference and are proud to be an insurance company that goes well beyond coverages... ...~ Hands-on experience with cloud ecosystems (AWS, GCP, Azure, Snowflake) and Python-based data engineering stacks ~...
Temporary work
Work at office
3 days per week
The Hartford
Columbus, OH
2 days ago
Senior GCP Data Architect - Hybrid
$88 - $100 per hour
...Senior Google Cloud Data Architect Genesis10 is currently seeking a Senior Google Cloud... ...(including Bigtable, Spanner and other GCP services) to meet throughput, latency,... ...experience in data architecture, cloud data engineering, or enterprise data platform design...
Permanent employment
Contract work
Genesis10
Columbus, OH
5 days ago
GCP Data Architect
...I have an opportunity for "GCP Data Architect" and looking for a candidate who can join Immediately if you are interested reply me with... ...• Certifications o Minimum: Google Professional Data Engineer, Google Professional Cloud Architect o Preferred: Google...
Contract work
Immediate start
Navtech
Columbus, OH
4 days ago
Data Engineer - Senior Manager
$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...Engineer, Google Professional Cloud Architect, GCP Data Engineer Microsoft Azure Solutions...
Full time
H1b
PwC
Columbus, OH
5 days ago
Data Engineer - Cloud/AI
...Job Description Job Summary As a Data Engineer - Cloud/Gen AI , you will be responsible for designing, building, and maintaining scalable... ...Services (AWS), Microsoft Azure, and/or Google Cloud Platform (GCP) Understanding of emerging technologies (such as Generative...
Temporary work
Vertiv Group Corp.
Westerville, OH
2 days ago
Data Engineer - Manager
$99k - $232k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...Engineer, Google Professional Cloud Architect, GCP Data Engineer Microsoft Azure Solutions...
Full time
H1b
PwC
Columbus, OH
13 days ago
Senior Data Analytics Engineer
$68.5k - $88.02k
Cardinal Health is looking for a Senior Specialist in Data Analytics to oversee the analytics life-cycle. Ideal candidates should have hands-on experience with Python scripting, enterprise scheduling tools, and database design practices. The position offers a salary range...
Full time
Cardinal Health
Dublin, OH
4 days ago
Senior Data Platform Engineer
...marketing pros, and support teams around the world. The Job Details are as follows: OCLC, Inc. seeks a Senior Data Platform Engineer at its Dublin, OH HQ, to develop and enforce operational best practices to maintain availability and responsiveness of...
Worldwide
OCLC
Dublin, OH
3 days ago
IS Technical Specialist (.NET/GCP/PowerShell)
$70k - $140k
...related work experience may be considered. Dev lead experience, Small team leadership experience. .NET, API, PowerShell scripting, Zena, GCP, cloud serverless, cloud run/functions. Agile methodology, Scrum delivery model experience. SailPoint and entitlement creation and...
Work experience placement
Work at office
Remote work
Work from home
Flexible hours
Huntington National Bank
Columbus, OH
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - GCP. Be the first to apply!