Senior Data Engineer

Full-time

Ztek Consulting INC

Remote

Job description -

Must Have Technical/Functional Skills

Google Cloud Platform (GCP)
PySpark
Python
Airflow
Hive
Kafka

Data Pipeline Development, Enhancement & Maintenance

Design, build, and maintain scalable ETL/ELT pipelines.
Automate data ingestion from multiple data sources.
Ensure reliable, high-performance, and scalable data movement.
Develop and optimize PySpark-based data processing frameworks.
Build and manage Airflow workflows and orchestration pipelines.
Work with Hive and Kafka-based batch and streaming data solutions.
Implement data quality, monitoring, governance, and operational controls.
Support production incidents, performance tuning, and continuous improvement initiatives

Roles & Responsibilities

The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations.

Preferred Experience

Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.
Strong experience with large-scale GCP Data Engineering solutions.
Hands-on experience with Airflow DAG development and support
Experience building and optimizing Spark/PySpark data pipelines.
Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Remote vacancy

Senior Data Engineer
...Rotterdam 4.202 - 6.351 p.m. Innovatie: Jij bouwt en optimaliseert data-backendoplossingen die onze organisatie intelligenter en efficië... ...oplossingen te ontwikkelen en te implementeren.Als Data Engineer bij Croonwolter&dros ben jij verantwoordelijk voor het ontwerpen...
Senior
Full time
Work at office
Croonwolter&dros
Rotterdam, NY
1 day ago
Senior Data Engineer (Remote)
About the RoleAs Senior Software Engineer, you will collaborate closely with design, product and engineering experts to tackle real-world challenges... ...product teamLeverage critical thinking, experimentation, data, and industry best practices to implement desired business outcomesFacilitate...
Senior
Remote work
Kohl's
Menomonee Falls, WI
2 days ago
Remote Senior Data Engineer
$140k - $170k
DescriptionKforce has a client that is seeking a Remote Senior Data Engineer.Responsibilities:* Design and own end-to-end data architecture: a landing zone with secure cloud object storage for raw partner files and API payloads, validated ingestion pipelines into our transactional...
Senior
Remote work
KForce
Carlsbad, CA
1 day ago
Senior Data Engineer, gTech Users and Products
$156k - $226k
...architecture, technical roadmap, and priorities for large-scale data products, pipelines, and reporting systems within gUP.Scope... ...and scripts.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related field.Experience integrating AI...
Senior
Google
Boulder, CO
23 hours ago
Senior Data Engineer
$91.7k - $163.7k
...medications, and services they need to feel their best. Join us to start Caring. Connecting. Growing together.Position SummaryAs a Senior Data Engineer on the Optum Rx Data Engineering Ops team, you will be responsible for ensuring the reliability, operational excellence, and...
Senior
Minimum wage
Full time
Work experience placement
Local area
Remote work
UnitedHealth Group
Chicago, IL
3 days ago
Senior HPC Data Storage Engineer (RHEL)
$140k - $160k
OverviewAMERICAN SYSTEMS, a 100% employee-owned federal government contractor, is seeking a Senior HPC Data Storage Engineer to manage and optimize high-performance storage supporting mission-critical scientific and technical computing for a specialized customer environment...
Senior
For contractors
Second job
Remote work
AMERICAN SYSTEMS
Arlington, VA
1 day ago
Senior Data Engineer
...Cricut helps turn inspiration into real, tangible creations—one project at a time.Let’s make.Job DescriptionWe're hiring a Senior Data Engineer to shape the data foundation behind Cricut's product analytics, personalization, and AI initiatives. You'll own and evolve our...
Senior
Work at office
Remote work
Relocation
Relocation package
Cricut
Riverton, UT
3 days ago
Senior Data Engineer Remote
Senior Data Engineer
Senior
Full time
Remote work
SFE
Remote
2 days ago
Data Governance Engineer, Senior
$86.9k - $198k
Data Governance Engineer, SeniorThe Opportunity:Are you looking for an opportunity to combine your technical skills with big picture thinking to make an impact on national security? You understand your customer's environment and how to develop the right solutions for their...
Senior
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Columbia, MD
4 days ago
Senior Data Engineer - Remote
$91.7k - $163.7k
...make the health system work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative... ...Growing together.The Optum Health Financial Tech team is seeking a Senior Data Engineer to support Employer & Individual (E&I) HEDIS Retrospective data...
Senior
Minimum wage
Full time
Work experience placement
Work at office
Local area
Remote work
UnitedHealth Group
Eden Prairie, MN
1 day ago
Data Engineer, Senior
$77.6k - $176k
Data Engineer, SeniorThe Opportunity:Booz Allen is seeking a Data Engineer to help troubleshoot and resolve complex data engineering and software development problems. You’ll be responsible for ensuring the reliability, performance, scalability, and security of critical...
Senior
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Chantilly, Loudoun County, VA
2 days ago
Senior Data Engineer, Finance
...experience orchestration. Our platform connects people, systems, data and AI to help organizations deliver more personalized service,... ...You will operate with high autonomy, influencing architecture, engineering standards, and cross-functional data strategy across Finance...
Senior
Full time
H1b
Remote work
Work from home
Worldwide
Work visa
Flexible hours
Genesys
Indianapolis, IN
1 day ago
Senior Data Engineer (Scala) - Remote (USA)
$98.61k - $167.64k
The TeamOur Health Engineering Solutions (HES) team works side by side with customers to articulate a vision for success, and then make it... ...on the right solutions for the customer. We are looking for a Data Engineer who will be a key driver to make this happen. The position...
Senior
Full time
Contract work
Work experience placement
Work at office
Remote work
Flexible hours
ICF
Reston, VA
21 hours ago
Senior Data Engineer
$110k - $165.3k
Job LocationCINCINNATI GENERAL OFFICESJob DescriptionAs a Senior Data Engineer, you will be a technical leader and expert, responsible for architecting, designing, and implementing highly scalable and robust cloud-based data and analytics platforms (DAP) and complex data...
Senior
Full time
Work at office
Relocation
Flexible hours
Procter & Gamble
Cincinnati, OH
21 hours ago
Senior Data Engineer
$170k - $215k
...Build ingestion and transformation layers that stay correct when the upstream system does not. Team Data Engineering Type Full-time Band $170k - $215k Location San Francisco or remote (UTC-8 to UTC+2) We reply within one week, either way. What we look...
Senior
Hourly pay
Full time
For contractors
Remote work
Brainfullstack Ltd.
Eastern, KY
3 days ago
Senior Data Engineer
...Senior Data Engineer Company: ComboCurve Work Type: Remote Employment: Full Time Location: US Seniority: Senior Level Technologies: Python, PyArrow, Pandas, Pydantic, MongoDB, GCP BigQuery, Snowflake, FastAPI, Flask, Postman, Docker, NumPy, SciPy, PuLP, OR-Tools, CI/CD...
Senior
Full time
Remote work
ComboCurve
United States
3 days ago
Senior Data Engineer
$138.87k - $169.73k
...Shield of Massachusetts, we have an exciting opportunity for a Data Engineer to join our Data Delivery team. The primary focus of this role... ...supporting strategic business decisions by working alongside senior engineers and finance stakeholders to build robust data solutions...
Senior
Full time
Work experience placement
Remote work
Shift work
Blue Cross and Blue Shield Association
Boston, MA
2 days ago
Senior Data Engineer
$100k - $196k
About this role: Senior Data Engineer The Data, Analytics and Reporting Technology team is responsible for a cross-cutting set of capabilities within the Global Operations at Wells Fargo. The AI/ML Data Architecture, Engineering and Enablement team is seeking a Senior...
Senior
Full time
Work experience placement
Work at office
Remote work
Flexible hours
Wells Fargo
Charlotte, NC
1 day ago
Senior Databricks Data Engineer
...Senior Databricks Data Engineer (Azure Databricks | Lakehouse | ETL/ELT) Austin, Texas (Hybrid – 3 Days Remote | Onsite Every Monday & Thursday) Experience: Minimum 12+ Years Mandatory Requirements ✔ Databricks Certified Data Engineer (Associate or Professional...
Senior
Temporary work
Local area
Remote work
Delan Associates, Inc
Austin, TX
more than 2 months ago
Senior Remote Data Migration Engineer
A recruiting agency is looking for a Data Engineer to join a partner company. In this remote role, you will lead data migrations and ensure data quality while building robust backend processes. Responsibilities include managing end-to-end migration processes and collaborating...
Senior
Remote work
Flexible hours
Jobgether
United States
23 hours ago
Senior Data Engineer
...Senior Data Engineer Company: M1 Work Type: Remote Employment: Full Time Location: US Seniority: Mid Level Technologies: SQL, Python, dbt, Apache Airflow, AWS, S3, Redshift, Kubernetes Requirements: 5+ years in data engineering or backend software; expert SQL and Python...
Senior
Full time
Remote work
M1
United States
3 days ago
Data Engineer, Senior
$77.5k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield...
Senior
Full time
Contract work
Part time
Work at office
Local area
Remote work
Booz Allen Hamilton
Huntsville, AL
2 days ago
Senior Data Ops Engineer, Data Activation & Products - Activision
$102.8k - $190.2k
Job Title:Senior Data Ops Engineer, Data Activation & Products - ActivisionRequisition ID:R028025Job Description:Your MissionWe are looking for a Site Reliability Engineer to help improve the reliability, observability, and operational maturity of our data platforms, Kubernetes...
Senior
Full time
Temporary work
Part time
Work at office
Local area
Remote work
Worldwide
Relocation package
Monday to Thursday
Activision
Santa Monica, CA
21 hours ago
Senior Data Engineer
...Senior Data Engineer (Level II & Level III) Level II is Remote workLevel III is Onsite at Los Angeles, CA We are looking for experienced Data Engineers to support a large-scale Oracle to Snowflake migration initiative. This role involves dbt development, data transformation...
Senior
Remote work
EITACIES
United States
4 days ago
Senior Data Engineer
...Engineering – Senior Data Engineer – Atlanta or DC Area Preferred – Full-Time DNS and netflow telemetry lands in a data lake in our own AWS account, detection pipelines score it, and the findings are written into an intelligence graph. Security researchers design...
Senior
Full time
Remote work
Flexible hours
Voreas Laboratories Inc.
Eastern, KY
2 days ago
Senior Big Data Engineer
...Focusing on building scalable Big Data solutions, the remote Senior Big Data Engineer will optimize high-load platforms and contribute to a real-time risk assessment project in the cybersecurity and AdTech domain. Key responsibilities Optimize Snowflake performance and...
Senior
Remote work
Virtual Vocations Inc
United States
3 days ago
Senior Data Reporting Engineer
$50 - $52.5 per hour
...Title: Senior Data Reporting Engineer Location: Deerfield, IL - Hybrid (4 Days Onsite / 1 Day Remote) Duration & Type: 6-Month Contract with Potential for Extension or Full-Time Conversion - Hours, Mon-Fri: 8-5pm CST Compensation: Competitive hourly W2 rate ($50-52.50...
Senior
Hourly pay
Full time
Contract work
Local area
Remote work
Chamberlain Advisors
Chicago, IL
3 days ago
Senior Data Analytics Engineer
...To build and scale data products and analytical foundations, the full-time remote Senior Data Analytics Engineer will design, develop, and maintain production-grade analytical models and semantic layers, while collaborating with cross-functional teams to enhance data usability...
Senior
Full time
Remote work
Virtual Vocations Inc
United States
2 days ago
Senior Data/Machine Learning Engineer
$171k - $198k
...standards for product craft and rebuilding the systems behind these experiences. As a Tech Lead specializing in Machine Learning and Data Engineering, you will lead the technical direction for end-to-end ML capabilities that ship as part of our product, while also ensuring...
Senior
Full time
Work at office
Local area
Relocation
The Coca-Cola Company
Atlanta, GA
23 hours ago
Senior Data Engineer
...Role and Responsibilities Design and implement large-scale data architectures and optimize data pipelines daily. Monitor... ...Qualifications and Education Requirements ~10+ years of data engineering experience ~ Proficient in SQL, Python, dimensional modeling,...
Senior
Work at office
Remote work
LucyRx
Eastern, KY
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!