Senior Data Engineer

Diverse Lynx

Remote

Job Description

Job Title: Senior Data Engineer
Location: Sunnyvale, CA (Remote)
Duration: Fulltime

Skills: Kafka | Python | ETL Testing | Hive
Salary: 120K-150K/Year

Required Skills & Qualifications:

Must Have Technical/Functional Skills

Google Cloud Platform (Eligible to workP)
PySpark
Python
Airflow
Hive
Kafka

Data Pipeline Development, Enhancement & Maintenance

Design, build, and maintain scalable ETL/ELT pipelines.
Automate data ingestion from multiple data sources.
Ensure reliable, high-performance, and scalable data movement.
Develop and Eligible to workimize PySpark-based data processing frameworks.
Build and manage Airflow workflows and orchestration pipelines.
Work with Hive and Kafka-based batch and streaming data solutions.
Implement data quality, monitoring, governance, and operational controls.
Support production incidents, performance tuning, and continuous improvement initiatives

Roles & Responsibilities

The Data Engineer will be responsible for designing, building, governing, and Eligible to workimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations.

Preferred Experience

Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.
Strong experience with large-scale Eligible to workP Data Engineering solutions.
Hands-on experience with Airflow DAG development and support
Experience building and Eligible to workimizing Spark/PySpark data pipelines.
Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Remote vacancy

Senior Data Engineer - USA
...international teams and partners, building technology that creates an impact. Learn more: \n Job Overview We are looking for a Senior Data Engineer based in the US to design, build, and maintain robust data pipelines and scalable infrastructure across our cloud platform....
Senior
Remote work
Coderio
New Jersey
1 day ago
Senior Data Migration Engineer - Enterprise Application Modernization
Description Concept Solutions, LLC (CS) is seeking an experienced Senior Data Migration Engineer to support a mission-critical application modernization program for a Department of War (DoW) customer. In this role, you will lead complex data migration initiatives, ensuring...
Senior
Full time
Contract work
For contractors
Immediate start
Remote work
Monday to Friday
CONCEPT SOLUTIONS LLC
Virginia
2 days ago
Senior Data Engineering Developer
...Exemption Status: Yes Job Summary: The Geisinger Research Data Core is responsible for transforming and managing clinical... ...each project to be successful. We are seeking a skilled Senior Data Engineer with experience in cloud-based data platforms, particularly the...
Senior
Full time
Part time
Work experience placement
Work at office
Local area
Work from home
Shift work
Geisinger
Pennsylvania
1 day ago
Senior Data Engineer - Databricks & Analytics
$90.9k - $129.9k
...co-contractors, suppliers, competitors, academia or the public. What we're looking for ~9+ years of experience in data engineering, ETL/ELT development, and data warehousing, with expertise in modern data solutions. ~ Strong technical skills in Databricks...
Senior
Full time
For contractors
Remote work
Flexible hours
Gainwell Technologies LLC
Ohio
2 days ago
Senior Data Engineer
$140k - $175k
...-generation solutions that patients and healthcare partners need today and into the future. Job Description The Senior Data Engineer will be responsible for building and maintaining the platform that services timely and accurate data for operational teams and...
Senior
Full time
Temporary work
Work experience placement
Remote work
Work visa
Flexible hours
Fuze Health
Kansas, KS
3 days ago
Senior Data Engineer
$160k - $190k
...Senior Data Engineer | GCP, BigQuery & Data Platform I’m recruiting for a growing AdTech company looking for a Senior Data Engineer to take real ownership of its analytical data platform. This is not a role where you inherit a perfectly organized warehouse and spend...
Senior
Remote work
Averity
New York, NY
3 days ago
Senior Data Engineer
...Company – Our client is a growing global provider of data-driven analytical and technical services supporting critical national... ...long-standing reputation as a top workplace. Job Title – Senior Data Engineer Location – Hybrid in Alexandria, VA – typically 3 days...
Senior
Full time
Remote work
Covenant HR
Alexandria, VA
1 day ago
Senior Data Engineer
...Senior Data Engineer (Microsoft Fabric / Azure) Location: Remote Employment Type: Full-Time About the Opportunity We're partnering with an established organization undergoing a significant transformation of its enterprise data infrastructure. They're looking...
Senior
Full time
Remote work
Talent
United States
4 days ago
Senior Data Engineer
...Position: Senior AI Data Engineer Location: remote work (Base location Chicago, IL) Duration: 6+ Months PURPOSE: The Senior AI Data Engineer will join Data Engineering team to deliver data and AI capabilities for key initiatives. This role partners closely with...
Senior
Full time
Remote work
Alpha Business Solutions
Chicago, IL
1 day ago
Senior Data Engineer Databricks
$119k - $145k
...Position: Senior Data Engineer, Databricks Compensation: $119-$145k, depending on experience Location: Remote Inceed has partnered with a great company to help find a skilled Senior Data Engineer Databricks to join their team! This is an exciting opportunity...
Senior
Remote work
Inceed
Greenwood Village, CO
1 day ago
Senior Data Engineer - Data Lake / AI
$170k - $200k
...We are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and AI/ML platform ingestion to join a newly formed data engineering team at one of the world’s largest and most prestigious law firms as it undergoes a major data and AI...
Senior
Full time
H1b
Remote work
Visa sponsorship
Onward Legal Innovation
Washington DC
1 day ago
Senior Data Engineer
...Job Title: Senior Data Engineer Location: Remote (US) Overview We are seeking a hands-on Senior Data Engineer to build, operate, and improve an enterprise data warehouse and production data pipelines in an Azure Databricks environment. This role works across...
Senior
Full time
Contract work
Remote work
NexTech Solutions
Pittsburgh, PA
1 day ago
Senior Data Engineer
...enterprise and federal clients across the United States. We hire engineers directly, invest in specialized training at our own cost, and... ...day one. About the Role :Revature is hiring experienced data engineers to join a large-scale Databricks platform build supporting...
Senior
Full time
Local area
Remote work
Relocation
Revature
Washington DC
2 days ago
Senior Data Engineer
$110k - $160k
...Senior Data Engineer – Enterprise Data Modeling Location: Remote – U.S. | Phoenix, AZ candidates preferred Compensation: $110,000–$160,000 Employment: Full-time About the Company A large, established organization is making a significant investment in...
Senior
Full time
Remote work
Harnham
Phoenix, AZ
3 days ago
Senior Data Engineer
...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...Role: We are seeking an experienced Senior Data Engineer with 8+ years of expertise...
Senior
Full time
Remote work
Quantiphi
United States
4 days ago
Senior Data Engineer
...You’ll build and maintain data pipelines and datasets that support reporting, visualization, machine learning and data-driven decision... ...technical guidance, reviewing code and mentoring other data engineer Requirements ~7+ years of experience in data engineering,...
Senior
Contract work
Bitful Consulting
Remote
18 days ago
Senior Data Engineer
...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...Role: We are seeking an experienced Senior Data Engineer with deep expertise in...
Senior
Full time
Remote work
Quantiphi
United States
23 hours ago
Senior Data Engineer (Snowflake)
...services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence . We work with industry-... ...quickly and effectively. We are looking for a Senior Data Engineer to join a small, cross-functional engineering...
Senior
Full time
Solvd
Remote
9 days ago
Senior Data & Machine Learning Engineer
...personalized ads powered by a self-learning recommendation engine. We're seed-stage and growing quickly. The... ...like owners. Debate is open and direct. We let data settle arguments. THE ROLE We're looking for a Senior Data & Machine Learning Engineer who can...
Senior
PatternIQ
New York, NY
23 hours ago
Senior Data Engineer (Databricks)
...Senior Data Engineer With Databricks Remote, Anywhere in the Continental US Due to the nature of the role, this position requires U.S. Citizenship. Data Surge is disrupting the services industry with cutting-edge technology that brings together the very best...
Senior
Full time
Immediate start
Remote work
Data Surge
United States
4 days ago
Senior Data Engineer
$10k
...of users across the globe, we’ve become the most trusted way to find a relationship, for all. About the Role: As a Senior Data Engineer at Hinge, you will create essential data processes and contribute to components of a modern data pipeline that will be the foundation...
Senior
Full time
Work experience placement
Hinge
New York, NY
1 day ago
Senior Data Engineer - Financial Services & Insurance (Direct Hire/FTE)
...OneUS Technologies has partnered with a premier, globally recognized management and technology consultancy to identify talented Senior Data Engineers. Our client specializes in delivering complex, sector-focused strategy and transformation programs for the financial...
Senior
Permanent employment
Full time
Remote work
Monday to Thursday
Afternoon shift
OneUS Technologies LLC
United States
23 hours ago
Senior Data Engineer
$145k - $165k
...expertise and modern, modular platform, our partners use real-time data to transform their business performance and optimize their... ...models in the marketplace. Position Summary The Senior Data Engineer owns the data platform end to end — designing, building, and...
Senior
Full time
RxSense
Remote
9 days ago
Senior Reference Data Engineer
$150k - $190k
...Insurance and Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,... ...the Role: We are seeking a hands-on Senior Reference Data Tech Lead with 8+ years of professional software engineering experience to design, architect, and enhance...
Senior
Full time
Temporary work
Remote work
Worldwide
BIP US
New York, NY
2 days ago
Senior Data Engineer
...Best Places to Work 4 years in a row! Job Summary The Data Engineer leads the design, development, and maintenance of scalable and... ...junior engineers, and drives innovation and best practices. The Senior Data Engineer collaborates cross-functionally to align data...
Senior
Full time
Work at office
Local area
Work from home
DOWC
Parsippany, NJ
3 days ago
Senior Data Engineer - Hadoop
$145k - $165k
...consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This... ...offering tremendous career growth potential. Job Title: Senior Data Engineer - Hadoop Location: 100% Remote (U.S.) Position Type:...
Senior
Full time
H1b
Local area
Immediate start
Remote work
Visa sponsorship
Bright Vision Technologies
Remote
2 days ago
Senior Data Engineer 2
...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...: Website or LinkedIn Page. Role: Senior Knowledge Graph Engineer Experience:...
Senior
Full time
Remote work
Quantiphi
Remote
7 days ago
Senior Data Engineer
...automation to businesses of all sizes through an innovative warehouse-as-a-service model. What we need Exol is seeking a Senior Data Engineer to join our Data Platform team within our IT organization. Your job will be to design, build, and scale a cloud-native,...
Senior
Full time
Work experience placement
Remote work
Flexible hours
Exol
Remote
4 days ago
Senior Data Engineer
...family rental industry. As an AI native company, we turn complex data into clarity that helps the industry move forward with... ...move the industry forward, together! What you’ll do: As a Senior Data Engineer on the Data Platform team, you will be responsible for building...
Senior
Full time
Mainstay Labs Inc.
Remote
7 days ago
Senior Data Engineer, Consulting
...Senior Consultant, Data Engineering (L4) About Vivanti Vivanti is a home for high-performing technologists who drive measurable impact for clients. Our mission is to transform businesses and build a smarter, more connected world through the power of data, cloud,...
Senior
Full time
Work at office
Work from home
Flexible hours
Shift work
Vivanti Consulting
New York, NY
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!