Senior Data Engineer
Diverse Lynx
Senior Data Engineer
Location: Sunnyvale, CA (Remote) Duration: Fulltime Skills: Kafka | Python | ETL Testing | Hive Salary: 120K-150K/Year
Required Skills & Qualifications: Must Have Technical/Functional Skills
- Google Cloud Platform (Eligible to workP)
- PySpark
- Python
- Airflow
- Hive
- Kafka
Data Pipeline Development, Enhancement & Maintenance
- Design, build, and maintain scalable ETL/ELT pipelines.
- Automate data ingestion from multiple data sources.
- Ensure reliable, high-performance, and scalable data movement.
- Develop and optimize PySpark-based data processing frameworks.
- Build and manage Airflow workflows and orchestration pipelines.
- Work with Hive and Kafka-based batch and streaming data solutions.
- Implement data quality, monitoring, governance, and operational controls.
- Support production incidents, performance tuning, and continuous improvement initiatives
Roles & Responsibilities
- The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations.
Preferred Experience
- Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.
- Strong experience with large-scale data engineering solutions.
- Hands-on experience with Airflow DAG development and support
- Experience building and optimizing Spark/PySpark data pipelines.
- Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
- Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable
Diverse Lynx LLC is an Equal Opportunity Employer. All applicants and employees are evaluated without discrimination, based solely on their qualifications, ability, competence and performance. This email and its attachments may contain confidential or proprietary information and is intended only for the recipient(s). If you received this message in error, please disregard it and notify the sender. If you no longer wish to receive our communications, you may unsubscribe at any time.
Our official website is We do not operate or authorize any other websites representing Diverse Lynx LLC.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in United States vacancy
- ...Job Title: Senior AWS Data Engineer Experience: 8+ Years Skills: AWS Glue, Lambda, Pyspark, Python Location: Fort Mill, SC Job Description : Develop migration workflows based on the approved metadata extraction design. Implement support for full...SeniorFull time
Coforge
Fort Mill, York County, SC1 day ago - Job ID: 21061868Reference Number: 24-00028Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-05Company: HAN StaffingDESenior
HAN Staffing
Iselin, NJ1 day ago - Job ID: 21057342Reference Number: 24-00019Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-04Company: HAN StaffingData EngineerSenior
HAN Staffing
Iselin, NJ1 day ago $160k - $190k
...Senior Data Engineer | GCP, BigQuery & Data Platform I’m recruiting for a growing AdTech company looking for a Senior Data Engineer to take real ownership of its analytical data platform. This is not a role where you inherit a perfectly organized warehouse and spend...SeniorRemote workAverity
New York, NY1 day ago$110k - $150k
...SENIOR DATA ENGINEER – ENTERPRISE DATA MODELING HYBRID IN PHOENIX, AZ $110,000 – $150,000 BASE + BENEFITS The Opportunity We're partnering with a large enterprise organization modernizing its data platform and looking for a Senior Data Engineer with strong...SeniorHarnham
Phoenix, AZ23 hours ago- ...We are looking for a Senior Data Engineer to support a major billing data migration from Recurly to Stripe . This engineer will play a key role in building and validating the data infrastructure required to move from the existing Recurly environment to Stripe, including...SeniorFull time
Gardner Resources Consulting, LLC
New York, NY3 days ago - Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:... ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,...SeniorContract workRemote work
HAN Staffing
Iselin, NJ1 day ago - THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SeniorWork at office
Harnham
Boston, MA23 hours ago - ...Job Title: Senior Data Engineer Location: Washington, DC (Onsite Job) Employment Type: Full Time Must-Haves ~4+ years of hands-on Data Engineering experience ~ Experience delivering multiple production-grade cloud data platform implementations ~ Advanced...SeniorFull time
Galent
Washington DC23 hours ago - ...Looking for Data Engineer in Redmond, WA . US Citizen only . Responsibilities 1. Ingest and process data from Salesforce (Investments), Dynamics 365 & Coupa (Finance), Workday (HR), Concur (Operations), and external program/partner data (e.g., Health, Education)....SeniorFull time
Sophus IT Solutions
Redmond, WA1 day ago - TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...SeniorFull time
Gen Digital
Tempe, AZ23 hours ago - ...Role: Data Engineer Engagement: Fixed-term contract Location: Chicago, IL (hybrid) About the Role The role will design and deliver data pipelines, data model and AI-ready data products for our Leasing data platform, with structured deliverables. Responsibilities...SeniorFixed term contract
TechNET
Chicago, IL-4 - ...Job Title: Senior Data Engineer (Palantir) Location- Lafayette, LA, Knoxville, TN, Birmingham, AL Position Description: CGI is seeking a Senior Data Engineer with deep expertise in Palantir Foundry to join a fast-paced data engineering team supporting large scale...Senior
Mastech
Lafayette, LA-4 - ...Are you an experienced Senior Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Senior Data Engineer to work at their company. Need only US Citizens Description: This role...Senior
TALENT Software Services
United States3 days ago - ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Senior Data EngineerLocation - Mount Laurel, NJ (Day 1 Onsite)Job Description:Senior Data Engineer with 10 + years of experienceWorked on ETL, Azure, Databricks, Informatica, Oracle...SeniorWork at office
SRI Tech
Mount Laurel, NJ23 hours ago - ...Job Title- Senior Data Engineer Location, Denver, Colorado Job Type- Full Time AWS Data Services PostgreSQL AWS Glue Apache Spark / PySpark SQL Data Modeling ETL/ELT Development Microsoft SQL Server Design, develop, and maintain...SeniorFull time
Maveric Systems Limited
Denver, CO3 days ago - ...About the Role We are looking for a Senior Data Engineer to help build and improve our clients data privacy and PII management capabilities. This person will work closely with Data Engineering, Data Platform, Legal, and application/data owners to identify sensitive data...SeniorFull time
Gardner Resources Consulting, LLC
New York, NY3 days ago - ...Senior Data Engineer | Miami | Enterprise Data Platform I’m hiring a Senior Data Engineer to help build and operate a scalable enterprise data platform within a growing financial services organization. This is a hands-on role where you’ll own data pipelines...SeniorFull time
Harnham
Miami, FL23 hours ago - ...and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses... ...practices. • Integrate up-and-coming data management and software engineering technologies into existing data structures. • Develop set...SeniorFull timeWork experience placement
OpTech
Cincinnati, OH2 days ago - ...Position Overview Objectways is seeking an experienced Senior Data Engineer to design, develop, and maintain modern data platforms supporting analytics, reporting, machine learning, and business operations. Strong experience with the Google Cloud Platform ecosystem,...SeniorFull time
Objectways
Phoenix, AZ23 hours ago - ...We are seeking a Senior Data Engineer to design, develop, and optimize scalable data integration pipelines and data solutions. This is a hands-on engineering role with a strong focus on Databricks, Spark/PySpark, Python, SQL, Delta Lake, and Unity Catalog. The ideal...Senior3 days per week
G2O
Cleveland, OH23 hours ago - ...MDM Lead Engineer — Semarchy xDM Client: Asset Management Firm Location: New York City — Hybrid, 3 days onsite per week Employment... ...MDM Lead Engineer to support our end-client's Client Master Data team. This individual will serve as the technical owner of the Master...SeniorFull time3 days per week
Tiger Advisory
New York, NY2 days ago - ...Senior Data Engineer Fort Mill, SC Responsibilities: Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake. Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks...SeniorFull time
Coforge
Fort Mill, York County, SC2 days ago $160k - $180k
...Senior Data Engineer Location: Orange County, CA Salary: $160-180k base + equity We are working with a rapidly scaling advanced technology company developing integrated software and hardware systems that operate in real world environments. Their platform processes...SeniorFull timeHarnham
Orange County, CA-4- OverviewWe are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into...Senior
Susquehanna International Group
Bala Cynwyd, PA4 days ago $119k - $145k
...Position: Senior Data Engineer, Databricks Compensation: $119-$145k, depending on experience Location: Remote Inceed has partnered with a great company to help find a skilled Senior Data Engineer Databricks to join their team! This is an exciting opportunity...SeniorRemote workInceed
Greenwood Village, CO-4- ...more than 40 years and has earned repeated recognition for both its healthcare content and workplace culture. Job Title - Senior Data Engineer Location - Hybrid in Montvale, NJ — 3 days per week onsite Role Type - 6–12 month contract Must Have Skills:...SeniorContract work3 days per week
Covenant HR
Montvale, NJ3 days ago - ...A leading global investment manager is expanding its data engineering function to support investment, research, and operational teams across the firm. The data team is responsible for building and maintaining the core data platform that powers analytics, reporting, and...SeniorFull time
Mondrian Alpha
New York, NY-4 - ...allows their financial services clients to provide high-level service and returns for their clients. They are currently hiring a Senior Data Engineer to work hybrid on-site in their NYC office 4 days per week. Qualified candidates will have 5-7+ years of professional...SeniorFull timeCurrently hiringWork at officeImmediate start
The Cypress Group
New York, NY-4 - Senior to Principal Data Engineer (SQLserver, Financial Services), Boston, MA. Hybrid, min 3 days week in office, 135k to 175k base on experienceCompensation Commensurate with experience, EOE, diverse highly educated culture Candidates must be a U.S. citizen or national...SeniorPermanent employmentContract workWork at officeLocal area3 days per week
BlueSkyClarity
Boston, MA23 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data pipeline engineer United States
- big data cloud engineer United States
- entry level big data engineer United States
- senior data quality engineer United States
- junior data developer United States
- data engineer graduate United States
- senior cloud data engineer United States
- junior data engineer United States
- data integration engineer United States
- bi data engineer United States