Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

Guru Schools

Overview:

Role: Data Engineer

Location: New York (100% onsite) (Need local to NY)

Interview mode: (1 Video interview and Client will be in person)

Rate: $70/hr. on C2C

Candidates need to have colab set up ready with Gmail account so they can code on the L1 interview

Must have:

Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL

Cloud Platforms: AWS

Data Warehousing & Analytics: Redshift or Snowflake or Big Query

Data Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bricks

CI/CD: AWS Code Pipeline, Jenkins, CloudFormation, Docker, Kubernetes

Job Description:

  • Results-driven Data Engineer with a decade of expertise in Data engineering across cloud platforms with a total of 12 years in IT.
  • Extensive experience utilizing Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Dataprep, and Pub/Sub, for data engineering solutions.
  • Proficient in building and managing GCP data pipelines with tools like Cloud Composer and Cloud Dataflow.
  • Proven ability in developing and deploying applications on Google Kubernetes Engine (GKE).
  • Strong background in implementing security and compliance on GCP, ensuring data privacy and regulatory adherence.
  • Track record of optimizing cost and resource usage within GCP environments.
  • Skilled in AWS services such as Amazon EMR, Redshift, and Glue for efficient data processing.
  • Expertise in architecting scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless computing.
  • Adept at setting up AWS Kinesis streams to process real-time data, enhancing system responsiveness and data-driven decision-making.
  • Proficient in leveraging AWS DynamoDB to create scalable, low-latency NoSQL databases for dynamic applications.
  • Deep expertise in optimizing and managing Amazon Redshift data warehouses to deliver high-performance analytics and business insights.
  • Experienced in integrating AWS services into CI/CD pipelines, streamlining automation for continuous integration, delivery, and deployment.
  • Skilled in setting up and securing AWS Virtual Private Cloud (VPC) environments.
  • Proficient in managing Azure virtual machines (VMs) for cloud infrastructure operations.
  • Extensive experience managing on-premises data infrastructure, including data warehouses and databases.
  • Familiar with AWS DevOps practices for continuous integration and deployment.
  • Expertise in using Git for version control in DBT projects, ensuring proper tracking and documentation of data model changes.
  • Skilled in performance optimization and tuning of on-premises data systems.
  • Proficient in data migration strategies between on-premises and cloud environments.
  • Strong troubleshooting skills in resolving issues within on-premises data systems.
  • Proven ability to maintain high availability and disaster recovery solutions in on-premises environments.
  • Experienced in implementing CI/CD pipelines using tools like Jenkins and GitLab CI/CD.
  • Adept in automated testing processes, including unit, integration, and regression testing.
  • Skilled in gathering and analyzing project requirements to ensure alignment with business goals.
  • Experienced in Agile project management, contributing to successful outcomes through data-driven analytics and collaborative teamwork

Skills:

Data Analysis,AWS CWI
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
  • Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...
    Suggested

    ECHO IT SOLUTIONS INC .

    New York, NY
    5 days ago
  •  ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical... 
    Suggested

    TMX Group

    New York, NY
    a month ago
  •  ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required... 
    Suggested
    Full time

    Centraprise

    Jersey City, NJ
    5 days ago
  • $220k - $230k

     ...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress...  ...Teams. Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production... 
    Suggested
    Local area
    Flexible hours

    Galaxy USA

    New York, NY
    3 days ago
  •  ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design... 
    Suggested
    Long term contract
    Work at office

    InterSources

    New York, NY
    5 days ago
  •  ...Video Visa : USC, GC, GC EAD, H4, L2 This is onsite from day-1 Description : Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in the Asset Management/ Financial Services / Investment Management... 

    ShiftCode Analytics

    New York, NY
    4 days ago
  • $220k - $300k

     ...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines... 
    Local area
    Remote work
    Flexible hours

    Bayview Asset Management

    New York, NY
    1 day ago
  • $175k - $255k

     ...deserve, we'd love to meet you. About the Role The Revenue Engine team at Charlie Health services all parts of our business...  ...externally sourced datasets, and building user-facing products. As a data engineer on the Revenue Engine team, you will be responsible for... 
    Full time
    Work at office
    Local area

    Charlie Health Outreach

    New York, NY
    5 days ago
  •  ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern cloud environments. This role requires full lifecycle ownership across Snowflake pipelines, data modeling, and... 

    TheStaffed

    New York, NY
    5 days ago
  •  ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15... 
    Contract work

    Argyle Infotech

    New York, NY
    5 days ago
  •  ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building a... 

    Maintec Technologies

    New York, NY
    4 days ago
  • $220k

     ...Specialist Recruiter | Databricks Data Engineer Recruitment | Connecting Top Talent with Leading US Opportunities Job Title: Lead Data Engineer Location: Remote Employment Type: Full-time Compensation: Up to $220k + benefits About the Role We’re hiring experienced Lead... 
    Full time
    Remote work
    Flexible hours

    KDR Talent Solutions USA

    New York, NY
    1 day ago
  • $174k - $230k

     ...The Job We are looking for our first in-house Data Engineer to own and evolve our core data infrastructure. This is an early and high-impact role. As the data engineering function grows under Engineering, you’ll have a real voice in shaping how it’s built - the processes... 
    For contractors
    Remote work

    Atticus Inc

    New York, NY
    1 day ago
  •  ...Job Title: Lead Data Engineer Location: Jersey City Type: Contract Key Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Responsibilities: ~ Lead the design, development, and implementation of data solutions using AWS and Snowflake... 
    Contract work
    Work experience placement

    VBeyond

    Jersey City, NJ
    1 day ago
  •  ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location... 
    Remote work

    VBeyond

    Jersey City, NJ
    2 days ago
  •  ...English, both spoken and written. Please note that all resumes should be submitted in English. We are seeking two Data Analysts, one specializing in data engineering & migration, and another focused on data pipeline & automation. Candidates with strengths in either area are... 
    Full time
    Temporary work
    Remote work
    Monday to Friday

    World Business Lenders

    New York, NY
    1 day ago
  •  ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business...  ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science... 

    MetLife

    New York, NY
    4 days ago
  • $160k - $220k

     ...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we... 
    Full time
    Worldwide
    Relocation
    Flexible hours
    Shift work
    Night shift
    Day shift

    Deliberate AI

    New York, NY
    5 days ago
  • Job Title Okay with relocation. 5 Openings total. USC/GC/H4 Only! Client: Fidelity location: Jersey City, NJ (Hybrid) Duration: 12 Month+ Pay: $68/Hr W2 Need LinkedIn Must Have Skills: Skills wise we need a Senior Level Oracle Database Developer, that is ...
    Relocation

    Saxon Global

    Jersey City, NJ
    5 days ago
  • $100k - $120k

     ...Lead Data Engineer This role is to be based near our offices in New York City or West Los Angeles. We drive intelligent growth for ambitious businesses and leading brands. Customer understanding is more potent and drives greater value when insights go to work... 
    Worldwide

    Material Service Corporation

    New York, NY
    22 days ago
  • TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...

    Gen Digital Inc

    New York, NY
    3 days ago
  •  ...collaborate directly with the client's team, make business trips.... Digis islooking for anexperienced, proactive, and self-driven Lead Data Engineer tojoin our fully remote team. About the Project You’ll bepartofalarge-scale platform focused on performance management and... 
    Remote work

    DIGIS Corporation

    New York, NY
    1 day ago
  •  ...hands-on skills in PySpark, Python, and SQL, with experience in building, operating, and optimizing data pipelines. Additionally, candidates with application engineering experience should have proficiency in building APIs using FastAPI or Flask and possess robust data modeling... 

    Optomi

    Jersey City, NJ
    4 hours ago
  •  ...EPAM Systems, Inc. is seeking a candidate to lead the development of a data platform while overseeing teams. Applicants should have strong skills in Python and SQL, and a deep understanding of AWS tools and micro-service architecture. Enjoy flexible scheduling, opportunities... 
    Remote work
    Flexible hours

    EPAM Systems Inc

    New York, NY
    23 hours ago
  • $125k - $140k

     ...Back Cloudera Data Engineer – Application Development, remote, Mar 3, 2026 Blu Omega is looking for a Cloudera Data Engineer. In this role, you’ll work with a variety of technologies across the Hadoop and Cloudera ecosystems to move, transform, and optimize data from multiple... 
    Work experience placement
    Remote work

    Blu Omega LLC

    New York, NY
    4 days ago
  •  ...A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing robust data pipelines, guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over 5... 

    OPSWAT

    New York, NY
    1 day ago
  •  ...A leading technology firm is seeking a Mid-Senior level Data Engineering Lead to manage a team for complex data integration projects. Your responsibilities will include designing data models, developing ETL/ELT pipelines, and ensuring data accuracy. The ideal candidate... 
    Remote work

    Largeton Group

    New York, NY
    1 day ago
  •  ...As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing and maintaining technical excellence within our data engineering team. Your deep expertise in data architecture, ETL processes, and data modeling will be instrumental in optimizing data workflows... 
    Flexible hours

    Rearc

    New York, NY
    1 day ago
  •  ...Lead Data Engineer, Identity & Access Management position This is a hybrid Lead Data Engineer role working from either the NYC, Seattle, WA, Burbank, CA or Orlando, FL offices - 4 days onsite Work location: NY, Seattle, Burbank, or Orlando INTERNAL NOTES:... 
    For contractors
    Immediate start

    3B Staffing LLC

    New York, NY
    5 days ago
  •  ...Title: Lead Snowflake Data Engineer Location: NYC | Fully Onsite | Prioritizing local candidates Contract with potential for extension We are seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern... 
    Contract work
    Local area

    Suncap Technology

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!