Data Engineer
Guru Schools
Overview: Role: Data Engineer Location: New York (100% onsite) (Need local to NY) Interview mode: (1 Video interview and Client will be in person) Rate: $70/hr. on C2C Candidates need to have colab set up ready with Gmail account so they can code on the L1 interview Must have: Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL Cloud Platforms: AWS Data Warehousing & Analytics: Redshift or Snowflake or Big Query Data Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bricks CI/CD: AWS Code Pipeline, Jenkins, CloudFormation, Docker, Kubernetes Job Description:
- Results-driven Data Engineer with a decade of expertise in Data engineering across cloud platforms with a total of 12 years in IT.
- Extensive experience utilizing Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Dataprep, and Pub/Sub, for data engineering solutions.
- Proficient in building and managing GCP data pipelines with tools like Cloud Composer and Cloud Dataflow.
- Proven ability in developing and deploying applications on Google Kubernetes Engine (GKE).
- Strong background in implementing security and compliance on GCP, ensuring data privacy and regulatory adherence.
- Track record of optimizing cost and resource usage within GCP environments.
- Skilled in AWS services such as Amazon EMR, Redshift, and Glue for efficient data processing.
- Expertise in architecting scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless computing.
- Adept at setting up AWS Kinesis streams to process real-time data, enhancing system responsiveness and data-driven decision-making.
- Proficient in leveraging AWS DynamoDB to create scalable, low-latency NoSQL databases for dynamic applications.
- Deep expertise in optimizing and managing Amazon Redshift data warehouses to deliver high-performance analytics and business insights.
- Experienced in integrating AWS services into CI/CD pipelines, streamlining automation for continuous integration, delivery, and deployment.
- Skilled in setting up and securing AWS Virtual Private Cloud (VPC) environments.
- Proficient in managing Azure virtual machines (VMs) for cloud infrastructure operations.
- Extensive experience managing on-premises data infrastructure, including data warehouses and databases.
- Familiar with AWS DevOps practices for continuous integration and deployment.
- Expertise in using Git for version control in DBT projects, ensuring proper tracking and documentation of data model changes.
- Skilled in performance optimization and tuning of on-premises data systems.
- Proficient in data migration strategies between on-premises and cloud environments.
- Strong troubleshooting skills in resolving issues within on-premises data systems.
- Proven ability to maintain high availability and disaster recovery solutions in on-premises environments.
- Experienced in implementing CI/CD pipelines using tools like Jenkins and GitLab CI/CD.
- Adept in automated testing processes, including unit, integration, and regression testing.
- Skilled in gathering and analyzing project requirements to ensure alignment with business goals.
- Experienced in Agile project management, contributing to successful outcomes through data-driven analytics and collaborative teamwork
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
- ...Data Engineer To build, manage, optimize, and assist in the design of data pipelines in support of information, analytics, and strategic business needs across the enterprise. Identify and understand source data systems and data flow between systems. Recognize...SuggestedWork at office
Michigan Farm Bureau
New York, NY13 hours ago - ...and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorganChase within the Commercial & Investment Bank Operational Resiliency team, you are an integral part of an agile team...Suggested
JP Morgan Chase
New York, NY3 days ago - ...TimeWorking Type On SiteJob Reference 0000017586Salary Type AnnuallyIndustry Hedge Fund;Private EquitySelling Points Drive impactful data engineering initiatives in a fast-paced financial environment. Collaborate on innovative projects utilizing cutting-edge technologies....Suggested
Green Key Resources
New York, NY4 days ago $100k - $150k
$100,000-$150,000 per annum New York, United States Permanent Data Catalog EngineerNew York, NY - Hybrid (3 Days Per Week in Office) My client is seeking a Data Catalog Engineer to join a growing Data Governance team focused on improving data discovery, lineage...SuggestedPermanent employmentWork at office3 days per weekApollo Solutions
New York, NY4 days ago- ...Venture Capital and Private EquitySelling Points Shape scalable data systems to drive strategic insights and analytics. Collaborate with... ...with cutting-edge optimization techniques.Job DescriptionData Engineer OverviewThe Data Engineer will design and implement scalable...Suggested
Green Key Resources
New York, NY1 day ago $50 - $60 per hour
DescriptionKforce has a client seeking a hybrid Data Engineer to join their team in Dallas, TX, Raleigh, NC, or Princeton, NJ.Summary:This role is centered on developing reliable data solutions within an existing enterprise platform. The position requires more than moving...KForce
New York, NY3 days ago$101.7k - $119.6k
Are you ready to make an impact?West Monroe is seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their most complex needs, working alongside a team of highly skilled engineers and...Local areaImmediate startFlexible hours2 days per weekWest Monroe Partners
New York, NY2 days ago$137.7k - $229.5k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ..., and fuel growth through innovation.Work You’ll DoAs a Lead Data Engineer II on the team, you will be responsible for:Support...Local areaDeloitte
New York, NY1 day ago- ...digital assets including Fandango, Rotten Tomatoes, GolfNow and GolfPass. Job Description We are seeking a hands-on Data Product Engineering Lead to lead engineering resources to deliver trusted, scalable, and reusable data products from source systems through...Full timeLocal area
Versant Media
New York, NY7 days ago - ...thinking about — in real time, at scale, across every screen. Our data exists with the consent of over a billion people, organized into... ...most culturally relevant. We are looking for a Lead Data Engineer to join our Revenue Operations team.This role sits at the intersection...
Samba
New York, NY12 days ago $61k - $101k
...Salary: $61,000 - 101,000 per year Requirements: At least 5 years of relevant experience in data engineering, analytics engineering, or data platform engineering, with delivery experience across the data lifecycle from collection to analytics enablement. Strong...Full timeJ.P. Morgan
New York, NY2 days ago$110k - $169k
## Pricing Data EngineerApplyremote type: Hybridlocations: New York: Austin: Atlanta: Wilmington: San Franciscotime type: Full timeposted... ...hard work and excellence.**Job Description:**The Pricing Data Engineer builds and maintains the data infrastructure and tools that...Full timeWork at officeMcDermott
New York, NY2 days ago$110k - $169k
...Pricing Data Engineer Build and maintain data infrastructure and tools for consistent, data‑driven pricing across the firm. Collaborate with cross‑functional teams to modernize workflows, integrate AI, and improve pricing analysis. Essential Functions and Responsibilities...Full timeWork at officeMcDermott Will & Schulte LLP
New York, NY2 days ago$170k - $220k
...Lead Data Engineer New York, NY What Is Coast Coast is re-imagining the trillion-dollar U.S. B2B card payments infrastructure, with a focus on the country's 500,000 commercial fleets, 40 million commercial vehicles, and many millions of commercial drivers. The...Work at officeLocal areaRelocation packageFlexible hoursCoast
New York, NY3 days ago- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...Contract work
Argyle Infotech
New York, NY4 days ago $197.3k - $225.1k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One
New York, NY2 days ago- ...Type HybridJob Reference 0000021410Salary Type AnnuallyIndustry Broker Dealer;Financial ServicesSelling Points Lead impactful data engineering projects at a leading organization. Drive innovation with modern cloud-based data platforms and tools. Enhance your expertise...
Green Key Resources
New York, NY4 days ago - ...people who want to do meaningful work in an environment that expects more and delivers more.Job DescriptionEquinox is seeking a Sr. Data Engineer to join our technology team. This hands-on role will build and continuously evolve the data platform, business applications, and...Work at office
Equinox Holdings
New York, NY2 days ago $135k - $180k
...analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million users trust Medidata'... ...functions including product, delivery, data science, engineering, partnerships, and biostatistics. Successful Medidata AI candidates...Ongoing contractWork at officeLocal areaFlexible hoursDassault Systèmes
New York, NYa month ago- ...Job Description Job Description Data Engineer Location: New York, NY Employment Type: Full-time Focus: Data Engineering, Snowflake, Data Modeling, AI Data Infrastructure, Marketing Technology About Our Client Our client is building an AI-powered platform...Full time
NxT Level
New York, NYa month ago - ...Job Description Job Description Apply now: Data Engineer (AVP Level), location is Hybrid (3 days/week onsite in NYC). The start date is ASAP (targeting end of summer) for this long-term contract-to-hire position. Job Title: Data Engineer (AVP Level) Location-Type...Long term contractSummer workLocal areaImmediate startRelocation3 days per week
Mondo
New York, NYa month ago - ...Hi Our client is looking for a Data Engineer project in New York / New Jersey below is the detailed requirement. Job positing Title: Data Engineer Location: New York / New Jersey Job description: Bachelor's degree in related field Strong experience...
Lorven technologies
New York, NY2 days ago - ...Job Responsibilities: Design, plan, and execute data collection studies, working closely with research and product teams to gather... ...on data quality and reliability. ~ Additional years/depth of engineering experience beyond the minimum level. ~ Signal processing...
SGS Consulting
New York, NYmore than 2 months ago - ...Job Description Job Description Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work alongside the Director of Data Engineering to build, optimize, and scale our data infrastructure, supporting the development...Work at officeRemote workFlexible hours
BDG
New York, NYa month ago - ...Job Description Job Description Duties and Responsibilities Data Infrastructure & Pipeline Engineering● Design, build, and operate scalable data pipelines across Salesforce, Snowflake, and external systems (ticketing, lottery, partners)● Leverage Fivetran and API...
Nederlander Productions
New York, NYa month ago - ...we are looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who should apply? Recent computer science/engineering/mathematics/statistics...Full timeH1bImmediate startRemote work
SynergisticIT
New York, NY1 day ago - ...Data Engineer Work location: New York City, NY (Hybrid, 3 days in a week) In-person Interview is required Client: Mizuho Bank Visa: ANY Looking for skilled Data Engineer with comprehensive experience in designing, developing, and maintaining scalable data solutions...3 days per week
Argyle Infotech
New York, NY2 days ago - ...Responsibilities: Build and maintain data pipelines using Python and SQL. Create and manage workflows in Databricks and... ...and fix issues to meet service goals. Work with analytics, engineering, and business teams to deliver clean, ready-to-use datasets....Work at office
Trinity Technology Solutions
New York, NY1 day ago - ...our unparalleled access to a wide range of publicly available data sources. About our Team: KEPL is a fast-growing team at... ...Requirements ~ Master/PhD degree in math, computer science, engineering, or other related fields. ~1-3 years of professional...
Point72
New York, NY3 days ago $140k - $180k
...Data Engineer, Data Platform About the Role We are building out our Data Platform team at Sigma, with a relentless focus on developing data models that fuel trusted insights across the company. As a Data Platform Engineer, you will be responsible for the underlying...Full timeWork at officeFlexible hoursSigma Computing
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- senior cloud data engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- entry level data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- data platform engineer New York, NY
- data engineer intern New York, NY
- data engineering intern summer New York, NY