Data Engineer
Guru Schools
Overview: Role: Data Engineer Location: New York (100% onsite) (Need local to NY) Interview mode: (1 Video interview and Client will be in person) Rate: $70/hr. on C2C Candidates need to have colab set up ready with Gmail account so they can code on the L1 interview Must have: Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL Cloud Platforms: AWS Data Warehousing & Analytics: Redshift or Snowflake or Big Query Data Integration & ETL: AWS Glue, Aws EMR, Spark, Data Bricks CI/CD: AWS Code Pipeline, Jenkins, CloudFormation, Docker, Kubernetes Job Description:
- Results-driven Data Engineer with a decade of expertise in Data engineering across cloud platforms with a total of 12 years in IT.
- Extensive experience utilizing Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Dataprep, and Pub/Sub, for data engineering solutions.
- Proficient in building and managing GCP data pipelines with tools like Cloud Composer and Cloud Dataflow.
- Proven ability in developing and deploying applications on Google Kubernetes Engine (GKE).
- Strong background in implementing security and compliance on GCP, ensuring data privacy and regulatory adherence.
- Track record of optimizing cost and resource usage within GCP environments.
- Skilled in AWS services such as Amazon EMR, Redshift, and Glue for efficient data processing.
- Expertise in architecting scalable, cost-effective solutions on AWS, with proficiency in configuring AWS Lambda for serverless computing.
- Adept at setting up AWS Kinesis streams to process real-time data, enhancing system responsiveness and data-driven decision-making.
- Proficient in leveraging AWS DynamoDB to create scalable, low-latency NoSQL databases for dynamic applications.
- Deep expertise in optimizing and managing Amazon Redshift data warehouses to deliver high-performance analytics and business insights.
- Experienced in integrating AWS services into CI/CD pipelines, streamlining automation for continuous integration, delivery, and deployment.
- Skilled in setting up and securing AWS Virtual Private Cloud (VPC) environments.
- Proficient in managing Azure virtual machines (VMs) for cloud infrastructure operations.
- Extensive experience managing on-premises data infrastructure, including data warehouses and databases.
- Familiar with AWS DevOps practices for continuous integration and deployment.
- Expertise in using Git for version control in DBT projects, ensuring proper tracking and documentation of data model changes.
- Skilled in performance optimization and tuning of on-premises data systems.
- Proficient in data migration strategies between on-premises and cloud environments.
- Strong troubleshooting skills in resolving issues within on-premises data systems.
- Proven ability to maintain high availability and disaster recovery solutions in on-premises environments.
- Experienced in implementing CI/CD pipelines using tools like Jenkins and GitLab CI/CD.
- Adept in automated testing processes, including unit, integration, and regression testing.
- Skilled in gathering and analyzing project requirements to ensure alignment with business goals.
- Experienced in Agile project management, contributing to successful outcomes through data-driven analytics and collaborative teamwork
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
- ...Job Description: Job Summary: We are seeking an experienced Data Engineer / Support Analyst with strong expertise in Databricks, Azure cloud services, Bloomberg terminal and BBG data integration, and batch job support. The ideal candidate will have a background in financial...Suggested
ALLTECH CONSULTING SVC INC
New York, NY4 days ago $125k - $140k
...achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. This role focuses on driving technical excellence in data engineering, statistical techniques, and domain‑specific applications within VettaFi’s digital...SuggestedTMX Group
New York, NY3 days ago$170k - $220k
...Fuel Card built on a cutting-edge spend management platform. About the Role We are looking for a leader of the Coast data engineering team to shape our company's data culture and underlying infrastructure. At Coast, the success of our data platform is driving...SuggestedWork at officeLocal areaRelocation packageFlexible hoursCoast
New York, NY5 days ago$140k - $160k
...Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more...SuggestedTemporary workWork at officeImmediate startWorldwideShift work2 days per weekFitch Ratings
New York, NY3 days ago- ...We are partnered with an established Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on...Suggested
SO Digital Recruitment
New York, NY3 days ago $215.2k - $245.6k
Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal areaCapital One
New York, NY4 days ago- ...Video Visa : USC, GC, GC EAD, H4, L2 This is onsite from day-1 Description : Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in the Asset Management/ Financial Services / Investment Management...
ShiftCode Analytics
New York, NY5 days ago $135k - $150k
...New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...Career-Mover
New York, NY3 days ago$70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...Contract workLocal areaRemote workFlexible hoursINSPYR Solutions
New York, NY3 days ago- ...Role Value Proposition The MetLife Corporate Functions Data Office is part of the Data and Analytics Organization (D&A) within GTO.... ...MetLife as we head into our New Frontier strategy! The Lead Data Engineer plays a critical role in big data development within the data analytics...Work at office
MetLife
New York, NY2 days ago - ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...Contract work
Argyle Infotech
New York, NY1 day ago $110k - $169k
...work: We offer generous compensation packages that recognize hard work and excellence. Job Description: The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while...Full timeWork at officeMcDermott Will and Emery
New York, NY5 days ago$125k - $140k
...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...VettaFi
New York, NY3 days ago$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...Local areaRemote workFlexible hoursBayview Asset Management
New York, NY2 days ago$130k - $155k
...and strategic Senior BI/Tableau Report Developer to join our data team, specializing in the Media and Entertainment industry. The... ...various media platforms. Collaborate extensively with Data Engineers and Scientists to define and refine data models (e.g., star schemas...Full timeTemporary workPart timeLocal areaTegna
New York, NY13 hours ago- ...The Market Data team designs and operates the high-performance systems that power our production trading environment. In our business... ...performance or stability. We are seeking a self‑driven Senior Market Data Engineer to take end-to-end ownership of core components of our market...
Citadel Securities
New York, NY3 days ago $115k - $130k
...Job Purpose The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient data transfer...C2Q Health Solutions
New York, NY4 days ago- ...Data Engineer Princeton, NJ/New York, NY About Us Edgestream Partners is a team of scientists, engineers, and investment professionals dedicated to developing quantitative models of financial markets and deploying them in systematic trading strategies continuously...H1bVisa sponsorship
Edgestream
New York, NY1 day ago $188k - $275k
...Firstminute. What We’re Looking For We’re moving fast, and our data infrastructure needs to keep up. GPU telemetry, product usage, and... ..., faster model iteration, and cleaner ops. As our first Data Engineer , you will help us get there. This is an early, high‑scope role...Work at officeWork from homeFlexible hours2 days per weekLightning AI
New York, NY2 days ago$120k - $160k
...Data Engineer Company: Asylon Location: 52 Buttonwood Street, Norristown, PA 19401 Salary: $120,000 - $160,000 a year | Full-time Work setting: In-person Benefits: 401(k); Health insurance; Paid time off; Vision insurance; Dental insurance Job details Pay: $120,000 - $...Permanent employmentFull timeMonday to FridayWeekend workDecisive Point
New York, NY1 day ago- ...Data Engineer New York Cubist Systematic Strategies is one of the world's premier investment firms. The firm deploys systematic, computer-driven trading strategies across multiple liquid asset classes, including equities, futures, and foreign exchange. The core of...
Point72 Private Investments
New York, NY5 days ago $145k - $165k
...compliance in everything we do. Join us and help build the future of global investing! About The Team We are looking for a Data Engineer who thrives on solving data problems, and enjoys working cross-functionally with product, engineering and analytics teams to...Full timeWork at officeRemote workWorldwide2 days per week3 days per weekDriveWealth
New York, NY4 days ago- ...Description:- Bachelor's degree in the areas of Computer Science, Engineering, Information Systems, Business, or equivalent field of study required 7+ years of experience in working with data solutions. 3+ years of experience coding in Python, or Scala or similar scripting...
TechDigital Group
New York, NY4 days ago - ...Life Sciences (HLS) Mission: Reporting to the Tech GM of Field Engineering, the Specialist Solutions Architect Manager for Healthcare & Life... ...) RDQ427R109: At the company, we are passionate about enabling data teams to solve the world's toughest problems — from making the...Part timeRemote work
United States Digital Space LLC
New York, NY4 days ago $120k - $150k
...diagnosis to initiating and remaining on therapy to achieve optimal health outcomes. About the Team You’ll join an early and growing data engineering team that’s shaping the foundations of our data platform. We are investing in a modern transformation layer, reliable...Courier Health
New York, NY3 days ago- ...Overview The Tyndale Company, a 9x Top Workplace winner in PA, is seeking a skilled Data Engineer to join our growing AI organization. This role will play a critical part in our mission to harness data for advanced AI and Machine Learning applications. You will collaborate...Casual workWork at officeRemote work1 day per week
Work with Adiona
New York, NY3 days ago - ...Job Title- Data Engineer Location- New York, NY 10112 Reporting Type- Onsite Duration: 10 months Summary This role involves building and delivering advanced data science and AI/ML solutions in an agile environment, with a focus on...
campus4tech
New York, NY2 days ago - ...Top Buy Side firm is looking for a Data Engineer to work with large and complex data sets. Qualified candidates must have: Financial industry experience, preferably in a Quant Trading environment working directly with Researchers/PM's BS and/or MS degree in Computer Science...Full time
C2R Ventures
New York, NY2 days ago - ...About Mecka AI Mecka AI is building the data infrastructure layer for robotics and embodied AI. We partner with leading AI labs and... ...by data quality. The Role We are hiring a Forward Deployed Data Engineer to operate on the frontier with customers: take messy, real-world...
Mecka AI
New York, NY1 day ago $150k - $350k
...range $150,000.00/yr - $350,000.00/yr Join a cross-disciplinary technology group embedded within a leading investment firm, where engineers, data scientists, and domain experts collaborate to extract insights from unconventional datasets. Our team is responsible for the...Full timeAffinity North
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote New York, NY
- data engineering intern summer New York, NY
- hadoop big data developer New York, NY
- senior data quality engineer New York, NY
- aws data engineer New York, NY
- associate data engineer New York, NY
- staff data engineer New York, NY
- data engineer New York, NY
- finance data engineer New York, NY
- senior data center engineer New York, NY