Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

JConnect Infotech

Data Engineer Must Have Technical/Functional Skills Hands-on experience in building ETL using Databricks SaaS infrastructure. Experience in developing data pipeline solutions to ingest and exploit new and existing datasources Expertise in leveraging SQL, programming language like Python and ETL tools like Databricks Perform code reviews to ensure requirements, optimal execution patterns and adherence to established standards. Expertise in AWS Compute (EC2, EMR), AWS Storage (S3, EBS), AWS Databases (RDS, DynamoDB), AWS Data Integration (Glue). Advanced understanding of Container Orchestration services including Docker and Kubernetes, and a variety of AWS tools and services. Good understanding of AWS Identify and Access management, AWS Networking and AWS Monitoring tools. Proficiency in CI/CD and deployment automation using GITLAB pipeline. Proficiency in Cloud infrastructure provisioning tools e.g., Terraform. Proficiency in one or more programming languages e.g., Python, Scala. Experience in Starburst, Trino and building SQL queries in federated architecture. Good knowledge of Lake house architecture. Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and Apache Spark (PySpark and Scala). Build data ingestion workflows from various sources (structured, semi-structured, Develop reusable components and frameworks for efficient data processing. · Implement best practices for data quality, validation, and governance. · Collaborate with data architects, analysts, and business stakeholders to understand data requirements. · Tune Spark jobs for performance and scalability in a cloud-based environment. · Maintain robust data lake or Lakehouse architecture. · Ensure high availability, security, and integrity of data pipelines and platforms. · Support troubleshooting, debugging, and performance optimization in production workloads. Roles & Responsibilities

  • Work on migrating applications from an on-premises location to the cloud service providers.
  • Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.
  • Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.
  • Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.
  • Perform problem analysis, data analysis, reporting, and communication.
  • Work with peers across the system to define and implement best practices and standards.
  • Assess applications and help determine the appropriate application infrastructure patterns.
  • Use the best practices and knowledge of internal or external drivers to improve products or services.
Location: New York, NY (Onsite) Duration: Full-time only JConnect Infotech

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
  • $400k

     ...Senior Data Engineer - Hedge Fund - New York - Up to $400k TC Join a leading Hedge Fund where Data Engineering sits at the heart of the investment process. Global hedge fund with a consistent record of strong returns Heavy investment in technology and data,... 
    Senior
    Full time

    Durlston Partners

    New York, NY
    2 days ago
  •  ...Senior Data Engineer Overview The Senior Data Engineer designs and maintains enterprise data platforms, ensuring secure, scalable solutions for analytics, reporting, and AI initiatives. Collaborates with cross-functional teams to deliver data solutions aligned with... 
    Senior
    Full time

    Green Key Resources

    New York, NY
    1 day ago
  • $180k - $220k

     ...THIS POSITION IS HYBRID WITH 4 DAYS ONSITE IN MIDTOWN NYC WITH A COMPENSATION RANGE IN THE $180,000-$220,000 ANNUAL RANGE.*** Data Engineer develops and maintains Microsoft Fabric Lakehouse solutions, data pipelines, and enterprise data platforms that deliver secure,... 
    Senior

    DBI Staffing

    New York, NY
    13 days ago
  •  ...Semarchy Engineer Location: New York, NY Work Model: Hybrid – 3 days onsite per week Employment...  ...years About the Role We are seeking a senior, hands-on MDM Lead Semarchy Engineer to join our Client Master Data team. This person will serve as the technical... 
    Senior
    Full time
    Work at office
    3 days per week

    Tiger Advisory

    New York, NY
    2 days ago
  •  ...Role Overview The Senior Data Engineer is responsible for overseeing enterprise data platform architecture, managing cloud data warehouse environments, and building data ingestion workflows. The role shapes the organization's data strategy by implementing efficient... 
    Senior
    Full time

    The Phoenix Group

    New York, NY
    17 hours ago
  •  ...Data Engineer Location: Manhattan, NY Schedule: Hybrid | 3 Days Onsite, 2 Days Remote A growing consumer products organization is seeking a Data Engineer to play a critical role in modernizing and scaling its enterprise data and analytics environment. This individual... 
    Senior
    Full time
    Remote work

    Tenth Revolution Group

    New York, NY
    2 days ago
  • $10k

     ...of users across the globe, we’ve become the most trusted way to find a relationship, for all. About the Role:   As a Senior Data Engineer at Hinge, you will create essential data processes and contribute to components of a modern data pipeline that will be the foundation... 
    Senior
    Work experience placement

    Hinge

    New York, NY
    a month ago
  • $150k - $170k

     ...and is headquartered in New York, NY. Job Summary The Senior Data Analyst will serve as the bridge between business...  ...with Finance, Sales, Operations, Product, Customer Success, and Engineering to deliver trusted analytics, semantic models, dashboards, and... 
    Senior
    Full time
    Worldwide

    Boost Payment Solutions

    New York, NY
    3 days ago
  • $140k - $155k

     ...Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and...  ...We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic Team. Additional Information... 
    Senior
    Full time
    Temporary work
    Flexible hours

    Synechron

    New York, NY
    4 days ago
  • $150k - $200k

     ...Insurance and Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,...  ...the Role: We are seeking a hands-on Senior Reference Data Tech Lead with 8+ years of professional software engineering experience to design, architect, and enhance... 
    Senior
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    3 days ago
  • $180k - $211.5k

     ...Senior Analytics Engineer for a Series B Venture backed Startup | New York City, NY | Hybrid Compensation: $180K–$211.5K base + equity About...  ...business operations. As the company continues to scale its data and analytics capabilities, they are hiring a Senior... 
    Senior
    Relocation
    Visa sponsorship

    Bauhinia Search Partners

    New York, NY
    17 hours ago
  • $121.79k - $162.05k

     ...( , Facebook ( , X ( and Instagram ( . Position Summary: We have an exciting opportunity to join our team as a Senior Data Scientist/Engineer. Onsite position. We are seeking a qualified Senior Data Scientist/Engineer to work within the Predictive Analytics... 
    Senior
    Full time

    NYU Langone Health

    New York, NY
    1 day ago
  • $180k - $220k

    Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing... 
    Senior
    Work at office
    Remote work
    Flexible hours
    Shift work
    2 days per week
    1 day per week

    Consortia

    New York, NY
    8 hours ago
  • $250k - $300k

     ...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside...  ..., complex structured and unstructured data sets. As a senior member of our Data Engineering team, you will help set... 
    Senior
    Work experience placement

    Point72

    New York, NY
    3 days ago
  •  ...: Paul KrugJob ID: REQ8765ROLE OVERVIEWThe Equities Alternative Data team is responsible for sourcing, integrating, curating, and delivering...  .... We are looking for an experienced, pragmatic, and eager data engineer to join the team. This individual will help design and scale the... 
    Senior

    Balyasny Asset Management

    New York, NY
    1 day ago
  • $156k - $226k

     ...economics.Architect relational and semantic data layers in distributed warehouses so...  ...plain language.Partner with executives, engineers, analysts, and vendor teams to scope ambiguous...  ...Language Model (LLM) inference.As a Senior Data Engineer in Technical Solutions, you... 
    Senior

    Google

    New York, NY
    8 hours ago
  • $184k - $287.5k

     ...autonomous-driving simulation. NuRec converts real-world sensor data into high-fidelity, simulation-ready driving environments....  ...variations beyond the original sensor path. We seek a Senior Synthetic Data Engineer to join the NVIDIA DRIVE team and contribute to automotive... 
    Senior
    Full time
    Remote work

    Nvidia

    New York, NY
    4 days ago
  • $175.5k - $180k

     ...technical owner, designing and leading the implementation of scalable data architectures for cutting-edge AI and agentic systems. You will...  .... You will also spearhead the design of complex feature engineering workstreams, ensuring our data assets are not only robust but also... 
    Senior
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    3 days ago
  •  ...country where we have a legal entity. Responsibilities ResponsibilitiesOur Product DE organization is looking for a Senior Data Engineer reporting to the Senior Data Engineering Manager. You will be responsible for designing premier data architecture and solutions... 
    Senior
    Work at office
    Local area

    Atlassian

    New York, NY
    3 days ago
  • Senior Databricks Data Engineer (Azure Databricks | Lakehouse | ETL/ELT) Austin, Texas (Hybrid - 3 Days Remote | Onsite Every Monday & Thursday) Experience: Minimum 12+ Years Mandatory Requirements • Databricks Certified Data Engineer (Associate or Professional) • Azure... 
    Senior
    Local area
    Remote work

    Delan Associates Inc

    New York, NY
    1 day ago
  • Software Guidance & Assistance, Inc. (SGA) is searching for a Senior Data Engineer - Investment Technology (Python) for a Direct Hire assignment with one of our premier Financial Services clients in Lower Manhattan, NYC . This is a hybrid role requiring onsite presence... 
    Senior

    Software Guidance & Assistance

    New York, NY
    2 days ago
  • $110k - $190k

    Senior Data Management Professional - Data Engineering (Data AI) Location New York Business Area Data Ref # 10054379 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    3 days ago
  • $200k - $275k

     ...The Role You will be Doctronic's first dedicated data engineer, and you will own the plumbing end to end: how data moves from our production systems into our lakehouse and warehouse, how it gets transformed into trusted, documented tables, and who can access what.... 
    Senior
    Full time

    doctronic

    New York, NY
    7 days ago
  • $128.01k - $152.18k

     ...businesses to manage risks with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead Innovation in Property & Casualty Insurance Data SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern, first, AI-first data... 
    Senior
    Full time
    Work at office
    Local area

    Argo Group

    New York, NY
    1 day ago
  • $130k - $178k

     ...future of logistics but building what comes next.Job Title:Senior Semantic Data EngineerCompany:PrologisA day in the lifePrologis is transforming...  ...into the core of its operations. As a Senior Semantic Data Engineer on the Data Solutions team, you will help create a shared... 
    Senior
    Full time

    Prologis

    New York, NY
    1 day ago
  • $180.5k - $236.91k

    We're hiring a Senior Data Engineer II to join our Data team.About the role:In this role, you will build the trusted member-context and event-data foundation that powers personalization, predictive models, and LLM-enabled experiences.This role will help build Oscar Health... 
    Senior
    Full time
    Work at office
    Flexible hours

    Oscar Health Insurance

    New York, NY
    2 days ago
  •  ...subscriber relevance. Keep the feature store accurate, remove differences between training and live serving, and own the health of the data pipelines. Lead the data warehouse transformation layer (dbt), subscriber tagging with foundation models, and automated... 
    Senior
    Full time
    Visa sponsorship

    George Bernard Consulting

    New York, NY
    2 days ago
  • $176k - $179.5k

     ...patients. You will design and manage scalable data pipelines and secure analytics platforms,...  ...data scientists, machine learning engineers, and industry experts to develop impactful...  ...McKinsey. There is flexibility to hire at the Senior Data Engineer I/II or Principal Data... 
    Senior
    Apprenticeship
    Easy work
    Shift work

    McKinsey & Company

    New York, NY
    1 day ago
  • $144.41k - $183k

     ..., email, and push notifications, our AI-powered personalization engine delivers bespoke experiences that drive performance, revenue, and...  ...across the organization Design, build, and maintain scalable data models, semantic layers, and reporting datasets using dbt, Looker... 
    Senior
    Full time
    Remote work

    Digitailor

    New York, NY
    1 day ago
  • $175k - $215k

     ...This Role: The Senior Analytics Engineer will own the analytics data products that our internal teams rely on to make decisions. You will turn prototypes and one-off analyses into trusted, production-grade models and metrics. That means reusable models, business-facing... 
    Senior
    Work at office
    Relocation
    3 days per week

    Norm Ai

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!