Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

RIT Solutions

Senior Data Engineer

Software Engineer with strong ETL experience to design, build, and support file-to-table data transformations using IBM InfoSphere DataStage. You'll turn inbound file feeds into reliable, auditable SQL Server table loads with solid performance, clear error handling, and repeatable operations.

Key responsibilities:

  • Design, develop, and maintain IBM DataStage ETL jobs that ingest file feeds (CSV, fixed-width, delimited) and load curated destination tables in SQL Server.
  • Build end-to-end ETL flows, including staging, transformations, validations, and publishing to downstream schemas.
  • Perform source-to-target mapping and implement transformation logic based on business and technical requirements.
  • Use common DataStage stages and patterns (e.g., Sequential File, Transformer, Lookup, Join/Merge, Aggregator, Sort, Funnel, Remove Duplicates), with attention to partitioning and parallel job design.
  • Write, optimize, and tune SQL Server queries, stored procedures, and T SQL scripts used in ETL workflows.
  • Implement restartable and supportable jobs: parameterization, robust logging, reject handling, auditing columns, and reconciliation checks.
  • Apply data quality controls (format checks, referential checks, null/duplicate checks, threshold checks) and produce clear exception outputs for remediation.
  • Monitor and troubleshoot ETL runs using DataStage Director/Operations Console and SQL Server tooling; perform root-cause analysis and fix defects.
  • Improve performance through job design tuning (partitioning strategy, sorting choices, buffering, pushdown where appropriate) and SQL tuning (indexes, statistics, set-based logic).
  • Participate in code reviews, testing, documentation, and release activities; maintain clear runbooks and operational procedures.
  • Collaborate with business analysts, data modelers, QA, and production support to deliver stable pipelines.
  • Required skills and experience:

    • Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation.
    • Strong SQL Server experience with advanced T SQL (joins, window functions, CTEs, temp tables, indexing basics, query plans).
    • Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters, quoting/escaping).
    • Experience designing ETL jobs with good operational characteristics: parameter-driven design, logging, error handling, restart/re-run strategy, and auditability.
    • Ability to troubleshoot data issues end-to-end (source file → stage tables → target tables) and communicate findings clearly.

    Preferred qualifications:

    • Experience with DataStage Parallel Jobs tuning (partitioning methods, collect/sort trade-offs, skew handling).
    • Familiarity with UNIX/Linux basics and shell scripting for orchestration and file handling.
    • Experience with job scheduling/orchestration tools (e.g., Control M, Autosys) and CI/CD practices.
    • Knowledge of common warehousing patterns (incremental loads, slowly changing dimensions, surrogate keys, effective dating).
    • Experience with version control (Git) and structured promotion/release processes across environments (dev/test/prod).
    • Exposure to data governance practices (metadata, lineage, naming standards) and secure handling of sensitive data.

    Education:

    Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent practical experience.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
  • %PDF-1.6 %âãÏÓ 138 0 obj endobj 162 0 obj /Filter/FlateDecode/ID[]/Index[138 41]/Info 137 0 R/Length 114/Prev 129880/Root 139 0 R/Size 179/Type/XRef/W[1 3 1] stream hÞbbd```b``þ"–ƒH¦Lɲ,"çÅŸÅ5À"º`öz°+0{3˜íf·ÙÕ`²l2Ø^A¹äd4ºbç_‘Zý`óÓ€äÿ0& «$Áº©Lþg`ªÿ` Ûzb endstream endobj...
    Senior

    Covington & Burling

    New York, NY
    2 days ago
  • $250k - $300k

     ...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside...  ..., complex structured and unstructured data sets. As a senior member of our Data Engineering team, you will help set... 
    Senior
    Work experience placement

    Point72

    New York, NY
    1 day ago
  • $180k - $220k

    Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing... 
    Senior
    Work at office
    Remote work
    Flexible hours
    Shift work
    2 days per week
    1 day per week

    Consortia

    New York, NY
    1 day ago
  •  ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast... 
    Senior
    Work at office
    Remote work

    Interactive Brokers

    New York, NY
    4 days ago
  • Req ID:376263NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want...  ...-thinking organization, apply now.We are currently seeking a Senior Data Engineer - Snowflake to join our team in Remote, New York (US-NY), United... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    New York, NY
    1 day ago
  • $123k - $215.25k

     ...StatesSalary: $123000 - $215250 annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeCareer Area: TechnologyCompany...  ..., travel and lifestyle, and automation, grounded in our data technology model that prioritizes data governance. It employs a... 
    Senior
    Worldwide
    Visa sponsorship

    American Express

    New York, NY
    4 days ago
  •  ...candidate to join our talented Team.Implement and integrate access controls, security policies, and governance mechanisms across enterprise data platforms.Key ResponsibilitiesDevelop and maintain data pipelines.Implement row-level and column-level security.Integrate metadata... 
    Senior

    Ampcus

    New York, NY
    4 days ago
  • $190k - $220k

     ...by role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data...  ...customized experiences to our customers.We're looking for a Senior Data Engineer who can take loosely defined problems and drive... 
    Senior
    Full time
    Work at office
    Local area
    2 days per week
    3 days per week

    Gusto

    New York, NY
    7 hours ago
  • $140k - $160k

     ...strategy centers on making journalism so good that it’s worth paying for. About the RoleThe New York Times is looking for a Senior Data Engineer to join the Customer-Facing Data Products team to develop real-time data pipelines and APIs that process events and serve aggregated... 
    Senior
    Full time
    Local area
    Flexible hours

    The New York Times

    New York, NY
    7 hours ago
  • $128.01k - $152.18k

     ...businesses to manage risks with confidence.Job DescriptionAI-First Data Strategy for P&C Insurance Carrier | Lead Innovation in Property & Casualty Insurance Data SolutionsWe are seeking a Senior Data Engineer to spearhead our transition to a modern, first, AI-first data... 
    Senior
    Full time
    Work at office
    Local area

    Argo Group

    New York, NY
    3 days ago
  • Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy is looking for a Senior Data Engineer to join our dynamic Data Engineering team. In this role, you’ll be at the forefront of... 
    Senior
    Full time
    Local area

    Audacy

    New York, NY
    4 days ago
  • $182k - $242k

     ...Nasdaq: CRWV) in March 2025. Learn more at .What You'll Do:The Data Engineering Team builds and operates the foundational data infrastructure...  ...'s most complex data design challenges, and partner with senior engineers and stakeholders to translate business requirements... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    7 hours ago
  • $147k - $181k

     ...team as we help shape a brighter way forward. About JLL and Data PlatformJLL is a leading professional services firm that specializes...  ...-building pipelines of their own.What this job involvesAs a Senior Data Engineer on the Data Consumption team, you will own the design and... 
    Senior
    Full time
    Contract work
    Local area
    Remote work

    Jones Lang LaSalle

    New York, NY
    2 days ago
  • $110k - $190k

    Senior Data Management Professional - Data Engineering - Entities Location New York Business Area Data Ref # 10052582 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context... 
    Senior
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $137.4k - $161.7k

    Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies... 
    Senior
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    1 day ago
  •  ...Reference 0000019385Salary Type AnnuallyIndustry Private Equity;Venture Capital and Private EquitySelling Points Shape the future of data engineering at a leading organization. Drive innovation through scalable data platforms and AI capabilities. Enjoy comprehensive benefits... 
    Senior

    Green Key Resources

    New York, NY
    1 day ago
  •  ...visualization capabilities related to Fusion Operational Dashboards. The ideal candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders from inception to completion of a capability, and should... 
    Senior

    NTT DATA

    New York, NY
    2 days ago
  • $200k - $250k

     ...media and we need your help adding fuel to the fire.About the RolePolymarket is looking for a Senior Analytics Engineer to own the modeling layer that sits between our raw data and the decisions the business makes with it. You'll join a small, high-ownership team,... 
    Senior

    Polymarket

    New York, NY
    2 days ago
  •  ...Job Title: Senior Data Engineer Location: New York, NY 10011 Contract Duration: 10 months Detailed Job Description: Create detailed design of data pipelines Work on development, code review, implement validation, in line with architecture and... 
    Senior
    Contract work

    eTeam

    New York, NY
    2 days ago
  •  ...agility, and growth — driving the company's success. At New York Life will join a team of analytics engineers focused on delivering clean, well-structured, and reliable data to power various business and AI solutions across the enterprise. In this role, you will help... 
    Senior
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    1 day ago
  •  ...digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver...  ...Bold ambition. Practical action. Endless possibilities.As a Senior Data Engineer, AI & Agents, you will prepare enterprise domain data... 
    Senior
    Contract work

    Appnovation

    New York, NY
    3 days ago
  • $124k - $177k

    Location Designation: Hybrid - 3 days per week Role Overview:The Data Protection Engineer (Unstructured Data) plays a key role in advancing New York Life’s data governance initiatives. This individual contributor role focuses on the operational design and execution of... 
    Senior
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    2 days ago
  • $50 - $55 per hour

     ...Senior AWS Data Engineer Healthfirst is seeking a Senior AWS Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions. This role focuses on ETL development, AWS data services, and CI/CD-driven deployments to support enterprise... 
    Senior
    Hourly pay
    Work from home
    Flexible hours

    Inteletech Global Inc.

    New York, NY
    5 days ago
  • $77k - $214k

     ...ApplicableSpecialismData EngineeringManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Forward Deployed Data Engineering - Senior Associate, you will be at the forefront of developing innovative software solutions that drive digital transformation and... 
    Senior
    Full time
    H1b

    PwC

    New York, NY
    7 hours ago
  •  ...Your Role The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer,Senior will report to the Sr Manager, Data Solutions / Manager. This role is responsible... 
    Senior

    Blue Shield of CA

    New York, NY
    1 day ago
  • $140k - $175k

     ...talented people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC headquarters... 
    Senior
    Full time
    Work at office

    Rockstar Games

    New York, NY
    7 hours ago
  • $150k - $180k

     ...time on solving meaningful problems for our customers.We’re looking for a Senior Analytics Engineer (Technical Level 4) to own and evolve the analytics foundation that powers Stash—our dbt-powered data mart, Looker semantic layer, and the quality systems that keep daily... 
    Senior
    Work at office
    Work from home
    Flexible hours

    Stash

    New York, NY
    7 hours ago
  • $215.2k - $244.7k

     ...make an impact?West Monroe is seeking a Senior Architect to join our thriving Technology...  ...opportunity to work with clients developing Big Data strategy and roadmaps, while gaining...  ...Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval... 
    Senior
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    3 days ago
  • $140.5k - $205k

     ...Join us!Position SummaryThe Artificial Intelligence (AI) Sr. Data Engineer will design, build, validate, and operationalize AI-enabled solutions...  ...risks, and tradeoffs clearly to engineering teams, senior stakeholders, governance partners, and cross-functional leadersRequired... 
    Senior
    Full time
    Work at office
    Flexible hours
    Day shift

    Bank of America

    New York, NY
    7 hours ago
  •  ...new areas of inspiration and expand your capabilities, then consider a career in Advisory.KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice.Responsibilities:Assist with technical design and development activities and lead a small workstream... 
    Senior
    Local area
    Visa sponsorship

    KPMG

    New York, NY
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!