Senior Data Engineer
RIT Solutions
Senior Data Engineer
Software Engineer with strong ETL experience to design, build, and support file-to-table data transformations using IBM InfoSphere DataStage. You'll turn inbound file feeds into reliable, auditable SQL Server table loads with solid performance, clear error handling, and repeatable operations.
Key responsibilities:
- Design, develop, and maintain IBM DataStage ETL jobs that ingest file feeds (CSV, fixed-width, delimited) and load curated destination tables in SQL Server.
- Build end-to-end ETL flows, including staging, transformations, validations, and publishing to downstream schemas.
- Perform source-to-target mapping and implement transformation logic based on business and technical requirements.
- Use common DataStage stages and patterns (e.g., Sequential File, Transformer, Lookup, Join/Merge, Aggregator, Sort, Funnel, Remove Duplicates), with attention to partitioning and parallel job design.
- Write, optimize, and tune SQL Server queries, stored procedures, and T SQL scripts used in ETL workflows.
- Implement restartable and supportable jobs: parameterization, robust logging, reject handling, auditing columns, and reconciliation checks.
- Apply data quality controls (format checks, referential checks, null/duplicate checks, threshold checks) and produce clear exception outputs for remediation.
- Monitor and troubleshoot ETL runs using DataStage Director/Operations Console and SQL Server tooling; perform root-cause analysis and fix defects.
- Improve performance through job design tuning (partitioning strategy, sorting choices, buffering, pushdown where appropriate) and SQL tuning (indexes, statistics, set-based logic).
- Participate in code reviews, testing, documentation, and release activities; maintain clear runbooks and operational procedures.
- Collaborate with business analysts, data modelers, QA, and production support to deliver stable pipelines.
- Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation.
- Strong SQL Server experience with advanced T SQL (joins, window functions, CTEs, temp tables, indexing basics, query plans).
- Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters, quoting/escaping).
- Experience designing ETL jobs with good operational characteristics: parameter-driven design, logging, error handling, restart/re-run strategy, and auditability.
- Ability to troubleshoot data issues end-to-end (source file → stage tables → target tables) and communicate findings clearly.
- Experience with DataStage Parallel Jobs tuning (partitioning methods, collect/sort trade-offs, skew handling).
- Familiarity with UNIX/Linux basics and shell scripting for orchestration and file handling.
- Experience with job scheduling/orchestration tools (e.g., Control M, Autosys) and CI/CD practices.
- Knowledge of common warehousing patterns (incremental loads, slowly changing dimensions, surrogate keys, effective dating).
- Experience with version control (Git) and structured promotion/release processes across environments (dev/test/prod).
- Exposure to data governance practices (metadata, lineage, naming standards) and secure handling of sensitive data.
Required skills and experience:
Preferred qualifications:
Education:
Bachelor's degree in Computer Science, Engineering, Information Systems, or equivalent practical experience.
- ...Job Title: Senior Data Engineer Location: New York, NY 10011 Contract Duration: 10 months Detailed Job Description: Create detailed design of data pipelines Work on development, code review, implement validation, in line with architecture and...SeniorContract work
- ...Your Role The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Data Engineer,Senior will report to the Sr Manager, Data Solutions / Manager. This role is responsible...Senior
$50 - $55 per hour
...Senior AWS Data Engineer Healthfirst is seeking a Senior AWS Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions. This role focuses on ETL development, AWS data services, and CI/CD-driven deployments to support enterprise...SeniorHourly payWork from homeFlexible hours$170k - $190k
...investors, such as Redbird, Tarsadia, Mayfair, StepStone, and Edison Partners. About the Role Willow Wealth is seeking a Senior Data Engineer who will be responsible for owning and improving the company's data stack. This includes expanding our data warehouse,...Senior- ...Chartmetric, Inc. is a 10-year-old startup specializing in music data analytics. We are trusted by Universal MusicGroup, Sony, Warner... ...stakeholders ~ Bachelor's degree in Computer Science, Data Engineering, or equivalent practical experience ~ Thrives in dynamic startup...SeniorWork at office
$200k - $275k
...The Role You will be Doctronic's first dedicated data engineer, and you will own the plumbing end to end: how data moves from our production systems into our lakehouse and warehouse, how it gets transformed into trusted, documented tables, and who can access what....Senior- ...At Camber, we're building systems that actually work for clinicians-because healthcare deserves better software. As a Senior Data Engineer, you'll be hands-on with the backbone of that system: the infrastructure and pipelines that keep everything flowing smoothly...SeniorWork at officeRemote workFlexible hours
- ...About the job Senior Data Engineer Job Title: Senior Data Engineer Location: Remote (US) Salary 125K-155K + 12% bonus Experience- 5-8 years No. of open roles 1 Responsibilities: Design and build robust, scalable data transformation pipelines...SeniorRemote work
- ...Senior Data Engineer We're hiring a Senior Data Engineer to lead the design, development, and scaling of our data warehouse and analytics platform — critical systems that give enterprise customers direct access to their own data and power reporting for every team inside...SeniorFull time
- ...Senior Data Engineer We are looking for a Senior Data Engineer to help design, build, and operate the core data platform that powers analytics, machine learning, and business decision-making at Nelo. This is a hands-on, high-impact role for an experienced engineer...SeniorWork at officeRelocation package
$139.6k - $174.5k
...Senior Data Engineer Charlotte, North Carolina, United States; Denver, Colorado, United States; New York, New York, United States About Judi Health Judi Health is a health technology company providing benefit administration solutions to employers, unions, health...SeniorWork at officeLocal areaFlexible hours$145k - $160k
...Overview: Our client is a well-known lifestyle and wellness organization based in New York City, seeking an experienced Senior AWS Data Engineer to join their Technology team. This is a hands-on opportunity to take ownership of data pipelines and architecture while...SeniorHourly payRelocation package$170k - $200k
...Senior Data Engineer New York, New York, United States Tatari is on a mission to revolutionize TV advertising. Founded in 2016 to help transform the antiquated world of TV advertising through the intelligent application of AI and machine learning, Tatari helps some...SeniorWork at office2 days per week- ...Hybrid Data Analyst Role This is Hybrid role (3 days in office / 2 day remote) About Interactive Brokers: Interactive Brokers (IBKR) is one of the world's largest and most technologically advanced electronic brokerage firms, serving individual investors, hedge...SeniorWork at officeRemote work
$110k - $190k
...Senior Data Management Professional - Data Engineering - Private Funds Location New York Business Area Data Ref # 10052928 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context...SeniorTemporary workFor contractorsWork experience placement$190k - $220k
...Senior Data Engineer Gusto is on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so owners can focus on their craft and their customers. With teams in Denver, San Francisco, and New York, we support...SeniorFull timeWork at officeLocal area2 days per week3 days per week- ...About the role We're looking for a top-tier Senior Data Engineer to join our tech team and work hand-in-hand with our CTO, Denis Charrier , and the rest of the tech team. Your core responsibilities will be to: Build and operate large-scale, high-throughput...SeniorFlexible hours
- ...Senior Data Engineer As a Senior Data Engineer at Regard, you will own the design, development, and production deployment of the data services that power the Regard platform. From ingesting and standardizing clinical data across health systems to making it reliably...SeniorWork at officeLocal areaHome officeVisa sponsorshipRelocation package
$128.01k - $152.18k
...manage risks with confidence. Job Description AI-First Data Strategy for P&C Insurance Carrier | Lead Innovation in Property & Casualty Insurance Data Solutions We are seeking a Senior Data Engineer to spearhead our transition to a modern, first, AI-first data...SeniorWork at officeLocal area- ...Data Engineer Opportunity At Plaid We believe that the way people interact with their finances will drastically improve in the next few years. We're dedicated to empowering this transformation by building the tools and experiences that thousands of developers use to...SeniorWork experience placementLocal areaFlexible hours
$160k - $200k
...crypto industry. We transform raw, complex data and facts into actionable research,... ...asset class. Who You Are: Software engineering is your passion, and you have special talents... .... What You'll Do: As our Senior Data Engineer , you will be directly responsible...SeniorFull timeWork at officeRemote workFlexible hours$150k - $200k
...Senior Data Engineer Gibson Dunn is a leading global law firm, advising clients on significant transactions and disputes. Our exceptional teams craft and deploy creative legal strategies that are meticulously tailored to every matter, however complex or high-stakes...SeniorLocal areaFlexible hours- ...and is uniquely positioned to create a more modern, connected oncology ecosystem. We're looking for a customer-obsessed Senior Data Engineer to help us accomplish our mission to improve and extend lives by learning from the experience of every person with cancer. Are...SeniorFull timeWork at officeWork from homeFlexible hours
$146k - $180k
...receive quality mental healthcare? Come join our mission of getting therapy in the hands of everyone! We are looking for a Senior Data Engineer to join our Data Science team. The Senior Data Engineer will lead the design and development of scalable, high-performance...SeniorLive inLocal areaRemote workWorldwideFlexible hours$1,000 per month
...well positioned to build the future of inclusive finance through cutting-edge technology and customer-centric solutions. Senior Data Engineer Join our Data Platform & Analytics team and help shape the trusted data foundation that powers analytics, strategy, and downstream...SeniorTemporary workWork at officeImmediate startRemote workFlexible hours$200k
...Our client is seeking a Senior Data Infrastructure Engineer (KDB) to join their growing engineering team within a fast-paced financial services environment. This individual will play a critical role in designing, optimizing, and maintaining large-scale historical market...Senior$185k
...Senior Data Engineer New York, NY (This role is based in Trepp's NYC office and follows a hybrid work schedule) The Data Platform Team powers all products at Trepp by using distributed data technologies built on our data lake. The Pipeline Team plays a crucial role...SeniorTemporary workWork at officeWork from homeMonday to FridayFlexible hours$160k - $175k
...to Fortune 500 brands. As of 2023, Velir acquired Brooklyn Data Company, a premier data and analytics consultancy focused... ...offers competitive pay and excellent benefits. Overview The Senior Data & Analytics Engineer will play a crucial role in helping our client...SeniorRemote work- ...Job Title : Senior Data/Software Engineer Job Location - Address : New York, United States Skill Cluster : Data-Talend with Big Query, DBT, Spark, GCP data services, cloud storage, pipeline orchestration. Primary Skill : Data analytics Job Description :...Senior
- ...Job Description Job Description Senior Data Engineer II Level: IC4 Employment Type: Full-time Focus: Data Platform, Pipeline Architecture, Analytics Engineering, Data Infrastructure, AI-Enabled Data Workflows About Our Client Our client is scaling...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- data platform engineer New York, NY
- aws data engineer New York, NY
- data engineer intern New York, NY
- data science developer New York, NY
- sr information security engineer New York, NY
- data engineer graduate New York, NY
- senior data engineer New York, NY
- data engineer machine learning New York, NY
- principal data engineer New York, NY
- associate data engineer New York, NY



