Senior Data Engineer
RIT Solutions, Inc.
Senior Data Engineer 3 days Hybrid in Orlando, FL Locals only 5+ months contract Role summary Software Engineer with strong ETL experience to design, build, and support file-to-table data transformations using IBM InfoSphere DataStage. You'll turn inbound file feeds into reliable, auditable SQL Server table loads with solid performance, clear error handling, and repeatable operations. Key responsibilities
- Design, develop, and maintain IBM DataStage ETL jobs that ingest file feeds (CSV, fixed-width, delimited) and load curated destination tables in SQL Server.
- Build end-to-end ETL flows, including staging, transformations, validations, and publishing to downstream schemas.
- Perform source-to-target mapping and implement transformation logic based on business and technical requirements.
- Use common DataStage stages and patterns (e.g., Sequential File, Transformer, Lookup, Join/Merge, Aggregator, Sort, Funnel, Remove Duplicates), with attention to partitioning and parallel job design.
- Write, optimize, and tune SQL Server queries, stored procedures, and T SQL scripts used in ETL workflows.
- Implement restartable and supportable jobs: parameterization, robust logging, reject handling, auditing columns, and reconciliation checks.
- pply data quality controls (format checks, referential checks, null/duplicate checks, threshold checks) and produce clear exception outputs for remediation.
- Monitor and troubleshoot ETL runs using DataStage Director/Operations Console and SQL Server tooling; perform root-cause analysis and fix defects.
- Improve performance through job design tuning (partitioning strategy, sorting choices, buffering, pushdown where appropriate) and SQL tuning (indexes, statistics, set-based logic).
- Participate in code reviews, testing, documentation, and release activities; maintain clear runbooks and operational procedures.
- Collaborate with business analysts, data modelers, QA, and production support to deliver stable pipelines.
- Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation.
- Strong SQL Server experience with advanced T SQL (joins, window functions, CTEs, temp tables, indexing basics, query plans).
- Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters, quoting/escaping).
- Experience designing ETL jobs with good operational characteristics: parameter-driven design, logging, error handling, restart/re-run strategy, and auditability.
- bility to troubleshoot data issues end-to-end (source file → stage tables → target tables) and communicate findings clearly.
- Experience with DataStage Parallel Jobs tuning (partitioning methods, collect/sort trade-offs, skew handling).
- Familiarity with UNIX/Linux basics and shell scripting for orchestration and file handling.
- Experience with job scheduling/orchestration tools (e.g., Control M, Autosys) and CI/CD practices.
- Knowledge of common warehousing patterns (incremental loads, slowly changing dimensions, surrogate keys, effective dating).
- Experience with version control (Git) and structured promotion/release processes across environments (dev/test/prod).
- Exposure to data governance practices (metadata, lineage, naming standards) and secure handling of sensitive data.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
$150k
...Our client is seeking a Senior Data Center Engineer to support the installation, maintenance, and physical infrastructure of a high-availability data center environment. The ideal candidate will have strong communication skills and be a collaborative team player who thrives...Senior- ...EvolutionIQ is seeking a Senior Analytics Engineer to lead the design, development, and scaling of a robust analytical data platform in the US. You will architect data models, pipelines, and governance to ensure accurate BI data assets, partnering with data scientists...Senior
- %PDF-1.6 %âãÏÓ 138 0 obj endobj 162 0 obj /Filter/FlateDecode/ID[]/Index[138 41]/Info 137 0 R/Length 114/Prev 129880/Root 139 0 R/Size 179/Type/XRef/W[1 3 1] stream hÞbbd```b``þ"–ƒH¦Lɲ,"çÅŸÅ5À"º`öz°+0{3˜íf·ÙÕ`²l2Ø^A¹äd4ºbç_‘Zý`óÓ€äÿ0& «$Áº©Lþg`ªÿ` Ûzb endstream endobj...Senior
$157k - $210k
...CoreWeave plans, sources, builds, and delivers data center capacity for our customers. We partner closely with Supply Chain, Product Engineering, Data Center Operations, and the... ...analytical findings and recommendations to senior leadership in a clear, actionable format....SeniorPermanent employmentFull timeCasual workWork at office- ...Position; Senior Data Engineer Location: NYC, NY (Locals or near by only) Duration: 12 Months SKILLS / QUALIFICATIONS Bachelor's degree in computer science, Software Engineering, Information Technology, Management Information Systems or related field...SeniorLocal area
- ...Job Title : Senior Data/Software Engineer Job Location - Address : New York, United States Skill Cluster : Data-Talend with Big Query, DBT, Spark, GCP data services, cloud storage, pipeline orchestration. Primary Skill : Data analytics Job Description :...Senior
$180k - $220k
Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing...SeniorWork at officeRemote workFlexible hoursShift work2 days per week1 day per week- ...Job Description Job Description Senior Data Engineer II Level: IC4 Employment Type: Full-time Focus: Data Platform, Pipeline Architecture, Analytics Engineering, Data Infrastructure, AI-Enabled Data Workflows About Our Client Our client is scaling...SeniorFull time
- MLabs, a high-volume DeFi protocol, is seeking a Senior Data Engineer in New York (Hybrid) to lead data infrastructure initiatives and optimize high-throughput pipelines. You will build an advanced infra layer to empower engineering teams with self-service deployment,...Senior
- Cortex is seeking a Senior Data Engineer to own our internal data systems, ingest and transform data, and consolidate a stack across Segment, Hevo, BigQuery, and Omni into a single, trustworthy source of truth for reporting. You will lay the foundation for higher-volume...SeniorRemote job
- Jump Trading Group is seeking an experienced software engineer to build and maintain the Derived Data platform. You will work with market data to generate bars, residuals, curves, and greeks, collaborating with traders and researchers to fit analytics into real-world workflows...Senior
- Senior Data Engineer Position Summary: As a Senior Data Engineer, the candidate will be responsible in integrating, analyzing raw data, developing, and maintaining datasets and improving data quality and efficiency. The engineer needs to have strong analytical skills and...Senior
- ...institutional entities globally, monitoring over a trillion events each day. The Role We’re looking for a strong Software Engineer with experience in Data Engineering. Someone who is proficient in building robust, scalable, maintainable, and thoroughly monitored data...SeniorRemote workWorldwide
- Work with our data teams to ensure data is flowing accurately through data creation to our presentation layers. Improve our Data Engineering stack through containerization, data modeling. developing our ETL pipelines, and more. Minimum of 5 years of relevant professional...Senior
$200k - $275k
...Job Description Job Description Founding Data Engineer — AI Healthcare The Opportunity Our client is building an AI-powered healthcare platform designed to make high-quality care more accessible at massive scale. They're now hiring their first dedicated Data...SeniorImmediate start- Senior Databricks Data Engineer (Azure Databricks | Lakehouse | ETL/ELT) Austin, Texas (Hybrid - 3 Days Remote | Onsite Every Monday & Thursday) Experience: Minimum 12+ Years Mandatory Requirements • Databricks Certified Data Engineer (Associate or Professional) • Azure...SeniorLocal areaRemote work
- Hinge is seeking a Senior Data Engineer to design and maintain the data pipelines and analytics infrastructure that drive product decisions and user insights. You will contribute to a modern data stack, enabling data-driven decisions across the organization. You will work...Senior
- Alpaca is seeking a Senior Data Engineer to help design and build the next generation of our Data Platform on Google Cloud Platform. You will tackle streaming, batch ingestion, and lakehouse management, enabling scale for hundreds of millions of events daily. You will...SeniorRemote job
- A leading technology services company in New York is seeking a Senior Data Engineer specializing in Credit Risk. The role involves application development using Python and SQL Server, as well as maintaining data models. The ideal candidate will have around 15 years of...Senior
$220k - $245k
...and using AI to scale that impact further and faster than anyone else can. About the role: We are seeking an exceptional Senior Data Engineer with a high sense of ownership who is excited about our mission, eager to learn and teach others, and can deliver across the...SeniorWork at officeFlexible hours3 days per week$500 per month
...accounts. Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to... ...impact, we encourage you to apply. Your Role: We are seeking a Senior Data Engineer to help design and build the next generation of our Data...SeniorRemote workHome office- Sr Data Engineer The Sr Data Engineer will influence an integral part of a major IT initiative to enable National Grid Business Partners by improving how our employees serve our customers today and by creating the platform for tomorrow’s growth. This is an integral role...Senior
- Job Posting Our client is seeking a skilled Senior Data Engineer for a 12-Month contract opportunity. This position is 100% remote and offers a competitive hourly pay rate, and candidates must have the legal right to work in the US without sponsorship. Interested? Details...SeniorHourly payContract workRemote work
- Kavyos Consulting is building a modern cloud-native data platform on Google Cloud and seeks a hands-on Senior Data Engineer to own the transformation layer from raw source data through analytics-ready models that power business reporting and decision-making. You will design...Senior
- Req ID:376263NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want... ...-thinking organization, apply now.We are currently seeking a Senior Data Engineer - Snowflake to join our team in Remote, New York (US-NY), United...SeniorFull timeWork at officeRemote workFlexible hours
$10k
...millions of users across the globe, we’ve become the most trusted way to find a relationship, for all. About the Role: As a Senior Data Engineer at Hinge, you will create essential data processes and contribute to components of a modern data pipeline that will be the...SeniorWork experience placement- Senior Data Engineer Location: Remote Duration: Contract (C2C / FT) Start Date: Immediate Mandatory Skills: Azure Data Factory (ADF) Snowflake ETL Informatica PowerCenter Disclaimer: E-Solutions Inc. provides equal employment opportunities (EEO) to all employees and applicants...SeniorContract workLocal areaImmediate startRemote work
- Veriipro in New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines, migrate data from Hadoop to Snowflake using PySpark, and develop enterprise...Senior
$182k - $242k
...Nasdaq: CRWV) in March 2025. Learn more at .What You’ll Do:The Data Engineering Team builds and operates the foundational data infrastructure... ..., and actionable at scale.About the role:We're seeking a Senior Data Engineer to design and build the foundational datasets that...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- Required Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark, and SQL. Strong understanding of data warehousing concepts and cloud data platforms, especially Snowflake. Hands-on experience with release...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- aws data engineer New York, NY
- director data engineering New York, NY
- data platform engineer New York, NY
- data engineer machine learning New York, NY
- data science developer New York, NY
- senior data engineer New York, NY
- finance data engineer New York, NY
- bi data engineer New York, NY
- principal data engineer New York, NY
- big data devops engineer New York, NY


