Data Senior Engineer
NTT Data
Key Responsibilities
• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.
• Assess complex Informatica workflows including sessions, mappings, and parameterizations and translate them into equivalent Python EL scripts and dbt transformation models.
• Develop and maintain Python EL pipelines to land high-volume data, including billion-row tables, into the target warehouse using SQLAlchemy, cx_Oracle, pyodbc, and bulk export tools such as Oracle Data Pump and SQL Server BCP.• Design and develop dbt transformation models based on Informatica mapping logic, incorporating dbt best practices including model layering, macros, incremental strategies, and snapshot patterns.
• Develop dbt-native tests as well as custom Python unit tests to validate transformation correctness and data quality.
• Develop Airflow DAGs to orchestrate Python EL and dbt scripts end-to-end, producing output that is functionally equivalent to the source Informatica workflows.
• Contribute to GitLab CI/CD pipeline for dbt and Airflow code, including lint gates, automated testing, and deployment to shared NAS.
• Perform peer code reviews and provide constructive technical feedback to fellow engineers.
• Troubleshoot performance issues and data discrepancies during SIT and UAT, including row-count reconciliation between source Oracle/SQL Server systems and the target warehouse.
• Contribute to technical documentation, runbooks, and handover materials.
Vacancy posted 20 days ago
Similar jobs that could be interesting for youBased on the Data Senior Engineer in Indiana vacancy
$140k - $175k
...-generation solutions that patients and healthcare partners need today and into the future. Job Description The Senior Data Engineer will be responsible for building and maintaining the platform that services timely and accurate data for operational teams and...SeniorFull timeTemporary workWork experience placementRemote workWork visaFlexible hours- ...Data is only as powerful as the foundation beneath it. At SEP, we're building that foundation — and we're looking for a Senior Data Engineer who's ready to lead the way. We've been partnering with companies to build software that matters since 1988. From Fortune...SeniorFull time
$102.7k - $167.9k
...JOB SUMMARY This role is an integral senior member of a technical team, responsible for... ..., and maintenance of the organization's data infrastructure, ensuring the efficient and... ...with data professionals, analysts, and engineers to build and optimize data pipelines, ensuring...SeniorFull timeTemporary workFor contractorsWork at officeLocal areaRemote work- ...Senior Data Engineer — Azure, Databricks & dbt Position Overview We are looking for a Senior Data Engineer with experience designing, developing and optimizing data solutions on Azure and Databricks. The successful candidate will build data ingestion and transformation...Senior
- Senior Data Engineer Location: Indianapolis, IN Metro (Hybrid / 3-Day Onsite) (Open to Regional/EST Candidates with Onsite Travel) Contract Type: Contractor Full-Time / Enterprise Project Engagement (Outsourced via Xenon7) About Xenon7 Where elite tech talent meets world...SeniorFull timeContract workFor contractors
$122.9k - $204.9k
...better working world. We are seeking a talented Adobe CJA Developer Senior Consultant to join our dynamic Marketing Transformation team. In... .... The ideal candidate will have a strong background in data analytics, experience with Adobe CJA, and a passion for delivering...SeniorSummer holidayImmediate startFlexible hours- ...s largest companies to small and mid-market firms, rely on SS&C for expertise, scale, and technology. Job Description Senior Data Platform Engineer Role Summary We are seeking a Senior Data Platform Engineer to help build, scale, and operate our bespoke enterprise...SeniorOngoing contractFull timeWorldwide
$124k - $280k
...The Opportunity As an Applied AI Health Services Data Science-Senior Manager you will lead client-facing work focused on designing and... .... In this role at PwC, you will draw on data and analytics engineering, artificial intelligence, and machine learning skills to develop...SeniorH1b- ...MANTECH seeks a motivated, career and customer-oriented Senior Information Assurance Engineer to join our team in Crane, Indiana . This is an onsite position. We are seeking an enthusiastic and forward-thinking member to join our team and be at the forefront of innovation...SeniorFor contractorsWork at office
$186.07k - $218.9k
...sessions called “surges.”Learn more about working at Coinbase. The Data Platform team builds and operates the systems that centralize... ..., machine learning, and powering end-user experiences. As an engineer on the team you'll contribute across the full spectrum of our systems...SeniorLocal area- ...reserved for a select group of organizations that go above and beyond in building exceptional workplace cultures. Senior Lead Software Product Data Engineer, GSS Software Engineering This position serves as the senior architectural authority for product data across...SeniorFull timeH1b
- ...transform how digital marketing, product, and engineering teams connect. In just five years, we’ve... ...by cutting‑edge web, mobile, cloud, data, and AI technologies. If you’re excited by... ...Are We Looking to Add to Our Team? As a Senior Data Engineer, you will focus on designing...SeniorFull time
- ...Job Description Job Description Job Title: Senior Databricks Data Engineer Work Location: St. Louis, MO, Richardson, TX 75082 or Indianapolis, IN 46241 Contract duration: 06 Months Detailed Job Description: Bachelor s degree or foreign equivalent required...SeniorContract work
- ...Role Summary NTT DATA is seeking a highly experienced Senior Data Engineer / Technical Lead for a large-scale banking data modernization program involving migration of approximately 2 PB of historical data from Cloudera Hadoop/Hive to Apache Iceberg. The role requires...Senior
- ...Req ID: 398144 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want... ...organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN)....SeniorWork at officeRemote workFlexible hours
- ...designing, creating, deploying, and maintaining an organization's data architecture. -To ensure that the organization's data assets... ..., migration, and management. -Lead and mentor a team of data engineers in the design and development of datapipelines, ETL processes,...Senior
- ...Note: This position is intended for site/civil engineers with direct experience delivering AI, Hyperscale, Colocation data centers, semiconductor facilities, advanced... ...drivers. Job Description We're looking for a Senior Civil Engineer to join our Advanced...SeniorWork at officeLocal area
- Senior Encryption Engineer (Data at Rest) Location: This role requires associates to be in-office 1 - 2 days per week, fostering collaboration and connectivity, while providing flexibility to support productivity and work-life balance. This approach combines structured...SeniorTemporary workWork at officeLocal area2 days per week1 day per week
- ...Job Description Job Description Data is only as powerful as the foundation beneath it. At SEP, we're building that foundation — and we're looking for a Senior Data Engineer who's ready to lead the way. We've been partnering with companies to build software that...SeniorWork at officeRelocation packageFlexible hours
- ...Req ID: 374238 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you... ...thinking organization, apply now. We are currently seeking a Senior Data Engineer - Market #3 to join our team in Remote, Delhi (IN-DL), India...SeniorWork at officeLocal areaImmediate startRemote workFlexible hours
$160.2k - $183.1k
...Description Summary:Faegre Drinker has an opportunity for a Senior Information Security Engineer - AI & Application Security to work with our Technology &... ...and executes testing for prompt injection, jailbreaking, data leakage, and cross-client isolation in retrieval-...SeniorFull timeLocal areaFlexible hours$93.4k - $210k
...Remote Remote Full time R50127 C.H. Robinson is seeking a Senior Information Security Engineer with a strong focus on Identity and Access Management (... ...efficiency, and protect critical business systems and data. You'll collaborate with teams across Security, Infrastructure...SeniorHourly payFull timeContract workTemporary workRemote workWorldwideFlexible hours$79.2k - $209.5k
Job Description We are facing several engineering challenges in critical foundational virtual networking data-plane services that power the next gen OCI cloud. We need... ...latency. We are looking for self-motivated senior developers with passion and expertise in solving...SeniorTemporary workWork experience placementFlexible hours$130k - $160k
...Mon & Fri Open to: Boston, MA, or Indianapolis, IN Reports to: Senior Vice President, Business Intelligence & Analysis Position Summary: We are seeking a VP / Senior Data Engineer with a minimum of 9 years of relevant experience; 10+ years is preferred...SeniorWork at officeFlexible hours$82k - $137k
...it easier for coaches and athletes at any level to capture video, analyze data, share highlights and more. Ready to join us? Your Role We’re hiring a Senior Quality Assurance Engineer to join our Core Video & Data team, where quality work supports the platform...SeniorFull timeWork at officeLocal areaRemote workFlexible hours- ...today!Your day-to-day will include:Leverage Elanco’s Enterprise Data and PaaS/SaaS Platforms to deliver mission-critical product... ...Provide technical leadership in the design and execution of systems engineering solutions, driving standards across the R&D landscape to ensure...Full timeWork at office
- ...growth. We treat our people like family, we are mission-focused, and we give back! Join us today. We are seeking a skilled Data Analytics Engineer to join our team to support the U.S. Army Financial Management Command (USAFMCOM) in Indianapolis, IN. You will be...Work experience placement
- ...Role: QA / Test Engineer Total Experience: 5+ years Relevant Experience: 3+ years Role Overview The QA / Test Engineer will... ...readiness evidence. The role will ensure that implemented platform, data and analytics components meet agreed functional, technical and...Senior
- ...Job Description: Senior Data / Business Analyst (P&C or General Insurance Domain Experience Required) Position Overview: We are... ..., Underwriting, and Regulatory/Reporting teams to align data engineering with business goals. Experience & Qualifications: • 8+...Senior
- We Are:The beginning of a new Data & AI decade that will reshape work and society has begun. Accenture is stepping boldly into this... ...Investment, Exceptional Talent, and Power Ecosystem.You Are:As a Data Engineering, Management & Governance professional, you will play a pivotal...Work experience placementLive inWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Senior Engineer. Be the first to apply!
Related searches




