Senior Data Engineer
Valid8 Financial, Inc.
BDIPlus is seeking a Senior Data Engineer to support a Fortune 100 financial services client’s real-time intelligence initiatives.
In this role, You’ll work in a virtualization-first architecture using Denodo , building both virtual and physical data products that are governed, high-quality, and AI-ready.
You will play a critical role in establishing trusted, reusable data assets —each backed by formal data contracts, quality controls, and full lineage.
What You’ll Do
- Build governed virtual data models in Denodo , including cross-system joins, canonical schemas, ABAC policies, and column-level masking
- Configure and optimize semantic layer connectivity (JDBC/ODBC, connection pooling, failover)
- Implement data quality rules (completeness, validity, uniqueness, anomaly detection, scoring)
- Configure data catalog, lineage, and marketplace publishing
- Build physical data products:
- Source extraction (mainframe, CDC, COBOL copybooks)
- Data Lakehouse storage using Apache Iceberg on AWS S3
- Define and implement machine-readable data contracts (YAML/JSON), including schema guarantees, SLAs, and dependency tracking
- Develop APIs, SLA monitoring dashboards, reconciliation processes, and production-grade delivery patterns
- Partner with client teams through demos, rotations, and structured knowledge transfer
- Leverage AI-assisted development (Claude Code) to accelerate delivery and improve productivity
Required Qualifications
- 5+ years of data engineering experience in enterprise-scale environments
- Strong expertise with Denodo (VQL development, query optimization, caching, governance)
- Experience with Apache Iceberg on AWS (S3, Glue, Athena), including schema evolution and partitioning
- Hands‑on experience with Informatica
- Experience implementing data quality frameworks
- Strong SQL and programming skills (Python, Spark; dbt preferred)
- Experience with CDC technologies (e.g., Debezium, Informatica CDC, or equivalent)
- Familiarity with API development (FastAPI, Node.js) and OpenAPI standards
- Experience working with AI‑assisted development tools (Claude Code preferred; training available)
Preferred Qualifications
- Experience with mainframe data environments (COBOL copybooks, VSAM, AIX/AS400 extraction)
- Financial services or insurance domain experience
- Familiarity with multi‑tier data certification frameworks (e.g., Bronze/Silver/Gold or Foundation/Production/Enterprise)
- Experience with API gateways and AI integration patterns (e.g., Kong Gateway , APIGEE, MCP)
- Experience designing and enforcing formal data contracts and dependency management
- Consulting or client‑facing experience with structured knowledge transfer
- AWS certifications (Solutions Architect, Data Analytics) are a plus
About BDIPlus
BDIPlus is a data and AI consulting firm with deep experience delivering for Fortune 500 clients, including American Express and Morgan Stanley . We specialize in enterprise data products, identity resolution, semantic layers, and event‑driven architecture .
Our engineers are AI‑native , leveraging tools like Claude Code from day one to deliver faster, higher-quality solutions than traditional consulting teams.
BDIPlus is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
#J-18808-LjbffrVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
$180k - $220k
Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing...SeniorWork at officeRemote workFlexible hoursShift work2 days per week1 day per week$120k - $135k
Full Time, Fully Remote Sr. Azure Data Engineer opportunity with rapidly growing financial corporation Employee testimonials: Great company... ...135,000 +Bonus Responsibilities: This fully remote, full-time Senior Azure Data Engineer role sits at the center of a modern Azure-...SeniorFull timeRemote work$250k - $300k
...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside... ..., complex structured and unstructured data sets. As a senior member of our Data Engineering team, you will help set...SeniorWork experience placement- ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast...SeniorWork at officeRemote work
- Req ID:376263NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want... ...-thinking organization, apply now.We are currently seeking a Senior Data Engineer - Snowflake to join our team in Remote, New York (US-NY), United...SeniorFull timeWork at officeRemote workFlexible hours
$110k - $190k
Senior Data Management Professional - Data Engineering - Private Funds Location New York Business Area Data Ref # 10052928 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context...SeniorTemporary workFor contractorsWork experience placement$182k - $242k
...Nasdaq: CRWV) in March 2025. Learn more at .What You’ll Do:The Data Engineering Team builds and operates the foundational data infrastructure... ..., and actionable at scale.About the role:We're seeking a Senior Data Engineer to design and build the foundational datasets that...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$190k - $220k
...by role and will be assessed during the interview process.The Data Engineering team builds tools and systems that make Gusto's data... ...customized experiences to our customers.We're looking for a Senior Data Engineer who can take loosely defined problems and drive...SeniorFull timeWork at officeLocal area2 days per week3 days per week$123k - $215.25k
...StatesSalary: $123000 - $215250 annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeCareer Area: TechnologyCompany... ..., travel and lifestyle, and automation, grounded in our data technology model that prioritizes data governance. It employs a...SeniorWorldwideVisa sponsorship$128k - $252.5k
...programs that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and... ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas such...SeniorLocal area$140k - $160k
...strategy centers on making journalism so good that it’s worth paying for. About the RoleThe New York Times is looking for a Senior Data Engineer to join the Customer-Facing Data Products team to develop real-time data pipelines and APIs that process events and serve aggregated...SeniorFull timeLocal areaFlexible hours- Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy is looking for a Senior Data Engineer to join our dynamic Data Engineering team. In this role, you’ll be at the forefront of...SeniorFull timeLocal area
$110k - $190k
Senior Data Management Professional - Data Engineering - Commodities Data Location New York Business Area Data Ref # 10050802 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and...SeniorTemporary workFor contractorsWork experience placement$110k - $190k
Senior Data Management Professional - Data Engineering - Entities Location New York Business Area Data Ref # 10052582 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context...SeniorTemporary workFor contractorsWork experience placement$137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies...SeniorLocal areaImmediate startFlexible hours- ...Reference 0000019385Salary Type AnnuallyIndustry Private Equity;Venture Capital and Private EquitySelling Points Shape the future of data engineering at a leading organization. Drive innovation through scalable data platforms and AI capabilities. Enjoy comprehensive benefits...Senior
- ...visualization capabilities related to Fusion Operational Dashboards. The ideal candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders from inception to completion of a capability, and should...Senior
- ...A government services provider in New York is looking for a CommVault Systems Engineer. You'll focus on designing and implementing backup and recovery solutions in a federal environment. The ideal candidate possesses strong expertise in Commvault, troubleshooting complex...Senior
CGS Federal (Contact Government Services)
New York, NY13 hours ago - ...immediate opening for the below position with one of our premium clients. Job Description Job Title: Senior Principal Snowflake Data Engineer Location: New York City, NY (Hybrid) Relocation: Near-by states only Interview: Video Experience...SeniorH1bImmediate startRelocation
IT Engagements
New York, NY1 day ago - ...media and we need your help adding fuel to the fire.About the RolePolymarket is looking for a Senior Analytics Engineer to own the modeling layer that sits between our raw data and the decisions the business makes with it. You'll join a small, high-ownership team,...Senior
- ...agility, and growth — driving the company's success. At New York Life will join a team of analytics engineers focused on delivering clean, well-structured, and reliable data to power various business and AI solutions across the enterprise. In this role, you will help...SeniorLocal area3 days per week
$100k - $143k
Location Designation: Hybrid - 3 days per week Role Overview:The Data Governance Engineer plays a key role in advancing New York Life’s data governance initiatives. This individual contributor role focuses on the operational design and execution of metadata cataloging,...SeniorLocal area3 days per week$77k - $214k
...ApplicableSpecialismData EngineeringManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Forward Deployed Data Engineering - Senior Associate, you will be at the forefront of developing innovative software solutions that drive digital transformation and...SeniorFull timeH1b- Location Designation: Hybrid - 3 days per week We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management strategy. As a key member of Enterprise Data Platform team, you will work with talented engineers, architects...SeniorLocal area3 days per week
$140k - $175k
...talented people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC headquarters...SeniorFull timeWork at office- ...Senior Data Engineer Location: New York, NY Contract Duration: 10 months Detailed Job Description: Create detailed design of data pipelines Work on development, code review, implement validation, in line with architecture and requirements. Collaborating...SeniorContract work
eTeam
New York, NY4 days ago - ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a large Datalake, managing data flows that integrate information from various sources into a common pool implementing data pipelines...Senior
Cardinal Integrated
New York, NY2 days ago - ...Senior Data Engineer Our client is a high-volume decentralized finance (DeFi) protocol based on Arbitrum, facilitating leveraged trading of real-world assets—including commodities, forex, indices, and equities—alongside crypto with full self-custody. The client...Senior
MLabs
New York, NY2 days ago $150k - $180k
...time on solving meaningful problems for our customers.We’re looking for a Senior Analytics Engineer (Technical Level 4) to own and evolve the analytics foundation that powers Stash—our dbt-powered data mart, Looker semantic layer, and the quality systems that keep daily...SeniorWork at officeWork from homeFlexible hours- ...Primary Skill : BigQuery, Python, GCP Skill Cluster : Data-GCP Data Plex, with Data Governance, Data Catalog, Data Lineage, Data Quality. We are seeking a highly skilled Data Engineer with strong hands-on experience in BigQuery and Apache Iceberg to design, build...Senior
Diversity Nexus
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data platform engineer New York, NY
- aws data engineer New York, NY
- azure data engineer New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- big data developer New York, NY
- software data engineer New York, NY
- data center engineer New York, NY
- big data cloud engineer New York, NY
- director data engineering New York, NY