Senior Data Engineer
Valid8 Financial, Inc.
BDIPlus is seeking a Senior Data Engineer to support a Fortune 100 financial services client’s real-time intelligence initiatives.
In this role, You’ll work in a virtualization-first architecture using Denodo , building both virtual and physical data products that are governed, high-quality, and AI-ready.
You will play a critical role in establishing trusted, reusable data assets —each backed by formal data contracts, quality controls, and full lineage.
What You’ll Do
- Build governed virtual data models in Denodo , including cross-system joins, canonical schemas, ABAC policies, and column-level masking
- Configure and optimize semantic layer connectivity (JDBC/ODBC, connection pooling, failover)
- Implement data quality rules (completeness, validity, uniqueness, anomaly detection, scoring)
- Configure data catalog, lineage, and marketplace publishing
- Build physical data products:
- Source extraction (mainframe, CDC, COBOL copybooks)
- Data Lakehouse storage using Apache Iceberg on AWS S3
- Define and implement machine-readable data contracts (YAML/JSON), including schema guarantees, SLAs, and dependency tracking
- Develop APIs, SLA monitoring dashboards, reconciliation processes, and production-grade delivery patterns
- Partner with client teams through demos, rotations, and structured knowledge transfer
- Leverage AI-assisted development (Claude Code) to accelerate delivery and improve productivity
Required Qualifications
- 5+ years of data engineering experience in enterprise-scale environments
- Strong expertise with Denodo (VQL development, query optimization, caching, governance)
- Experience with Apache Iceberg on AWS (S3, Glue, Athena), including schema evolution and partitioning
- Hands‑on experience with Informatica
- Experience implementing data quality frameworks
- Strong SQL and programming skills (Python, Spark; dbt preferred)
- Experience with CDC technologies (e.g., Debezium, Informatica CDC, or equivalent)
- Familiarity with API development (FastAPI, Node.js) and OpenAPI standards
- Experience working with AI‑assisted development tools (Claude Code preferred; training available)
Preferred Qualifications
- Experience with mainframe data environments (COBOL copybooks, VSAM, AIX/AS400 extraction)
- Financial services or insurance domain experience
- Familiarity with multi‑tier data certification frameworks (e.g., Bronze/Silver/Gold or Foundation/Production/Enterprise)
- Experience with API gateways and AI integration patterns (e.g., Kong Gateway , APIGEE, MCP)
- Experience designing and enforcing formal data contracts and dependency management
- Consulting or client‑facing experience with structured knowledge transfer
- AWS certifications (Solutions Architect, Data Analytics) are a plus
About BDIPlus
BDIPlus is a data and AI consulting firm with deep experience delivering for Fortune 500 clients, including American Express and Morgan Stanley . We specialize in enterprise data products, identity resolution, semantic layers, and event‑driven architecture .
Our engineers are AI‑native , leveraging tools like Claude Code from day one to deliver faster, higher-quality solutions than traditional consulting teams.
BDIPlus is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
$180k - $220k
Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing...SeniorWork at officeRemote workFlexible hoursShift work2 days per week1 day per week$120k - $135k
Full Time, Fully Remote Sr. Azure Data Engineer opportunity with rapidly growing financial corporation Employee testimonials: Great company... ...135,000 +Bonus Responsibilities: This fully remote, full-time Senior Azure Data Engineer role sits at the center of a modern Azure-...SeniorFull timeRemote work$250k - $300k
...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside... ..., complex structured and unstructured data sets. As a senior member of our Data Engineering team, you will help set...SeniorWork experience placement- ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast...SeniorWork at officeRemote work
$110k - $190k
Senior Data Management Professional - Data Engineering - Private Funds Location New York Business Area Data Ref # 10052928 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context...SeniorTemporary workFor contractorsWork experience placement- Req ID:376263NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want... ...-thinking organization, apply now.We are currently seeking a Senior Data Engineer - Snowflake to join our team in Remote, New York (US-NY), United...SeniorFull timeWork at officeRemote workFlexible hours
$182k - $242k
...Nasdaq: CRWV) in March 2025. Learn more at .What You’ll Do:The Data Engineering Team builds and operates the foundational data infrastructure... ..., and actionable at scale.About the role:We're seeking a Senior Data Engineer to design and build the foundational datasets that...SeniorPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$123k - $215.25k
...StatesSalary: $123000 - $215250 annually + bonus + benefitsJob Function: Engineering & ArchitectureSchedule: Full timeCareer Area: TechnologyCompany... ..., travel and lifestyle, and automation, grounded in our data technology model that prioritizes data governance. It employs a...SeniorWorldwideVisa sponsorship$128k - $252.5k
...programs that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and... ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas such...SeniorLocal area$140k - $160k
...strategy centers on making journalism so good that it’s worth paying for. About the RoleThe New York Times is looking for a Senior Data Engineer to join the Customer-Facing Data Products team to develop real-time data pipelines and APIs that process events and serve aggregated...SeniorFull timeLocal areaFlexible hours- Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy is looking for a Senior Data Engineer to join our dynamic Data Engineering team. In this role, you’ll be at the forefront of...SeniorFull timeLocal area
$110k - $190k
Senior Data Management Professional - Data Engineering - Commodities Data Location New York Business Area Data Ref # 10050802 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and...SeniorTemporary workFor contractorsWork experience placement$137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies...SeniorLocal areaImmediate startFlexible hours$106.9k - $176.5k
...go. Join EY and help to build a better working world.Senior Consultant - Financial Services - Data & Analytics - Data Architecture and EngineeringEY is... ...Data Products Management (DPM), Data Architecture and Engineering (DAE), Data Governance and Controls (DGC), and Data Analytics...SeniorWork experience placementSummer holidayFlexible hours- ...Reference 0000019385Salary Type AnnuallyIndustry Private Equity;Venture Capital and Private EquitySelling Points Shape the future of data engineering at a leading organization. Drive innovation through scalable data platforms and AI capabilities. Enjoy comprehensive benefits...Senior
- ...visualization capabilities related to Fusion Operational Dashboards. The ideal candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders from inception to completion of a capability, and should...Senior
- ...A government services provider in New York is looking for a CommVault Systems Engineer. You'll focus on designing and implementing backup and recovery solutions in a federal environment. The ideal candidate possesses strong expertise in Commvault, troubleshooting complex...Senior
CGS Federal (Contact Government Services)
New York, NY2 days ago - ...agility, and growth — driving the company's success. At New York Life will join a team of analytics engineers focused on delivering clean, well-structured, and reliable data to power various business and AI solutions across the enterprise. In this role, you will help...SeniorLocal area3 days per week
$100k - $143k
Location Designation: Hybrid - 3 days per week Role Overview:The Data Governance Engineer plays a key role in advancing New York Life’s data governance initiatives. This individual contributor role focuses on the operational design and execution of metadata cataloging,...SeniorLocal area3 days per week$110k - $190k
Senior Data Management Professional - Analytics Engineer - DMO BI Location New York Business Area Data Ref # 10052485 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context...SeniorTemporary workFor contractorsWork experience placementImmediate start$77k - $214k
...ApplicableSpecialismData EngineeringManagement LevelSenior AssociateJob Description & SummaryThe OpportunityAs a Forward Deployed Data Engineering - Senior Associate, you will be at the forefront of developing innovative software solutions that drive digital transformation and...SeniorFull timeH1b- ...A leading technology services company in New York is seeking a Senior Data Engineer specializing in Credit Risk. The role involves application development using Python and SQL Server, as well as maintaining data models. The ideal candidate will have around 15 years of...Senior
Govserviceshub
New York, NY22 hours ago - ...TechnologyExperience Level: Experience ProfessionalsContact: Ashley RezinJob ID: REQ8361ROLE OVERVIEW We are looking for an experienced Senior Market Data Engineer to join our team. The ideal candidate will have a strong background in Python, cloud technologies, and extensive...Senior
$140k - $175k
...talented people in the industry. Rockstar Games is on the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position based out of Rockstar’s NYC headquarters...SeniorFull timeWork at office- Location Designation: Hybrid - 3 days per week We are seeking energetic and passionate Senior Data Engineer to design and execute our company’s modern data management strategy. As a key member of Enterprise Data Platform team, you will work with talented engineers, architects...SeniorLocal area3 days per week
$150k - $180k
...time on solving meaningful problems for our customers.We’re looking for a Senior Analytics Engineer (Technical Level 4) to own and evolve the analytics foundation that powers Stash—our dbt-powered data mart, Looker semantic layer, and the quality systems that keep daily...SeniorWork at officeWork from homeFlexible hours- ...Location: New York, NY ( 100% Onsite )-Local Candidates are Only Accepted We are looking for a Data Engineering Specialist to design and optimize high-scale cloud solutions. This role is focused on the "heavy lifting" of data—leveraging GCP Bigtable for massive, low-latency...SeniorLocal area
Marvel Infotech
New York, NY2 days ago - ...because it's an investment in our people, our future, and what we stand for as a firm.KPMG is currently seeking a Senior Associate, Ignition - Tax Data Engineer to join our Tax Ignition practice.Responsibilities:Collaborate with cross-functional teams and clients to...SeniorLocal area
$215.2k - $244.7k
...make an impact?West Monroe is seeking a Senior Architect to join our thriving Technology... ...opportunity to work with clients developing Big Data strategy and roadmaps, while gaining... ...Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval...SeniorLocal areaImmediate startFlexible hours- ...Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows and manage data pipelines; ensure smooth operation of data systems. Responsibilities Lead development of large-scale data pipelines...Senior
Saransh
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data platform engineer New York, NY
- aws data engineer New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- big data developer New York, NY
- software data engineer New York, NY
- data center engineer New York, NY
- big data cloud engineer New York, NY
- director data engineering New York, NY
- hadoop big data developer New York, NY