US_East | Data Engineer_L2

Senior Markit EDM Developer / Technical SME

We are seeking a Senior Markit EDM Developer / Technical SME with deep expertise in Client Markit EDM and strong experience in modern cloud-native, event-driven, and data engineering ecosystems. This role goes beyond traditional EDM development and requires ownership of end-to-end data mastering architecture, integrating EDM with data lakes, microservices, APIs, streaming platforms, and DevOps pipelines.

Key Responsibilities:

• Lead design and development of enterprise MDM solutions on Markit EDM (CADIS)
• Architect and implement core matcher frameworks, entity resolution, survivorship rules, and golden record creation
• Develop end-to-end data mastering pipelines including data constructors, data porters, data flows, and rules engines
• Ensure scalability, reusability, and performance optimization
• Design and develop workflow UI components (WF pages, WF elements, user-driven stewardship flows)
• Implement data governance workflows including approvals, exception handling, and audit trails
• Enable data lineage transparency and stewardship across domains (especially Party/Client)
• Implement real-time processing and notifications using Apache Kafka / Confluent
• Design event-driven EDM triggers and near real-time mastering/synchronization patterns
• Integrate EDM into enterprise event ecosystems
• Develop and expose RESTful APIs using Data Generators and Process Launchers
• Integrate with microservices architecture (Java, Spring Boot, Node.js)
• Enable API-first EDM integration across enterprise systems
• Deploy EDM solutions on AWS (or equivalent Azure environments)
• Work with AWS Glue, Lambda, S3, RDS (Aurora), SNS/SQS
• Integrate with Snowflake, Databricks, Redshift
• Design hybrid architecture between EDM, data lakes, and analytical layers
• Use Python, PySpark, and Spark SQL for large-scale data processing
• Build ingestion pipelines from APIs, files, streaming feeds, and databases
• Optimize batch and streaming data pipelines
• Build CI/CD pipelines using GitHub, GitLab, Jenkins, Azure DevOps, Octopus Deploy
• Implement Infrastructure as Code using Terraform / CloudFormation
• Manage automated deployments and environment promotion strategies
• Work with Docker and Kubernetes (EKS / AKS)
• Deploy and manage microservices and EDM integration layers
• Ensure scalable and resilient cloud-native deployments
• Use Splunk, ELK, Prometheus, Grafana, CloudWatch for monitoring
• Perform performance tuning for matchers and batch jobs
• Conduct root cause analysis and production support
• Work across SQL Server, Oracle, PostgreSQL, and Snowflake
• Develop complex SQL queries, stored procedures, indexing strategies
• Optimize database performance and data models
• Lead onsite/offshore delivery model
• Act as technical SME / solution architect for EDM
• Collaborate with business analysts, data architects, and Scrum teams
• Conduct code reviews, design reviews, and release governance

Required Qualifications:

• 5–10 years of MDM experience, including 5+ years in Markit EDM (Client/CADIS)
• Strong expertise in: core matcher design, data mastering pipelines, workflow/UI development
• Hands-on experience with Kafka or similar streaming platforms
• Strong AWS cloud experience
• REST API development experience
• Strong database experience (RDBMS + cloud data warehouses)
• Experience with CI/CD tools and Git/Terraform
• Proficiency in Python or Spark-based processing

Preferred Qualifications:

• Markit EDM Cloud 19.x experience
• Domain knowledge in Party / Client / Instrument MDM
• Experience with Databricks and Snowflake ecosystems
• Microservices architecture (Spring Boot, Node.js)
• Kubernetes/containerization experience
• Exposure to data governance tools (Collibra, Alation, etc.)

Key Competencies:

• Strong EDM and modern data ecosystem expertise
• System architecture and design thinking
• Ability to lead enterprise data platform transformations
• Strong communication and stakeholder management
• Performance tuning and problem-solving skills

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.