Data Engineer

We are looking for a Senior Markit EDM Developer Technical SME with deep expertise in IHS Markit EDM and strong experience in modern cloud native event driven and data engineering ecosystems. This role goes beyond traditional EDM development and requires ownership of end-to-end data mastering architecture integrating EDM with data lakes, microservices, APIs, streaming platforms and DevOps pipelines. Key Responsibilities Markit EDM CADIS Core Development: Lead design and development of enterprise MDM solutions on Markit EDM CADIS; architect and implement core matcher frameworks, entity resolution, survivorship rules; create golden records and manage their lifecycle; build data constructors and ensure scalability, reusability and performance optimization. Workflow UI Data Governance: Design and develop Workflow UI components for user‑driven stewardship flows; implement data governance workflows, approval and exception handling, audit trails; enable data lineage transparency and stewardship across domains, especially Party and Client. API & Microservices Integration: Develop and expose RESTful APIs, data generators and process launchers; integrate with microservices architecture using Spring Boot, Java, Node.js; deploy and manage EDM solutions on AWS or Azure; orchestrate with Glue and Lambda, manage S3 data lake integration, RDS Aurora, SNS/SQS eventing, and integrate with Snowflake, Databricks, Redshift. Data Lake & Platform Integration: Design near‑real‑time mastering and synchronization patterns; integrate EDM into enterprise event ecosystems; build hybrid architecture where EDM serves as the golden source for data lake analytical layers. Advanced Data Engineering: Work with Python, PySpark and Spark SQL to transform data, ingest from various sources, and optimize large‑volume batch and streaming pipelines. DevOps & CI/CD Infrastructure: Build and maintain CI/CD pipelines for EDM; use Infrastructure‑as‑Code with Terraform and CloudFormation; automate deployments; manage version control, Docker, Kubernetes (EKS or AKS) for integration layers around EDM. Performance Engineering: Implement monitoring and logging; tune performance of matchers and batch jobs; conduct root‑cause analysis and provide production support. Data Modeling & Database: Design and optimize Snowflake cloud‑native warehouses; develop complex SQL, stored procedures, indexing strategies and performance tuning. Leadership & Delivery: Act as technical SME and solution architect; collaborate with business analysts and data architects; conduct code reviews, design reviews and release governance. Required Qualifications 5‑10 years of experience in MDM, with 5 years in Markit EDM (IHS). Strong expertise in workflow UI development. Hands‑on experience with Kafka or equivalent streaming platform. Strong database experience across RDBMS and cloud data warehouses. Experience with CI/CD, Git, Terraform. Proficiency in Python or Spark‑based data processing. Preferred Qualifications Experience with Markit EDM Cloud 19x. Party/Client Instrument MDM. Experience with Databricks, Snowflake ecosystems. Microservices architecture using Spring Boot and Node.js. Strong architecture and system design mindset. Ability to lead complex data platform transformations. Excellent communication and stakeholder management. Strong problem‑solving and performance optimization skills. The pay range that the employer in good faith reasonably expects to pay for this position is $34.67/hour - $54.18/hour. Our benefits include medical, dental, vision and retirement benefits. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non‑public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations. #J-18808-Ljbffr