Data Engineer

Data EngineerLong term contract position with a major financial firm. Hybrid, 3 days/week in Newark, NJ.Business Requirements: Centralize market data feeds from various third-party market data vendors into the central "Market Data Hub. Source data feeds from a 3rd party EDM system (e.g. Gresham, Golden Source, RIMES, Bloomberg). Ensure that data quality rules and checks are applied to each dataset. (This would be configurable within the EDM System) Land consolidated data from EDM system within MS Fabric (example data flow: 3rd party market data vendor EDM System MS Fabric) Migrate existing market data feed ingestion and ETF processes to the MS Fabric or EDM System. Sunset existing market data feed ingestion. 5-10 years of experience.Responsibilities:Prior experience working with Market Data feeds and asset management industry or financial services experience.Prior experience designing and implementing a medallion architecture for enterprise data.Prior experience in Fabric and EDM (e.g. enterprise data management system, like Gresham, Golden Source, RIMES, Bloomberg) preferred.Design, build and maintain data quality rules and data extracts from EDM vendor.Design, build and maintain scalable data pipelines from EDM vendor into MS Fabric to support 3rd party market data feeds. Note some data feeds may need to bypass the EDM vendor and be ingested directly into MS Fabric.Design, build and maintain data validation and quality rules for data ingested into MS fabric.Prior experience with Microsoft Purview or other data governance tool is a plusPrepares data for analytical or operational usesBuilds data pipelines to pull information from different source systems; integrating, consolidating and cleansing data; and structuring it for use in applicationsCreates interfaces and mechanisms for the flow and access of information.Payrate: 65 - 75 per hour depending on experience