Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Jobtailor

Responsibilities Lead the design, development, and support of party reference data applications, APIs, and data services. Partner with business stakeholders, architects, and engineering teams to deliver reference data solutions supporting client, counterparty, issuer, and legal entity domains. Develop and maintain cloud-native data pipelines utilizing AWS services such as Glue, Lambda, EventBridge, S3, RDS, and Kafka/MSK. Support the modernization of legacy reference data platforms through migration to scalable cloud-based solutions. Integrate third‑party reference data sources including Dun & Bradstreet, S&P Global, and other data providers to support enrichment, validation, and compliance requirements. Develop and support APIs and data services consumed by CRM, compliance, reporting, operations, and trading platforms. Implement data quality controls, validation rules, matching and deduplication processes, survivorship logic, and lineage tracking capabilities. Collaborate with data governance and architecture teams to support reference data standards, metadata management, and best practices. Participate in Agile planning, backlog refinement, estimation, sprint execution, and delivery activities using Jira. Provide technical leadership and mentorship to junior engineers and project team members. Requirements Minimum of 7 years of experience in data engineering, software engineering, cloud engineering, or related technical disciplines. Minimum of 2 years of experience serving as a technical lead, project lead, or people leader. Experience developing and supporting cloud-native applications, APIs, and data platforms. Experience developing event‑driven architectures, data pipelines, and distributed data services. Bachelor’s degree in Computer Science, Information Technology, Engineering, Mathematics, or a related technical field (or equivalent combination of education and relevant work experience). Core Competencies Demonstrates expertise in designing and developing cloud‑native data applications and APIs, with a strong focus on data quality, governance, and integration of third‑party data sources. Proven ability to lead technical teams and collaborate with stakeholders to deliver scalable reference data solutions. #J-18808-Ljbffr

Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Columbia, SC vacancy
  • $106.61k - $284.28k

     ...SUMMARY At CVS Health, protecting the privacy and security of customer, patient, member, and colleague data is foundational to our mission. The Lead Data Privacy Engineer will play a critical role in advancing enterprise data protection capabilities by designing and... 
    Suggested
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    CVS Health

    Columbia, SC
    1 day ago
  •  ...Process Engineer Location: Cincinnati, OH (HQ) We are searching for an experienced Process...  ..., and welcoming culture Job Summary As a Data Engineer at Senneca, you will join a high...  ...and process improvement skills Experience leading cross-functional projects Knowledge of manufacturing... 
    Suggested
    Full time

    Subzero Engineering

    Springdale, SC
    1 day ago
  • $115k

     ...Maximus is currently seeking a Senior Engineer - Data Analytics to support our Enterprise Data Services team. Enterprise Data Services is a team within Maximus aligned under the Office of the Chief Data Information Officer. Primarily engaged in building and supporting... 
    Suggested
    Work at office
    Remote work

    MAXIMUS

    Columbia, SC
    16 hours ago
  •  ...Overview Job Summary: We are looking for a skilled Data Engineer with strong hands-on experience in AWS to design, build, and maintain scalable data pipelines and cloud-based data platforms. The ideal candidate will have expertise in modern data warehousing, ETL/ELT development... 
    Suggested

    The Value Maximizer

    Columbia, SC
    3 days ago
  • $60.5k - $123.4k

     ...their individual plans. General Summary This position is for a Data Engineer who will design, build and maintain data systems and pipelines...  ...and positively to change, viewed as embracing change and leading proof of concept work and prototyping when necessary. Preferred... 
    Suggested
    Temporary work
    Work experience placement
    Worldwide
    Flexible hours

    SwiftCruit

    Columbia, SC
    1 day ago
  • $91.4k - $187k

     ...Job Description The Data Center Construction organization at Oracle Cloud Infrastructure...  ...of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority...  ...and resolving execution issues quickly. Lead the change order process, validating... 
    Temporary work
    Live in
    Local area
    Worldwide
    Relocation
    Relocation package
    Flexible hours

    Oracle

    Columbia, SC
    16 hours ago
  • $160k - $200k

     ...Datavant is the data collaboration platform trusted for healthcare. Guided by our mission...  ...-oriented and impact-driven Senior Data Engineer to strengthen our capabilities around...  ...love to hear from you! What You Will Do Lead the design and evolution of scalable data... 

    Datavant

    Columbia, SC
    1 day ago
  • $165.56k - $188.09k

     ...Sr. Data Analytics Engineer Sr. Data Analytics Engineer Values & Innovation At Under Armour, we are committed to empowering those who...  ...visualization and reporting requirements. Leverage industry-leading integration and analytics tools to build a modern data... 
    Local area
    Remote work
    Relocation

    Under Armour

    Columbia, SC
    3 days ago
  • $84.63k - $112.84k

     ...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and...  ...us today. The Role Cybersecurity Incident Response Team (CIRT) Engineers at Lumen are on the front lines of protecting the systems that... 
    Temporary work
    Remote work
    Shift work

    Lumen Inc

    Columbia, SC
    3 days ago
  • $123.4k - $176.3k

     ...established design control processes and good engineering practices. This job family programs and...  .... Cardinal Health’s Enterprise Master Data Management technology team is on a...  ...Consolidation applications within SAP Fiori. Lead requirements gathering and designs the... 
    Temporary work
    Work experience placement
    Local area
    Immediate start
    Flexible hours

    Cardinal Health

    Columbia, SC
    1 day ago
  • Job Summary We are looking for a Senior Data Engineer with strong experience in real-time data streaming using Apache Kafka. The ideal candidate will design and build scalable data pipelines, streaming architectures, and data platforms to support real-time analytics and... 

    The Value Maximizer

    Columbia, SC
    4 days ago
  • $135k - $170k

     ...and ongoing skills training opportunities Employee resource groups Swag, ticket giveaways, and more! About The Role The Senior Data Engineer will own the path from raw transactional and event data to trustworthy, well‑modeled datasets powering BetMGM's analytics, ML,... 
    Contract work
    For contractors
    H1b
    Visa sponsorship
    Flexible hours

    BetMGM

    Columbia, SC
    1 day ago
  • $150k - $170k

     ...successful track record in handling complex data pipelines for high transaction volume...  ...synchronization with legacy systems. The Senior Data Engineer provides support to the Application...  ...the Data Architects and technical leads in designing how data will be stored, accessed... 
    Work experience placement
    H1b
    Work at office
    Local area

    Karsun Solutions, LLC

    Columbia, SC
    4 days ago
  • What you’ll do: Designs, develops, and optimizes data integration processes, ETL workflows, and data platforms, leading the creation of technical designs and...  ...in programming languages commonly used in data engineering, such as Python or Java. What We Offer: Comprehensive... 
    Work experience placement

    Carrington

    Columbia, SC
    16 hours ago
  •  ...A leading engineering and design firm is seeking a Senior Electrical Engineer to work with major technology clients. This remote role requires 8+ years of electrical engineering experience, a Bachelor’s degree in electrical engineering, and a PE license. Responsibilities... 
    Remote work
    Flexible hours

    Olsson

    Columbia, SC
    4 days ago
  • $130k - $170k

     ...Senior Mechanical Engineer - Data Centers SSOE is seeking a Senior Mechanical Engineer - Data Centers who will play a pivotal role in...  ...the most successful years in our history. Along with industry-leading salary compensation, you'll be eligible to purchase shares in... 
    For contractors
    Local area
    Remote work
    Flexible hours

    SSOE Group

    Columbia, SC
    4 days ago
  • $45 per hour

    Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot - that’s how we refer to this role at Mindrift - you’... 
    Hourly pay
    Part time
    Freelance
    Remote work
    10 hours per week

    Mindrift

    Columbia, SC
    2 days ago
  • $45 per hour

    Mindrift is seeking a Senior Python Data Scraping Engineer for the Tendem project. This part-time remote role involves collaborating with Tendem Agents to perform data scraping workflows using tools like Apify and OpenRouter. The ideal candidate has 5+ years of experience... 
    Remote job
    Hourly pay
    Part time
    10 hours per week

    Mindrift

    Columbia, SC
    2 days ago
  • $123.4k - $176.3k

     ...established design control processes and good engineering practices. This job family programs and...  .... Cardinal Health’s Enterprise Master Data Management technology team is on a...  ...extensive global SAP implementation experience. Lead and direct teams during problem-solving... 
    Temporary work
    Work experience placement
    Local area
    Immediate start
    Flexible hours

    Cardinal Health

    Columbia, SC
    1 day ago
  • $84.63k - $112.84k

     ...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and...  ...a Candidate • 3–5 years of experience in data science, data engineering, analytics, or a related role • Strong Python and SQL skills... 
    Temporary work
    Remote work
    Work from home

    Lumen Inc

    Columbia, SC
    1 day ago
  • $85k - $113k

     ...Overview As the nation's leading provider of high-quality home care services, we empower...  ..., analytical, and technically driven Data Scientist to join our growing Analytics...  ...business stakeholders, BI Analysts and Data Engineers on defining and building data sets to be... 
    Weekly pay
    Work at office
    Remote work
    Flexible hours

    Help At Home

    Columbia, SC
    3 days ago
  •  ...The opportunity At Hitachi Energy, Field Service Engineers for Data Centers play a vital role in transformer lifecycle management. You'll apply...  ...service needs, and help improve energy systems. You'll lead on-site projects, solve technical issues, and work with teams... 
    For subcontractor
    Work at office
    Remote work
    Relocation package

    Hitachi Energy

    Columbia, SC
    1 day ago
  • $165k - $180k

     ...the limit of your curiosity. Join Team Karsun, and Find Your Next! Summary We are seeking a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building scalable data platforms and incorporating Generative AI into data engineering workflows.... 
    Work experience placement
    H1b
    Work at office
    Local area

    Karsun Solutions, LLC

    Columbia, SC
    2 days ago
  • $91k - $121.33k

     ...-digit year-over-year revenue growth, the opportunities to make your mark are limitless! We are looking for a motivated Junior Data Engineer to join our data team. The ideal candidate will help build and maintain data pipelines and support our modern data platform built... 
    Full time
    Temporary work
    Internship
    Local area

    Cumming Group

    Columbia, SC
    9 hours ago
  •  ...: We’re looking for a Principal Sales Engineer who is not only passionate about technology...  ...can successfully be the technical sales lead on software opportunities to progress and...  ...prospective clients to understand their data integration challenges, especially around... 
    Worldwide

    Rocket Software

    Columbia, SC
    1 day ago
  • Senior Electrical Engineer - Data Center (Remote) Arizona - Remote; Arkansas - Remote; Florida - Remote; Georgia - Remote; Idaho - Remote; Illinois - Remote; Indiana - Remote; Iowa - Remote; Kansas - Remote; Kentucky - Remote; Louisiana - Remote; Michigan - Remote; Minnesota... 
    Remote job
    Full time
    Internship
    Flexible hours

    Olsson

    Columbia, SC
    4 days ago
  • Company Description We are Olsson. We engineer and design solutions that improve the world around us. As a company, we promise to always...  ...write technical reports, and prepare documents. Experience in the Data Center industry is preferred. You will also coordinate with... 
    Remote job
    Full time
    Flexible hours

    Olsson

    Columbia, SC
    2 days ago
  • $130k - $170k

    Senior Mechanical Engineer - Data Centers Job Locations: Austin, TX; Atlanta, GA; Birmingham, AL; Columbia, SC; Columbus, OH; Huntsville, AL...  ...OR; and additional locations. Job Type: Full Time Overview: Lead mechanical engineering for high‑performance data center and AI... 
    Full time
    For contractors
    Local area
    Remote work

    SSOE

    Columbia, SC
    2 days ago
  • Principal Data Scientist Job Responsibilities Lead the design and development of advanced statistical and machine learning models that improve claims...  ...detection, and probabilistic modeling. Partner with AI Engineering teams to productionize models and integrate them into... 

    Sedgwick

    Columbia, SC
    2 days ago
  • $60k - $90k

     ...skills and experience — talk with your recruiter to learn more. Base pay range $60,000.00/yr - $90,000.00/yr Title: Jr. Data Scientist / AI-ML Engineer Location: Columbia, SC (Remote) Duration: Full Time Responsibilities Collaborate with stakeholders to understand... 
    Full time
    Remote work

    DetaPent

    Columbia, SC
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!