Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer - Data Lake / AI

$170k - $200k

Onward Legal Innovation

We are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and AI/ML platform ingestion to join a newly formed data engineering team at one of the world’s largest and most prestigious law firms as it undergoes a major data and AI transformation.

This is a senior, hands-on role focused on building an AWS data lake/lakehouse and evolving the enterprise data platform, ingesting data from complex enterprise business systems and creating high-quality datasets for analytics, reporting and AI/ML in a regulated environment. You’ll need to be comfortable with ambiguity, shape solutions, and collaborate closely with internal teams, vendors, and technology partners.

The role is primarily remote, but you must live within approximately 1.5 hours of Washington DC

Salary $170-200k plus Generous Benefits + Bonus

Candidates must already be eligible to work (Green Card or US Citizen), as there are no H-1B transfers or new visa sponsorship.

Key skills required for the Senior Data Engineer

  • Circa 10+ years of enterprise data engineering experience.
  • Experience working through large-scale data transformation or cloud modernisation programmes.
  • Strong hands-on experience with AWS data platforms and services.
  • Experience building data lakes, data warehouses and lakehouse architectures.
  • Strong experience with technologies like Amazon EMR, Databricks and Apache Spark.
  • Amazon Kinesis experience is desirable, particularly for real-time or streaming data ingestion.
  • Exposure to data pipelines supporting AI/ML, embeddings, vector databases and RAG.
  • Strong ETL/ELT, SQL and Python skills.
  • Experience with orchestration tools such as Airflow.
  • Knowledge of Bronze / Silver / Gold data architectures.
  • Experience with data quality, lineage, governance and metadata.
  • Ability to work effectively with ambiguity and turn loosely defined requirements into scalable technical solutions.
  • Strong experience collaborating with third-party vendors, consultancies and technology partners.
  • Background in large enterprise, consulting, professional services or financial services environments is highly desirable.

What you’ll do as a Senior Data Engineer

  • Design and build scalable AWS-based data platforms, and potentially other data stacks.
  • Build distributed processing workloads with tools like Amazon EMR, Spark and Databricks.
  • Consolidate data from multiple enterprise applications into centralised data platforms.
  • Build and optimise scalable ETL/ELT pipelines.
  • Create curated, model-ready datasets for analytics, reporting and AI/ML.
  • Implement data quality, lineage, metadata and governance standards.
  • Work with internal stakeholders and external vendors to shape technical solutions and integrations.
  • Navigate changing requirements and bring structure to complex, ambiguous problems.
  • Help shape technical standards and mentor other data engineers.

Why this role?

This is a chance to join a globally recognised organisation at a key stage in a major data and AI transformation.

You’ll work to modernise a complex enterprise data estate and build the data foundations for analytics, machine learning and generative AI.

The role is particularly suited to someone who combines strong hands-on engineering with the ability to operate in ambiguity, influence vendors and stakeholders, and help drive a large-scale transformation forward.

Apply now or message us for more details. Referrals always welcome!

#AWSJobs #DataEngineering #Databricks #DataTransformation #TexasTechJobs

Vacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Data Lake / AI in Columbia, SC vacancy
  • $102k - $178.5k

     ...Senior AWS IAM & Data EngineerCGI is seeking a Senior AWS IAM & Data Engineer to support enterprise cloud identity services and AWS based data and analytics capabilities...  ...particularly Redshift, S3, Glue, Athena, and Lake Formation.. Experience developing and supporting... 
    Senior
    Local area

    LED FastStart

    Columbia, SC
    4 days ago
  •  ...Senior AWS Python Developer / PySpark Data EngineerWe are looking for a Senior Python + PySpark Data Engineer with strong AWS big data experience — ideally someone who has worked in cybersecurity...  ....4+ years of experience working with AI related technologies or applications.... 
    Senior

    System One Holdings, LLC

    Columbia, SC
    18 hours ago
  •  ...Role: Senior Azure Data Migration & Dataverse Integration Engineer Company: Arch Systems Location: Remote Type: Full-time Position Summary Seeking a...  ...of the following is highly desirable: Azure Data Lake Storage Gen2 Azure SQL Database Azure SQL Managed... 
    Senior
    Full time
    Temporary work
    Remote work

    Arch Systems

    Columbia, SC
    21 hours ago
  • Senior AWS Data Engineer Location: Knoxville, TN, Columbia SC or Lafayette, LA or Birmingham, AL Senior AWS Data Engineer to support the development...  ...and production support. Exposure to Generative AI and opportunities to apply AI driven automation within data... 
    Senior

    System One Holdings, LLC

    Columbia, SC
    15 hours ago
  • Job Title: Senior Data Engineer Location: Columbia, SC (Hybrid) Duration: 12+ Months Position Type: Contract Role Summary: As a S enior Data...  ...architecture and development of data solutions (e.g., data lakes, data warehouses). Collaborate with stakeholders to ensure data... 
    Senior
    Contract work

    InterSources

    Columbia, SC
    1 day ago
  • Senior Data Engineer Greystar is building the data foundation that will power the most AI-advanced operator in global multifamily real estate. We're seeking a Senior Data Engineer...  ...& Technologies Databricks, Spark, Delta Lake, Unity Catalog (domains, metric views). Python... 
    Senior
    Shift work

    Greystar

    Columbia, SC
    4 days ago
  •  ...Senior Data Engineer (Microsoft Fabric / Azure) Location: Remote Employment Type: Full-Time About the Opportunity We're partnering with an established organization undergoing a significant transformation of its enterprise data infrastructure. They're looking... 
    Senior
    Full time
    Remote work

    Talent Inc.

    Columbia, SC
    4 days ago
  •  ...OneUS Technologies has partnered with a premier, globally recognized management and technology consultancy to identify talented Senior Data Engineers. Our client specializes in delivering complex, sector-focused strategy and transformation programs for the financial... 
    Senior
    Permanent employment
    Full time
    Remote work
    Monday to Thursday
    Afternoon shift

    Jobrapido

    Columbia, SC
    15 hours ago
  • $186.07k - $218.9k

     ...more about working at Coinbase. As a Senior Software Engineer on the Data Platform team within the Platform...  ...spanning cloud data warehouses, data lakes, orchestration (Airflow), batch processing...  ...monitoring. Utilizes generative AI responsibly, maintaining human oversight... 
    Senior
    Local area

    Coinbase

    Columbia, SC
    4 days ago
  • $106.61k - $284.28k

     ...patient, member, and colleague data is fundamental to our mission. The Lead Data Privacy Engineer will play a critical role in advancing...  ...GCP, SQL/NoSQL databases, data lakes, and enterprise-scale data...  ...platforms. Demonstrated application of AI, automation, and advanced... 
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    CVS Health

    Columbia, SC
    15 hours ago
  • $117.6k - $161.7k

    Become a part of our caring community The Senior Data Engineer Designs, builds, and maintains data processing architectures and solutions enabling the efficient conversion of structured and unstructured data to insights at enterprise scale. The Senior Data Engineer work... 
    Senior
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Work from home
    Home office

    CenterWell

    Columbia, SC
    3 days ago
  •  ...Job Title: Senior AWS IAM & Data Engineer Location: Lafayette, LA, Knoxville, TN, Columbia, SC, Birmingham, AL Type: Direct Hire Work Model...  ...AWS data services such as Redshift, S3, Glue, Athena, and Lake Formation. • Proven ability to develop and support ETL/... 
    Senior
    Local area

    System One

    Columbia, SC
    20 days ago
  • $117.6k - $161.7k

    Become a part of our caring community The Senior Data Engineer designs, builds, and maintains data processing solutions that enable the efficient transformation of structured and unstructured data into meaningful insights. Working closely with engineers and cross functional... 
    Senior
    Bi-weekly pay
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Immediate start
    Remote work
    Work from home
    Home office

    Humana

    Columbia, SC
    2 days ago
  •  ...Job Title: Senior Information Protection & AI Security Engineer Location: Lafayette, LA, Knoxville, TN, Columbia, SC, Birmingham, AL Type: Permanent...  ...Protection & AI Security Engineer to support enterprise data protection, AI governance, and insider risk... 
    Senior
    Permanent employment
    Full time

    System One

    Columbia, SC
    19 hours ago
  • $140k - $185k

     ...partner is looking for a Manager, Data Engineering based in the United States....  ...Databricks, Spark, Delta Lake, SQL Server, dbt, Boomi, and...  ...architects, business partners, and senior leadership. Strong...  ...Jobgether works: We use an AI-powered matching process to... 
    Temporary work
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Flexible hours

    Jobgether

    Columbia, SC
    3 days ago
  •  ...Job Title: Senior AWS Python Developer / PySpark Data Engineer Location: Lafayette, LA · Knoxville, TN · Columbia, SC · Birmingham, AL Type: Direct...  ...Spark, and Hive. ~4+ years of experience working with AI related technologies or applications. ~ Hands on CI... 
    Senior
    Local area

    System One

    Columbia, SC
    4 days ago
  •  ...patient care. Banner Health's Data Platform Team is building the...  ...health analytics and AI-enabled by data. We're looking...  ...you'll work directly with data engineers on coding standards, CI/CD practices...  ...business in partnership with Senior Leadership, stakeholders, and... 
    Work experience placement
    Live in
    Remote work
    Monday to Friday
    Shift work

    Banner Health

    Columbia, SC
    7 hours ago
  •  ...Data Engineer (Python, Java) Remote (50%) Columbia SCData Engineer (Python, Java) Remote (50%) Columbia SCAuthorized to work in the USNo...  ...design and maintenance of scalable data solutions, including data lakes and warehouses.Collaborate with cross-functional teams to... 
    Remote work

    NexonIT LLC

    Columbia, SC
    4 days ago
  • Data Engineer Anywhere Type: Contract Category: Engineer Industry: Retail Workplace Type: Remote Standard Hours: Open Reference ID: JN...  ...engineering for machine learning with Python and Vertex AI, and ensuring quality through automated testing and CI/CD. The... 
    Hourly pay
    Contract work
    Local area
    Remote work

    Eliassen Group

    Columbia, SC
    1 day ago
  • AWS Data Engineer CGI is seeking an experienced AWS Data Engineer to support the development, enhancement, and maintenance of Enterprise Risk...  .... The role also provides opportunities to apply Generative AI and automation capabilities to improve data engineering processes... 

    CGI

    Columbia, SC
    15 hours ago
  • $115k - $135k

     ...live, learn, and work. This role owns the data foundation underpinning Nelnet’s GenAI...  ...higher education and SLED clients. The Data Engineer builds and maintains the data pipelines, classification...  ...safely and reliably usable by agentic AI solutions built on the Gemini Enterprise... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work

    Nelnet

    Columbia, SC
    2 days ago
  •  ...Data Engineer (Platform) Fully Remote Strong compensation package (Base Salary + Bonus) Excellent Benefits & Unlimited PTO About the Role We are seeking a hands-on Data Engineer to help build and scale a modern data platform that will serve as the foundation for multiple... 
    Remote work

    Elios AI

    Columbia, SC
    21 hours ago
  •  ...most visible investments. Built on a native, AI-powered platform and more than a decade of proprietary data—including billions of social interactions,...  ...more at later. com . About this position As a Senior Data Platform Engineer at Later, you'll own the foundation our data... 
    Senior
    Full time
    Live in

    Later

    Columbia, SC
    24 days ago
  • $150k - $190k

     ...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As... 
    Senior
    Full time
    Work experience placement
    Remote work
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Columbia, SC
    1 day ago
  •  ...By joining our clients team as a Senior Machine Learning Engineer , you will play a pivotal role in building cutting-edge AI products that directly impact how new therapies reach...  ...and MLOps best practices to build robust data pipelines and deploy models at scale. You’ll... 
    Senior
    Remote work

    Harnham

    Columbia, SC
    19 hours ago
  • $89.4k - $183.5k

     ...’s next. Join us.General Summary:We’re looking for a Senior MLOps Engineer to help build, scale, and evolve the platforms that take...  ...an MLOps role with exposure to GenAI and agentic AI.You’ll work closely with data science and engineering teams to maintain and improve... 
    Senior
    Full time
    Temporary work
    Work experience placement
    Work at office

    Unum Group

    Columbia, SC
    4 days ago
  • $95k - $154k

     ...re a Java developer, software programmer, data scientist, or data analyst struggling to break...  .../Java developers, data analysts/data engineers/data scientists, and machine learning engineers...  ...in Junior Developers | SynergisticIT Is AI Going to Replace Software Programmers? |... 
    Full time
    H1b
    Remote work

    SynergisticIT

    Columbia, SC
    4 days ago
  •  ...as little as one hour. We're hiring a Senior Machine Learning Engineer for our Personalization Platform team...  ...organization. You'll partner closely with Data Scientists to design, deploy, and...  ...CI/CD and monitoring. If you have an AI-first mindset and enjoy building platforms... 
    Senior
    Work at office
    Flexible hours

    Grid Dynamics

    Columbia, SC
    21 hours ago
  • $99k - $232k

     ...Description & SummaryThe OpportunityAs an AI & GenAI Data Scientist - Manager, you will play a...  ...will apply data, algorithms, and software engineering to build and deploy software and...  ...Sacramento; MA-Boston; MO-St. Louis; UT-Salt Lake City; TX-San Antonio; CA-San Diego; CA-... 
    Full time
    H1b

    PwC

    Columbia, SC
    8 days ago
  • $77k - $202k

    The Opportunity As an AI & GenAI Data Scientist-Senior Associate you will leverage advanced analytics, statistical modeling, exploratory analysis...  ...and inform decisions within our Data and Analytics Engineering practice. As a Senior Associate you will analyze complex... 
    Senior
    H1b
    Shift work

    PwC

    Columbia, SC
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer - Data Lake / AI. Be the first to apply!