Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer - Data Lake / AI

$170k - $200k

Onward Legal Innovation

We are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and AI/ML platform ingestion to join a newly formed data engineering team at one of the world’s largest and most prestigious law firms as it undergoes a major data and AI transformation.

This is a senior, hands-on role focused on building an AWS data lake/lakehouse and evolving the enterprise data platform, ingesting data from complex enterprise business systems and creating high-quality datasets for analytics, reporting and AI/ML in a regulated environment. You’ll need to be comfortable with ambiguity, shape solutions, and collaborate closely with internal teams, vendors, and technology partners.

The role is primarily remote, but you must live within approximately 1.5 hours of Washington DC

Salary $170-200k plus Generous Benefits + Bonus

Candidates must already be eligible to work (Green Card or US Citizen), as there are no H-1B transfers or new visa sponsorship.

Key skills required for the Senior Data Engineer

  • Circa 10+ years of enterprise data engineering experience.
  • Experience working through large-scale data transformation or cloud modernisation programmes.
  • Strong hands-on experience with AWS data platforms and services.
  • Experience building data lakes, data warehouses and lakehouse architectures.
  • Strong experience with technologies like Amazon EMR, Databricks and Apache Spark.
  • Amazon Kinesis experience is desirable, particularly for real-time or streaming data ingestion.
  • Exposure to data pipelines supporting AI/ML, embeddings, vector databases and RAG.
  • Strong ETL/ELT, SQL and Python skills.
  • Experience with orchestration tools such as Airflow.
  • Knowledge of Bronze / Silver / Gold data architectures.
  • Experience with data quality, lineage, governance and metadata.
  • Ability to work effectively with ambiguity and turn loosely defined requirements into scalable technical solutions.
  • Strong experience collaborating with third-party vendors, consultancies and technology partners.
  • Background in large enterprise, consulting, professional services or financial services environments is highly desirable.

What you’ll do as a Senior Data Engineer

  • Design and build scalable AWS-based data platforms, and potentially other data stacks.
  • Build distributed processing workloads with tools like Amazon EMR, Spark and Databricks.
  • Consolidate data from multiple enterprise applications into centralised data platforms.
  • Build and optimise scalable ETL/ELT pipelines.
  • Create curated, model-ready datasets for analytics, reporting and AI/ML.
  • Implement data quality, lineage, metadata and governance standards.
  • Work with internal stakeholders and external vendors to shape technical solutions and integrations.
  • Navigate changing requirements and bring structure to complex, ambiguous problems.
  • Help shape technical standards and mentor other data engineers.

Why this role?

This is a chance to join a globally recognised organisation at a key stage in a major data and AI transformation.

You’ll work to modernise a complex enterprise data estate and build the data foundations for analytics, machine learning and generative AI.

The role is particularly suited to someone who combines strong hands-on engineering with the ability to operate in ambiguity, influence vendors and stakeholders, and help drive a large-scale transformation forward.

Apply now or message us for more details. Referrals always welcome!

#AWSJobs #DataEngineering #Databricks #DataTransformation #TexasTechJobs

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Data Lake / AI in New York, NY vacancy
  •  ...по данным и ИИ для работы над проектами крупного фармацевтического клиента. Основная роль — проектирование и внедрение AWS data lakes, настройка AI-систем, разработка на Python, работа со Snowflake; кандидаты должны базироваться в Европейском Союзе и иметь полное право... 
    Senior

    RED Global

    New York, NY
    2 days ago
  •  ...AppGate is hiring a Staff or Principal Data Engineer in New York City to own the data platform and data lake for fraud detection and response. As part of a small team,...  ...continuous improvement of data pipelines that fuel AI capabilities. The ideal candidate has extensive... 
    Suggested

    AppGate

    New York, NY
    3 days ago
  •  ...consider a career in Advisory.KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice.Responsibilities:Assist...  ...in Databricks to support multiple use cases (delta lake, reporting and analytics, AI/ML)Support design and development of technology and... 
    Senior
    Local area
    Visa sponsorship

    KPMG

    New York, NY
    6 days ago
  • $215.2k - $244.7k

     ...West Monroe is seeking a Senior Architect to join our...  ...clients developing Big Data strategy and roadmaps,...  ...and implement scalable AI/ML and Generative AI solutions...  ...Models (LLMs), prompt engineering, embeddings, vector...  ...Azure SQL, Azure Data Lake or Azure Data Factory.Excellent... 
    Senior
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    4 days ago
  • $124k - $177k

     ...cutting-edge technologies like Generative AI to increase productivity, streamline...  ...company's success. Role Overview: The Data Protection Engineer plays a key role in advancing New York...  ...for NYL’s democratized enterprise data lakes in AWS (RedShift, DataBricks) & GCP (BigQuery... 
    Senior
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    4 days ago
  • €38 per hour

     ...Senior Data Engineer (Databricks & PySpark) Location: 100% Remote (Warsaw, PL) Rate: Up to 38 EUR /...  .... You will join a Sustainability Data & AI team that values reliability, operational...  ...scalable data products using Databricks, Delta Lake, and PySpark. Build and maintain data... 
    Senior
    Full time
    Remote work

    Optiveum

    New York, NY
    2 days ago
  • $200k - $275k

     ...RoleYou will be Doctronic's first dedicated data engineer, and you will own the plumbing end to end...  ...role serves every team in the company: AI engineering, product, finance,...  ...PostgreSQL, MongoDB) into our S3 + Iceberg lake and SnowflakeStand up a transformation layer... 
    Senior

    Doctronic

    New York, NY
    15 hours ago
  • $119k - $145k

     ...Position: Senior Data Engineer, Databricks Compensation: $119-$145k, depending on experience...  ...deliver trusted data for reporting and AI use cases. If you enjoy hands-on engineering...  ...platform. ~ Advanced knowledge of Delta Lake and Databricks workflows. ~ Experience... 
    Senior
    Remote work

    Jobrapido

    New York, NY
    3 days ago
  •  ...As a Senior Data Engineer you will own the design and delivery of complex data engineering solutions that power enterprise analytics, AI, and reporting capabilities. Reporting to the Lead Data Engineer...  ...dimensional warehousing, data lake architectures on Azure. Contribute... 
    Senior

    PRI Technology

    New York, NY
    2 days ago
  •  ...Senior Data EngineerWhile technology is the heart of our business, a global and diverse...  ...!Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on delivering...  ...cloud-native data pipelines and data lake architectures in Snowflake to support... 
    Senior

    Quantiphi

    New York, NY
    3 days ago
  •  ...Senior Data EngineerAs a Senior Data Engineer at Regard, you'll own the design, development, and production deployment...  ...downstream product, analytics, and AI research workflows, you'll build and...  ...catalogs and access controls such as Glue, Lake Formation, and IAMExperience with... 
    Senior
    Work at office
    Local area
    Home office
    Visa sponsorship
    Relocation package
    1 day per week

    TenOneTen Ventures

    New York, NY
    13 hours ago
  •  ...Senior Data EngineerLocation: [Location(s) / Remote] – Hybrid – Manhattan...  ...: Trianz is an applied AI solutions company that accelerates...  ...We are seeking a Senior Data Engineer will design, build, and support...  ...organizing it in a cloud-based data lake, and enabling reliable... 
    Senior
    Local area
    Remote work

    Trianz

    New York, NY
    3 days ago
  • $185k

     ...Senior Data EngineerNew York, NY (This role is based in Trepp's NYC office...  ...built on our data lake. The Pipeline Team plays a crucial...  ...with multiple product teams and engineering teams to solve complex...  ...innovation.Design and integrate AI-driven workflows, including LLM... 
    Senior
    Temporary work
    Work at office
    Work from home
    Monday to Friday

    Trepp, LLC

    New York, NY
    4 days ago
  • $150k - $200k

     ...precision and vision. Based in the US, the Senior Data Engineer will be responsible for designing,...  ...systems, curating it within scalable data lakes and warehouses, and delivering high-...  ...datasets to analysts, data scientists, and AI/ML workflows. This role blends hands‑on... 
    Senior
    Local area
    Flexible hours

    Gibson Dunn & Crutcher

    New York, NY
    4 days ago
  • $157.95k - $259.48k

     ...Senior ML/Data EngineerCatapult is building the future of sports performance...  ....We are now building the AI layer that brings together the...  ...looking for a Senior ML / Data Engineer to build the data...  ...volume time-series storageData lake and analytical infrastructureLow... 
    Senior
    Full time
    Temporary work
    Internship

    Catapult Sports

    New York, NY
    4 days ago
  • $125k - $140k

     ...Senior Data EngineerEkimetrics is a global leader in Marketing & Commercial effectiveness and AI-powered solutions. Since 2006, we've been helping businesses...  ...a Senior Data Engineer, you will lead and contribute...  ...Proficient with Databricks (Delta Lake, Spark, Asset Bundles,... 
    Senior
    Work at office
    Flexible hours

    Ekimetrics

    New York, NY
    2 days ago
  • $109.7k - $164.5k

     ...business leaders. We deliver cloud, data and customer experience...  ...seeking a highly skilled Sr. Data Engineer with strong expertise in AWS Data...  ...with team lead/ architects, AI Engineers, Data Scientists, and...  ...Snowflake, including:Amazon S3 / Lake FormationGlue, Lambda, EMR,... 
    Senior
    Permanent employment
    Full time
    Temporary work
    Remote work

    TEKsystems

    New York, NY
    2 days ago
  •  ...Job Description Hiring: Lead Data Engineer - Databricks \n \n Important \n \n Visa...  ...analytics, digital \n products, and emerging AI use cases. The candidate will drive...  ...Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and \n ~ workflow orchestration... 
    Senior

    Wise Skulls

    New York, NY
    4 days ago
  •  ...Data Engineer Role at RevvRevv is on a mission to revolutionize the global...  ...The combination pairs Revv's AI-powered software and proprietary...  ....We're looking for a senior or staff-level data engineer who...  ...Azure) into our Snowflake data lake alongside Revv's existing AWS... 
    Senior
    Remote work
    2 days per week
    1 day per week

    Revv LLC

    New York, NY
    3 days ago
  • $220k - $250k

     ...Senior AI Data Engineer Cooley AI is seeking a Senior AI Data Engineer to join the Innovation team. About Cooley AI: Cooley AI is the wholly...  ...infrastructure development ~ Databricks experience including Delta Lake, Unity Catalog, Databricks SQL, and medallion architecture... 
    Senior
    Full time
    Temporary work
    Work at office
    Flexible hours
    Weekend work

    Cooley LLP

    New York, NY
    4 days ago
  •  ...& Experience • 7+ years in data or database engineering\n• Strong experience administering...  ..., cloud databases, data lakes, or modern cloud-native data...  ...WME is seeking a Senior Data Engineer to own, support...  ...modernization planning. This is not an AI/ML engineering role and does... 
    Senior

    Insight Global

    New York, NY
    1 day ago
  • $157.95k - $259.48k

     ...performance software, science, and data, in a world where 1% can...  ...health, performance, video, and AI insights from the locker room...  ...job. It is the highest-leverage engineering position in Phase 1 of a...  ..., time-series databases, data lakes, feature stores in a real-time... 
    Senior

    Catapult

    New York, NY
    2 days ago
  •  ...consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner...  ...We are seeking an experienced Data Engineer to join our data team. In this role,...  ...understanding of data modeling, data lake/lakehouse architecture, data... 
    Senior
    Local area

    Tiger Analytics

    New York, NY
    1 day ago
  •  ...development, and maintenance of data integration and reporting...  ...our reporting, analytics, and AI/ML workloads. The ideal candidate...  ...experience with other modern data engineering tools such as Azure Data...  ...implementation of batch and streaming data lake architectures supporting both... 
    Senior

    AgSource

    New York, NY
    1 day ago
  • Senior Data Engineer Location: Herndon, VA (Remote Work) Must have an Public Trust Clearance KEY RESPONSIBILITIES...  ...identified by SBA OIG into Azure Data Lake Storage. • Normalize entity attributes...  .... • Stay current with emerging AI tooling relevant to data engineering and... 
    Senior
    Work experience placement
    Remote work

    Node.Digital

    New York, NY
    1 day ago
  •  ...backed by a16z, Coatue, Silver Lake, Lightspeed, and Stanford University...  ...layer for a decentralized and AI-enabled Web3 ecosystem. For...  ...Role Build and run the internal data platform that helps Alchemy...  ...serving customers. The existing Data Engineer intake centers on ingestion,... 
    Senior
    Work at office
    Worldwide
    Flexible hours

    Alchemy Insights, Inc

    New York, NY
    1 day ago
  • $175k - $225k

    Senior Data Engineer / Elliott Management Corporation:Design, build, and operate scalable and secure...  ...pipelines that support analytics, reporting, AI/ML, and self-service data across the...  ...optimization, in cloud data warehouse or data lake/lakehouse environments; * 4 years of... 
    Senior
    Full time
    Remote work
    Flexible hours

    Elliott Management

    New York, NY
    3 days ago
  • $168k - $270.25k

    Senior Data Engineer NVIDIA's Digital Marketing Operations team is seeking a Senior Data Engineer to...  ...cloud environment. Experience with data lake and lakehouse architectures, including open...  ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.... 
    Senior
    Worldwide

    NVIDIA

    New York, NY
    4 days ago
  • Senior Data Engineer We're looking for a top-tier Senior Data Engineer to join our tech team and work...  ...high-throughput data pipelines powering AI-ready web search Design and maintain distributed...  ...freshness SLAs ( Build a real-time data lake to serve embeddings, metadata, and... 
    Senior
    Remote work
    Flexible hours

    Linkup Inc

    New York, NY
    1 day ago
  • $134k - $175k

    Senior Data Engineer Build and own scalable data pipelines, modern cloud data platforms, and trusted...  ...reliability, and help shape the future of AI-ready data capabilities. Remote-first...  ...patterns, including data warehouses, data lakes, lakehouses, and curated data products.... 
    Senior
    Casual work
    Work at office
    Remote work
    Flexible hours

    Quadpay, A Zip Company

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer - Data Lake / AI. Be the first to apply!