Senior Data Engineer - Data Lake / AI
$170k - $200kOnward Legal Innovation
We are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and AI/ML platform ingestion to join a newly formed data engineering team at one of the world’s largest and most prestigious law firms as it undergoes a major data and AI transformation.
This is a senior, hands-on role focused on building an AWS data lake/lakehouse and evolving the enterprise data platform, ingesting data from complex enterprise business systems and creating high-quality datasets for analytics, reporting and AI/ML in a regulated environment. You’ll need to be comfortable with ambiguity, shape solutions, and collaborate closely with internal teams, vendors, and technology partners.
The role is primarily remote, but you must live within approximately 1.5 hours of Washington DC
Salary $170-200k plus Generous Benefits + Bonus
Candidates must already be eligible to work (Green Card or US Citizen), as there are no H-1B transfers or new visa sponsorship.
Key skills required for the Senior Data Engineer
- Circa 10+ years of enterprise data engineering experience.
- Experience working through large-scale data transformation or cloud modernisation programmes.
- Strong hands-on experience with AWS data platforms and services.
- Experience building data lakes, data warehouses and lakehouse architectures.
- Strong experience with technologies like Amazon EMR, Databricks and Apache Spark.
- Amazon Kinesis experience is desirable, particularly for real-time or streaming data ingestion.
- Exposure to data pipelines supporting AI/ML, embeddings, vector databases and RAG.
- Strong ETL/ELT, SQL and Python skills.
- Experience with orchestration tools such as Airflow.
- Knowledge of Bronze / Silver / Gold data architectures.
- Experience with data quality, lineage, governance and metadata.
- Ability to work effectively with ambiguity and turn loosely defined requirements into scalable technical solutions.
- Strong experience collaborating with third-party vendors, consultancies and technology partners.
- Background in large enterprise, consulting, professional services or financial services environments is highly desirable.
What you’ll do as a Senior Data Engineer
- Design and build scalable AWS-based data platforms, and potentially other data stacks.
- Build distributed processing workloads with tools like Amazon EMR, Spark and Databricks.
- Consolidate data from multiple enterprise applications into centralised data platforms.
- Build and optimise scalable ETL/ELT pipelines.
- Create curated, model-ready datasets for analytics, reporting and AI/ML.
- Implement data quality, lineage, metadata and governance standards.
- Work with internal stakeholders and external vendors to shape technical solutions and integrations.
- Navigate changing requirements and bring structure to complex, ambiguous problems.
- Help shape technical standards and mentor other data engineers.
Why this role?
This is a chance to join a globally recognised organisation at a key stage in a major data and AI transformation.
You’ll work to modernise a complex enterprise data estate and build the data foundations for analytics, machine learning and generative AI.
The role is particularly suited to someone who combines strong hands-on engineering with the ability to operate in ambiguity, influence vendors and stakeholders, and help drive a large-scale transformation forward.
Apply now or message us for more details. Referrals always welcome!
#AWSJobs #DataEngineering #Databricks #DataTransformation #TexasTechJobs
- ...по данным и ИИ для работы над проектами крупного фармацевтического клиента. Основная роль — проектирование и внедрение AWS data lakes, настройка AI-систем, разработка на Python, работа со Snowflake; кандидаты должны базироваться в Европейском Союзе и иметь полное право...Senior
- ...AppGate is hiring a Staff or Principal Data Engineer in New York City to own the data platform and data lake for fraud detection and response. As part of a small team,... ...continuous improvement of data pipelines that fuel AI capabilities. The ideal candidate has extensive...Suggested
- ...consider a career in Advisory.KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice.Responsibilities:Assist... ...in Databricks to support multiple use cases (delta lake, reporting and analytics, AI/ML)Support design and development of technology and...SeniorLocal areaVisa sponsorship
$215.2k - $244.7k
...West Monroe is seeking a Senior Architect to join our... ...clients developing Big Data strategy and roadmaps,... ...and implement scalable AI/ML and Generative AI solutions... ...Models (LLMs), prompt engineering, embeddings, vector... ...Azure SQL, Azure Data Lake or Azure Data Factory.Excellent...SeniorLocal areaImmediate startFlexible hours$124k - $177k
...cutting-edge technologies like Generative AI to increase productivity, streamline... ...company's success. Role Overview: The Data Protection Engineer plays a key role in advancing New York... ...for NYL’s democratized enterprise data lakes in AWS (RedShift, DataBricks) & GCP (BigQuery...SeniorLocal area3 days per week€38 per hour
...Senior Data Engineer (Databricks & PySpark) Location: 100% Remote (Warsaw, PL) Rate: Up to 38 EUR /... .... You will join a Sustainability Data & AI team that values reliability, operational... ...scalable data products using Databricks, Delta Lake, and PySpark. Build and maintain data...SeniorFull timeRemote work$200k - $275k
...RoleYou will be Doctronic's first dedicated data engineer, and you will own the plumbing end to end... ...role serves every team in the company: AI engineering, product, finance,... ...PostgreSQL, MongoDB) into our S3 + Iceberg lake and SnowflakeStand up a transformation layer...Senior$119k - $145k
...Position: Senior Data Engineer, Databricks Compensation: $119-$145k, depending on experience... ...deliver trusted data for reporting and AI use cases. If you enjoy hands-on engineering... ...platform. ~ Advanced knowledge of Delta Lake and Databricks workflows. ~ Experience...SeniorRemote work- ...As a Senior Data Engineer you will own the design and delivery of complex data engineering solutions that power enterprise analytics, AI, and reporting capabilities. Reporting to the Lead Data Engineer... ...dimensional warehousing, data lake architectures on Azure. Contribute...Senior
- ...Senior Data EngineerWhile technology is the heart of our business, a global and diverse... ...!Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on delivering... ...cloud-native data pipelines and data lake architectures in Snowflake to support...Senior
- ...Senior Data EngineerAs a Senior Data Engineer at Regard, you'll own the design, development, and production deployment... ...downstream product, analytics, and AI research workflows, you'll build and... ...catalogs and access controls such as Glue, Lake Formation, and IAMExperience with...SeniorWork at officeLocal areaHome officeVisa sponsorshipRelocation package1 day per week
- ...Senior Data EngineerLocation: [Location(s) / Remote] – Hybrid – Manhattan... ...: Trianz is an applied AI solutions company that accelerates... ...We are seeking a Senior Data Engineer will design, build, and support... ...organizing it in a cloud-based data lake, and enabling reliable...SeniorLocal areaRemote work
$185k
...Senior Data EngineerNew York, NY (This role is based in Trepp's NYC office... ...built on our data lake. The Pipeline Team plays a crucial... ...with multiple product teams and engineering teams to solve complex... ...innovation.Design and integrate AI-driven workflows, including LLM...SeniorTemporary workWork at officeWork from homeMonday to Friday$150k - $200k
...precision and vision. Based in the US, the Senior Data Engineer will be responsible for designing,... ...systems, curating it within scalable data lakes and warehouses, and delivering high-... ...datasets to analysts, data scientists, and AI/ML workflows. This role blends hands‑on...SeniorLocal areaFlexible hours$157.95k - $259.48k
...Senior ML/Data EngineerCatapult is building the future of sports performance... ....We are now building the AI layer that brings together the... ...looking for a Senior ML / Data Engineer to build the data... ...volume time-series storageData lake and analytical infrastructureLow...SeniorFull timeTemporary workInternship$125k - $140k
...Senior Data EngineerEkimetrics is a global leader in Marketing & Commercial effectiveness and AI-powered solutions. Since 2006, we've been helping businesses... ...a Senior Data Engineer, you will lead and contribute... ...Proficient with Databricks (Delta Lake, Spark, Asset Bundles,...SeniorWork at officeFlexible hours$109.7k - $164.5k
...business leaders. We deliver cloud, data and customer experience... ...seeking a highly skilled Sr. Data Engineer with strong expertise in AWS Data... ...with team lead/ architects, AI Engineers, Data Scientists, and... ...Snowflake, including:Amazon S3 / Lake FormationGlue, Lambda, EMR,...SeniorPermanent employmentFull timeTemporary workRemote work- ...Job Description Hiring: Lead Data Engineer - Databricks \n \n Important \n \n Visa... ...analytics, digital \n products, and emerging AI use cases. The candidate will drive... ...Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and \n ~ workflow orchestration...Senior
- ...Data Engineer Role at RevvRevv is on a mission to revolutionize the global... ...The combination pairs Revv's AI-powered software and proprietary... ....We're looking for a senior or staff-level data engineer who... ...Azure) into our Snowflake data lake alongside Revv's existing AWS...SeniorRemote work2 days per week1 day per week
$220k - $250k
...Senior AI Data Engineer Cooley AI is seeking a Senior AI Data Engineer to join the Innovation team. About Cooley AI: Cooley AI is the wholly... ...infrastructure development ~ Databricks experience including Delta Lake, Unity Catalog, Databricks SQL, and medallion architecture...SeniorFull timeTemporary workWork at officeFlexible hoursWeekend work- ...& Experience • 7+ years in data or database engineering\n• Strong experience administering... ..., cloud databases, data lakes, or modern cloud-native data... ...WME is seeking a Senior Data Engineer to own, support... ...modernization planning. This is not an AI/ML engineering role and does...Senior
$157.95k - $259.48k
...performance software, science, and data, in a world where 1% can... ...health, performance, video, and AI insights from the locker room... ...job. It is the highest-leverage engineering position in Phase 1 of a... ..., time-series databases, data lakes, feature stores in a real-time...Senior- ...consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner... ...We are seeking an experienced Data Engineer to join our data team. In this role,... ...understanding of data modeling, data lake/lakehouse architecture, data...SeniorLocal area
- ...development, and maintenance of data integration and reporting... ...our reporting, analytics, and AI/ML workloads. The ideal candidate... ...experience with other modern data engineering tools such as Azure Data... ...implementation of batch and streaming data lake architectures supporting both...Senior
- Senior Data Engineer Location: Herndon, VA (Remote Work) Must have an Public Trust Clearance KEY RESPONSIBILITIES... ...identified by SBA OIG into Azure Data Lake Storage. • Normalize entity attributes... .... • Stay current with emerging AI tooling relevant to data engineering and...SeniorWork experience placementRemote work
- ...backed by a16z, Coatue, Silver Lake, Lightspeed, and Stanford University... ...layer for a decentralized and AI-enabled Web3 ecosystem. For... ...Role Build and run the internal data platform that helps Alchemy... ...serving customers. The existing Data Engineer intake centers on ingestion,...SeniorWork at officeWorldwideFlexible hours
$175k - $225k
Senior Data Engineer / Elliott Management Corporation:Design, build, and operate scalable and secure... ...pipelines that support analytics, reporting, AI/ML, and self-service data across the... ...optimization, in cloud data warehouse or data lake/lakehouse environments; * 4 years of...SeniorFull timeRemote workFlexible hours$168k - $270.25k
Senior Data Engineer NVIDIA's Digital Marketing Operations team is seeking a Senior Data Engineer to... ...cloud environment. Experience with data lake and lakehouse architectures, including open... ...is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes....SeniorWorldwide- Senior Data Engineer We're looking for a top-tier Senior Data Engineer to join our tech team and work... ...high-throughput data pipelines powering AI-ready web search Design and maintain distributed... ...freshness SLAs ( Build a real-time data lake to serve embeddings, metadata, and...SeniorRemote workFlexible hours
$134k - $175k
Senior Data Engineer Build and own scalable data pipelines, modern cloud data platforms, and trusted... ...reliability, and help shape the future of AI-ready data capabilities. Remote-first... ...patterns, including data warehouses, data lakes, lakehouses, and curated data products....SeniorCasual workWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Data Lake / AI. Be the first to apply!
- data systems engineer New York, NY
- finance data engineer New York, NY
- data engineer contract New York, NY
- big data devops engineer New York, NY
- sr data engineer New York, NY
- senior data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer freelance New York, NY
- principal data engineer New York, NY
- data engineer graduate New York, NY




