AWS Lakehouse Data Engineer: Scalable AI/ML Pipelines

Guidehouse

Guidehouse seeks an AWS Lakehouse Data Engineer to design, build, and operate a cloud-native data platform powering AI/ML, analytics, reporting, and data visualization. You will construct a scalable lakehouse on Amazon S3 using Iceberg/Parquet, enable ACID transactions, and provide fast interactive querying with AWS services.

You will implement batch and streaming ingestion, Python/PySpark ETL pipelines, metadata governance, and automated provisioning with CI/CD.

#J-18808-Ljbffr

Apply

Vacancy posted 11 hours ago

Similar jobs that could be interesting for youBased on the AWS Lakehouse Data Engineer: Scalable AI/ML Pipelines in Washington DC vacancy

Senior Data Engineer - Data Lake / AI
$170k - $200k
...are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and AI/ML platform ingestion... ...an AWS data lake/lakehouse and evolving the enterprise... ...Exposure to data pipelines supporting AI/ML,... ...requirements into scalable technical solutions...
Amazon Web Service
Pipeline
Full time
H1b
Remote work
Visa sponsorship
Onward Legal Innovation
Washington DC
2 days ago
Senior Technology Consultant - Data / AI Native Engineer
...Technology Consultant – Data / AI Native... ...Data / AI Native Engineer with strong expertise... ...in Databricks, AWS, PySpark, and modern Lakehouse architecture.... ...software and data pipeline development. The... ....Build scalable Lakehouse solutions... ...stores, and AI/ML applications.Develop...
Amazon Web Service
Pipeline
Local area
Kasmo Global
Arlington, VA
3 days ago
AWS Lakehouse Data Engineer
$113k - $188k
...Obtain Public TrustAWS Lakehouse Data EngineerWe are seeking an AWS Lakehouse Data Engineer to design, implement,... ...platform that powers AI/ML, analytics, reporting,... ...You will also develop scalable batch and streaming ingestion... ...and PySpark ETL/ELT pipelines, metadata and...
Amazon Web Service
Pipeline
Flexible hours
Guidehouse
Washington DC
12 hours ago
Data & AI Engineer
...RevStar Position: Data & AI Engineer Reports To:... ...build greenfield Lakehouse solutions at the bleeding... ...-agnostic Data, ML, and AI practice.... ...AI into live, scalable enterprise solutions... ...Databricks Lakehouse & Pipeline Engineering:... ...cloud environments (AWS, Azure, GCP). Implement...
Amazon Web Service
Pipeline
Full time
For contractors
Remote work
RevStar
Washington DC
8 hours ago
Lead AI & Data Analytics Engineer (Palantir Foundry)
...a Lead Palantir Data Engineer to support a federal... ...on delivering AI-driven analytics and... ...platforms, and develop scalable analytics... ...engineering, analytics, AI/ML, business... ...Azure Data Factory, AWS Glue, Delta Lake,... ...ability to design data pipelines, integrate and...
Amazon Web Service
Pipeline
Full time
For contractors
Local area
MissionTek Advisors
Arlington, VA
3 days ago
Senior AI/ML Data Engineer
$242k - $305k
...Senior AI/ML Data Engineer Why This is an Exciting Role: BI&A is seeking... ...to rapidly deliver scalable, secure, and reliable AI solutions... ...Deep experience with Azure, AWS, or Google Cloud data and AI... ...vector databases, embedding pipelines, retrieval systems, and Retrieval...
Amazon Web Service
Pipeline
Contract work
Remote work
Worldwide
Bia Boeing
Washington DC
4 days ago
Senior AI/ML Data Engineer
$242k - $305k
...Senior AI/ML Data Engineer Why This is an Exciting Role: BI&A is seeking... ...to rapidly deliver scalable, secure, and reliable AI solutions... ...Deep experience with Azure, AWS, or Google Cloud data and AI... ...vector databases, embedding pipelines, retrieval systems, and Retrieval...
Amazon Web Service
Pipeline
Contract work
Remote work
Worldwide
Boeing Company
Washington DC
1 day ago
Senior AI/ML Data Engineer
$242k - $305k
...your future with us. Senior AI/ML Data Engineer Why This is an Exciting Role... ...stakeholders to rapidly deliver scalable, secure, and reliable AI... ...Deep experience with Azure, AWS, or Google Cloud data and AI... ...vector databases, embedding pipelines, retrieval systems, and Retrieval...
Amazon Web Service
Pipeline
Contract work
Remote work
Worldwide
Flexible hours
Boeing
Washington DC
3 days ago
Sr AI/ML Data Engineer Remote or Office-Based in MN/DC
$120.1k - $214.5k
...Senior Ai/Ml Software EngineerOptum Tech... ...everyone. From advanced data analytics and AI... ...AI/ML Software Engineer to build AI-powered... ...AI frameworksBuild scalable full-stack... ...data platforms and pipelines using Python or Java... ...platforms such as AWS, Azure, or GCP2+ years...
Amazon Web Service
Pipeline
Minimum wage
Full time
Work experience placement
Work at office
Local area
Remote work
UnitedHealthcare
Washington DC
2 days ago
Data & AI Forward Deployed Engineer
...RevStar Position: Data & AI Forward Deployed Engineer (FDE) Reports To:... ...operate. As an Advanced AWS Consulting Partner,... ...and deploy secure, scalable, and resilient cloud... ...GenAI and ML workloads leveraging... ...with automated CI/CD pipelines (GitHub Actions, GitLab...
Amazon Web Service
Pipeline
Full time
For contractors
Remote work
RevStar
Washington DC
6 days ago
Data Engineer
$80k - $90k
...Job Title: Senior Data Engineer – Cloud Data Platforms... ...design and maintain scalable pipelines, help shape data models... ...optimize data warehouse and lakehouse structures (Snowflake... .../Data Factory, or AWS Glue/Redshift. •... ...work preparing data for AI/ML use cases. •...
Amazon Web Service
Pipeline
Full time
AARATECH
Washington DC
1 day ago
Senior Data Engineer
...seeking a Senior Data Engineer to support large-scale... ...platforms and pipelines that support mission... ...maintenance of scalable, secure, and auditable... ...within Databricks Lakehouse environments.... ...data platforms in AWS or Azure cloud environments... ...(MLOps) and AI/ML data pipelines. Experience...
Amazon Web Service
Pipeline
ANALYTICA
Washington DC
6 days ago
Data and AI Engineer
Job Title: Data and AI Engineer Company: BLN24 About Us: We find strength... ...and implement advanced data pipelines, scalable analytics frameworks, and... ..., and impact analysis. AI/ML Integration & Generative AI... ...cloud data platforms (e.g., AWS, Azure, or GCP) and data lakes...
Amazon Web Service
Pipeline
Remote work
BLN24
Washington DC
3 days ago
Architect, Data Engineering
$155k - $215k
...modernize their data and put AI to work, not in... ...Advisory, Data Engineering, Analytics &... ...Generative AI & ML, and Cloud Migration... ...across AWS, Azure, and GCP... ...out of modern, scalable data platforms and pipelines for clients across... ...oversee large-scale lakehouse and warehouse...
Amazon Web Service
Pipeline
Remote work
Lovelytics
Arlington, VA
2 days ago
Senior Data Engineer
$150k - $200k
...Senior Data EngineerGibson Dunn is... ...the Senior Data Engineer will be responsible... ...it within scalable data lakes and... ...scientists, and AI/ML workflows. This... ...warehouses, and lakehouse environments (on... ...ETL/ELT pipelines to ingest, transform... ...platforms (e.g., AWS, Azure, Google...
Amazon Web Service
Pipeline
Local area
Flexible hours
Gibson Dunn
Washington DC
3 days ago
Senior Manager Data Engineering
$160k - $262k
...Senior Manager Data Engineering (Technology Architect... ...implementing scalable, high-... ...streaming data pipelines across modern cloud... ...frameworks. Support AI-enabled... ...Lake, or similar lakehouse patterns.... ...to support AI/ML deployment, validation... ...AI services, AWS AI services, or...
Amazon Web Service
Pipeline
Contract work
Sapient Corporation
Arlington, VA
4 days ago
Air Force A10 AI/ML Engineer / Data Scientist
$132.9k - $207.75k
...awardNoblis is hiring multiple AI/ML Engineers and Data Scientists. This will be a... ...cloud-native ML infrastructure on AWS. Develop and maintain DevOps and MLOps pipelines to streamline model... ...emerging technologies. Architect scalable and resilient infrastructure to...
Amazon Web Service
Pipeline
Full time
Contract work
Part time
Local area
Remote work
Noblis
Arlington, VA
6 days ago
Data Engineer / Metadata Engineer
...seeking a talented Data Engineer / Metadata... ...and optimize data pipelines, metadata repositories... ...build, and maintain scalable data pipelines and... ..., data lakes, and lakehouse architectures.... ...solutions within Azure, AWS, or Google Cloud... ...enterprise analytics, AI/ML, business...
Amazon Web Service
Pipeline
Full time
Omniscius Consulting
Arlington, VA
18 days ago
Mid-Level Databricks/Informatica Data Engineer
...Databricks/Informatica Data Engineer to support enterprise... ...involves building scalable data pipelines in Databricks, developing... ...: Experience in AWS, Azure, or Google Cloud... ...Architecture, and Data Lakehouse concepts. ~... ...reporting, analytics, AI/ML, and business intelligence...
Amazon Web Service
Pipeline
Remote work
Eliassen Group
Arlington, VA
2 days ago
Onsite, ML FinTech Data Engineer (Bethesda Maryland)
$65 - $67 per hour
...Description Position Title: ML Data Engineer Location:... ...heavily in modern data and AI capabilities to... ...build, and maintain scalable data pipelines to ingest data from multiple... ...data lake / lakehouse to standardize and curate... ...cloud platforms (AWS, Azure, or GCP). Experience...
Amazon Web Service
Pipeline
Contract work
Local area
Relocation
Monday to Friday
Addison Group
Bethesda, MD
more than 2 months ago
Data Scientist AI / ML
...Data Scientist AI/MLDuration - Long term (12+ months... ...business needs into scalable data science... ...Collaborate with data engineers, cloud engineers,... ...using AWS-native services.Develop... ...within an AWS data lakehouse, including scalable... ...machine learning pipelines using AWS-native...
Amazon Web Service
Pipeline
Inizio Partners
Washington DC
5 days ago
Air Force A10 AI/ML Engineer / Data Scientist
$132.9k - $207.75k
...Noblis is hiring multiple AI/ML Engineers and Data Scientists. This will be a full... ...cloud-native ML infrastructure on AWS. Develop and maintain DevOps and MLOps pipelines to streamline model... ...emerging technologies. Architect scalable and resilient infrastructure to...
Amazon Web Service
Pipeline
Full time
Contract work
Part time
Local area
Remote work
Noblis
Arlington, VA
2 days ago
Senior Data Solutions Architect - Cloud & AI
...in enterprise data. Insight... ...into modern, scalable data solutions... ...analytics and AI. We're... ...warehouse and lakehouse solutions.... ...prototypes, pipelines, integrations... ...modern data engineering technologies.... ...support analytics, ML and GenAI use... ...cloud platform: AWS, Azure or GCP...
Amazon Web Service
Pipeline
Full time
Immediate start
Insight Global
Washington DC
1 day ago
Senior Principal AI Data Engineer
$174.25k - $235.75k
...None Job Family: Data Science and Data Engineering Job Qualifications... ...Senior Principal AI Data Engineer to... ...and operate data pipelines that ingest, store... ...for modern AI/ML processes. You will... ...prompts), implement scalable storage layers (such as a data lakehouse and vector stores...
Pipeline
Contract work
Temporary work
Immediate start
Remote work
Worldwide
Flexible hours
General Dynamics Information Technology, Inc.
Arlington, VA
3 days ago
Data Platform Engineer - AI
...-on Technical Lead – Data Platform & Services Engineering with strong expertise... ...Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions... ...Data Factory. Design Lakehouse/Medallion... ...Support experience AI/ML or AI-enabled analytics...
Pipeline
Full time
Programmers.io
Washington DC
8 hours ago
Data Scientist / Machine Learning Engineer
$160k - $185k
...ECS is seeking a Data Scientist/Machine... ...Machine Learning Engineer to design, develop... ...data into scalable, production-ready AI and predictive analytics... ...algorithms, AI/ML-assisted clustering... ..., and monitoring pipelines.Implement CI/CD... ...Machine Learning, AWS SageMaker, Databricks...
Amazon Web Service
Pipeline
ECS Federal
Arlington, VA
6 days ago
Director, Data Engineering - Data & AI Platform - Job ID 959
$157.1k - $252k
...Director, Data Engineering - Data & AI Platform - Job ID 959 Arlington, VA Attention... ...platform, stands up an AI/ML platform, and moves the... ...a data model, and unblock a pipeline yourself. This is a player‑coach... ...certification, or cloud (AWS/Azure) certifications valued...
Amazon Web Service
Pipeline
Contract work
Temporary work
Remote work
Flexible hours
Day shift
Kapitus, Inc.
Arlington, VA
2 days ago
Senior Data Engineer
$115k - $150k
...Insomniac, we leverage AI to free our teams... ....As a Senior Data Engineer, you will architect... ...build, and optimize scalable data platforms... ...design of robust data pipelines, enforce best... ...cloud platforms (AWS, GCP, Azure) and cloud... ...).Experience with ML pipelines (e.g., feature...
Amazon Web Service
Pipeline
Full time
Visa sponsorship
Insomniac Design
Washington DC
6 days ago
Data Platform Engineer (Azure AI)/Data Engineer with Azure/Azure Data Platform Engineer/Senior Azure Data Engineer/Data Platform Technical Lead
...Job Title: Data Platform Engineer (Azure AI)/Azure Data Platform Engineer/... ...ADLS Gen2, Delta Lake, Lakehouse Architecture Azure... ...Build scalable Azure data platforms and ETL/ELT pipelines. Develop data solutions... .... Preferred AI/ML or AI-enabled analytics...
Pipeline
Full time
Programmers.io
Washington DC
8 hours ago
AI Data Engineer
$128.82k - $161.02k
...making a difference. The AI Accelerator exists to... .... This role builds the data-engineering foundation every AI... ...person implements the pipelines, transformation patterns... ...Not required to be an ML researcher; required to... ...from the first commit. AWS foundations: IAM, S3, KMS...
Amazon Web Service
Pipeline
Contract work
Live in
Visa sponsorship
3 days per week
Howard Hughes Medical Institute
Chevy Chase, MD
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Lakehouse Data Engineer: Scalable AI/ML Pipelines. Be the first to apply!