AWS Lakehouse Data Engineer: Scalable AI/ML Pipelines

Guidehouse

Guidehouse seeks an AWS Lakehouse Data Engineer to design, build, and operate a cloud-native data platform powering AI/ML, analytics, reporting, and data visualization. You will construct a scalable lakehouse on Amazon S3 using Iceberg/Parquet, enable ACID transactions, and provide fast interactive querying with AWS services. You will implement batch and streaming ingestion, Python/PySpark ETL pipelines, metadata governance, and automated provisioning with CI/CD. #J-18808-Ljbffr Guidehouse

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the AWS Lakehouse Data Engineer: Scalable AI/ML Pipelines in Washington DC vacancy

AI/ML Data Engineer
...Strategies is seeking an AI/ML Data Engineer to support the U.S.... ...-grade data pipelines that enable Artificial... ...modernization program focused on lakehouse architecture, cloud-... ...deploy, and maintain scalable data platforms that... ...as Kafka, Airflow, AWS Glue, APIs, message...
Amazon Web Service
Pipeline
Central Strategies, LLC
Washington DC
3 days ago
Data Engineer: Databricks Lakehouse for AI/ML workloads
540 is seeking a Data Engineer to support a mission-critical modernization... ...Databricks-based data pipelines and lakehouse capabilities at enterprise... ...Working with software engineers, AI/ML teams, cybersecurity and... ..., you will create scalable, reliable solutions using Databricks...
Pipeline
540
Arlington, VA
5 days ago
Senior AI Data Engineer
$165k - $180k
...and motivated Sr. AI Data Engineer with a proven track... ...in building scalable data platforms and... ...maintain scalable data pipelines and workflows using... ...support AI/ML and analytics workloads... ...layers) following data lakehouse best practices.... ...experience with AWS data services (e.g...
Amazon Web Service
Pipeline
Work experience placement
H1b
Work at office
Local area
Karsun Solutions
Washington DC
2 days ago
Senior AI/ML Data Engineer
...The Senior AI/ML Data Engineer will serve as a technical leader responsible... ...stakeholders to rapidly deliver scalable, secure, and reliable AI... ...Deep experience with Azure, AWS, or Google Cloud data and AI... ...vector databases, embedding pipelines, retrieval systems, and Retrieval...
Amazon Web Service
Pipeline
Omniscius Consulting
Washington DC
12 days ago
Data/Metadata Engineer
$160k - $180k
...ECS is seeking a Data/Metadata Engineer to join our team... ...and optimize data pipelines, metadata repositories... ..., and maintain scalable data pipelines... ...data lakes, and lakehouse architectures.Ensure... ...within Azure, AWS, or Google Cloud... ...enterprise analytics, AI/ML, business...
Amazon Web Service
Pipeline
ECS Federal
Arlington, VA
4 days ago
Lead AI & Data Analytics Engineer - Must be government clearance eligible
...is rooted in agility, scalability, and a commitment to... ...seeking a proactive Lead AI & Data Analytics Engineer to support a federal... .... Develop data pipelines, reusable data models... ...business intelligence, AI/ML, or analytics product... ...Azure Data Factory, AWS Glue, Apache NiFi,...
Amazon Web Service
Pipeline
Full time
Contract work
Navaide
Arlington, VA
more than 2 months ago
Senior Data Engineer
...seeking a Senior Data Engineer to support large-scale... ...platforms and pipelines that support mission... ...maintenance of scalable, secure, and auditable... ...within Databricks Lakehouse environments.... ...data platforms in AWS or Azure cloud environments... ...(MLOps) and AI/ML data pipelines. Experience...
Amazon Web Service
Pipeline
ANALYTICA
Washington DC
22 hours ago
Data Scientist / AI Engineer
...leads transformative data-driven process... ...Senior Data Scientist / AI Engineer serves as the... ...ADVANA, Databricks, AWS SageMaker, LangChain... ...Requirements: 35% — LLM/RAG Pipeline Architecture,... ...implementation of scalable, secure RAG and... ...deploying and operating ML/AI workloads on...
Amazon Web Service
Pipeline
Temporary work
For contractors
Remote work
Flexible hours
2 days per week
3 days per week
Phoenix Group of Virginia, Inc.
Washington DC
6 days ago
Data Engineer
...Data Engineer Opportunity At Virtualitics... ...category leader in AI-native... ...applications run on — the pipelines, models, and... ..., and maintain scalable, secure data pipelines... ...to support AI/ML workloads,... .... ~ Advanced AWS experience (S3,... ...and lakehouse architectures (...
Amazon Web Service
Pipeline
Remote work
Flexible hours
Shift work
Virtualitics Inc
Washington DC
2 days ago
Air Force A10 AI/ML Engineer / Data Scientist
$132.9k - $207.75k
...awardNoblis is hiring multiple AI/ML Engineers and Data Scientists. This will be a... ...cloud-native ML infrastructure on AWS. Develop and maintain DevOps and MLOps pipelines to streamline model... ...emerging technologies. Architect scalable and resilient infrastructure to...
Amazon Web Service
Pipeline
Full time
Contract work
Part time
Local area
Remote work
Noblis
Arlington, VA
22 hours ago
Onsite, ML FinTech Data Engineer (Bethesda Maryland)
$65 - $67 per hour
...Position Title: ML Data Engineer Location: Bethesda, MD... ...heavily in modern data and AI capabilities to... ...build, and maintain scalable data pipelines to ingest data from multiple... ...data lake / lakehouse to standardize and curate... ...with cloud platforms (AWS, Azure, or GCP)....
Amazon Web Service
Pipeline
Contract work
Temporary work
Local area
Relocation
Monday to Friday
Addison Group
Bethesda, MD
a month ago
Data Engineer
...Description 540 is seeking a Data Engineer to support a mission-... ...-based data pipelines and lakehouse capabilities that enable... ..., analytics, AI/ML, and operational workloads... ...stakeholders, you will build scalable and reliable... ...based data services in AWS, Azure, or Google Cloud...
Amazon Web Service
Pipeline
Temporary work
Work at office
Local area
Flexible hours
540
Arlington, VA
7 days ago
Senior Data Engineer
...is seeking a Senior Data Engineer to support a mission-... ...Databricks-based data pipelines and lakehouse capabilities that enable... ..., analytics, AI/ML, and operational workloads... ...requirements into secure, scalable solutions using... ...operating Databricks within AWS, Azure, or Google...
Amazon Web Service
Pipeline
Temporary work
Work at office
Local area
Flexible hours
540
Arlington, VA
7 days ago
Data Engineer - East Region
$100k - $115k
...custom software, data, AI, and cloud... ...Architecture & Engineering team sees data... ...Web Services (AWS), Microsoft Azure... ...operationalize scalable data solutions.... ...streaming data pipelines, integrations,... ...distributed processing, lakehouse architectures,... ...support AI, ML, Generative AI,...
Amazon Web Service
Pipeline
Temporary work
Work at office
Slalom
Washington DC
4 days ago
Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries)
$146.6k - $150k
...build the foundational data infrastructure that powers cutting-edge AI applications... ...will design and maintain scalable data pipelines, manage secure data environments... ...hypotheses into engineered features, manage secure... ...major cloud platforms (AWS, Azure, GCP) Exceptional...
Amazon Web Service
Pipeline
Apprenticeship
Work at office
Local area
Easy work
McKinsey & Company
Washington DC
4 days ago
Data Scientist / Machine Learning Engineer
$160k - $185k
...ECS is seeking a Data Scientist/Machine... ...Machine Learning Engineer to design, develop... ...data into scalable, production-ready AI and predictive analytics... ...algorithms, AI/ML-assisted clustering... ..., and monitoring pipelines.Implement CI/CD... ...Machine Learning, AWS SageMaker, Databricks...
Amazon Web Service
Pipeline
ECS Federal
Arlington, VA
4 days ago
Senior Data Engineer
$115k - $150k
...Insomniac, we leverage AI to free our teams... ....As a Senior Data Engineer, you will architect... ...build, and optimize scalable data platforms... ...design of robust data pipelines, enforce best... ...cloud platforms (AWS, GCP, Azure) and cloud... ...).Experience with ML pipelines (e.g., feature...
Amazon Web Service
Pipeline
Full time
Visa sponsorship
Insomniac Design
Washington DC
22 hours ago
Data Engineer, PXT Central Science
$152k - $205.6k
...and Generative AI to proactively identify... ...of science, engineering, and UX to build... ...worldwide.As a Data Engineer on... ...turning leading-edge ML and Generative... ...into reliable, scalable production systems... ...include:• Data Pipeline Development: Design... ...using native AWS services (Glue,...
Amazon Web Service
Pipeline
Local area
Worldwide
Flexible hours
Amazon
Arlington, VA
22 hours ago
Senior Data Engineer
$140k - $190k
The Data Engineer will be writing code that moves data through a pipeline, fixing data pipeline issues, optimizing... ...-on experience with AI and ML pipelines, MLOps... ...services to improve scalability and maintainability.Write... ...modern cloud platforms (AWS, Azure, GCP, etc.).•...
Amazon Web Service
Pipeline
Contract work
Work experience placement
Work at office
Modern Technology Solutions
Alexandria, VA
2 days ago
Data Engineer
...cybersecurity operations, AI/ML integration, cloud modernization, data governance, and... ...Summary The Data Engineer interprets business... ..., develops data pipelines, supports data infrastructure... ..., with a focus on AWS cloud services and... ...redesigns for scalability Develop and...
Amazon Web Service
Pipeline
Full time
Disruptive Solutions, LLC
Washington DC
2 days ago
Senior Principal AI Data Engineer
...seeking a Senior Principal AI Data Engineer to support our AI team... ..., and operate data pipelines that ingest, store, and... ...primarily for modern AI/ML processes. You will partner... ...prompts), implement scalable storage layers (such as a data lakehouse and vector stores), and...
Pipeline
Contract work
General Dynamics Information Technology
Arlington, VA
27 days ago
Data & AI Engineer - 90408785 - Remote
...Environment: Remote The Data & AI Engineer Specialist plays a key role... ...transforms data requirements into scalable pipelines and services, ensures the... ...• Experience with data lakehouse or cloud data platforms.... ...practices. • Exposure to AI/ML pipeline development,...
Pipeline
Hourly pay
Permanent employment
Temporary work
Work experience placement
Interim role
Local area
Remote work
Relocation
Flexible hours
Amtrak
Washington DC
more than 2 months ago
Data Engineer
...Get AI-powered advice on this job... ...redefining how critical data and intellectual... ..., and automate ML workflows that... ...role with real engineering depth. What You’... ...and deployment pipelines Enhance and... ...GitHub Actions, AWS (ECS, Lambda, Step... ...that values clean, scalable architecture and...
Amazon Web Service
Pipeline
Full time
Flexible hours
HireCapital
Washington DC
1 day ago
Senior Data Engineer
...Senior Data Engineer This Department of War enterprise... ...requirements into scalable, production-ready... ..., and emerging AI technologies.... ...and maintain data pipelines and architectures... ...cloud environments (AWS, Azure, or GCP).... ...Experience supporting AI/ML data preparation...
Amazon Web Service
Pipeline
Leidos
Alexandria, VA
3 days ago
Remote Senior Data Engineer
$120k - $127k
...Opportunity As a Senior Data Engineer at Orijin, you will be... ...be on data modeling, pipelines, architecture,... ...architecture to support scalability, reliability, and near... ...using tools such as: AWS (S3, RDS, Redshift, Lambda... ...the platform matures. ML & AI Enablement Design build...
Amazon Web Service
Pipeline
Permanent employment
Work experience placement
Work at office
Remote work
GrabJobs
Washington DC
3 days ago
Lead Data Engineer
$164k - $200k
...a high-performing Lead Data Engineer to play a vital role as... ...writing code, building scalable data pipelines, pioneering responsible AI practices, and deploying... ...-grade solutions for AI/ML, BI, and operations. The... ...in a multi-cloud (GCP, AWS, Azure) ecosystem to unify...
Amazon Web Service
Pipeline
Full time
Work at office
Worldwide
Flexible hours
2 days per week
1 day per week
American Society of Clinical Oncology
Alexandria, VA
1 day ago
Semantic Data and AI Engineer
$150k - $210k
...) is hiring for a full-time Semantic Data and AI Engineer to join our growing Knowledge and Data... ...client engagements, including retrieval pipeline architecture, embedding strategies, and... ...Experience with cloud platforms (AWS, Azure, or GCP) for deploying and operating...
Amazon Web Service
Pipeline
Remote job
Full time
For contractors
H1b
Work at office
Local area
Enterprise Knowledge
Arlington, VA
22 hours ago
Data Engineer
...Data EngineerExpression is seeking an experienced Data Engineer to support the design, development... ...operational deployment of scalable, AI-enabled data... ...and deploy data pipelines, preprocessing... ..., and production ML responsibilities... ...environments, including AWS, Azure, or...
Amazon Web Service
Pipeline
Full time
For contractors
Work at office
Immediate start
Expression Networks
Arlington, VA
1 day ago
AWS Data Engineer
...AWS Data EngineerSystem One is looking for a strong AWS Data Engineer for a remote contract-to-hire position.... ...ResponsibilitiesBuild and operate data pipelines (batch and streaming... ....Build and manage a scalable lakehouse on Amazon S3 using... ..., analytics, AI/ML, security,...
Amazon Web Service
Pipeline
Contract work
Local area
Remote work
System One Holdings, LLC
McLean, VA
2 days ago
Lead Data Engineer
...customers with the data and insight to... ...senior data engineers who share our passion... ...for big data, AI, and machine learning... ...back-end or ML/AI work... ...primarily on the data pipelines Interface directly... ...optimization, and scalability Experience with Azure or AWS cloud-based...
Amazon Web Service
Pipeline
Ex Parte
Bethesda, MD
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Lakehouse Data Engineer: Scalable AI/ML Pipelines. Be the first to apply!