Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Forward Deployed Engineer (Model Customization and Optimization), AWS Forward Deployed Engineering

$143.7k - $194.4k
Full-time

Amazon Locker

As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with strategic customers to build, optimize, and run custom generative AI models in production alongside their engineering teams. You own complete model workstreams end-to-end from defining the evaluation bar and preparing data, through training and inference optimization, to production deployment.

FDE IIs on this team works at the intersection of models and systems. They customize state-of-the-art open-weight and foundation models for new domains, languages, and modalities; migrate and optimize training and inference workloads on AWS Trainium and operate those models as production services. They are autonomous contributors who take on projects where the business goal is clear, but the path is not. They make design trade-offs with appropriate guidance, limit short-term workarounds, coach others on producing high-quality code, and train new team members.

Key job responsibilities
Embed within customer ML and engineering teams: Understand the customer's business, data, model stack, and operational constraints. Translate ambiguous goals into a measurable evaluation bar and a technical plan for your workstream such as model selection, customization approach, and serving architecture. Requires up to 25% travel.

Customize and post-train models. Adapt open-weight and foundation models to customer domains through continued pre-training, supervised fine-tuning, preference optimization, and reinforcement learning (including RLHF, RL with verifiable rewards, and multi-turn agentic RL). Build the data pipelines, synthetic data generation, and evaluation harnesses that prove a customized model out performs the baseline on the customer's own quality, latency, and cost bar. Apply these techniques to high-value patterns such as coding agents, domain foundation models, and multi-adapter serving.

Build large-scale training and inference systems. Design and implement distributed training and RL post-training pipelines using frameworks such as PyTorch FSDP2, Megatron-LM, Miles, and verl. Build RL interaction harnesses using NeMo Gym or OpenEnv to connect agent workflows, tools, environments, and reward functions to training. Develop production inference stacks with engines such as SGLang and vLLM, and optimize throughput, latency, memory footprint, and cost per token through quantization, parallelism, speculative decoding, and batching.

Optimize models on AWS chips. Migrate and tune training and inference workloads for AWS Trainium using the AWS Neuron SDK. Profile performance, close accuracy-parity gaps against GPU baselines, and develop custom kernels where needed. Benchmark rigorously and turn results into decisions customers can act on.

Accelerate impact beyond the engagement. Codify reusable fine-tuning recipes, evaluation frameworks, benchmarking tools, and optimization patterns that accelerate future deployments. Feed field learnings back to AWS service teams, including Amazon Bedrock, Amazon SageMaker AI, and AWS Neuron. Identify opportunities to expand model customization and optimization within your customer engagement.

About the team
ABOUT AWS:

 
Diverse Experiences
Amazon values diverse experiences. Even if you do not meet all of the preferred qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.

 
Why AWS
Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never stopped innovating — that’s why customers from the most successful startups to Global 500 companies trust our robust suite of products and services to power their businesses.

Work/Life Balance
We value work-life harmony. Achieving success at work should never come at the expense of sacrifices at home, which is why we strive for flexibility as part of our working culture. When we feel supported in the workplace and at home, there’s nothing we can’t achieve in the cloud. 

Inclusive Team Culture
AWS values curiosity and connection. Our employee-led and company-sponsored affinity groups promote inclusion and empower our people to take pride in what makes us unique. Our inclusion events foster stronger, more collaborative teams. Our continual innovation is fueled by the bold ideas, fresh perspectives, and passionate voices our teams bring to everything we do.

Mentorship and Career Growth
We’re continuously raising our performance bar as we strive to become Earth’s Best Employer. That’s why you’ll find endless knowledge-sharing, mentorship and other career-advancing resources here to help you develop into a better-rounded professional. 

Team
The Custom Model and Optimization team, part of the Forward Deployed Engineering team partners with enterprises, AI-native startups, and foundation model providers to build, customize, and optimize generative AI models at scale. Our work spans domain foundation models, post-training of open-weight models, and moving training and inference workloads onto AWS Trainium. As embedded engineers within the AWS Forward Deployed Engineering motion, we bring deep model and optimization expertise to customers' most strategic AI workloads, and we turn what we learn into tooling and patterns that scale across AWS.

10047

Basic qualifications

- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
- Hands-on experience with generative AI technology, such as LLMs, vision-language models, or speech models

Preferred qualifications

- Bachelor's degree in computer science or equivalent
- Experience with large-scale distributed training of LLMs on multi-node accelerator clusters, using frameworks such as PyTorch FSDP2, TorchTitan, Megatron-LM/Megatron Core, NeMo, DeepSpeed, or NeuronX Distributed
- Experience with LLM post-training, including SFT, DPO, RLHF, and RL with verifiable rewards or multi-turn agentic RL, using frameworks such as Miles, slime, verl, NeMo-RL, OpenRLHF, SkyRL, or TRL
- Experience optimizing model training or inference for latency, throughput, or cost, using serving engines such as SGLang, vLLM, or TensorRT-LLM, on AWS Trainium or Inferentia (Neuron SDK), on AWS services such as SageMaker AI, SageMaker HyperPod, or EKS, or by writing custom kernels (CUDA, Triton, NKI)
- Experience deploying and operating ML models in customer production environments, working with teams that build and scale end-to-end production systems

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at .

USA, MA, Boston - 143,700.00 - 194,400.00 USD annually
USA, NY, New York - 158,100.00 - 213,800.00 USD annually
USA, VA, Arlington - 143,700.00 - 194,400.00 USD annually
USA, WA, Seattle - 143,700.00 - 194,400.00 USD annually
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Forward Deployed Engineer (Model Customization and Optimization), AWS Forward Deployed Engineering in Washington DC vacancy
  • $165.2k - $223.6k

    As a Forward Deployed Engineer II (FDE II) on the Custom Model and Optimization team, you embed directly with strategic customers to build, optimize, and run custom generative...  ...optimize training and inference workloads on AWS Trainium and operate those models as production... 
    Amazon Web Service
    Temporary work
    Internship
    Flexible hours

    AmazonWebServices

    Arlington, VA
    4 days ago
  • $168.1k - $227.4k

    As a Senior Forward Deployed Engineer (Senior FDE) on the Custom Model and Optimization team, you are the technical lead embedded inside a strategic customer, accountable...  ...production. You combine the technical depth of an AWS senior engineer with the urgency of a startup... 
    Amazon Web Service
    Full time
    Internship
    Local area
    Flexible hours

    Amazon

    Washington DC
    a month ago
  •  ...Title - Forward Deployed Engineer (FDE) – AI Business Transformation Associate...  ...Washington, USA (Onsite Initially; Customer Deployment within USA upon...  ...Process improvement and optimization AI-led process...  ...partnerships across Microsoft, AWS, Salesforce, and Snowflake,... 
    Amazon Web Service
    Full time
    Work experience placement
    Internship
    Relocation

    Sonata Software North America Inc.

    Washington DC
    16 hours ago
  • $143.7k - $194.4k

    A Forward Deployed Engineer II (FDE II) embeds directly inside a strategic enterprise customer to independently design, build, deploy...  ...rigor of an AWS SDE with the urgency...  ...Integrate foundation models, customer data sources...  ...AI experiences. Optimize for latency, reliability... 
    Amazon Web Service
    Temporary work
    Internship
    Flexible hours

    AmazonWebServices

    Arlington, VA
    4 days ago
  • $193.3k - $261.5k

    A Forward Deployed Engineer (FDE) embeds directly inside a strategic enterprise customer to design, build, deploy, and run AI-powered...  ...rigor of an AWS SDE with the urgency...  ...Integrate foundation models, customer data sources...  ...AI experiences. Optimize for latency, reliability... 
    Amazon Web Service
    Internship
    Local area
    Flexible hours

    AmazonWebServices

    Arlington, VA
    3 days ago
  • $110k - $147k

    Washington, D.C.Engineering /Full-time /On-siteA World-Changing...  ...more.The RoleForward Deployed Enablement Engineers...  ...with centralized customer success teams to maximize...  ...effectively build and optimize their workflows. You’...  ...the same, but as a Forward Deployed Enablement Engineer... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package

    Palantir Technologies

    Washington DC
    1 day ago
  •  ...Senior Forward Deployed Engineer Washington, DC area | Hybrid | Strong base + equity InnoForge...  ...Forward Deployed Engineer. You’ll take a customer problem from the first conversation...  ...team works with React, TypeScript and AWS. This could suit a forward-deployed... 
    Amazon Web Service
    Full time

    InnoForge

    Washington DC
    1 day ago
  • $145k - $250k

    Overview We are seeking a Senior Forward Deployed Engineer to embed directly with mission...  ...clearance and onsite presence at the customer’s location five (5) days per week to...  ...Familiarity with cloud computing deployment models, especially AWS GovCloud and/or working within a... 
    Amazon Web Service
    Contract work
    Remote work

    LMI

    Arlington, VA
    3 days ago
  • $187k - $225k

    As Forward Deployed Engineer III (6706), you’ll serve as chief technologist across software architecture...  ...passion for our people. Value for our customers.If you think you can see yourself...  .../ML platforms, data pipelines, cloud (AWS/Azure), containerization, and security... 
    Amazon Web Service
    Full time
    Local area

    MetroStar Systems

    Washington DC
    1 day ago
  •  ...About the Role CVP NextLabs is hiring an RMF Forward Deployed Engineer (FDE) to install, configure, and train customers on FiferAUDIT. You will be the domain expert...  ...will deploy FiferAUDIT in customer environments (AWS, Azure, GCP), configure control mappings, train... 
    Amazon Web Service

    Customer Value Partners

    Washington DC
    20 days ago
  • $77.6k - $176k

    Forward Deployed EngineerThe Opportunity: Our team develops and...  ...products into customer environments, supporting...  ...across forward deployed engineering activities that ensure...  ...cyber companies, frontier model providers, and defense...  ...providers such as AWS, Azure, GCP, or on-premises... 
    Amazon Web Service
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Arlington, VA
    4 days ago
  • $168.1k - $227.4k

     ...Top Secret clearance with SCI (or higher).A Forward Deployed Engineer (FDE) embeds directly inside a strategic enterprise customer to design, build, deploy, and run AI-powered...  ...deployment, combining the technical rigor of an AWS SDE with the urgency and ownership required... 
    Amazon Web Service
    Ongoing contract
    Internship
    Flexible hours

    AmazonWebServices

    Arlington, VA
    3 days ago
  •  ...integrating consulting, engineering, and global delivery...  ...intelligence.You Are:As a Forward Deployed Engineer, you will be...  ...deliver value for the customer.Structured problem...  ...within Palantir (AIP, model deployment, feature engineering...  ...with cloud platforms (AWS, Azure, or GCP)Minimum... 
    Amazon Web Service
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Arlington, VA
    1 day ago
  •  ...day. Our speech models and real-time infrastructure...  ...and on-premises deployments. Built for...  ...a Senior Forward Deployed Engineer to join our Applied...  ...on federal customers. In this role, you...  ...deployment and ongoing optimization. You'll map...  ...models (AWS GovCloud, Azure... 
    Amazon Web Service
    Full time
    Remote work

    deepgram

    Washington DC
    9 days ago
  •  ...Description 540 is seeking a Forward Deployed Engineer to support a high-impact...  ...agentic systems and language models across the DoW. In this role...  ...solutions to fit specific customer environments Experience...  ...from a commercial CSP (e.g., AWS, Google Cloud, Azure) Experience... 
    Amazon Web Service
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    540

    Arlington, VA
    3 days ago
  • $118.2k - $160k

     ...Manager Imagine being the strategic force behind how AWS Professional Services (ProServe) and Forward Deployed Engineering (FDE) connect with the world. As a Sr Executive...  ...Identify and capture delivery outcomes, customer transformation stories, and technical proof points... 
    Amazon Web Service
    Internship
    Flexible hours

    A W S

    Arlington, VA
    3 days ago
  •  ...you We are standing up forward deployed engineering for our U.S. Federal business...  ...a major federal civilian customer as our vetting and open-...  ...Feedback and Operational Optimization Evaluate AI classifier...  ...knowledge of cloud hosting (AWS preferred), virtualization... 
    Amazon Web Service
    Full time
    Work at office
    Overseas

    Maltego

    Washington DC
    more than 2 months ago
  •  ...missing children, and more. The Role   Forward Deployed Enablement Engineers are embedded with centralized customer success teams to maximize the outcomes of our...  ...teams, ensuring they can effectively build and optimize their workflows. You’ll have the opportunity to... 
    Full time

    palantir

    Washington DC
    9 days ago
  • $134.5k - $265.1k

     ...Summary Our Deloitte AI & Engineering team works to transform...  ...Work you’ll doAs a Snowflake Forward Deployed Engineer (FDE), you will...  ...safety, latency, cost, and model risk.Deliver production-quality...  ...Experience with cloud environments (AWS, Azure, and/or Google Cloud)... 
    Amazon Web Service
    Local area

    Deloitte

    Rosslyn, VA
    4 days ago
  • $111.3k - $215.1k

     ...currently seeking a Manager, Forward Deployed Engineer to join our Clients,...  ...benchmark, and deploy hybrid model configurations (LLMs and Type...  ...environments across Azure, AWS, or Google Cloud (GCP)Deep familiarity...  ...model evaluationExceptional customer-facing presence with the... 
    Amazon Web Service
    Local area

    KPMG

    McLean, VA
    4 days ago
  •  ...and mission-aligned deployments that meet government...  ...safety. About the role Forward Deployed Engineers (FDEs) lead complex...  ...of frontier models in production. You will...  ...government and public sector customers—where model...  ...deployment models (Azure, AWS), Kubernetes, Terraform... 
    Amazon Web Service
    Full time
    Work at office
    Relocation package

    OpenAI

    Washington DC
    9 days ago
  • $182k - $250.21k

     ...CSQ427R94 As a Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their data...  ...applications and data ingestion and ML/AI model integration Transformational...  ...or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at... 
    Amazon Web Service
    Remote job
    Worldwide

    Databricks

    Washington DC
    6 days ago
  • $182k - $250.21k

     ...CSQ127R318 As a Sr. Forward Deployed Engineer (FDE) you will work with customers to build and productionize solutions to their...  ...applications and data ingestion and ML/AI model integration Transformational...  ...or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at... 
    Amazon Web Service
    Remote job
    Worldwide

    Databricks

    Washington DC
    6 days ago
  •  ...and we apply that combination to a customer set that desperately needs it. We stay...  ...About the Role We are seeking Forward Deployed Software Engineers to join our expanding team in the DC...  ...managing cloud infrastructure (e.g. AWS, Kubernetes) as well as Edge infrastructure... 
    Amazon Web Service
    Full time
    Temporary work
    For contractors
    Work at office

    runetech

    Rosslyn, VA
    9 days ago
  • $182k - $250.21k

     ...infrastructure platform so our customers can use deep data...  ...business. Founded by engineers, and customer obsessed...  ...The Role As a Sr. Forward Deployed Engineer (FDE), you...  ...data ingestion and ML/AI model integration...  ...common Cloud ecosystems (AWS, Azure, GCP) with expertise... 
    Amazon Web Service
    Remote job
    Worldwide

    Databricks

    Washington DC
    6 days ago
  •  ...Staff Forward Deployed Engineer Direct Hire Seattle, WA (Onsite) The Role We are seeking...  .... You will work directly with customers and internal engineering teams throughout...  ..., deployment, and post-launch optimization. Key Responsibilities Lead technical... 
    Full time

    SPECTRAFORCE

    Washington DC
    3 days ago
  • $135k - $200k

     ...designers, and cross-discipline engineers to bring the most exquisite...  .... You will collaborate with customers, operators, MR designers,...  ...requirements today.The Original Forward Deployed Software EngineerAt Palantir...  ...mitigate wildfire risks to optimize power grids?” or “How can we... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package
    Flexible hours

    Palantir Technologies

    Washington DC
    2 days ago
  • $184.9k - $250.2k

    A Forward Deployed Engineer (FDE) embeds directly inside a strategic enterprise customer to design, build, deploy, and run AI-powered production systems alongside the customer...  ...deployment combining the technical rigor of an AWS SDE with the urgency and ownership required... 
    Amazon Web Service
    Full time
    Internship
    Flexible hours

    Amazon

    Washington DC
    3 days ago
  •  ...leading AI-first Modernization Engineering company, powered by our...  ...with partners like Microsoft, AWS, Salesforce, and Snowflake strengthen...  ...: Deliver supervised customer transformation and hands-on AI...  ...Washington offices initially and deployed to customer location within... 
    Amazon Web Service
    Full time

    Sonata Software

    Washington DC
    3 days ago
  • $110.7k - $218.3k

     ...Summary Our Deloitte AI & Engineering team works to transform...  ..., safety, latency, cost, and model risk.Deliver production-quality...  ...hands-on experience building and deploying GenAI or large language model...  ...to putting your best foot forward in the interview, we want you... 
    Amazon Web Service
    Local area

    Deloitte

    Rosslyn, VA
    16 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Forward Deployed Engineer (Model Customization and Optimization), AWS Forward Deployed Engineering. Be the first to apply!