Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years

Temporary

TMS LLC

Los Angeles, CA

Job Description

Job Title: AI Engineer / Generative AI Engineer
Location: Los Angeles, CA (Hybrid)
Duration: 3+ Months (Extension Possible)
Experience: 15+ Years
Job Summary
We are seeking a hands-on AI Engineer with expertise in Python, Agentic AI, AWS Bedrock AgentCore, and LLM evaluation to build, deploy, monitor, and continuously improve production-grade AI agents.
Key Responsibilities
Develop AI agents using Python and Claude Agent SDK.
Deploy agents using AWS Bedrock AgentCore Runtime.
Design golden datasets and implement LLM-as-a-Judge evaluations.
Integrate automated evaluations into CI/CD pipelines as quality gates.
Implement Langfuse/OpenTelemetry for AI observability and tracing.
Evaluate agent accuracy, task completion, tool execution, and performance.
Support RAG pipelines and AWS data processing workflows.
Required Skills
Python and Agentic AI development.
AWS Bedrock AgentCore Evaluations / Bedrock evaluation.
Golden-dataset design and curation.
LLM-as-a-Judge design and calibration against human labels.
Automated evaluation and CI gate integration.
Langfuse and/or OpenTelemetry.
Good to Have
RAGAS or equivalent evaluation frameworks.
Trajectory evaluation and agentic red-teaming.
Bedrock Guardrails, Strands Agents SDK, and GitHub Actions.

Qualifications

6–8+ years of software engineering, cloud engineering, or AI/ML experience.
Hands-on experience with production AI agents and continuous evaluation.
Strong problem-solving and troubleshooting skills.

Additional Information

All your information will be kept confidential according to EEO guidelines.

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years in Los Angeles, CA vacancy

Hiring: AI Engineer / Generative AI Engineer | (Agentic AI,AWS Bedrock AgentCore,Claude Agent SDK,La
...Job Description Role: AI Engineer / Generative AI Engineer Duration... ...CA (Hybrid) Specialisation: Agentic AI, AWS Bedrock AgentCore, Claude Agent SDK, Langfuse, AI Observability & Evaluation... .... Qualifications ~6–8+ years of software engineering, cloud...
Amazon Web Service
TMS LLC
Los Angeles, CA
1 day ago
AI Engineer (Agentic AI / AWS Bedrock)
...on W2 Job Description: AI Engineer (Agentic AI / AWS Bedrock) Experience: 6 8 Years Role: AI Engineer /... ...: Agentic AI, AWS Bedrock AgentCore, Claude Agent SDK, Langfuse, AI Observability & Evaluation... ...and operational costs. 15. Identify and troubleshoot...
Amazon Web Service
Varite, Inc
Santa Monica, CA
7 days ago
AI Engineer (Agentic AI / AWS Bedrock)
...Description Title: AI Engineer (Agentic AI / AWS Bedrock) Location: Los... ...6 month contract-to-hire Experience Range: 6-10 years Our client is seeking... ...workflows on Amazon Bedrock AgentCore Runtime with error... ...and monitoring using Langfuse for LLM and agent...
Amazon Web Service
Contract work
Local area
Expert In Recruitment Solutions
Los Angeles, CA
7 days ago
Security Engineer (AWS Bedrock AgentCore / AI Security)
.../hr - $100/hr on W2 Security Engineer (AWS Bedrock AgentCore / AI Security) Experience: 6–8 Years Role: Cloud Security Engineer... ...frameworks for enterprise Agentic AI applications built on AWS Bedrock... ...Manager, and CloudWatch. 15. Automate IAM policy deployment...
Amazon Web Service
Varite, Inc
Santa Monica, CA
7 days ago
Hiring: Principal IAM Architect | AWS Security & Authorization | 15+ Years | local to CA only
...Description Job Description Hiring: Principal IAM Architect | AWS Security & Authorization... ...) Experience: 15+ Years We are looking for an... ..., workloads, and AI-enabled applications.... ...Familiarity with AWS Bedrock and AgentCore identity or gateway capabilities...
Amazon Web Service
Local area
Remote work
TMS LLC
Los Angeles, CA
5 days ago
Lead Python AI Engineer
$130k - $160k
...Lead Python AI Engineer to build robust... ...services and agentic workflows. In... ...: 7+ years of backend engineering... ...with AWS, Docker, ECS/... .../Claude, AWS Bedrock, or equivalent... ..., LangSmith, Langfuse, Arize) RAG... ...eligible to accrue 15-25 paid days... ...eligible and hired into a...
Amazon Web Service
Temporary work
Remote work
Flexible hours
EPAM Systems Inc
Los Angeles, CA
1 day ago
Senior AWS Agentic AI Developer (Contractor)
$50 - $80 per hour
Senior AWS Agentic AI Developer (Contractor) Job Category : Information Technology... ...our designs for over 30 years! Recognized as #8 on America'... ...of up to 15-20 hours per week. Independent... ...using AWS, including Amazon Bedrock Build AI agents, RAG systems,...
Amazon Web Service
Hourly pay
Contract work
Part time
For contractors
Remote work
Munchkin, Inc.
Los Angeles, CA
2 days ago
Sr AI/Agentic Engineer
$111.2k - $185k
...conversational AI that helps small... .... Design new agentic workflows: LLMs... ...open‑weight and Bedrock‑hosted models)... ...underwriting and platform engineering to translate... ...5+ years of software engineering... ...LLM provider - AWS Bedrock,... ...salary for new hires for the position...
Amazon Web Service
Full time
Work at office
Local area
B.S.D. Capital Inc. dba Lendistry
Los Angeles, CA
1 day ago
Staff AI & Data Engineer, HR Systems
...lifecycle.As a Staff AI & Data Engineer, HR Systems, you will... ...EngineeringDesign and build agentic AI solutions using... ...Required Qualifications: 7+ years of software... ...orchestration platforms, AWS lambda and relevant SaaS... ...Chance Initiative for Hiring Ordinance, the Los Angeles...
Amazon Web Service
Local area
Flexible hours
Riot Games
Los Angeles, CA
1 day ago
Ai Engineer
$85k - $110k
...education. For more than 140 years, Johnson Controls has... ...(JCI) is seeking an AI Engineer to join our... ...applications. Build agentic workflows and task‑specific... ...OpenAI/Azure ML, AWS SageMaker/Bedrock, or Google Cloud Vertex... ...now or in the future. HIRING SALARY RANGE: $85,000...
Amazon Web Service
Free visa
Johnson Controls
Glendale, CA
1 day ago
Principal - AI Platform & Governance Engineer - Business Consulting
...DescriptionPrincipal Consultant - AI Platform & Governance Engineer - Infosys... ...Enterprise & Local) on Azure/AWS.Configure MCP servers... ...interoperability with agentic platforms (MoveWorks, Bedrock, Foundry).Develop and enforce... ....Minimum of 7+ years in cloud architecture or...
Amazon Web Service
Full time
Temporary work
Local area
Infosys Technologies
Los Angeles, CA
17 hours ago
Associate AI Engineer (Onsite in Los Angeles)
$90k - $110k
...disruptor our AI-powered Insights... ...platform with senior engineers working... ...calling agents on AWS Bedrock and AgentCore using the... ...desks away. We hire for fundamentals... ...engineers with a year or two of... ...deeper into AI and agentic systems. You do... ...Time Off : ~15 vacation days...
Amazon Web Service
Full time
Work experience placement
Internship
Work at office
Remote work
Flexible hours
Fuel Cycle
Los Angeles, CA
5 days ago
Data/AI engineer with Python
...frameworks supporting AI, analytics, and business... ...product managers, and engineering teams to translate business... ....SkillsMust have10+ years of professional software... ...LangGraph, LangChain, agentic workflows, or orchestration... ..., Neptune, and other AWS data services.Strong...
Amazon Web Service
Luxoft
Los Angeles, CA
1 day ago
Cyber - AI Cloud Security Engineer - Manager
$134.5k - $265.1k
...Deloitte is seeking an AI Cloud Security Engineer, Manager to lead... ...generative AI, agentic AI, retrieval-... ...Amazon Web Services (AWS), Microsoft Azure... ...of a degree6+ years of professional... ...Google Gemini, Amazon Bedrock, or Vertex... ...individual to be hired at or near the top...
Amazon Web Service
Work experience placement
Local area
Visa sponsorship
Deloitte
Los Angeles, CA
17 hours ago
AI Engineer
...an experienced Senior AI Engineering to design, build, and... ...generation, vector search, agentic workflows, MCP, model... ...use cases. Support hiring, mentoring, and day-to... ...Copilot/Azure OpenAI, AWS Bedrock, and open-source... ...degree preferred. ~10+ years of progressive experience...
Amazon Web Service
East West Bank
Pasadena, CA
28 days ago
Agentic Delivery Software Engineer III
$107.6k - $198.4k
...analytics, Generative AI, transformative... ...creatives, designers, engineers, and architects.... ...agent development, and agentic system... ...technical field4+ years of experience in software... ...Amazon Web Services (AWS), Microsoft Azure,... ...an individual to be hired at or near the top...
Amazon Web Service
Local area
Deloitte
Los Angeles, CA
4 days ago
Senior AI Engineer
$170k - $200k
...Metropolis is seeking a Senior AI Engineer to join our Applied AI... ...applications and agentic workflows that... ...we're looking for ~6+ years of software engineering... ...cloud infrastructure (AWS) ~ Ability to work highly... ...of the tool. If you are hired for the position, your...
Amazon Web Service
Temporary work
Work at office
Local area
Metropolis
Los Angeles, CA
15 days ago
AI Sales Engineer
$220k - $260k
...Artificial Intelligence (AI) landscape with our... ...and experienced AI Sales Engineer to support the technical... ...homegrown AI and popular agentic AI tools.Your Responsibilities... ...field of study 5+ years of technical sales experience... ...platforms (e.g., AWS, Azure, GCP)Ability to travel...
Amazon Web Service
Worldwide
Home office
Fortinet
Los Angeles, CA
2 days ago
Software Architect - AI Accelerated Engineering Lead (West)
...solutions while advancing AI-empowered software... ...team, comprised of engineers, product leaders,... ...(typically 6+ years) in building and operating... ...: Daily use of agentic IDEs and advanced... ...Strong background with AWS/Azure/GCP,... ...For the role, we are hiring at the following levels...
Amazon Web Service
Temporary work
Local area
Slalom
Los Angeles, CA
1 day ago
Applied AI Engineer/Architect
$258.8k - $304.2k
...ready to make an impact?Applied AI Engineer/Architect West Monroe is... ...practice.What You Will Bring7+ years of experience in software engineering... ..., including Azure OpenAI, AWS Bedrock, Google Vertex AI, Databricks... ...will also be available upon hire date. Seattle or Washington,...
Amazon Web Service
Local area
Immediate start
Flexible hours
West Monroe Partners
Los Angeles, CA
4 days ago
Staff Data and AI Engineer - Enterprise
...to next-generation AI capabilities.As a Staff Data and AI Engineer on the Enterprise Data... ...Enterprise agentic analytics and AI services... ...solutions).8+ years of experience in enterprise... ...such as AWS data services, dbt,... ...Chance Initiative for Hiring Ordinance, the Los...
Amazon Web Service
Local area
Immediate start
Flexible hours
Riot Games
Los Angeles, CA
4 days ago
Senior Agentic AI Engineer
$51.4 - $66.71 per hour
Senior Agentic AI Engineer Location: Glendale, AZ Onsite Flexibility: Hybrid — 3 days onsite per week Contract Details Position Type: Contract... ...related field (Master's preferred). Required Experience 8 years of relevant software engineering experience. 3 years of...
Contract work
Work visa
3 days per week
Global Technical Talent, Inc.
Glendale, CA
1 day ago
Sr. AI Platform Data Engineer, Ring Decision Science, Ring Decision Science
$154.6k - $209.1k
We seek an AI Platform Builder—a Data Engineer focused on developing Platforms and Agentic AI solution—who embraces prompt... ...assisted development with AWS services and internal... ...best practices- 5+ years of data engineering... ...the application and hiring process, including support...
Amazon Web Service
Local area
Flexible hours
Amazon
Hawthorne, CA
1 day ago
Principal AI Engineer
$250k
...Company is seeking a full-time, year-round Principal AI Engineer to join the Artificial Intelligence... ...BI, or Dataverse preferred. ~ AWS experience (Bedrock, IAM, Lambda) preferred. ~ Experience... ...to pay for this position upon hire is $250k plus bonus....
Amazon Web Service
Full time
Work at office
Flexible hours
Afternoon shift
Discovery Land Company
Beverly Hills, CA
5 days ago
Senior AI AppSec Engineer
$153.84k - $246.15k
...can succeed as a Senior AI AppSec Engineer at Capital Group”As a... ...adoption of AI. You will use agentic tooling to review code,... ...to apply.You have 8+ years of relevant experience... ...of the people we hire. More than 9,000 associates... ...where Capital contributes 15% of your eligible...
Full time
Temporary work
Local area
Flexible hours
Capital Group
Los Angeles, CA
1 day ago
Cyber - AI Cloud Security Engineer - Senior Consultant
$105.4k - $207.8k
...Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to... ...for generative AI, agentic AI, retrieval-augmented... ...lieu of a degree3+ years of professional experience... ...Gemini, Amazon Bedrock, or Vertex AIExperience... ...an individual to be hired at or near the top of...
Amazon Web Service
Work experience placement
Local area
Visa sponsorship
Deloitte
Los Angeles, CA
17 hours ago
Principal, Agentic Reliability Engineer
$171k - $210k
Agentic Reliability Engineer (ARE)Slalom · Agentic Managed Services... ...who makes AI agents dependable... ...BRINGRequired* 5+ years of engineering experience... ...CrewAI, AutoGen, AWS Bedrock Agents, or... ...for AI systems (Langfuse, Braintrust, RAGAS... ...this role, we are hiring at the following...
Amazon Web Service
Temporary work
Local area
Remote work
Slalom
Los Angeles, CA
17 hours ago
Agentic AI Engineer (Freelance, Remote)
$50 per hour
...USD/hr. Weekly payments. Trusted by 10,000+ software engineers worldwide MIN EXP REQUIRED 2+ years PAY RATE Up to $50 USD/hr Earn Up To $50 USD/... ...and more — completely free ~ Over $200/month in AI access, included at no extra cost. Overview...
Weekly pay
Extra income
Contract work
Freelance
Internship
Remote work
Worldwide
Outlier
Los Angeles, CA
1 day ago
Director of AI Engineering
$143.5k - $205k
...TechnologyWork Days: Full Time DaysThe Director of AI Engineering is responsible for leading the research,... ...: Azure (Synapse, ADF, Databricks), AWS, Google Cloud, Snowflake.· Programming &... ...a related field (PhD preferred).· 12+ years of experience in AI, data science, or ML...
Amazon Web Service
Full time
Local area
ABM Industries
Los Angeles, CA
4 days ago
Principal AI Software Engineer, TechEx (US)
$175k - $205.9k
...is searching for a Principal AI Software Engineer, to join our team in our Technology... ...and APIs (e.g., Java, React, AWS). Ensure scalability,... ...equivalent experience required.8+ years of experience in software... ...will also be available upon hire date. Seattle or Washington,...
Amazon Web Service
Local area
Immediate start
Flexible hours
West Monroe Partners
Los Angeles, CA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years. Be the first to apply!