AI Automation engineer
Full-time
SoftPathTechnologies
AI Automation engineer
Onsite role in Bellevue, Wasington.
Fulltime position.
Total 15+ exp
Must have skills
ETL Pipeline
ML /AI
AI Ops (ML Ops, Agent Ops & LLM Ops) Workflow
Python , SQL
System Design,
MCP Client server design
Job description:
Design and build end-to-end AI testing frameworks covering unit, functional, integration, and regression testing including automated test case generation and model output validation against defined quality benchmarks.
Develop load and performance testing simulating high-concurrency scenarios to validate scalability, latency SLAs, and platform stability under peak load.
Build LLM evaluation pipelines covering relevance, groundedness, and hallucination metrics integrated into CI/CD workflows to enforce automated quality gates before every model or agent deployment.
Own regression testing strategy across the AI platform maintaining automated suites that validate agent behavior, RAG pipeline accuracy, and API contracts after every release to prevent quality degradation.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Automation engineer in Washington DC vacancy
$135k - $168k
...our clients and the communities in which we practice.What You Will Be DoingThe Automation Engineer is responsible for leading the design, implementation, andmaintenance of automated and AI based solutions to improve legal workflows. This rolerequires legal knowledge, technical...SuggestedFull time$165k - $230k
...should start talking.About the RoleThis is applied agent engineering: tool-using AI systems built on real business data, embedded in the workflows... ..., define success metrics, and decide what's worth automating versus what's worth redesigning.On the engineering side:Build...SuggestedWork experience placementSummer workLive outLive inWork at officeLocal areaRemote work2 days per weekBetterUp
Arlington, VA3 days ago- ...5+ years of professional software engineering experience focusing on Python-based production... ...configurations. Experience with generative AI implementation using platforms such as... ...Design and deploy production-grade automation solutions and scalable backend services...Suggested
RESOURCESOFT, INC.
Bethesda, MD2 days ago $150k - $200k
...AI Automation Engineer – Finance & AccountingAt Cengage, our employees have a direct impact in helping students around the world discover the power and joy of learning. We are bonded by our shared purpose – driving innovation that helps millions of learners improve their...SuggestedLocal areaWorldwideCengage
Washington DC3 days ago$101.9k - $163k
...AI Automation Engineer – Sales & MarketingAt Cengage, our employees have a direct impact in helping students around the world discover the power and joy of learning. We are bonded by our shared purpose – driving innovation that helps millions of learners improve their...SuggestedContract workLocal areaWorldwideCengage
Washington DC3 days ago- ...a team supporting a U.S. Government customer. You will develop automated data pipelines for machine learning integrations and create automation... ...background eligibility. Responsibilities include implementing AI/LLM integrations with cloud services, data transformation...
- Level Access in Arlington, Virginia, is seeking an AI Transformation Engineer for a 6-month contract role. The engineer will design and automate AI-powered workflows to enhance operations within the People organization. Responsibilities include collaborating with cross-...Contract work
$105k - $245k
...Autonomous Systems and Artificial Intelligence. You will collaborate on projects that prioritize national security, working on cutting-edge AI technologies. The ideal candidate will have a strong STEM background, with skills in programming languages like C++ and Python. The...$80k - $128k
ResponsibilitiesPeraton is seeking a Senior Test Automation Engineer to join our team of qualified, diverse individuals. This is a hands-on position focused on designing and developing automation frameworks, driving test coverage, and enabling continuous integration and...Permanent employmentContract workShift work- ...2005 Information Security Management System (ISMS), and CMMI-DEV Level 3"Job DescriptionCandidate must have a background in test automation, Web Application front-end development, or Siebel. Candidates with previous experience on Agile teams especially within Government...Flexible hours
- ...We build AI agents that actually work in enterprise environments — not prototypes, not demos. We need engineer's who can own the entire agent stack: a production frontend, a robust backend, a properly secured API and identity layer, a memory architecture that scales, and...Full timeTemporary work
Trilagen
Bethesda, MD1 day ago - ...Title: Senior Embodied AI Engineer About Us: UnitX builds the world's leading physical AI systems to automate repetitive visual tasks in factories. UnitX is a fast-moving startup with a team from Stanford, MIT, Google, and beyond. Since inception, UnitX has deployed...Full time
Unitx
Washington DC1 day ago - ...Description The work Generative AI Engineers build production applications around foundation models and large language models. They turn model capabilities into tools for search, drafting, summarization, information extraction, multimodal work, and guided action...Full time
Opendatajobs
Washington DC1 day ago $140k - $180k
...experiences. Their innovative strategies and solutions securely and rapidly transform the way their clients do business. As a Senior AI Engineer, you will understand how AI is positioned to meet business objectives and then deliver projects for customers as part of a team....Full timeReply
Washington DC1 day ago- ...Description The work AI Engineers build and operate systems that turn data, documents, models, and AI services into useful applications and workflows. The work runs from understanding the problem and preparing inputs through model or service selection, system design...Full time
Opendatajobs
Washington DC1 day ago $150k - $210k
...Enterprise Knowledge (EK) is hiring for a full-time Semantic Data and AI Engineer to join our growing Knowledge and Data Services Sector. In this role, you will be responsible for designing and deploying cutting-edge data discovery, integration, and governance solutions...Remote jobFull timeFor contractorsH1bWork at officeLocal areaEnterprise Knowledge
Arlington, VA1 day ago$220k - $350k
...possible, with the ultimate goal of enabling human life on Mars.SR. AI ENGINEER, SPECIAL PROGRAMS - TOP SECRET CLEARANCESr. AI engineers work... ...audibility.Build internal tooling to streamline workflows and automate repetitive tasks in secure environments.Partner with agency...Permanent employmentTemporary workFor contractorsShift workWeekend work$86.8k - $198k
AI Software Engineer, SeniorThe Opportunity:As an AI software engineer, you know that good software is more than just a nice-looking interface... ...developer tools, including chat-based interfaces or automated coding agentsExperience prototyping, evaluating, and refining...Full timeContract workPart timeWork at officeLocal areaRemote work- ...development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the... ...fast-paced, dynamic environment supporting the development of AI Policy and capabilities. In this role, you will work closely...
$99k - $225k
Agentic AI EngineerThe Opportunity:We are looking for a highly skilled Agentic AI Engineer to join our team, specializing in building autonomous, goal-oriented AI systems. You will play a crucial role in shifting our AI strategy from passive LLM chatbots to proactive,...Full timeContract workPart timeWork at officeLocal areaRemote workShift work$170k - $185k
As Sr. AI Engineer I (Salesforce), you’ll support a Salesforce-centered modernization and digital transformation program. This role will... ...capabilities that accelerate mission outcomes through automation, predictive insights, and human-AI collaboration.The ideal candidate...Full timeLocal area- Analytica is seeking an AI Engineer to support the development of scalable AI applications, text analytics pipelines, and agentic AI solutions that improve taxpayer service, compliance, and internal operational efficiency. This candidate will contribute to the design, development...
- ...development & deployment, targeting & intelligence analysis, systems engineering & integration, and training capabilities and solutions for the... ...-paced, dynamic environment supporting the development of IC AI Policy and capabilities. In this role, you will work closely...
$135k - $216k
ResponsibilitiesPeraton is seeking experienced AI professionals to support the modernization and... ...will support strategic AI initiatives focused on automation, analytics, generative AI, intelligent agents, software engineering, governance, and enterprise modernization...Contract workShift work- Overview/ Job ResponsibilitiesWe are seeking an accomplished AI Requirements Engineer to lead the end-to-end design, development, and... ...to integrate commercial off-the-shelf solutions, APIs, and automation tools.Lead cross-functional teams through sprint planning,...Full time
$220k - $240k
GovCIO is currently hiring an AI Ops Engineer with an active Secret clearance to implement artificial intelligence and automation capabilities within IT operations to improve monitoring, incident response, predictive analytics, and system reliability. This role is based...Currently hiringRemote work$77.6k - $176k
AI EngineerThe Opportunity: As a programmer, you know that machine learning is critical to understanding and processing massive datasets... ...platforms, and various stakeholder needs. As a machine learning engineer on our Global Defense team, you’ll train, test, deploy, and...Full timeContract workPart timeWork at officeLocal areaRemote work- Washington, District of ColumbiaOnsiteDirect Hire$180k - $270kA startup technology company is seeking a Senior AI Engineer to join its team in a fully onsite role in Washington, DC. The ideal candidate will have 5+ years of professional software/ML engineering experience...Full time
- At the SEI AI Division, we conduct research in applied artificial intelligence and the engineering questions related to the practical design and implementation of AI technologies and systems. We currently lead a community-wide movement to mature the discipline of AI Engineering...Full timeWork experience placementWork at office
- ...IDT), a leading defense technology company, is seeking an AI-Native Software Engineer to be part of our Warfare Systems team and based out of our... ...AI developer tooling (agent frameworks, code copilots, automated testing agents)Mentor engineering teams on effective use of...Full timeWork at officeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Automation engineer. Be the first to apply!
Related searches
- ai engineer Washington DC
- machine learning ai engineer Washington DC
- senior ai engineer Washington DC
- ai ml engineer Washington DC
- ai prompt engineer Washington DC
- ai engineer remote Washington DC
- ai developer Washington DC
- autonomous systems engineer Washington DC
- senior marketing automation specialist Washington DC
- senior software test automation engineer Washington DC