AI Ops Engineer II

IDR is seeking a AI Ops Engineer II to join one of our top clients for a remote opportunity. In this role, youll help design and scale a unified operational AI interface used by IT Operations teams to access infrastructure data, insights, and automation in one centralized platform. Youll partner with AI architects to build foundational integrations and multi-agent workflows that support modern AIOps use cases across enterprise systems.

Position Overview for the AI Ops Engineer II:

• Build and enhance an enterprise operational AI platform that serves as a centralized interface for IT Operations engineers.
• Develop foundational data integrations connecting LLM frameworks to systems like ITSM/CMDB, monitoring, and cloud platforms.
• Design and implement multi-agent reasoning workflows to support incident triage, Help Desk automation, and root cause analysis (RCA).
• Create API-driven services and tooling in Python to connect disparate systems and enable reliable automation.
• Improve data quality, governance, and guardrails to increase AI safety, accuracy, and operational trust.

Requirements for the AI Ops Engineer II:

• 35 years of overall engineering experience, including a strong foundation in backend software engineering, API integration, data engineering, or traditional AIOps
• 12 years of hands-on experience with modern LLMs, prompt engineering, and Retrieval-Augmented Generation (RAG)
• Experience building multi-agent AI systems (e.g., LangChain, AutoGen, CrewAI) and leveraging tool-calling and/or Model Context Protocol (MCP) patterns
• Strong Python development skills with extensive experience building and consuming RESTful APIs
• Familiarity integrating with IT operations systems such as ServiceNow (ticketing/CMDB) and monitoring/telemetry platforms (e.g., Dynatrace, Zabbix) and cloud environments (e.g., GCP)

What's in it for you?

• Competitive compensation package
• Full Benefits; Medical, Vision, Dental, and more!
• Opportunity to get in with an industry leading organization.

Why IDR?

• 25+ Years of Proven Industry Experience in 4 major markets
• Employee Stock Ownership Program
• Dedicated Engagement Manager who is committed to you and your success.
• Medical, Dental, Vision, and Life Insurance
• ClearlyRated's Best of Staffing® Client and Talent Award winner 12 years in a row.
• 58-60/hr 
• #LI-Remote
  
  
  
   

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. IDR is subject to certain governmental recordkeeping and reporting requirements for the administration of civil rights laws and regulations. In order to comply with these laws, we invite employees to voluntarily self-identify their race or ethnicity, gender, and veteran status (if applicable). Submission of this information is voluntary and refusal to provide it will not subject you to any adverse treatment. The information obtained will be kept confidential and may only be used in accordance with the provisions of applicable laws, executive orders, and regulations, including those that require the information to be summarized and reported to the federal government for civil rights enforcement. You may access this form here.