System Architect - AI Reliability Engineer
Virtusa Corporation
DescriptionBuild an automated evaluation harness covering correctness, prompt stability, hallucination, and guardrail enforcement across all production agents.Stand up an LLM-as-judge framework with calibration tests so the judge itself stays honest over time.Run red team and adversarial testing prompt injection, jailbreaks, malformed tool outputs, corrupted upstream data.Build multi-agent chain tests. Single-agent evals miss the cascade failures that happen when one agent feeds another through MCP.Wire all of this into CI so failures block merges, with canary checks and rollback validation for production rollouts.Add cost regression to the pipeline. A prompt change that 3x's token usage should fail CI, not surface in a monthly bill.Instrument observability decision logs, token cost, latency, drift detection, HITL engagement telemetry, and a quality dashboard the team actually uses.Validate that the platform's self-reported confidence scores correlate with real correctness. If they do not, surface it.Build the audit trail so any agent decision can be reproduced from logs within 24 hours Should have good experience in technical Production support as a Architect and Designed and implemented automated evaluation frameworks to validate AI agent correctness, stability, hallucination prevention, and guardrail compliance across production environments. Provide regular status updates and reports to senior management on production health, ongoing incidents, and project progress. Should have good communication skills and strong Technical skills to support and lead a team Job Type: ExperiencedSchedule: Full-timeJob Level: Individual ContributorTravel: NoEmployee Status: Full Time
$113.1k - $232.3k
Position Summary Lead Applied AI Site Reliability Engineer II Role Overview: As a Lead Applied AI Site Reliability Engineer II, you will actively... ...track record in operating high-quality, resilient systems at scale. The ideal candidate will be a role-model leader...SuggestedWork at officeLocal areaVisa sponsorshipFlexible hours3 days per week$150k - $180k
Capstone Investment Advisors is seeking a technically curious Support Engineer to join the Front Office Technology team in New York. The role involves owning the reliability of Keystone, Capstone's trading platform, and engaging in automation through Python tooling and...Suggested$122.5k - $423.78k
...Description & SummaryThe OpportunityAs a Director, Solution Architect, AI-Native Engineering, you will lead the charge in developing innovative... ...within the organization- Balancing strategic choices with system-level enablers to drive change and innovation- Upholding...SuggestedFull timeWork experience placementH1b$201k - $272k
AI Engineers in AWS AI Engineering help customers build and use AI agents... ...and productionize agentic systems using services like Amazon... ...ensure solutions are secure, reliable, and cost-effective. In your... ...role within the Solutions Architect organization. You will maintain...SuggestedFlexible hoursDay shift$142.32k - $213.48k
...economic value that is systemically responsible and in our... ...through secure, reliable, and efficient services... ...Senior GenAI Platform Engineer to spearhead the design... ...cutting-edge Generative AI platforms. This role is... ...lines of business by architecting and delivering high-impact...SuggestedFull time- AI/ML Engineer**** Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of a Slalom... ...in areas such as Computer Vision, NLP, Recommendation Systems, etc.* Stay updated on fundamental AI/ML concepts and emerging...Temporary workWork at officeLocal area3 days per week
- ...'s leading financial institutions.As a AI/ML Engineering Associate at JPMorgan Chase within the... ...validation roadmap across Business Banking.Architect and embed end‑to‑end AI checks into... ...Integrate with upstream and downstream systems to ensure seamless tooling and support...
$182.4k - $250.6k
...hardware and battery systems to intuitive design, intelligent... ...? Join the Embodied AI team at General Motors... ...that support safe and reliable autonomous vehicle... ...AI/ML Future Sensing Engineer in the Embodied AI... ...evaluation Experience with architecting sensory systems or...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$155k - $215k
...our communities. This is a Generative AI & Machine Learning Engineering position at the Vice President level... ...results in quantitative trading systems, cutting-edge modeling and simulation... ...concept through production deployment. Architect scalable, secure, and resilient AI...Temporary workWorldwide- ...digital, cloud, data, and AI capabilities, drawing on... ...value.By combining hands-on engineering with deep industry... ...the full back-end stack — architecting APIs, building data pipelines... ...multi-modal database systems, and owning the reliability and performance of the services...Full timeWork experience placementLive inWork at officeLocal area
$120k - $165k
...communities. This is a Software Engineering III position at the Director... ..., Machine learning and Gen AI Platform team(s), across multiple... ...for building autonomous systems that can reason, use tools, and... ...distributed, scalable, and reliable data flows that ingest, process...Temporary work$200k - $250k
...States Permanent Senior AI EngineerLocation: New York,... ...are looking for a Senior AI Engineer to help design and deliver the... ...and implement multi-agent systems that can retrieve information... ...management systemsImprove the reliability, scalability, and performance...Permanent employment- Job-ID31175163Reference25-262131TypeContract Job Title: AI Engineer Employment Type: Contract (W2 Only) Number of Positions: 4... ...engineering, and DevOps practices, with the ability to design reliable and scalable systems.Key ResponsibilitiesBuild and orchestrate agentic...Contract work
$110.7k - $218.3k
Position Summary Our Deloitte AI & Engineering team works to transform technology platforms, drive innovation, and help make a significant... ...issues, and implement enhancements to improve accuracy, reliability, and scalability A successful candidate would possess these...Local area$182k - $242k
CoreWeave is The Essential Cloud for AI. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools,... ...March 2025. Learn more at .About the Role:As a Software and AI Engineer, IT Systems, you’ll design and develop AI agents and first-party...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- Firm Deployed Engineers come from the industries Intapp serves. You have practiced law, executed... .... Shape product - Work with the Industry Architects, Industry Principals and Product leaders... ...a live build. A real pull toward where AI is taking professional work, and the...Full timeLocal areaFlexible hours
$198k - $247.5k
...largest enterprises.About Forward Deployed Engineering (FDE) at ClouderaCloudera’s Forward... ...Engineering (FDE) function sits within the Applied AI organization, and is a specialized AI/ML... ...to demonstrate how AI and agentic systems solve real enterprise use casesPartner with...Full timeRemote workWork from homeRelocation$137.4k - $161.7k
Are you ready to make an impact?Senior AI Software Engineer - Technology & Experience (TechEx) West Monroe is seeking a Senior AI Software Engineer... ...technical challenges, and want to build modern software systems from concept through production. What You’ll Do Design,...Local areaImmediate startFlexible hours- ...25701612Reference Number: 25-00639Title: AI EngineerLocation: NYC, NY, 08830Posted Date... ...06-12Company: HAN Staffing Job Title: AI Engineer - Azure AI Foundry & LLM... ...Augmented Generation (RAG) and multi-agent systems into real-world applications.Key ResponsibilitiesAI...
$160k - $310k
...annum New York, United States Permanent Senior AI Software Engineer (New York City)OverviewMy client, is seeking a Senior AI Software... ..., and deploying cutting-edge Generative AI (GenAI) systems, integrating diverse data sources, and collaborating closely...Permanent employment$204k - $255k
Joining Collibra’s Unstructured AI TeamWork at the forefront of context engineering - shaping how AI systems retrieve, structure, and... ...that solve for data at scale, architecting the high-performance... ...required to deliver accurate, reliable results.Compensation for this...Work experience placementWork at officeFlexible hours2 days per week$120k - $165k
...communities. This is a Software Engineering position at the... ...Risk of the Firm. Our systems support daily risk... ...development of Python-based AI applications and... ...accountable for production, reliability, and evolution of AI... ...-service analytics.Architect and manage RESTful services...Temporary work$123k - $215.25k
...benefitsJob Function: Engineering & ArchitectureSchedule... ....At American Express, AI is reshaping the future... ...enable agentic AI systems to operate responsibly... ...security, explainability, reliability, and compliance... ...gracefully from failure.Architect and implement production...Visa sponsorship$139.1k - $231.9k
...innovative and technically accomplished AI/ML Engineering leader to accelerate the... ...and advance knowledge graphs, retrieval systems, and graph-RAG capabilities that enable... ...focused environmentProven experience architecting and implementing data-intensive AI/ML...Permanent employmentFull timeH1bLocal areaVisa sponsorshipWork visaRelocation package2 days per week$155k - $195k
OVERVIEWThe AI/Legal Workflow Engineer designs, develops, and improves AI-powered workflows for legal practice groups. The role focuses on prompt... ...vendors and internal technology teams to provide feedback on system performance, identify enhancement opportunities, and...Work at office- Job Description:This is a fullstack engineering role with a strong frontend emphasis. You’ll have ownership across the product stack, from users interfaces to infrastructure supporting AI models. Location: New York, NY or Boston, MA or San Francisco, CA (3 days/week)Salary...3 days per week
- As a Senior AI Engineer at Intapp, you’ll work on an AI-powered, industry-specific cloud platform... ...You’ll Do:Develop and maintain AI agent systems using LangGraph and LangChain to support... .... Translate business problems into reliable AI-driven processes by combining LLM reasoning...Full timeWork at officeLocal areaFlexible hours
- ...product management, design, and engineering together with the autonomy to... ...Are You are an exceptional AI-native software engineer who... ...fundamentals with product judgment, systems thinking, and a high bar for... ...the architecture, security, reliability, and quality of the product....Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
- ...succeed in college and in life. We now need a results-driven AI Software Engineer/ Integration Specialist to join our AI Enablement team.... ...to play a critical role in connecting AI tools with school systems. This role ensures that AI-powered solutions seamlessly integrate...Visa sponsorship
$150k - $215k
...communities. This is a Lead Software Engineering position at the Vice... ...Analytics, Machine learning and Gen AI Platform team(s), across... ...for building autonomous systems that can reason, use tools, and... ...Operationalize distributed, scalable, and reliable data flows that ingest,...Temporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to System Architect - AI Reliability Engineer. Be the first to apply!
- salesforce technical architect New York, NY
- pega system architect New York, NY
- technical architect New York, NY
- system architect New York, NY
- servicenow technical architect New York, NY
- embedded systems architect New York, NY
- system engineer remote New York, NY
- senior windows systems engineer New York, NY
- systems engineer intern New York, NY
- senior linux systems engineer New York, NY
