System Architect - AI Reliability Engineer
Virtusa Corporation
DescriptionBuild an automated evaluation harness covering correctness, prompt stability, hallucination, and guardrail enforcement across all production agents.Stand up an LLM-as-judge framework with calibration tests so the judge itself stays honest over time.Run red team and adversarial testing prompt injection, jailbreaks, malformed tool outputs, corrupted upstream data.Build multi-agent chain tests. Single-agent evals miss the cascade failures that happen when one agent feeds another through MCP.Wire all of this into CI so failures block merges, with canary checks and rollback validation for production rollouts.Add cost regression to the pipeline. A prompt change that 3x's token usage should fail CI, not surface in a monthly bill.Instrument observability decision logs, token cost, latency, drift detection, HITL engagement telemetry, and a quality dashboard the team actually uses.Validate that the platform's self-reported confidence scores correlate with real correctness. If they do not, surface it.Build the audit trail so any agent decision can be reproduced from logs within 24 hours Should have good experience in technical Production support as a Architect and Designed and implemented automated evaluation frameworks to validate AI agent correctness, stability, hallucination prevention, and guardrail compliance across production environments. Provide regular status updates and reports to senior management on production health, ongoing incidents, and project progress. Should have good communication skills and strong Technical skills to support and lead a team Job Type: ExperiencedSchedule: Full-timeJob Level: Individual ContributorTravel: NoEmployee Status: Full Time
$113.1k - $232.3k
Position Summary Lead Applied AI Site Reliability Engineer II Role Overview: As a Lead Applied AI Site Reliability Engineer II, you will actively... ...track record in operating high-quality, resilient systems at scale. The ideal candidate will be a role-model leader...SuggestedWork at officeLocal areaVisa sponsorshipFlexible hours3 days per week$150k - $180k
Capstone Investment Advisors is seeking a technically curious Support Engineer to join the Front Office Technology team in New York. The role involves owning the reliability of Keystone, Capstone's trading platform, and engaging in automation through Python tooling and...Suggested$122.5k - $423.78k
...Description & SummaryThe OpportunityAs a Director, Solution Architect, AI-Native Engineering, you will lead the charge in developing innovative... ...within the organization- Balancing strategic choices with system-level enablers to drive change and innovation- Upholding...SuggestedFull timeWork experience placementH1b$201k - $272k
AI Engineers in AWS AI Engineering help customers build and use AI agents... ...and productionize agentic systems using services like Amazon... ...ensure solutions are secure, reliable, and cost-effective. In your... ...role within the Solutions Architect organization. You will maintain...SuggestedFlexible hoursDay shift$95k - $125k
...Thornton Tomasetti applies engineering and scientific principles to solve the world’s challenges... ...Science background to contribute to CORE.AI, a dedicated research and development... ...code-compliant structural components and systems for data set preparation. Use constrained...SuggestedFull timeLocal areaWorldwideFlexible hours$142.32k - $213.48k
...economic value that is systemically responsible and in our... ...through secure, reliable, and efficient services... ...Senior GenAI Platform Engineer to spearhead the design... ...cutting-edge Generative AI platforms. This role is... ...lines of business by architecting and delivering high-impact...Full time- AI/ML Engineer**** Please note: This role is not eligible for 100% remote work. Employees must live within a commutable distance of a Slalom... ...in areas such as Computer Vision, NLP, Recommendation Systems, etc.* Stay updated on fundamental AI/ML concepts and emerging...Temporary workWork at officeLocal area3 days per week
- ...'s leading financial institutions.As a AI/ML Engineering Associate at JPMorgan Chase within the... ...validation roadmap across Business Banking.Architect and embed end‑to‑end AI checks into... ...Integrate with upstream and downstream systems to ensure seamless tooling and support...
$220k - $260k
...been abused by bad actors, and AI is making it exponentially... ...to bring on an additional AI Engineer to partner with our current AI... ...Engineer. You'll build the ML systems that make Cinder faster, more... ...smallest, most efficient, most reliable model for the job, and understanding...Full timeWork at officeRelocation$182.4k - $250.6k
...hardware and battery systems to intuitive design, intelligent... ...? Join the Embodied AI team at General Motors... ...that support safe and reliable autonomous vehicle... ...AI/ML Future Sensing Engineer in the Embodied AI... ...evaluation Experience with architecting sensory systems or...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$155k - $215k
...our communities. This is a Generative AI & Machine Learning Engineering position at the Vice President level... ...results in quantitative trading systems, cutting-edge modeling and simulation... ...concept through production deployment. Architect scalable, secure, and resilient AI...Temporary workWorldwide- ...digital, cloud, data, and AI capabilities, drawing on... ...value.By combining hands-on engineering with deep industry... ...the full back-end stack — architecting APIs, building data pipelines... ...multi-modal database systems, and owning the reliability and performance of the services...Full timeWork experience placementLive inWork at officeLocal area
- Job Description:This is a fullstack engineering role with a strong frontend emphasis. You’ll have ownership across the product stack, from users interfaces to infrastructure supporting AI models. Location: New York, NY or Boston, MA or San Francisco, CA (3 days/week)Salary...3 days per week
$155k - $195k
OVERVIEWThe AI/Legal Workflow Engineer designs, develops, and improves AI-powered workflows for legal practice groups. The role focuses on prompt... ...vendors and internal technology teams to provide feedback on system performance, identify enhancement opportunities, and...Work at office- As a Senior AI Engineer at Intapp, you’ll work on an AI-powered, industry-specific cloud platform... ...You’ll Do:Develop and maintain AI agent systems using LangGraph and LangChain to support... .... Translate business problems into reliable AI-driven processes by combining LLM reasoning...Full timeWork at officeLocal areaFlexible hours
- ...product management, design, and engineering together with the autonomy to... ...Are You are an exceptional AI-native software engineer who... ...fundamentals with product judgment, systems thinking, and a high bar for... ...the architecture, security, reliability, and quality of the product....Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
- ...succeed in college and in life. We now need a results-driven AI Software Engineer/ Integration Specialist to join our AI Enablement team.... ...to play a critical role in connecting AI tools with school systems. This role ensures that AI-powered solutions seamlessly integrate...Visa sponsorship
$123k - $215.25k
...benefitsJob Function: Engineering & ArchitectureSchedule... ....At American Express, AI is reshaping the future... ...enable agentic AI systems to operate responsibly... ...security, explainability, reliability, and compliance... ...gracefully from failure.Architect and implement production...Visa sponsorship$150k - $215k
...communities. This is a Lead Software Engineering position at the Vice... ...Analytics, Machine learning and Gen AI Platform team(s), across... ...for building autonomous systems that can reason, use tools, and... ...Operationalize distributed, scalable, and reliable data flows that ingest,...Temporary work- VP - AI/ML Engineer - Compliance EngineeringYOUR IMPACTAre you passionate about leveraging... ...of our team, you will:Design and architect scalable and reliable end-to-end AI/ML solutions... ...architecture design for distributed systems.Experience with data governance and...
$139.1k - $231.9k
...innovative and technically accomplished AI/ML Engineering leader to accelerate the... ...and advance knowledge graphs, retrieval systems, and graph-RAG capabilities that enable... ...focused environmentProven experience architecting and implementing data-intensive AI/ML...Permanent employmentFull timeH1bLocal areaVisa sponsorshipWork visaRelocation package2 days per week$133k - $166k
Job Description & ResponsibilitiesPersistent Systems is looking for an AI Engineer to design, build, and deploy secure AI applications that help employees... ...with business and technical teams to turn ideas into reliable AI solutions using modern generative AI, retrieval-...Flexible hours$128k - $252.5k
...executives and data scientists to AI strategists, machine learning specialists, and data engineers. SFL Scientific, a Deloitte... ...and clinical trials, autonomous systems and edge AI, and renewable energy... ...The Team Our Strategy offering architects bold strategies to achieve...Local areaVisa sponsorship$194k - $235k
...Monstro is a governed AI platform for regulated... ...this possible is how the system is built. Every recommendation... ...Applied AI Software Engineer to support our AI team... ...real scope: you'll architect and ship systems that power... ...that makes them reliable and auditable in production...Full time$157.04k - $235.56k
...Description Citi Wealth is seeking a highly experienced Senior AI/AML Engineering hands on senior engineer of enterprise-grade GenAI and... ...for designing, implementing, and scaling LLM-powered systems using modern agent frameworks, including ADK (Agent Development...Full time$185k - $200k
...Learn about the Danaher Business System which makes everything possible. The Senior Legal Engineer is responsible for designing, building, and deploying AI-powered solutions that transform legal... ...that legal teams trust and adopt.Architect and build AI-powered legal...Full timeContract workRemote workWork from homeFlexible hours$175k - $250k
AI EngineerAbout MillenniumMillennium is a global, diversified... ...and advanced proprietary systems that support the firm’s active... ...solution quality, robustness, reliability, and business impactPartner closely... ...with product managers, data engineers, and business stakeholders to...Flexible hours$125k - $150k
...work in the interest of our team. SUMMARY The AI Engineer builds agent-based systems and intelligent workflows that power Brooklyn Sports &... ...dashboards, and operational data platforms . Implement reliable tool-calling patterns that allow agents to safely...Full timeWork at officeLocal area$123k - $215.25k
...commitment to back the broader engineering community through open source... ...you. At American Express, AI is reshaping the future of commerce... ...that enable agentic AI systems to operate responsibly and at... ...for security, explainability, reliability, and compliance required in...Full timeWork at officeLocal areaFlexible hours$120k - $170k
...communities. This is a Software Engineering III position at the Director... ...We are looking for a Senior AI Software Engineer with 7 to 1... ...complex production systems, support pricing and trading... ...while incrementally improving reliability, testability, and maintainability...Full timeContract workTemporary work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to System Architect - AI Reliability Engineer. Be the first to apply!
- salesforce technical architect New York, NY
- pega system architect New York, NY
- technical architect New York, NY
- system architect New York, NY
- servicenow technical architect New York, NY
- embedded systems architect New York, NY
- system engineer remote New York, NY
- senior windows systems engineer New York, NY
- systems engineer intern New York, NY
- senior linux systems engineer New York, NY
