AI Testing Architect: Scenario Writing & Evaluation
$80 per hourMind Rift
A leading AI project specialist company is seeking experienced professionals for project-based opportunities. Candidates will focus on reviewing coding tasks, writing comprehensive tests, and analyzing AI model behaviors in a flexible environment. With rates up to $80/hour and the freedom to choose when and how to work, this role is ideal for specialists eager to contribute to innovative AI projects. Applicants should have a degree in Computer Science and extensive experience in software development, particularly in Python and Full-Stack frameworks. #J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Testing Architect: Scenario Writing & Evaluation in Brooklyn, NY vacancy
- ...A research lab in AI consulting is seeking Consulting Experts to refine business challenges... .... In this remote role, you'll create testing scenarios that enhance AI's problem-solving... ...include developing consulting deliverables, writing analytical prompts, and validating AI...SuggestedRemote work
AfterQuery Experts
New York, NY3 days ago - A company specializing in AI technology is seeking detailed-oriented individuals to join their team in training AI... ...schedule. Responsibilities include developing prompts, writing high-quality responses, and evaluating AI models. Ideal candidates should be fluent in English...SuggestedHourly payRemote workFlexible hours
DataAnnotation
New York, NY1 day ago - ...Principal Ai Platforms Architect Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver... ...viable prototypes or proof-of-concepts to test model architectures, RAG flows, and agent orchestration. Evaluate emerging AI frameworks and tools (e.g.,...Suggested
Boston Consulting Group
New York, NY1 day ago $40 per hour
...A leading AI training firm is seeking a Content Developer (Biology) to assist in training AI models. The role involves evaluating AI chatbot outputs and ensuring quality control within various... ...should demonstrate expert writing and editing skills and have a strong...SuggestedHourly payRemote workFlexible hoursDataAnnotation
New York, NY5 days ago- ...A tech-focused research lab is seeking Property Manager Experts to design and evaluate property management challenges for training AI models. This remote role allows you to leverage your expertise in real estate operations while making a significant impact on AI solutions...SuggestedRemote work
AfterQuery Experts
New York, NY3 days ago $20 per hour
...DataAnnotation is committed to creating quality AI. Join our team to help train AI chatbots... ...chatbots. You will develop complex prompts to test AI models, write high-quality responses to demonstrate excellence, and evaluate different model outputs based on accuracy and...Hourly payFull timeContract workPart timeFor contractorsSelf employmentFreelanceRemote workFlexible hoursDataAnnotation
Brooklyn, NY1 day ago$105.6k - $165k
...associated operating environment, evaluating system impacts, determining... .... We are seeking a Architect with strong hands-on experience... ...implementing and integrating AI platforms in alignment with approved... ...Delivery Build, configure, and test integrations between AI...Work at officeFlexible hoursShift workDay shiftBank of America
Jersey City, NJ1 day ago- ...Job Title: Gen AI Leads/Architect Location: NY and Atlanta locations... ...Lead projects where AI writes significant portions of the... ...delivery team Stay current: evaluate new models, frameworks, and... ...Agent Evaluation Testing non-deterministic outputs, guardrails...
Inficare
New York, NY5 days ago - ...employees. Through Genesys Cloud, the AI-powered Experience... ...experience together.The **Genesys AI Architect** is a senior presales AI... ...requirements.* **Establish AI evaluation frameworks and quality measurement... ..., and business impact. Create test sets, evaluation methodologies...Work from homeFlexible hours
$142.6k - $261.5k
...world. ServiceNow– ServiceNow/Moveworks AI Architect Manager In the digital economy, it... ...in selecting methods, techniques, and evaluation criteria for obtaining results.... ...to design, configuration/development, testing and deployment phases Ability to manage...Summer holidayWorldwideFlexible hoursEY
New York, NY4 days ago- ...real estate technology company is seeking remote PhD interns for Summer 2026. Interns will focus on developing innovative evaluation methodologies for AI systems, including metrics for generative models, privacy-preserving evaluation frameworks, and ethical compliance for...Remote jobSummer workInternship
$171.6k - $392.1k
...working world. ServiceNow – ServiceNow AI Architect Senior Manager In the digital... ...enterprise capabilities with ServiceNow or evaluating how AI can streamline service delivery.... ...to design, configuration/development, testing and deployment phases Ability to...Summer holidayWorldwideFlexible hoursEY
Hoboken, NJ1 day ago$182k - $214k
...records to powering the AI revolution in... ...The Integration Architect, MuleSoft Platform... ...— building APIs, writing DataWeave transformations... ...MuleSoft testing and deployment... ...opportunities Evaluate platform upgrades,... ...complex transformation scenarios across diverse data...Contract work$171.6k - $392.1k
...working world. ServiceNow - ServiceNow AI Architect Senior Manager In the digital economy,... ...capabilities with ServiceNow or evaluating how AI can streamline service delivery.... ...to design, configuration/development, testing and deployment phases Ability to manage...Summer holidayWorldwideFlexible hours$203.2k - $239.1k
Senior Architect, Software Engineering, US Are you ready to make an... ...products and agents that use AI including machine learning and... ...gathering, design, development, testing, implementation, and rollout.... ...salaries are determined by evaluating a variety of factors...TraineeshipH1bLocal areaImmediate startRelocationVisa sponsorshipFlexible hours- ...are doing well. Please find the below JD. Title: Gen AI Architect Location: NYC, NY/NJ Type of Hire: Full Time Job Description... ...with state management and high-performance UI rendering Testing & Observability Experience with automated unit and end-to-...Full time
Galent
Jersey City, NJ2 days ago - ...analysis. Responsibilities include designing high-converting landing pages, writing compliant copy, leading projects, and analyzing performance data. The ideal candidate should demonstrate strong A/B testing methodologies and wireframing skills. A competitive salary with...Remote work
MyCareer+
New York, NY3 days ago $156k - $214k
...offer any pricing model, and streamline finance workflows without writing code. Our platform computes millions of invoices per billing... ...Frontend Tools and Frameworks (React, Apollo GraphQL, Webpack, React Testing Library) CI/CD (AWS CodePipeline & CodeDeploy, CircleCI)...Full timeFlexible hoursCloudDevs
New York, NY3 days ago$286.45k - $370.7k
Advisory AI Architect (FDE Unit) Within the Forward Deployment Engineering (FDE) Unit, the Advisory AI Architect is a hands-on technical... ...software engineering practices (e.g., CI/CD, automated testing, observability, DevOps/SRE, infrastructure-as-code) * Experience...Remote workDell
New York, NY2 days ago$111.89k - $218.19k
...as the subject matter expert for securing AI/ML workloads operating within Molina's... ...Partner & Collaborate: Partners with solution architects, technology leaders, business, governance... ...principles and tools for security testing and automation in for Continuous Integration...Temporary workWork experience placementRemote workShift workMolina Healthcare
New York, NY3 days ago$120.7k - $142k
...Description Are you passionate about building AI systems that solve real operational... ...education sector? We're looking for a Senior Architect, AI Systems to lead the vision setting... ...Experience with frequent, incremental code testing and deployment practices Strong...Summer holidayWork at officeLocal areaFlexible hours3 days per weekUncommon Schools
New York, NY2 days ago- ...Automation Architect Exact Work Location NYC, NY Skills Required: Designed /Architected E2E testing of bigger programs with several components involved Core Java... ...Java + Selenium) Relational Databases/ Writing SQL queries BDD Automation of Windows...
ClifyX
New York, NY2 days ago - ...Senior IT Architects - AI Platforms at BCG Platinion Locations: Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit... ...They apply solid AI and software engineering skills to build, test, and improve AI platform capabilities. Comfortable with...Immediate start
Boston Consulting Group
New York, NY2 days ago - ...chaos experiments. In this remote role, you will collaborate on a cloud-native platform that manages millions of devices, focusing on testing to improve reliability and autonomous testing pipelines. Key responsibilities include designing chaos engineering tests using Azure...Remote work
EPAM Systems Inc
New York, NY5 days ago - ...Position: AI/ML Product Architect Location: New York (Hybrid) Position Type: Contract Experience requirements:... ...dev progress with frontend/backend developers and engineers; Testing the product from both AI model performance perspective and...Contract work
Futran Tech Solutions Pvt. Ltd.
New York, NY2 days ago $150k - $170k
...Gen AI Architect (AVP) New York, New York, United States $ 150,000.00 - 170,000.00 (US Dollar) Assistant Vice President, Generative... ...AWS, Azure, GCP, or Nvidia) LLMOps: Expertise in automated testing, CI/CD pipelines for AI projects Leadership &...Inizio Partners
New York, NY2 days ago- ...and build scalable AI‑led ecosystems to accelerate... ...for an IBM MDM ARCHITECT (REMOTE). Major... ...custom extensions. Evaluate and enhance logging... ...Java code, and write unit, integration, and system tests for all Java components... ...‑volume ingestion scenarios (e.g., 200M+ records...Immediate startRemote work
Premier Inn Hotels LLC (UAE)
New York, NY3 days ago - ...Role: Frontend Architect (Angular | AI-Driven Development) Location: Jersey City, New Jersey- USA (Onsite- must go to office) Must... ...user stories into development tasks Automating coding, testing, and integration workflows (SDLC/PDLC) Continuously refine...Work at office
Inficare
Jersey City, NJ1 day ago - ...like Voiceflow and Botpress. The role involves designing prompts, building chatbot flows, and optimizing AI responses. Ideal candidates will have strong prompt writing skills, familiarity with chatbot tools, and a creative approach to AI conversation design. This...Remote work
CoMind Labs
New York, NY5 days ago - ...Competency : Prior experience in building Windows device drivers or low-level IO (LLIO) development Experience in Writing functional, performance and load tests with proper code coverage. Knowledge of NDIS (Network Driver Interface Specification), Windows Driver Kit (WDK)...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Testing Architect: Scenario Writing & Evaluation. Be the first to apply!
