Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Italian AI QA Specialist: JSON & Real-Time Evaluations

Lifted (Upwork)

Lifted is seeking Italian-speaking coding experts to support the evaluation and improvement of AI-generated audio responses. You will review live transcripts, assess language quality, technical accuracy, and JSON structure, and provide clear written justifications. The role emphasizes real-time, natural responses with no pre-planned scripts. Projects run 2–3 months, with flexible scheduling. Fluent Italian and strong JSON literacy are required; additional languages are a plus. #J-18808-Ljbffr Lifted (Upwork)

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Italian AI QA Specialist: JSON & Real-Time Evaluations in New York, NY vacancy
  • Participating in live, real-time conversational scenarios with AI systems Reviewing and labeling...  ...transcripts Evaluating AI-generated responses using...  ...accuracy, formatting, and JSON structure Capturing required...  ...Enterprise clientis seeking Italian-speaking coding experts... 
    Italian language skills

    Lifted (Upwork)

    New York, NY
    1 day ago
  • Patrique Mercier Recruitment By Nellie is seeking an Italian Speaking In-Game Support Analyst to assist Italian-speaking players with real-time support via chat, email, and forums. You will troubleshoot gameplay and account issues and document cases in the ticketing system... 
    Italian language skills

    Employers from Greece

    New York, NY
    3 days ago
  • $30 per hour

    RWS Group offers a flexible, part-time evaluator position focused on improving AI data for search engines. Work from home in Switzerland with a weekly 5-20 hour commitment, requiring English and Italian proficiency and the ability to sign an NDA. Compensation is up to... 
    Italian language skills
    Remote job
    Hourly pay
    Part time
    Freelance
    Work from home
    Flexible hours

    RWS

    New York, NY
    1 day ago
  • $30 per hour

    RWS Group is seeking a web-savvy evaluator to refine search results by reviewing text,...  ...images and videos, helping to improve AI data used by major search engines. This flexible, part-time, remote role requires English and Italian proficiency, and residence in Switzerland... 
    Italian language skills
    Remote job
    Part time
    Freelance
    Flexible hours

    OpenKrill

    New York, NY
    2 days ago
  • $200k - $300k

     ...Job Description Job Description Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing...  ...behavior. Create scalable testing and evaluation frameworks incorporating A/B testing, regression testing, conversation QA, benchmarking, and KPI measurement.... 
    Suggested
    Permanent employment
    Full time
    Relocation
    Visa sponsorship

    HireNow Staffing

    New York, NY
    11 days ago
  •  ...‑month, independent contractor engagement to contribute to an AI evaluation project. Review AI‑generated content, annotate language data,...  ...linguistics, translation, or related backgrounds, professional fluency in Italian, and the ability to work eight‑hour #J-18808-Ljbffr Dorado
    Italian language skills
    For contractors

    Dorado

    New York, NY
    2 days ago
  • $85 per hour

    AuraOne is seeking a Medicare Enrollment Specialist - Remote AI Review to join as a contractor, enabling rapid evaluation of AI outputs across enrollment workflows. You...  ...paths while noting gaps for improvement in real-time. The role requires precise reasoning, attention... 
    Remote job
    Hourly pay
    For contractors
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  •  ...is not a traditional annotation role; you will evaluate AI outputs, flag gaps, and help improve system performance in real-world scenarios, where data quality, model evaluation...  ...intersect. This is a 100% onsite, full-time position with 40 hours per week. Candidates must... 
    Full time

    Welocalize, Inc.

    New York, NY
    3 days ago
  •  ...This 100% onsite role focuses on evaluating AI outputs, identifying gaps, and improving model behavior in real-world scenarios. German...  ...excel in this human-in-the-loop QA environment. Location-friendly...  ...other U.S. hubs; hours are full-time, 40 hours weekly, with W2 full... 
    Full time
    Remote work

    Welo Data

    New York, NY
    1 day ago
  • $30 - $60 per hour

    Jobgether SRL in the United States seeks a remote, contract-based role to design realistic medical tasks for evaluating AI in healthcare. This part-time position offers about 20 hours per week and remote work flexibility. You will create tasks involving clinical analysis... 
    Remote job
    Hourly pay
    Contract work
    Part time

    Jobgether SRL

    New York, NY
    3 days ago
  • Taxo.ai, Inc. in New York City is seeking a Senior Software Engineer (Voice AI) to own core voice-runtime services for production healthcare...  ...and backend pipelines, integrate with EHR connectors, and ship real-time voice AI systems that improve patient interactions. #J-18808-... 

    Taxo.ai, Inc.

    New York, NY
    1 day ago
  •  ...City is seeking a Senior Speech Software Engineer to drive both the infrastructure and applied speech intelligence behind our real-time voice AI platform. This role sits at the intersection of speech research, model optimization, and production engineering, ensuring... 

    ASAPP

    New York, NY
    4 days ago
  • Cloaked is building a cyber expert at your side, with a real-time voice AI product called Call Guard. We seek a Senior Software Engineer to own major parts of the stack, from voice agent design to adversarial robustness, in a fast-paced, privacy-focused environment. You... 
    Remote job

    Cloaked

    New York, NY
    3 days ago
  • $21.5 per hour

     ...possible Help Shape the Future of AI We are seeking detail-...  ...interest in digital marketing to evaluate and improve real-world AI business solutions....  ...skills in both Italian and English. 4 hours per day...  ...What we offer $21.50/hour with timely payments (Remote, part-time... 
    Italian language skills
    Part time
    Work at office
    Local area
    Immediate start
    Remote work
    Monday to Friday
    Flexible hours

    Aitrainer

    New York, NY
    2 days ago
  • $30 per hour

    BANGLA AI EVALUATION SPECIALIST Up to $30/hr Depending on the project Bachelor's Remote Part-time Flexible hours Opportunity Overview Handshake is looking for Bangla speakers as...  ...Handshake's annotation platform using your own real-world experience with AI tools Compare and... 
    Part time
    Local area
    Remote work
    Flexible hours

    Handshake

    New York, NY
    3 days ago
  •  ...Do Author task scenarios grounded in real work — e.g., drafting a listing presentation...  ...deliverable should include Grade AI-generated deliverables (often Word documents...  ...part in calibration sessions with other evaluators to align scoring standards Preferred Qualifications... 
    Temporary work
    Flexible hours

    Rise Data Labs

    New York, NY
    7 days ago
  • RWS Group is seeking a self-motivated evaluator to help refine search quality for global AI systems. You will assess everyday queries, provide precise feedback...  ...home-based hours (5-20 per week) with English and Italian language requirements, and training to get you started... 
    Italian language skills
    Remote job
    Part time
    Work from home
    Flexible hours

    RWS

    New York, NY
    1 day ago
  •  ...В составе Muse Group — Hal Leonard, публикующий нотные издания и образовательные материалы по всему миру. Задачи включают работу по QA моделей и разметке данных в области нотной записи и аудио, а также помощь в улучшении моделей и создании качественных золотых наборов... 

    Muse Group

    New York, NY
    1 day ago
  •  ...contributing to curriculum evolution. Ideal candidates will have experience teaching working professionals in tech, strong communication skills, and a learner-first mindset, with a willingness to work some weekends/evenings in Pacific time as #J-18808-Ljbffr Interview Kickstart
    Part time
    Weekend work
    Afternoon shift

    Interview Kickstart

    New York, NY
    2 days ago
  • $18 per hour

     ...Role Annotation is what helps AI make sense of the world. As an...  ...rating AI‑generated content, evaluating factual accuracy, or comparing...  ...have advanced proficiency in Italian (C1 or above) and a B2 level of...  ...project needs Take part in a part‑time, remote, freelance project... 
    Italian language skills
    Part time
    Freelance
    Internship
    Remote work

    Toloka Annotators

    New York, NY
    4 days ago
  • Mercor is seeking native Brazilian Portuguese speakers to evaluate AI-narrated audiobooks. You will listen with a critical ear, flag where...  ...slips, and help improve the underlying models. This remote, part-time role is about 20 hours per week, with flexibility on schedule.... 
    Remote job
    Part time

    Mercor Inc

    New York, NY
    2 days ago
  • $60 - $90 per hour

     ...Role We are looking for a Technical CRM & QA Specialist to support the reliable execution of our...  ...reach the intended audiences at the right time. This is a part-time contract role...  ...Working knowledge of REST APIs, webhooks, JSON payloads, and data flows into CRM platforms... 
    Remote job
    Hourly pay
    Contract work
    Part time
    10 hours per week
    Flexible hours

    TIA Inc

    New York, NY
    4 days ago
  • $50 per hour

     ...science/engineering professionals fluent in Mandarin to train and evaluate AI agents on realistic tasks. This remote, part-time role focuses on building prompts, workspaces, and grading rubrics based on real stem work from mainland China. The ideal candidate has 5+ years... 
    Remote job
    Part time

    Mercor

    New York, NY
    1 day ago
  • About the Opportunity A leading AI research organization is seeking...  ...importantly) plugins/connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle...  ...Notion, and similar tools, multiple times a week Heavy personal usage of... 
    Trial period

    Mercor

    New York, NY
    5 days ago
  •  ...seeking experienced Project Management Specialists to evaluate and improve AI-driven project plans and workflows....  ...communications, applying your real-world coordination across schedules,...  ...technical projects.This remote, part-time role starts immediately for about 4-... 
    Hourly pay
    Part time
    Immediate start
    Remote work

    Mercor

    New York, NY
    3 days ago
  •  ...Job Title AI Evaluation Engineer Location Hybrid / Remote...  ...Employment Type Full-time Job Summary...  ...scientists, product managers, and QA teams throughout the AI development...  ...and CI/CD REST APIs JSON AI evaluation frameworks... 
    Full time
    Remote work

    Ova Technologies

    New York, NY
    3 days ago
  • Prolific is seeking a Customer Support & Experience - AI Training specialist to help train and evaluate AI models using real service expertise. You will evaluate AI chatbot...  ..., and label sentiment to uphold professional QA standards; a PayPal account is required to receive... 
    Remote job
    Hourly pay
    Work from home
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • $30 per hour

    Prolific is hiring for Customer Support Representatives to join our Expert Network, helping train and evaluate AI models using real service expertise. If successful, you’ll be invited to join Prolific as a participant and get paid to train AI systems. Researchers paying... 
    Remote job
    Hourly pay

    Prolific

    New York, NY
    4 days ago
  • Prolific is seeking Customer Support Representatives to join our Expert Network to help train and evaluate AI models using real service expertise. If successful, you’ll be invited to join Prolific as a participant, where you’ll get paid to train and evaluate powerful AI... 
    Remote job
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • $85k - $115k

    Job Title AI Application QA Specialist Job Description FortiOS Release QA team in Burnaby has over 90 staff...  ...the testing lifecycle, ensuring timely resolution. Required Skills and Qualifications...  ...workflows (LLMs, prompt engineering, evaluation pipelines) and common data tools (for... 
    Full time
    Worldwide
    Flexible hours

    Virtue AI

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Italian AI QA Specialist: JSON & Real-Time Evaluations. Be the first to apply!