Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Safety Evaluation Specialist

$30 per hour
Full-time

Pro Integrate

AI Safety & Evaluation Specialist

Role type: Contractor

Location: United States

Commitment: Part-time, project-based

Duration: 6 weeks

Compensation: $30 $60 USD/hour

Required Skills

privacy risk assessment

data protection

ai evaluation

analytical skills

written communication

About the opportunity

micro1 is looking for privacy and data-protection professionals to evaluate how personal AI agents handle sensitive information.

You'll test AI agents, review their responses, and identify potential privacy violations or inappropriate disclosures. This role is ideal for professionals interested in applying their privacy expertise to AI evaluation.

What you'll do
  1. Test AI agents using privacy-focused scenarios.
  2. Review AI-generated responses for inappropriate disclosures of personal or sensitive information.
  3. Identify privacy risks and potential data-protection violations.
  4. Document findings and provide clear, evidence-based feedback.
  5. Apply privacy principles to evaluate complex or ambiguous cases.
What we're looking for

Required qualifications

  1. Professional experience in privacy, data protection, or related fields.
  2. Strong understanding of privacy risks and sensitive data handling.
  3. Analytical skills, attention to detail, and clear written communication.
  4. Based in the United States.

Preferred qualifications

  1. Experience evaluating LLMs or AI-generated content.
  2. Familiarity with AI agents and AI privacy or safety evaluations.
Application process

Candidates will complete an AI interview after applying. No additional assessments are required.

About micro1

micro1 is a data lab that connects professionals with opportunities to apply their expertise to customer projects. We work with specialists across fields such as engineering, finance, healthcare, and law to support AI labs and enterprises. Through our extended network, contributors bring their knowledge and judgment to projects with their own scope, requirements, and engagement terms.

Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Ai Safety Evaluation Specialist in New York, NY vacancy
  • $30 - $50 per hour

    AI Privacy, Safety And Evaluation Specialist Test personal AI agents and review responses for privacy risks in a six-week, part-time U.S. project paying $30 to $50 per hour. Remote Hourly · $30-$50/hr $30-$50/hr Compensation Contract, part-time Engagement Remote... 
    Suggested
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $75 - $110 per hour

     ...Neurology Evaluation Specialist is a remote clinical-review track for evaluating AI outputs that touch neurology. Reviewers grade differential reasoning, dosing logic, and guideline adherence; flag patient-safety issues; and document the corrected clinical reasoning so... 
    Suggested
    Hourly pay
    For contractors
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    3 days ago
  • Crossing Hurdles is seeking an Image Evaluation Expert for a remote contract role in the United States. You will upload photographs, compare real images with AI outputs, and assess lighting, perspective, and textures to ensure accuracy. You will provide clear, evidence-... 
    Suggested
    Remote job
    Contract work
    10 hours per week

    Crossing Hurdles

    New York, NY
    13 hours ago
  • Softechub is seeking an Image Evaluation Expert to remotely support our AI-driven image assessment projects in the United States. You will rate photos, provide detailed feedback, and help train next-generation AI systems with high-quality real-world input. The role emphasizes... 
    Suggested
    Remote job

    Softechub

    New York, NY
    2 days ago
  • $21 - $35 per hour

    Crossing Hurdles is seeking an Image Evaluation Expert (Visual Arts / Photography) on a remote contract basis. You will upload photos, compare AI-generated images with real photographs, and assess lighting, perspective, and textures to ensure visual accuracy. You will... 
    Suggested
    Remote job
    Hourly pay
    Contract work

    Crossing Hurdles

    New York, NY
    3 days ago
  • $8 - $65 per hour

    Epidemiology Specialist - Freelance AI Trainer Project United States of America Are you a master of epidemiology eager to shape the future of...  ...traces, and suggest improvements to our prompt engineering and evaluation metrics. A PhD degree in epidemiology, public health,... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start

    Meridial

    New York, NY
    2 days ago
  • AuraOne is seeking a Thai bilingual expert to evaluate generalist evaluation prompts and responses remotely. You will compare outputs,...  ...rationale for QA. Applicants should have linguistic or trust & safety review background and be able to work asynchronously. Responsibilities... 
    Remote job
    For contractors

    Auraone

    New York, NY
    3 days ago
  • AuraOne, Inc. is seeking a Domain Contributor Evaluation Specialist for a remote contractor role in the United States. You will review AI outputs against workflows, policy, and stakeholder-fit using a structured rubric, and document the next steps for model training. Responsibilities... 
    Remote job
    For contractors
    10 hours per week

    AuraOne, Inc.

    New York, NY
    13 hours ago
  • $60 per hour

    Prolific is seeking Computer Science Specialists to join our Expert Network to train and evaluate AI models. You’ll complete a quick 10- to 15-minute test and, if successful, join Prolific as a paid participant working from home with flexible hours. Researchers pay for... 
    Remote job
    Work from home
    Flexible hours

    Prolific

    New York, NY
    3 days ago
  • Mercor is hiring bilingual specialists to support safe AI model evaluation. You will use Czech fluency and business English to assess content on sensitive topics and help strengthen model responses. Training is provided, no prior AI/ML experience required. The role is part... 
    Part time
    Immediate start

    Mercor

    New York, NY
    1 day ago
  • $20 - $60 per hour

    AI Question and Answer Evaluation Specialist Create research-backed questions and answers, test AI model responses, and improve evaluation content remotely for $20 to $60 per hour equivalent, paid per task. $20-$60/hr equivalent, paid per accepted task Compensation... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    OpenTrain AI, Inc.

    New York, NY
    4 days ago
  • $45 - $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Jack Dorsey . Position: Behavioral Health Expert, AI Safety and Model Evaluation Type: Contract Compensation: $45–$70/hour Location... 
    Contract work
    Summer work
    Remote work
    Weekday work

    Mercor

    New York, NY
    12 days ago
  • Meridial is seeking independent contractor experts to evaluate AI-generated outputs. You will assess language fluency, customer service judgment, and coding knowledge, focusing on JSON structure, formatting accuracy, and response quality. Responsibilities include reviewing... 
    For contractors

    Meridial

    New York, NY
    13 hours ago
  • OpenTrain AI, Inc. is seeking an Employment and Labor Law AI Evaluation Expert to review AI-generated answers to U.S. employment law scenarios, assess legal accuracy and reasoning, and write feedback to improve models. This 100% remote, part-time freelance role requires... 
    Remote job
    Part time
    Freelance

    OpenTrain AI, Inc.

    New York, NY
    2 days ago
  • $30 - $40 per hour

    211 Specialist, Government Services AI Evaluator Use your experience helping people find public benefits and community resources to evaluate AI answers, write scoring guides, and give precise feedback. This U.S.-based contract role pays $30 to $40 per hour. Remote Hourly... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    Flexible hours

    OpenTrain AI, Inc.

    New York, NY
    13 hours ago
  • YO AI Labs seeks a former U.S. Consular Officer or Passport Specialist to evaluate AI-generated guidance on passport and citizenship matters. This remote, contractor role asks for 20-30 hours per week and leverages your State Department experience to ensure accuracy and... 
    Remote job
    For contractors

    YO AI Labs

    New York, NY
    1 day ago
  • Design and run realistic German customer service role-plays in travel, finance, and tech support. Evaluate AI audio responses using structured criteria for accuracy, naturalness, and task completion. Build high-quality audio datasets that reflect real-world customer expectations... 
    Remote job
    Hourly pay
    Freelance
    Flexible hours

    Jobgether

    New York, NY
    13 hours ago
  • Project Overview We are sourcing independent Audio Evaluation Specialists for an AI benchmark evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this domain - specifically real-world customer support scenarios... 
    Hourly pay
    For contractors
    Freelance
    Remote work

    Agency

    New York, NY
    13 hours ago
  • About the role Meridial seeks independent Audio Evaluation Specialists for an AI benchmark evaluation project. You will design evaluation frameworks, create training data, and audit AI outputs for realistic customer support scenarios across travel, finance, and technical... 
    Hourly pay
    For contractors
    Freelance
    Work at office
    Remote work
    Worldwide

    remote work

    New York, NY
    13 hours ago
  • AuraOne is seeking an AI Agent Evaluator to remotely review and label ai agent evaluation prompts and responses against AuraOne's quality rubric. You will compare outputs, identify edge cases, and provide structured feedback to support retraining. The role focuses on auditing... 
    Remote job

    Auraone

    New York, NY
    1 day ago
  • TaskUs is seeking a Biology Specialist to review flagged biological queries and apply precise labels to train safety filters. You will separate legitimate academic work from potential misuse, generate structured escalations, and collaborate with Senior Specialists in a... 
    Remote job

    TaskUs

    New York, NY
    1 day ago
  •  ...label edge cases, and write structured feedback to retrain models. You will label hallucinations, instruction-following issues, and safety content with tagged categories, and help calibrate ratings via weekly gold-standard comparisons. This independent contractor role... 
    Remote job
    For contractors

    Auraone

    New York, NY
    3 days ago
  • $120k - $170k

     ...together. Role description: Arcadis is seeking a Construction Safety Specialist to work in the NY/NJ area. As a Construction Safety...  ...operations, practices, construction equipment and processes to evaluate effectiveness, adherence with accepted programs, required regulations... 
    Full time
    Contract work
    Part time
    For contractors
    Work at office
    Local area

    ARCADIS

    New York, NY
    2 days ago
  • $38.2 - $57.3 per hour

     ...Department 10122 Enterprise Corporate - Patient Safety Department 10122 Enterprise Corporate -...  ...$38.20 - $57.30 The Patient Safety Specialist is a highly visible position with...  ...management of the data to support site evaluation of safety program outcomes. The Patient... 
    Daily paid
    Full time
    Temporary work
    Part time
    Remote work
    Flexible hours
    Shift work

    Hugh Chatham Health

    New York, NY
    1 day ago
  •  ...Engineering, Inc. (IEI) is looking for an experienced Construction Safety Specialist to join our team and support a major capital construction...  ...representatives, and other project stakeholders. Evaluate contractor construction safety and fire safety programs and... 
    Contract work
    Temporary work
    For contractors
    Work at office
    Local area
    Flexible hours
    Shift work
    Rotating shift
    Afternoon shift

    Infrastructure Engineering

    New York, NY
    2 days ago
  •  ...About the role Calibration Technology Evaluation Specialist is a remote review track for evaluating AI outputs across calibration technology evaluation specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational... 
    Hourly pay
    For contractors
    Work experience placement
    Remote work
    10 hours per week

    AuraOne

    New York, NY
    1 day ago
  • $100k - $125k

     ...Job Title: Senior IT Specialist Location: New York, NY (in-office) Salary: $100K – $125...  ...and outside IT providers • Manage the evaluation, selection, and onboarding process for new...  ..., accounting systems, and legal AI tools • A bachelor’s degree in a computer... 
    Work at office

    Addition Management

    New York, NY
    6 days ago
  •  ...Agency is seeking someone to create and execute role-play-based evaluation scenarios that simulate realistic customer service interactions for advanced agentic audio models. You will help develop diverse and representative datasets and assess model performance using standardized... 

    Agency.com

    New York, NY
    1 day ago
  • $110k - $138k

     ...build and scale intelligent AI, digital, cybersecurity, cloud...  ...doing? The Computer Vision Specialist is a member of WWT’s Global Solutions...  ...a business problem such as safety, quality, throughput, or...  ..., and on how models will be evaluated, optimized for edge deployment... 
    Full time
    Work experience placement
    Remote work
    Flexible hours
    Shift work

    World Wide Technology

    New York, NY
    2 days ago
  • $65k - $75k

     ...are searching for a result-oriented EHS Specialist to join our team at Vantage Elevation. About...  ...of environmental, health, and safety programs. This position assists with regulatory...  ...organized for employee reference. Evaluates and recommends safety equipment, personal... 
    Full time
    Temporary work
    Work at office
    Local area
    Monday to Friday

    Vantage Elevator Solutions

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Safety Evaluation Specialist. Be the first to apply!