Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Adversarial Prompt Specialist for AI Model Evaluation

$65 per hour

SaidGig

Adversarial Prompt experts engage in project-based work aimed at probing large language models for potential failure modes and harmful outputs. This role involves crafting prompts and scenarios designed to test model guardrails, exploring innovative methods to bypass restrictions, and systematically documenting the outcomes of these tests. You will adopt an adversarial mindset to identify weaknesses in the models, collaborating closely with engineers and safety researchers to share your findings and enhance system defenses. Key Responsibilities

  • Develop prompts and scenarios to evaluate the robustness of large language models.
  • Investigate and document failure modes and harmful outputs.
  • Collaborate with engineers and safety researchers to improve model defenses.
  • Explore creative strategies to bypass existing restrictions.
Qualifications
  • Experience with large language models and their applications.
  • Strong analytical skills and an understanding of adversarial testing.
  • Ability to document findings clearly and effectively.
  • Excellent collaboration skills to work with technical teams.
Work Terms

Part-time remote position with flexible hours.

Compensation

Up to $65/hr (depending on the project).

Eligibility

Open to applicants with relevant experience in AI and machine learning.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Adversarial Prompt Specialist for AI Model Evaluation in United States vacancy
  • $80 - $110 per hour

     ...Join a leading AI lab''s cutting-edge GenAI team to be at the core of the AI revolution, where your expertise...  ...fuels the development of the most advanced AI models. Overview A leading AI lab is building and evaluating frontier models and needs experienced computer vision... 
    Suggested
    Hourly pay
    Part time
    Work at office
    Remote work

    SaidGig

    United States
    3 days ago
  • $20 per hour

     ...technology firm is seeking remote workers to help train AI chatbots. Ideal candidates are analytical and detail-...  ...communications. Responsibilities include developing prompts, writing responses, and evaluating AI models. This role offers flexibility to choose projects and... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    Freelance

    DataAnnotation

    New York, NY
    2 days ago
  • $20 per hour

    A tech-driven AI company seeks individuals in the United States to join its team for a remote role teaching AI chatbots. The position focuses on developing prompts, writing high-quality responses, and evaluating AI performance. Candidates should preferably hold a bachelor... 
    Suggested
    Remote job
    Hourly pay
    Contract work

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $20 per hour

    A leading AI company is seeking analytical and detail-oriented individuals for remote roles in training AI chatbots. In this independent contractor position, you will create prompts, write responses, and evaluate AI outputs. Ideal candidates must be fluent in English,... 
    Suggested
    Remote job
    Hourly pay
    For contractors

    DataAnnotation

    Hartford, CT
    4 days ago
  • A technology company based in Washington is looking for an Analyst to train AI models. The role involves providing complex mathematics problems to AI chatbots and evaluating their outputs for correctness. Candidates should possess expert mathematical reasoning skills with... 
    Suggested
    Remote job
    Hourly pay
    Contract work
    Flexible hours

    DataAnnotation

    Washington DC
    22 hours ago
  • $20 per hour

    A innovative tech company in the United States is seeking remote workers to help train AI chatbots. This role involves writing high-quality responses, evaluating different model outputs, and requires strong writing and research skills. Ideal candidates are analytical and... 
    Remote job

    DataAnnotation

    Providence, RI
    4 days ago
  • $230k - $285k

     ...Technical Program Manager – Adversarial Model Research Human Data - San Francisco About...  ...and mitigating risks in advanced AI systems by designing evaluations, surfacing vulnerabilities, and collaborating...  ...with large language models, prompt engineering, or model evaluation... 
    Work at office
    Relocation package

    OpenAI

    Los Angeles, CA
    1 day ago
  • $75 per hour

     ...Collections Managers, and Librarians, play a crucial role in evaluating AI models within their fields. This position allows you to utilize...  ...various areas of expertise. Key Responsibilities Develop prompts for AI models that accurately reflect your field. Evaluate... 
    Part time
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • A leading AI company is seeking a Biology Specialist to help fine-tune large language models. Ideal candidates will be pursuing or hold a Ph.D. in Biology or a related field and possess strong research skills. The role involves solving complex biological problems and collaborating... 
    Remote job

    Turing

    Boston, MA
    20 days ago
  • $130 - $180 per hour

     ...expertise in Cardiology to train advanced AI models. This role offers a unique opportunity...  ...through the design of clinical scenarios and evaluation of model outputs against evidence-based...  ...Design clinically realistic prompts and scenarios based on your Cardiology practice... 
    Hourly pay
    Weekly pay
    Work at office
    Remote work

    SaidGig

    United States
    11 days ago
  • $130 - $180 per hour

     ...Join a pioneering initiative to enhance AI''s understanding of mental health care...  ...involves designing clinical scenarios, evaluating AI model outputs, and contributing to the development...  ...Design clinically realistic prompts and scenarios based on your Psychiatry... 
    Hourly pay
    Weekly pay
    Work at office
    Remote work

    SaidGig

    United States
    11 days ago
  •  ...clinical expertise to contribute to AI research projects that enhance...  ...practices. This role involves evaluating AI-generated content based on...  ..., and helping to refine AI models relevant to your field. The...  ...structured feedback. Develop prompts that accurately reflect real-... 
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • $90 per hour

     ...Sociology professionals can apply their expertise to evaluate and enhance AI models in a temporary research project. This role allows you to leverage...  ...tasks and language. Key Responsibilities Develop prompts for AI models that accurately reflect sociological concepts... 
    Temporary work
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • Medical Professionals can apply their expertise to evaluate AI models and enhance their understanding of healthcare tasks and terminology. This role involves assessing content relevant to your field and providing clear, structured feedback to improve AI performance. No... 
    Hourly pay
    Temporary work
    Part time
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • $50 - $75 per hour

    A leading tech company based in Australia is seeking an AI Model Evaluator on a contract basis. The role involves evaluating AI-generated responses, writing prompts, and providing justifications based on specific criteria. Ideal candidates will hold a Master's degree in... 
    Hourly pay
    Contract work

    Mercor

    San Francisco, CA
    2 days ago
  • $120 per hour

     ...airspace and on the ground. In this temporary AI research project, you will utilize your professional expertise to evaluate AI models relevant to your field, assess content, and...  .... Key Responsibilities Develop prompts for AI models that accurately reflect air traffic... 
    Temporary work
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • Nuclear professionals can apply their expertise to evaluate AI models and enhance their understanding of industry-specific tasks and language. This role involves assessing content related to your field and providing structured feedback to improve AI research outcomes.... 
    Temporary work
    Part time
    Remote work

    SaidGig

    United States
    2 days ago
  • $20 per hour

     ...DataAnnotation is committed to creating quality AI. Join our team to help train AI chatbots...  ...AI chatbots. You will develop complex prompts to test AI models, write high-quality responses to demonstrate excellence, and evaluate different model outputs based on accuracy... 
    Hourly pay
    Full time
    Contract work
    Part time
    For contractors
    Self employment
    Freelance
    Remote work

    DataAnnotation

    Wyoming, OH
    2 days ago
  • $20 per hour

    A leading AI training company is seeking analytical and detail-oriented individuals to teach AI chatbots remotely. This role offers flexible hours and the chance to choose projects, starting at $20+ per hour with potential bonuses. Ideal candidates will have strong writing... 
    Remote job
    Hourly pay
    Self employment
    Freelance
    Flexible hours

    DataAnnotation

    New York, NY
    22 hours ago
  • $180k - $270k

     ...building the world’s most trusted AI work companion for professionals...  ...systems, data pipelines, or evaluation harnesses that can run at scale against live model checkpoints. Can deeply partner...  ...g., Weights & Biases, MLflow). Adversarial Datasets: Curating complex datasets... 
    Full time
    Work at office
    Worldwide

    Plaud

    San Francisco, CA
    4 days ago
  • $150 per hour

    Aerospace Engineering Professionals can apply their expertise to evaluate AI models and enhance their understanding of aerospace tasks and terminology. This role involves assessing AI-generated content related to your field and providing structured feedback to improve... 
    Hourly pay
    Part time
    Remote work

    SaidGig

    United States
    18 days ago
  • $350k

     ...play a pivotal role in shaping the future of AI-powered legal reasoning. This position...  ...focuses on the intersection of large language models, agentic systems, and legal workflows, emphasizing the development of rigorous evaluation frameworks to measure and enhance AI... 
    Remote job
    Full time

    SaidGig

    United States
    22 days ago
  • $80 per hour

    Land administrators leverage their expertise in land management and accounting to support AI research through flexible, hourly contract work. This role involves evaluating AI-generated content and providing insights that enhance AI understanding of upstream land administration... 
    Hourly pay
    Contract work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • $60 - $150 per hour

     ...network of legal experts where your skills can shape the future of AI in the legal field. This opportunity allows you to connect...  ...background and interests. Key Responsibilities Train and evaluate AI models in Law. Create tasks and deliverables based on real-world legal... 
    Hourly pay
    Contract work
    Remote work

    SaidGig

    United States
    2 days ago
  • $30 - $90 per hour

     ...As a Go Developer, you will play a crucial role in evaluating and training next-generation AI coding tools during their highly confidential alpha stages...  ...performance optimization. Test and evaluate alpha AI models in Cursor over multiple 4-day, 5+ hour daily bursts.... 
    Remote job
    Hourly pay
    Contract work
    Part time

    SaidGig

    United States
    18 days ago
  • $100 per hour

    Aviation professionals can utilize their industry expertise to enhance AI research projects by evaluating AI model outputs related to their field. This role involves assessing content pertinent to aviation, providing clear and structured feedback that aids in refining the... 
    Temporary work
    Part time
    Remote work
    Flexible hours

    SaidGig

    United States
    2 days ago
  • $80 - $120 per hour

    Position: Government / public administration Evaluator Type: Hourly contract Compensation: $80-$120 per hour Location: Remote Commitment: 10-40 hours/week Role Responsibilities Evaluate AI-generated work products, including documents, spreadsheets, and slide decks... 
    Remote job
    Hourly pay
    Contract work
    Work at office

    Crossing Hurdles

    New York, NY
    2 days ago
  • $40 per hour

     ...DataAnnotation is seeking a Biotechnology R&D Scientist to train AI models. In this role, you will evaluate the outputs of AI chatbots and assess their logic to improve model quality. The ideal candidate should have a deep understanding of cell biology, genetics, biochemistry... 
    Hourly pay
    For contractors
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A data science team is seeking experienced quantitative professionals to evaluate AI-generated work and contribute to the development of cutting-edge AI systems. This fully remote position offers flexible scheduling and competitive hourly pay starting at $40+. Ideal candidates... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Madison, WI
    2 days ago
  • $60 per hour

     ...and contribute to developing cutting-edge AI systems, while enjoying the flexibility...  ...professionals to help advance AI development. AI models are increasingly capable of performing...  ...state-of-the-art AI models on tasks like evaluating AI-generated quantitative analysis,... 
    Hourly pay
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    Montgomery, AL
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Adversarial Prompt Specialist for AI Model Evaluation. Be the first to apply!