Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation

Risedatalabs

About Rise Data Labs Rise Data Labs is a leading AI training and data annotation company that specializes in creating high-quality training data for artificial intelligence systems. We work with top AI companies and research institutions to improve machine learning models through expert human annotation and validation. Our team of domain specialists, subject matter experts, and quality assurance professionals work across various fields including public administration, policy, and government compliance. We pride ourselves on our attention to detail, domain expertise, and commitment to delivering accurate, high-quality training data. Job Overview As a Government & Public Sector AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for public sector and government work. This role goes beyond traditional annotation and labeling — you'll author realistic, economically valuable government/policy tasks and rubrics based on real professional work, then grade AI-generated deliverables against them. What You'll Do Create realistic work scenarios based on your own professional experience — e.g., policy briefs, regulatory compliance reviews, public program reports, grant or budget documentation Supply the kinds of reference materials you'd normally work from (redacted reports, policy documents, program data) Write detailed rubrics specifying exactly what a correct, professional deliverable requires — accurate analysis, proper regulatory language, correct formatting Grade AI-generated deliverables (often policy documents or reports) against your rubric Join calibration sessions with other experts to ensure consistent scoring across the benchmark Preferred Qualifications Prior hands-on experience in public administration, policy analysis, regulatory affairs, or government program management Comfort reviewing detailed formal/regulatory documents Prior experience with AI model training, evaluation, or benchmark development is a plus What We Offer At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment. We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in government and public sector work. #J-18808-Ljbffr Risedatalabs

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation in Brooklyn, NY vacancy
  • Rise Data Labs is seeking a Government & Public Sector AI Training Specialist to craft realistic policy tasks and rubrics and to grade AI outputs against them. You’ll work on government-focused benchmarks and contribute to improving AI reliability in public programs. You... 
    Suggested

    Risedatalabs

    Brooklyn, NY
    2 days ago
  • $127 per hour

     ...mature and scale a governance framework that...  ...environment creations and manage tenant...  ...Copilot/AI interactions, controlling...  ...data flows. Evaluate and approve new...  ...of controls.Training & Community Building...  ...the governance model scales...  ...administrative tasks (PowerShell, Power... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    1 day per week

    MUFG

    Jersey City, NJ
    3 days ago
  •  ...apply now.We are currently seeking a AI Foundational Model Engineer to join our team in Jersey City...  ...to deployment, monitoring, evaluation, rollback, and continuous improvement...  ...reusable IaC modules, model risk, AI governance, audit controls, AI cost governance,... 
    Suggested
    Full time
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Jersey City, NJ
    14 hours ago
  •  ...mandatory. Only USCs/GCs are eligible AI Foundation Model Engineer LLM / Agentic AI / Full-...  ...or pipeline exposure; cannot explain evaluation, security, or rollback controls....  ...reusable IaC modules, model risk, AI governance, audit controls, AI cost governance, and... 
    Suggested

    Kasmo Global

    Jersey City, NJ
    19 hours ago
  •  ...SUMMARY This role converts AI concepts into secure,...  ...platform components, including model APIs, model gateways, data services...  ..., release management, model evaluation, inference optimization, and...  ...IaC modules, model risk, AI governance, audit controls, AI cost governance... 
    Suggested

    Compunnel

    Jersey City, NJ
    19 hours ago
  • $119k - $218.3k

     ...and Operating Model Design...  ...advanced data, AI, and emerging...  ...path to value creation. Work you’ll...  ...organization structure, governance, processes,...  ...to analyze public blockchain...  ...prioritize multiple tasks in a fast-...  ...industry sector, and a demonstrated...  ...mentoring or training others in... 
    Contract work
    Work at office

    Deloitte

    Jersey City, NJ
    4 days ago
  • $88.6k - $181.9k

     ...As an Applied AI Engineer II, you...  ...Learn to be a role model, leveraging...  ...Collaborative Co-Creation: Engage and...  ...prioritize multiple tasks in a fast-paced...  ...databases, evaluations, and AI agent orchestration...  ...experience and training; licensure and...  ...to the rules governing the program,... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    14 hours ago
  • $102.5k - $188.9k

     ...an Applied AI Engineer III...  ...to be a role model, leveraging...  ...Collaborative Co-Creation: Engage and...  ...multiple tasks in a fast-paced...  ...databases, evaluations, and AI...  ...industries/sectors you serve.Limited...  ...and training; licensure and...  ...to the rules governing the program,... 
    Work at office
    Local area
    Visa sponsorship
    Flexible hours
    3 days per week

    Deloitte

    Jersey City, NJ
    3 days ago
  • $30 per hour

    Mindrift is seeking AI Trainer - Writer to help train AI models by crafting text that teaches reasoning, logic, nuance, and clarity. This is a project-based...  ...permanent employment. Contributors will work on varied tasks, with expected weekly hours around 10-20 during active... 
    Hourly pay
    Permanent employment
    Temporary work
    Part time
    Freelance

    Mindrift

    Brooklyn, NY
    3 days ago
  • $40 per hour

    A leading AI development firm is seeking quantitative professionals to evaluate AI projects and provide feedback. You will work remotely from anywhere in the US, Canada, UK, Ireland, Australia, or New Zealand. Candidates should have at least 2 years of experience in a quantitative... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $60 per hour

     ...ethically shape the future of AI. About The Role We're...  ...realistic and structured evaluation scenarios for LLM-based agents...  ...simulate human-performed tasks and define gold‑standard...  ...own schedule. From creating training prompts to refining model responses, you'll help... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mindrift

    Brooklyn, NY
    2 days ago
  • $80 per hour

     ...proficiency. Mindrift connects specialists with project-based AI opportunities for leading...  ..., focused on testing, evaluating, and improving AI systems....  ...refine realistic coding tasks based on provided production...  ...to understand what the model struggles with vs. what it... 
    Permanent employment
    Temporary work

    Mindrift

    Brooklyn, NY
    2 days ago
  • $40 per hour

     ...company in the United States is seeking an R&D Biologist to train AI models and improve their quality. This position offers remote flexibility...  ...projects at your own schedule. Responsibilities include evaluating the performance of AI chatbots on complex biology topics.... 
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $105.4k - $207.8k

     ...that advance data governance, information...  ...Engineering Management Specialist on the Cyber...  ...and operating model improvements to...  ...multiple tasks in a fast-paced...  ...and industries/sectors you serve.Limited...  ...experience and training; licensure and...  ...regulations of public accounting. All... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    19 hours ago
  • SentiLink is hiring a Manager of Model Risk and Governance, a remote, US-based role. You will lead a team of data scientists and governance professionals, set the long-term strategy, and own governance documentation, validation, and model inventory. You will work with customers... 
    Remote job

    Apply

    Brooklyn, NY
    2 days ago
  • $105.4k - $207.8k

     ...generation of AI-enabled cyber...  ...operate the governed data foundations...  ...data models for risk and...  ...prioritize multiple tasks in a fast-...  ...function calling, evaluation or monitoring...  ...industries/sectors you serve....  ...experience and training; licensure and...  ...of public accounting.... 
    Local area
    Visa sponsorship

    Deloitte

    Jersey City, NJ
    3 days ago
  • $40 per hour

    # AI Image & Video Evaluation Specialist (PT, MT and CT)$40per hourContractor Remote Last verified 21 Jul 2026Listed on micro...  ..., you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-... 
    Remote work

    Aiworkexpert

    Brooklyn, NY
    2 days ago
  •  ...remote, hourly contractor role supporting AI data and language projects on a...  ...generation: writing high-quality prompts and model responses, or recording high-quality...  ..., and other content to support AI training datasets. LLM evaluation: reviewing AI-generated responses... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    CNTXT AI

    Brooklyn, NY
    8 days ago
  •  ...DataAnnotation is looking for a Clinical Specialist to help train AI models in the United States. The role involves evaluating AI outputs related to healthcare and ensuring their accuracy. Candidates must be fluent in English and hold a current or in-progress medical degree... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    2 days ago
  •  ...and deliver agentic AI platforms and large language model-enabled services...  ...system quality through evaluation and observability....  ..., unit test creation, documentation), while...  ..., and skillsFormal training or certification on...  ...language model cost governance and performance optimization... 

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  • $50 - $60 per hour

    DataAnnotation is seeking an Actuarial Analyst to help train AI models. In this role, you will evaluate the quality of AI Assistant answers related to finance and corporate trends. The ideal candidate should have proficiency in financial analysis and an advanced degree... 
    Remote job
    Hourly pay
    For contractors
    Work from home

    DataAnnotation

    Brooklyn, NY
    4 days ago
  •  ...scalable large language model systems and agentic AI platforms for...  ...solutions, establish evaluation and observability standards...  ...controlsBuild well-governed APIs and...  ...refactoring, unit test creation, documentation), while...  ...capabilities and skillsFormal training or certification on... 

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  •  ...chance to shape an AI-first Developer...  ...easy to discover, evaluate, and integrate—at...  ...responsibilitiesLead the creation of an AI-first...  ...consistent error models, and developer usability...  ...and skillsFormal training or certification...  ...institutional and government clients under the... 
    Contract work

    JP Morgan Chase

    Jersey City, NJ
    14 hours ago
  • $23 per hour

    A leading AI project company is seeking an Annotator to review and classify data to assist in training artificial intelligence. This remote freelance position offers flexibility and the opportunity to work on exciting AI projects. Candidates should possess a Bachelor's... 
    Remote job
    Hourly pay
    Freelance

    Toloka Annotators

    Brooklyn, NY
    19 hours ago
  • West Virginia University Health System is seeking an AI Literacy Specialist to bridge AI solutions with end users across the organization. The role focuses on creating training materials, running workshops, and supporting the adoption of AI and automation in clinical and... 

    WVU Medicine

    Brooklyn, NY
    2 days ago
  • $163k - $181k

    ## AI Change Enablement ConsultantApplylocations...  ...-a-thons, and evaluation of outcomes...  ...is not traditional training delivery. Enablement...  ..., and operating models.* Design and execute...  ...balance multiple tasks, and meet deadlines...  ...102)* Exposure to governance, security, or... 
    Worldwide
    Home office
    Flexible hours

    SHI International

    Brooklyn, NY
    2 days ago
  • $60 per hour

    A tech company specializing in AI is seeking legal consultants for project-based work evaluating AI systems. Ideal candidates will have a law degree and at least 2 years of experience in US law. Responsibilities include generating AI prompts, evaluating solutions, and improving... 
    Weekly pay
    Part time
    Freelance

    Mindrift

    Brooklyn, NY
    2 days ago
  •  ...offers a flexible/hybrid model of 3 days onsite and 2...  ..., machine learning, AI, and GenAI capabilities...  ...services environment where governance, risk, controls,...  ...Python for data engineering tasks, including data ingestion...  ...optimization, and evaluation. Oversee the application... 
    Remote work
    Flexible hours

    DTCC- The Depository Trust & Clearing Corporation

    Jersey City, NJ
    1 day ago
  • $128.03k - $261.63k

     ...Deloitte Tax, AI Engineer...  ...implementation including training development,...  ...hybrid work model that requires...  ...industries/sectors you serve....  ...library creation, and advanced...  ..., prioritize tasks, structure workload...  ...to the rules governing the program,...  ...of public accounting.... 
    Work at office
    Local area
    Visa sponsorship
    2 days per week
    3 days per week

    Deloitte

    Jersey City, NJ
    19 hours ago
  •  ...striving to be best-in-class.As a Quant Model Risk Vice President in the Model Risk Governance and Review team, you will be...  ...responsibility to oversee, train and mentor junior members of the...  ...specific products and structures.Evaluate model behavior and ensure the suitability... 

    JP Morgan Chase

    Jersey City, NJ
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Government & Public Sector AI Training Specialist — Task Creation & Model Evaluation. Be the first to apply!