Senior Responsible AI Evaluation Scientist (AGI)
Jobleads-US
Amazon.com Services LLC's AGI Responsible AI team seeks an Applied Scientist III to advance evaluation of frontier models, focusing on safety, fairness, and trust. You will design benchmarks, metrics, and scalable evaluation systems for large language models and generative AI.
You will collaborate with cross-functional teams, apply large-scale datasets and modern deep learning tools, and mentor colleagues to raise the scientific bar across the organization.
#J-18808-Ljbffr Jobleads-USVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Responsible AI Evaluation Scientist (AGI) in Kentucky vacancy
- ...We're seeking a Senior AI Software Engineer to architect and build... ...enterprise autonomous workflows at AGI Dialect. You'll work on... ..., and scalability. Responsibilities Architect and implement... ...Build robust generalized evaluation systems for agent capabilities...Senior
AGI Dialect, LLC
Eastern, KY5 days ago - Capital One is seeking an AI Engineer 5 to advance responsible AI systems and scalable AI infrastructure in the IFX team. You will design and deploy... ...emphasizes cross-functional collaboration, mentorship of senior engineers, and delivery of high-impact AI-powered products...Senior
$180k - $260k
...and comfort. Role Overview As a Senior AI Scientist at Atria, you will own the... ...throughout. Design and run rigorous evaluation: held-out clinical benchmarks, comparison... ...Genuine interest in healthcare and the responsibility that comes with building models that...SeniorRemote jobSummer workFlexible hours- ...coordinated, agent-driven action. Key Responsibilities Design and implement agentic workflows with LangGraph and Azure AI Foundry that power the Signal and Action Engines... ...via MCP / A2A and webhooks. Establish evaluation, guardrails, observability and cost...Senior
AiRo Digital Labs
Eastern, KY5 days ago $123.7k - $168.1k
Senior AI Specialist - Operations OperationsWalnut Creek,California Salary: USD 123,700... ...critical-thinking skills with the ability to evaluate complex operational and financial... ...field. Five or more years of progressively responsible experience in analytics, business...SeniorLocal area- ...a tech company that deploys AI-assisted teams to build and secure... ...scale. We are seeking a Senior AI Software Engineer with... ...00% Remote (Full-Time) Key Responsibilities Agentic System Architecture... ...-term, semantic memory). Evaluate, benchmark, and integrate state...SeniorPermanent employmentFull timeTemporary workRemote work
Build.com
Eastern, KY3 days ago - ...We are hiring a Senior AI Engineer to design, build, and operate AI-powered automation... ...and speed up real tasks and workflows Evaluate and select the right models and services... ...with LLM evaluation, monitoring, and responsible‑AI / guardrail practices ~ A track record...SeniorWork at officeLocal area
AMPS
Eastern, KY2 days ago $141.1k - $194k
...part of our caring communityMost AI engineering jobs are a thin... ...at the core of this role.As a Senior AI Applied Engineer, you will... ...APIs to model orchestration, evaluation frameworks, infrastructure, and... ...logging, alerting, and incident response processes for production...SeniorFull timeTemporary workApprenticeshipWork at officeRemote workRelocation3 days per weekHumana
Louisville, KY1 day ago$150k - $220k
...An Impact: xCures is looking for a Senior AI Software Engineer to help pioneer how... ...the pattern the team follows. Key Responsibilities: Own software design and architecture... ...work A metrics-driven approach to evaluating your own and your team's output...SeniorRemote workxCures
Eastern, KY4 days ago$106.48k - $185.15k
...Responsibilities The AI Developer will be part of a team of experts charged with providing support... ...current Cyber Defensive needs. As a Senior Developer on this program, you will be... ...software application APIs Experience evaluating the performance of different models...SeniorHourly payContract workTemporary workFor contractorsWork experience placementRemote workArcfield
Eastern, KY1 day ago- ...Why Blee: Blee is an AI-first marketing content compliance platform. PayPal, NerdWallet... ...values clarity, ownership, and shared responsibility—and is focused on building something... ...model fine-tuning, prompt engineering, evaluation frameworks, and customer-specific AI configurations...SeniorWork at officeRemote workWork visaFlexible hours3 days per week
Blee, Inc.
Eastern, KY5 days ago - ...contribute?** We are seeking a motivated Senior AI Engineer to design, implement, and... ...powered by large language models (LLMs). **Responsibilities & Deliverables:*** Develop key AI... ...and orchestration using CI/CD pipelines* Evaluate, benchmark, and document models**Required...SeniorLocal areaImmediate startWorldwide
Finastra
Eastern, KY5 days ago $150k - $220k
...We are seeking a highly skilled Senior Software Eng AI to design, build, and deploy production... ...automation in real business environments. Responsibilities AI Agent Development & Deployment... ..., including automated testing, evaluation harnesses, and regression detection...SeniorFlexible hoursBeacon Roofing
Eastern, KY5 days ago$123k - $180.4k
...Expires on December 7, 2026 26WD100761, Senior AI Developer Position Overview The... ...the platform and its roadmap. Responsibilities Design, code, test, debug and document... ...requirements and accurate estimates Evaluate and recommend tools, technologies and processes...SeniorPomona College
Eastern, KY5 days ago$120k - $160k
...increasingly digital world. Sr AI Engineer Location :... ...eligible for Relocation As a Senior AI Engineer, you will work in... ..., business requirement evaluation, team processes, continuous improvement... ...one. What You’ll Do Responsibilities Design complex AI-...SeniorWork at officeLocal areaImmediate startRelocationFlexible hoursOhioX
Eastern, KY2 days ago$130k - $220k
...Henderson is undertaking a firm-wide AI transformation to become the... ...; and the orchestration, evaluation, and observability services... ...with Percepta. As a Senior Applied AI Engineer, reporting... ...bolted on before release. Your responsibilities Build and run our AI...SeniorFlexible hoursJanus Henderson Group
Eastern, KY2 days ago- ...bill. This role owns the AI systems that change that. You... ...delivered and paid for. The Senior Applied AI Engineer designs,... ...fine-tuning, retrieval, and evaluation depend on, including labeling... ...ability to handle regulated data responsibly. Experience working under...SeniorRemote workWork visaFlexible hours
AgentGraph
Eastern, KY5 days ago $186k - $278k
## Senior AI EngineerApply: Flex: USA, GA, Atlanta: Full Time: Posted Today: JR-0110689*... ...shape how agents reason, act, and scale responsibly. High trust, high expectations, and... ...governance, guardrails, security layers, and evaluation mechanisms necessary when deploying...SeniorFull timeFlexible hoursJobleads-US
Eastern, KY2 days ago- ...AKIVA is an AI-native engineering firm specializing in enterprise services, domain... ...and government agencies. Key Responsibilities Architect and ship multi-agent orchestration... ...learning, RLHF/DPO, and agent evaluation methodology Partner with research and...SeniorLong term contractTemporary work
AKIVA AI, LLC
Eastern, KY5 days ago $175k - $275k
...East West Bank is seeking an experienced Senior AI Engineering to design, build, and... ...high-performing AI engineering team. Responsibilities Design, develop, and deploy enterprise... ...practices for CI/CD, testing, model evaluation, observability, performance...SeniorJobleads-US
Eastern, KY1 day ago- ...us. We can't do it without you. This Senior AI Engineer bridges AI experimentation and production engineering. This role is responsible for turning AI prototypes, agents, and platform... ...& Reliability: Develop testing, evaluation, monitoring, logging, and observability...SeniorPermanent employmentH1bWork at officeLocal areaShift work1 day per week
Jack Henry
Louisville, KY2 days ago $170k - $210k
...Note Health Note is building AI-powered digital assistants... ...what to improve next. As a Senior AI Product Engineer, you'll... ...measurement and improvement. Responsibilities Own improvements to the... ...Establish practical checks for evaluating changes before production...SeniorContract workNeara
Eastern, KY5 days ago- ...Euna Solutions is seeking a talented Senior AI Developer to be a key participant in our... ...orchestration, prompt engineering workflows, evaluation, and observability. Carry work from... ...experiment, and committed to using AI responsibly to augment—not replace—their expertise....SeniorWork at officeLocal areaRemote workFlexible hoursWeekend work
Eunasolutions
Eastern, KY5 days ago - ...build and scale intelligent AI, digital, cybersecurity, cloud... ...Security organization is hiring a Senior AI Security Engineer to help... ...for sanctioned AI use, evaluating third-party AI tools and vendors... ...the organization. Key Responsibilities Threat model AI/ML systems...Senior
World Wide Technology
Eastern, KY2 days ago $145.9k - $234.2k
...The Role Moderna is seeking a Senior AI Engineer in Cambridge, MA/ Warsaw, Poland to provide deep technical leadership... ..., release management, model and prompt versioning, evaluation, monitoring, incident response, and rollback. Guide integration of SAP and enterprise...SeniorPermanent employmentWork at officeWork from homeRXinsider
Eastern, KY5 days ago$135k - $160k
...architecture for the client,” helping them use AI to get the most out of their physical... ...their desiredoutcomes. You’re evaluated on results, not project completion... ...they serve. Role Summary The Senior AI Developer is responsible for designing, developing,...SeniorFlexible hoursShift workStellix
Eastern, KY3 days ago- ...Ignite IT Hub is seeking a senior AI/ML Engineer to maintain and... ...standardized codes to survey write-in responses. You will build and test... ...fields, and work with data scientists and MLOps engineers to... ...case tests, and work with the evaluation team to compare candidate results...SeniorContract workWork at officeFlexible hours
Ignite IT
Eastern, KY5 days ago $180k
...transforming how enterprises use AI to automate complex support at... ...SaaS. We’re looking for a Senior Applied AI Engineer to help... ...tool access. Build rigorous evaluation and observability systems that... ...deployment, monitoring, incident response, performance, reliability, and...SeniorTemporary workLive inRemote workVisa sponsorshipWork visaFlexible hoursOzmo Incorporated
Eastern, KY2 days ago- Capital One Group is seeking an AI Engineer 4 to advance our responsible AI foundation models and scalable inference pipelines. You will collaborate... ...and observability, with a hands-on approach to training, evaluation, and governance. #J-18808-Ljbffr Capital One GroupSenior
- # Senior AI Engineer - Multi-Agent FrameworksUnited States3 hours agoID 1932999Price on... ...expected to leverage AI daily, and we evaluate AI fluency as part of our hiring process... ...LLMs), and orchestration software. Key Responsibilities: • Design, develop, and maintain a robust...SeniorRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Responsible AI Evaluation Scientist (AGI). Be the first to apply!
Related searches
- ai scientist Kentucky
- ai data scientist Kentucky
- senior service associate Kentucky
- senior safety specialist Kentucky
- senior vice president of business development Kentucky
- senior service designer Kentucky
- senior sales recruiter Kentucky
- senior mulesoft developer Kentucky
- senior media manager Kentucky
- senior java software engineer Kentucky