AI Benchmark Architect & Evaluation Researcher
Deccan AI Automation Private Limited
Deccan AI is seeking an ML Researcher to drive end-to-end AI research, identify emerging directions, and design novel benchmarks and evaluation datasets aligned with organizational priorities. This role bridges theory and practice by translating recent papers into actionable benchmarks for agent frameworks, deep learning, NLP, and other AI paradigms, with strong documentation and clear success criteria. Collaborate with ML leads and project managers to deliver high-impact research outputs, #J-18808-Ljbffr Deccan AI Automation Private Limited
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Benchmark Architect & Evaluation Researcher in Mountain View, CA vacancy
- Deccan AI is a GenAI data company that runs the post-training... ...to managed AI workforces and evaluation infrastructure. Backed by A91... ...Description: 1. Background The ML Researcher plays a critical role in... ...directions, designing novel AI benchmarks, and creating high-quality...Suggested
- ...ModelMesh™), reliable model evaluation (LLM-IQ™), and... ...enterprises, we bring together research, engineering, product,... ...expertise to deliver AI that meets the... ...representation. Responsibilities: Architect and orchestrate... ..., prototyping, and benchmarking to parallel agent systems...Suggested
$201.3k - $352.3k
...meaningful work. Today, ServiceNow is the AI control tower for business reinvention... ...and privacy.• Create rigorous benchmarks and evaluation methods for tool-use correctness, plan... ...areas.• Experience turning ambiguous research questions into working prototypes, measurable...SuggestedWork at officeImmediate startRemote workFlexible hoursMoveworks
Mountain View, CA4 days ago$254.3k - $356.3k
...and measurable business impact. As an AI Architect, you will be a pivotal technical leader... ...deployment, and monitoring.Develop and maintain evaluation approaches for output quality,... ...technology serves the business.Actively research and evaluate cutting-edge AI/ML techniques...SuggestedRubrik
Palo Alto, CA3 days ago- Stanford University’s Evaluation Sciences Unit seeks a research professional with qualitative skills for a one-year fixed-term, hybrid role. You will design, conduct, and analyze mixed-methods evaluations of healthcare delivery models across the US, including interviews...SuggestedFixed term contract
$262.5k - $299.6k
...Applied Researcher 5 (AI Foundations: Evaluation and Agentic Workflows) At Capital One, we are creating trustworthy and reliable AI systems, changing banking for good. For years, Capital One has been leading the industry in using machine learning to create real-time,...Full timePart timeWork at officeLocal areaFlexible hoursCapital One
San Jose, CA1 day ago- ...Job Description You'll architect end-to-end solutions that unlock... ...to lead the next wave of AI by infusing intelligence... ...part of our commitment to lead research in a field where SAP's expertise... ..., ablation studies, and evaluation benchmarks. Contribute to datasets,...Permanent employmentFlexible hours
- ...At Rhoda AI, we’re building the next generation of generalist... ...possible by our cutting edge research and end-to-end system design.... ...Engineers to build the data and evaluation foundations for our video... ...Build evaluation frameworks and benchmarks to measure causal video model...Full time
- ...About the Role As an AI Researcher for Computer Vision & Autonomous Robots at TCS, you’ll work on the frontier of applied artificial intelligence... ..., Diffusion Models, Agentic AI frameworks). Test and benchmark algorithms on physical robot platforms and simulation...Full time
Tata Consultancy Services
Santa Clara, CA1 day ago $163.2k - $264k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...CareerAs a Principal AI Researcher, you will advance the... ...security research, rigorous evaluation, and applied LLM post-training... ...weaknesses, reward hacking, benchmark overfitting, and capability regressions...Full timeWork at officePalo Alto Networks
Santa Clara, CA21 hours ago- ...OpusClip is the world's No.1 AI video agent, built for... ...want to hire a hands-on Lead AI Researcher with strong technical depth.... ...tuning, preference optimization, evaluation, and learning from user feedback... ...skills, including offline benchmarks, human evaluation, online experiments...Full timeLocal area
$200k
eGain delivers trusted AI to transform customer experience for some of the largest brands... ...Knowledge Hub, AI Agent, Composer, and Evaluator products are deployed in mission-critical... ...for an experienced AI Knowledge Product Architect to drive the strategy, roadmap, and...Work at officeeGain Communications
Sunnyvale, CA4 days ago$141k - $231k
...that guide LinkedIn's growth and efficiency. We're hiring an AI Architect to design, build, and launch AI-powered features inside the business... ...end-to-end: from problem framing and prototyping, through evaluation and rollout, to monitoring in production. You'll partner...For contractorsWork at officeFlexible hoursLinkedin
Sunnyvale, CA3 days ago- ...entering a transformative era where Data & AI are reshaping industries, work, and... ...defining solutions. You Are: As an Advanced AI Architect, you will be responsible for designing... ...architectural requirements for AI solutions. Evaluate, rationalize and select technologies...Work experience placementLive inWork at officeLocal area
Accenture
Mountain View, CA3 days ago $129.6k - $288k
About the RoleWe are building AI capabilities that improve important human workflows across the company. As AI Architect, you will set the technical direction for how we design, evaluate, integrate, and operate AI systems. You will help teams choose the right approach...TripActions
Palo Alto, CA3 days ago- ...of Position We are seeking an experienced Senior Insights Architect for Analytics and AI Solutions to lead the design and implementation of our... ...candidate will have a strong background in developing analytics, evaluating AI solutions using Engineering and Supply Chain Data,...Local areaWorldwideFlexible hours
Intuitive Surgical
Sunnyvale, CA3 days ago - ...Function of PositionWe are seeking an experienced Insights Architect, Data & AI to shape and deliver scalable data, analytics, and AI capabilities... ...and consistently consume across analytics and AI use cases.Evaluate knowledge graphs, ontologies, and related semantic...Local areaWorldwideFlexible hours
Intuitive Surgical
Sunnyvale, CA2 days ago $172.1k - $278.3k
...Integrity, and Inclusion. We weave AI into the fabric of everything... ...a Principal Security Researcher, you will work at the forefront... ...build reliable harnesses and evaluation pipelines, analyze large-scale... ...findings, technical reports, benchmarks, responsible disclosures,...Full timeWork at officePalo Alto Networks
Santa Clara, CA2 days ago- ...Pramaana Labs is a frontier AI lab building the verification... ...Alto, Pramaana brings together researchers and formal methods experts... ...quality, representations, and evaluation. You’ll work with an RL Scientist... ...work. Develop rigorous benchmarks and evaluation methodologies...
Pramaana Labs
Palo Alto, CA2 days ago - ...Systems seeks a Dex Technical Writer to produce original research and translate complex AI hardware/software developments into clear, credible... ...investigate architectures, test claims through demos and benchmarks, and explain results for developers and the broader industry...
- ...the company's highest-priority AI initiatives, with impact... ...loyalty.We are seeking a Partner Architect to define and drive the long-... ...(agents, retrieval, evaluation, and Responsible AI) that teams... ...through working prototypes, benchmarks, modeling, simulations, and technical...Work at officeLocal areaImmediate startVisa sponsorshipWork visa
Microsoft Corporation
Mountain View, CA21 hours ago $175k - $275k
...Systems builds the world's largest AI chip, 56 times larger than... ...looking for a performance architect to guide the evolution of our... ...utilization and energy efficiency.Evaluate proposed architectural... ...source their cutting-edge AI research.Work on one of the fastest AI...Cerebras Systems
Sunnyvale, CA1 day ago$159.2k - $217.3k
Intrinsic is an AI robotics group at Google aiming to reimagine the potential of industrial... ...of industrial robotics.RoleAs a UX Researcher at Intrinsic, you will lead end-to-end... ...forwardPlan and execute generative and evaluative research studies across factory UI, developer...Full timeLocal areaFlexible hoursIntrinsic
Mountain View, CA14 hours ago$60 - $69 per hour
...Job Description Job Title: User Experience Researcher Position Description: Protingent Staffing... ...user research, analyzes workflows, evaluates usability risks, and synthesizes insights... ...innovation — from Software and Aerospace to AI, Clean Tech, Medical Devices, and Connected...Contract workProtingent
Mountain View, CA2 days ago$150k
...Models (IFM) is a dedicated research lab for building, understanding... ...the next generation of AI builders, and drive transformative... ...the data we train on and the benchmarks we measure against. You'll... ...and RL environments — and the evaluation suite that tells us,...Institute of Foundation Models
Sunnyvale, CA15 days ago- ...We are looking for an exceptional Research Scientist to develop next-generation AI technologies, focusing on user... ...applications. * Design, prototype, evaluate, and deploy transformer-based generative... ...and establish reproducible benchmarking pipelines. Collaborate Across...Full timeInternshipLocal area
Predactiv
Palo Alto, CAmore than 2 months ago $192.5k - $240.6k
Uniphore is the Business AI company. Our sovereign, composable... ...-AI interaction, and agentic evaluation, etc., come join us!... ...analysis. ~ Develop lightweight benchmarks, simulations, and offline/online... ...Machine Learning, Operations Research, Statistics, or related...Full time- ...Accenture’s more than 1,500 certified AWS architects across the company. Join our team and be... ...and AWS at Accenture here:.You Are:An AI/ML Sr Architect delivering full-stack AI... ...: retrieval, orchestration, governance, evaluation, lifecycle observability.Lead architecture...Work experience placementLive inWork at officeLocal area
Accenture
Mountain View, CA3 days ago $160k - $350k
...Collinear is a research-focused AI company building systems that make intelligent models more reliable... ...post-training, RL, distillation, and evaluation to help teams get practical reasoning... ...capability and safety beyond simple benchmarks. Close the Loop: Design and...Full timeWork at officeLocal areaImmediate startRelocation packageFlexible hoursCollinear AI, Inc.
Sunnyvale, CA3 days ago$150k - $200k
...Get AI-powered advice on this job and more exclusive features. This range is provided... ...of AI safety by developing novel evaluation benchmarks and alignment techniques for enterprise... ...language models. Responsibilities As a Research Scientist/ ML Engineer, you will play a...Full timeCollinear AI
Mountain View, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Benchmark Architect & Evaluation Researcher. Be the first to apply!
Related searches
- data collection researcher Mountain View, CA
- machine learning researcher Mountain View, CA
- design researcher Mountain View, CA
- music researcher Mountain View, CA
- court researcher Mountain View, CA
- field researcher Mountain View, CA
- human factors researcher Mountain View, CA
- security researcher Mountain View, CA
- product researcher Mountain View, CA
- researcher Mountain View, CA