AI Data Engineer: AI Agent Evaluation & Validation
Veeva Systems
A leading SaaS company is seeking an AI Evaluation Specialist to ensure the reliability and safety of their AI systems. This role involves defining evaluation strategies, assessing LLM outputs, and developing automated evaluation pipelines. Candidates should have a strong background in data integrity, programming expertise in Python, and a bachelor's degree in a related field. This position offers a flexible working environment in Portland, Oregon with competitive compensation and benefits. #J-18808-Ljbffr Veeva Systems
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Data Engineer: AI Agent Evaluation & Validation in Portland, OR vacancy
$85k - $225k
...accuracy, and safety of our Veeva AI Agents through rigorous evaluation and systematic validation methodologies. We're looking... ...integrity and coverage of test data sets to reflect real‑world usage... ...uncover AI edge cases. Prompt Engineering & Model Expertise: Demonstrated...SuggestedWork at officeLocal areaWork from homeFlexible hours- ...has run on fragmented data, manual processes, and... ...that. We're building the AI‑native platform that enables... ...Scientist / Software Engineer who can operate across... ...to uncover patterns, validate hypotheses, and inform... ...feature engineering, model evaluation, and iterative model...SuggestedFull timeWork at officeLocal areaImmediate startRemote workVisa sponsorshipWork visaDay shift
- This role is responsible for data collection procedures, including... ...metadata cleansing and data validations. The role performs root‑cause... ...project teams of other data engineers for all stages of design and... ...unstructured data. Reviews and evaluates designs and project...SuggestedWork experience placement
- SUMMARY As a Senior AI and Data Engineer, you will lead the design, development, and delivery of scalable data platforms and AI-enabled data solutions to solve complex business problems for our clients. You will play a critical role in bridging business needs with modern...SuggestedLocal area
- ...certified Agentic AI platform for healthcare... ...unify fragmented data, model industry-... ..., and deploy AI agents that automate workflows... ...Analytics Engineer who knows the senior... ...their data landscape, validate requirements, and... ...you are still evaluating You think about AI...SuggestedFull timeWork at officeRemote workFlexible hoursShift work
$161k - $173k
...technology, come join the movement! Position Overview : The AI & Data Systems Engineer will be a key individual contributor on Ceribell's Data... ...around testing, version control, and code review. Evaluate and integrate AI tools and third-party services into internal...Remote jobLocal areaFlexible hours- North Highland is looking for a Senior AI and Data Engineer in Portland, Oregon. In this role, you will lead the design, development, and delivery of scalable data platforms and AI-enabled solutions to solve complex business challenges. You must have 6+ years of experience...
$50 per hour
...field and strong real-world experience in Python. You will review AI-generated code, ensuring correctness and best practices, and... ...hr with flexible hours and remote work options. Join Prolific to help advance AI training and evaluation processes. #J-18808-Ljbffr ProlificRemote jobFlexible hours$142.8k - $261.8k
...help to build a better working world. AI & Data - Physical AI Engineering Consultant – Manager The opportunity... ...Additionally, you will monitor and evaluate learning processes to continuously... ...the‑loop (HIL) testing techniques to validate the performance of robotic systems in...Full timeWork experience placementSummer holidayFlexible hoursErnst & Young Oman
Portland, OR3 days ago- Scribd, Inc. is seeking a Senior AI Data Engineer to lead AI engineering efforts within the Data Platform team. You will build the data infrastructure for AI use cases, support stakeholders, and integrate AI tools into the engineering workflow. Ideal candidates have over...Flexible hours
$105.8k - $174.8k
...Artificial Intelligence and Data team helps apply cutting edge... ...and ambitions. As a Senior AI Native Engineer, you will be at the... ...analysing, transforming data and evaluating results to make meaningful predictions... ...(HIL) testing techniques to validate the performance of robotic...Full timeWork experience placementSummer holidayFlexible hours$80 per hour
Prolific is looking for Data Scientists and Data Analysts to join our Expert Network in Portland, OR. The role involves evaluating AI-generated data insights, fact-checking technical claims, and ensuring alignment with system guidelines. Candidates should have a BS, MS,...Remote jobHourly payWork from homeFlexible hours- ...Vice President of AI Engineering & Agent Platforms About the Company Industry-shaping healthcare technology (HealthTech) & software provider... ...proven track record in building and operating cloud-native, data-rich products and platforms, as well as experience in...
$32 - $40 per hour
...Platform Technology team, the Data Engineer Interns work side‑by‑side... ...pipeline orchestration, CI/CD, and AI. Qualifications Pursuing a... ...principles. What You Will Do Evaluate open‑source software solutions... ...pipelines. Help identify AI Agent solutions for data access management...Hourly payTemporary workWork experience placementInternshipSummer internshipCambia Health Solutions
Portland, OR3 days ago- ...Summary: The engineer in this position should have a wealth of experience engineering... ...would include the complete engineering of data centers including, but not limited to, infrastructure... ...collect data, establish facts, and draw valid conclusions. Ability to interpret an...For contractorsWork at officeLocal area
ADEX
Lake Oswego, OR12 hours ago $98.81k - $148.16k
...build, and test efficiently. As a Senior AI Engineer on theBoltlineteam, you will design,... ...institutional knowledge.You'llarchitect evaluation frameworks to ensure AI reliability, build... ...access to certain technology and technical data that is restricted under U.S. export...Permanent employmentFull timeRemote workGrabJobs
Portland, OR2 days ago- The Sr. Data Engineer position is going to help the Digital Dash team pull data from various sources, store it in a database where we can... ...data processing technology stack Build data pipelines, data validation frameworks, job schedules with emphasis on automation and...
- As a Sr Data Engineer, you will design, build, and maintain scalable data pipelines and data infrastructure that support analytics, reporting... ..., and Governance Controls Implement automated data validation, profiling, and cleansing routines; define quality rules, thresholds...Work experience placementLocal area
$140k - $150k
Position Overview The Data Management & Engineering (DME) team at David Yurman (DY) is responsible for designing and implementing state‑of‑the‑art... ...deployment pipelines with automated testing and validation. Implement monitoring and alerting for pipeline health, data...Work experience placementSummer workMonday to Friday$279.5k - $419.5k
...performance, energy efficient AI compute. Description As a pioneer... ...Software Distinguished Engineer - Framework Integration, you will... ...generation AI workloads spanning data centers to edge. This role is... ...teams to integrate and validate AI capabilities in Ampere’s platforms...Local area$166.6k - $218.7k
...deliberate, company-wide bet on AI. Frontier users are... ...boundaries—building agents, automating workflows,... ...internal systems and data sources into a coherent... ...interface for agents and engineers. Expand and operate... ...Build playgrounds and evaluation harnesses so internal AI...Shift work- ...are seeking a highly motivated and technically proficient AI Engineer to join our growing Data & Analytics team. In this role, you will be a key... ...frameworks like LangChain, LlamaIndex, or Semantic Kernel. Evaluate and select appropriate foundation models (OpenAI, Anthropic...Work experience placementWork at officeLocal areaRemote work
- As IT Data QE Engineering Manager at KinderCare Learning Companies, you will... ...platforms. This role focuses on validation, reliability, and... ...Working knowledge of model evaluation metrics (precision/recall, ROC... ...Experience operating within MLOps or AI‑enabled analytics...Remote jobLocal area
- ...strategies. The ideal candidate will have a strong background in data analytics, experience with Adobe CJA , and a passion for... ...business development opportunities throughout the sales lifecycle. A valid passport and US driver’s license; willingness and ability to travel...Work at officeFlexible hours
$84k - $116k
...those who secure our future. As AI reshapes how organizations... ...across endpoint, cloud, identity, data, and AI systems to deliver... ...outcomes. As an IT Datacenter Engineer, you will be tasked with owning... ...maintain change logs and post-change validation documentation. Enforce...Home officeFlexible hours$50 per hour
...- Senior Developers - AI Training - USA About Prolific... ...pool of quality human data in the world. Over 35,... ...to help train and evaluate cutting‑edge AI models.... ...background in Software Engineering, we’ll send you a quick... ...adherence to best practices Validate Logic & Reasoning:...Work from homeFlexible hours- Join to apply for the Data Engineer & AI/ML Specialist, Mid Level (Remote) role at Jobright.ai 1... ...in Phase 2. • Develop a compliance AI agent (MVP version) that runs scheduled checks... ...features, including tuning models and validating extracted data. Qualifications: Required...Remote jobContract work
$130k - $170k
Senior Electrical Engineer - Data Centers Job Locations: US-TX-Dallas | US... ...centers and high-performance AI factories. In this role, you... ...procedures, including project evaluations and technical recommendations... ...relationship management. Valid driver's license. #J-18808-Ljbffr...Remote workFlexible hours- Senior Agentic AI Engineer Join a dynamic and fast‑evolving team that is building... ...‑generation AI‑based tools and agent systems for the construction industry. Our AI and Data Team focuses on designing... ...‑world consequences. Build evaluation infrastructure for non‑deterministic...
$132.5k - $366.3k
...company at the forefront of AI-native innovation. We... ...to create next-generation, agent-powered workflows engineered to scale in real-world settings... ...routing, tool invocation, evaluation harnesses, and lifecycle observability... ...-with sessions to shape data-driven agent workflows with...Live inWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Data Engineer: AI Agent Evaluation & Validation. Be the first to apply!
Related searches
- ai engineer Portland, OR
- senior ai engineer Portland, OR
- ai developer Portland, OR
- ai prompt engineer Portland, OR
- data engineer analytics Portland, OR
- remote data engineer Portland, OR
- junior data engineer remote Portland, OR
- senior cloud data engineer Portland, OR
- data platform engineer Portland, OR
- data infrastructure engineer Portland, OR