AI Evaluation Engineer — Build Safe, Trustworthy AI Pipelines
NTT DATA North America
NTT DATA North America seeks an experienced AI Eval / Testing Engineer in Dallas, Texas, to ensure AI models deliver reliability and user experience. This role involves building evaluation pipelines, defining quality metrics, and collaborating across teams to enhance AI outputs. The candidate should have extensive experience in ML engineering or QA testing, particularly with generative AI systems. Strong skills in Python and familiarity with AI evaluation tools will be essential for this position. #J-18808-Ljbffr NTT DATA North America
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer — Build Safe, Trustworthy AI Pipelines in Dallas, TX vacancy
- ...currently seeking a AI Eval / Testing (Eval Engineer) to join our team... ...looking for an AI Evaluation & Test Engineer to... ...and applications are safe, accurate, trustworthy, and deliver an elegant... ...Responsibilities Build and maintain AI evaluation pipelines to test, measure,...PipelineFor subcontractorRemote work
$143.63k - $299.38k
...next chapter: building the most consumer... ...a team of engineers dedicated to delivering... ...to leverage AI to solve real... ..., evaluating emerging technologies... ...workflows, CI/CD pipelines, and... ...effectively, safely and inclusively... ...others; exhibiting trustworthiness and meeting expectations...PipelineWork at officeFlexible hours$79.25k - $86.5k
...WITHIN THE TEAM Full‑Stack AI Product Engineers build and deliver end‑to‑end AI... ...workflows, retrieval pipelines, evaluation gates, human‑in‑the‑loop... ...model behavior into clear, trustworthy product experiences with... ...your expertise in building safe, observable, and scalable...PipelineFull timeWork at officeLocal area1 day per week- ...Title : AI Enablement Engineer Work Location : Addison, TX Division... ..., cobuild, or directly build AI solutions where appropriate... ...ideas are framed, evaluated, and moved through a structured pipeline. Partner with business... ...them get started. Promote safe, effective, and...PipelineWork at officeLocal areaShift work
Authentix
Addison, TX3 days ago - Overview AI Engineer - Hybrid What You'll Own AI Governance... ...use, vendor evaluation). Define AI standards... ...Engineering: Architect and build the agent orchestration... ...Build and maintain RAG pipelines and vector search infrastructure... ...support end users to safely and effectively use AI...PipelineLocal area
- Winaxis LLC is looking for a talented AI/ML Engineer to design and develop machine learning solutions that address real-world business... .... Responsibilities include optimizing ML models, building data pipelines, and collaborating with cross-functional teams to deliver...Pipeline
$92k - $138k
...Profile Summary/Mission Design, build, and operate the AI systems that Operations relies on. The AI Engineer is responsible for the most... ..., harnesses, tools, and evaluation pipelines. Accountable for... ...energy security and provide safe, reliable and responsible energy...PipelineWork at office$128.5k - $171.5k
...market (GTM) strategy: building an in-depth understanding... .... We are hiring an AI Engineer to join the Coro team and... ...tasks reliably and safely, turning raw, heterogeneous... ..., including building evaluation approaches, working with data pipelines, and developing or integrating...PipelineFull timeTemporary workApprenticeship- ...forefront of Generative AI innovation,... ...innovative AI Product Engineer - Agentic... ...environments and offline evaluation Automated testing... ...learning Build production‑grade AI... ...Implement CI/CD pipelines for agent code, prompts... ...Resilience and fail‑safe mechanisms Embed...PipelineWork at officeRemote workFlexible hours
- ...Generative AI Engineer As a Generative AI Engineer, you’ll be a core member of this pod, building and integrating agentic systems powered... ...engineering, model fine-tuning, and evaluation of generative outputs.... ...Optimize AI inference pipelines for scalability, latency,...Pipeline
E-Solutions
Dallas, TX3 days ago - ...Seeking a hands-on AI Native Software Engineer to design, build, and deploy production-grade AI-driven systems within... ...-based routing Build evaluation frameworks for accuracy, latency,... ...driven patterns Implement CI/CD pipelines and infrastructure as code (e.g.,...PipelineFor contractors
Saxon Global
Dallas, TX3 days ago - ...AI/ML Engineer Primary Skills ~ Hypothesis Testing, T-Test... ...motivated AI Engineers to design, build, and deploy next-generation... ...using LLMs, RAG pipelines, tool calling, memory systems... ...and knowledge repositories Evaluate and leverage foundation models...Pipeline
Brillio
Dallas, TX1 day ago $80 - $88.88 per hour
...Job Title: AI Native Software Engineer Location: Dallas, TX (75% travel) Duration... ...India, we take pride in building long-term relationships and... ...policy-based routing. Build evaluation frameworks for accuracy,... ...patterns. Implement CI/CD pipelines and infrastructure as code...PipelineTemporary workFor contractorsBCforward
Dallas, TX3 days ago- ...Job Title AI Engineer (R&D) Experience Level 10+ years Job Summary... ...highly hands‑on role focused on building production‑grade data... ...Python and SQL code for data pipelines, AI‑enabled analytics, and automation... ..., and data quality checks Evaluate third‑party AI platforms and...PipelineFor subcontractor
NTT DATA North America
Dallas, TX4 days ago - ...Pereview Software is seeking an AI Engineer to join our growing Product... ...this role, you will design, build, and enhance intelligent... ...(LLMs), document processing pipelines, Retrieval-Augmented Generation... ..., structured outputs, and evaluation frameworks for Large Language...PipelineH1bLive inWork at officeMonday to Friday
Pereview Software
Dallas, TX1 day ago - ...Job Details 1. Data Engineering & Snowflake Platform |... ...→ STAGING → MART Build and maintain domain MARTs... ...read-only on MART, AI scoped to mart.ai_features... ...all tools Monitor pipeline health, warehouse... ...PII handling, vendor evaluation Ensure AI pipelines...PipelineLocal area
Jobot
Addison, TX2 days ago $88.2k - $173.5k
...Senior AI Software Engineer Category: Software Development/ Engineering | Main... ...Hubs to develop real‑time pipelines. Database Management: Strong... ...Proven experience designing and building medium‑sized applications... ...holidays per year. Paid sick and safe leave (at least 80...PipelineFull timeWork at officeLocal areaCGI Technologies and Solutions, Inc.
Dallas, TX4 days ago- ...development company dedicated to building innovative solutions that... ...’re looking for a skilled AI Performance Engineer to join our dynamic team... ...AI training and inference pipelines for throughput, latency, and... ...scheduling strategies. Evaluate new hardware and software offerings...PipelineFull timeH1bLocal areaImmediate startRemote workVisa sponsorshipWork visa
Bright Vision Technologies
Irving, TX2 days ago $88.2k - $173.5k
...Senior AI Software Engineer Location: Dallas, Texas (preferred) or Atlanta, Georgia – hybrid... ...experience with Kafka or Event Hubs to build real‑time pipelines. Database management – strong... ...least 80 consecutive hours of paid sick/safe leave (subject to applicable laws)....PipelineLocal areaFlexible hoursCGI Njoyn
Dallas, TX2 days ago$98.81k - $148.16k
...on Earth. That is why we’re building Nova, our fully and rapidly... ...test efficiently. As a Senior AI Engineer on theBoltlineteam, you will... ...processes to RAG pipelines that surface critical institutional... ...institutional knowledge.You'llarchitect evaluation frameworks to ensure AI...PipelinePermanent employmentFull timeRemote workGrabJobs
Irving, TX5 days ago$100k - $120k
...Junior-Level Ai Developer At Jacobs, we're challenging... ...with a solid software engineering foundation and a drive to build and deploy AI-powered... ...Retrieval-Augmented Generation) pipelines, agentic workflows, and... ...-hosted AI services Evaluate, integrate, and maintain...PipelineFull timeRemote workJacobs Solutions
Dallas, TX2 days ago- YO IT Consulting is seeking an AI Engineer to remotely apply expertise in training next-generation AI systems. In this role, you will design and optimize machine learning models, implement ML pipelines, and collaborate with teams to tackle real-world challenges. The ideal...PipelineRemote job
- RealPage is seeking a Senior AI Engineer to design, build, and deploy AI-powered applications at scale, leveraging LLMs, RAG pipelines, and agentic frameworks. You will collaborate with... ...and backend services, and advancing model evaluation and #J-18808-Ljbffr RealPagePipeline
- ...Summary We are seeking an AI Security Principal Developer... ...strategic advisor to AI and engineering teams on building secure, trustworthy AI solutions. This role... ...engineering and product teams. Evaluate AI architectures, models, and data pipelines to identify risks and...PipelineLocal area
Vistra
Irving, TX3 days ago - ...connecting APIs, and building end-to-end workflows.... ...orchestration. Prompt Engineering & Instruction Design:... ...knowledge management. Evaluation & Testing: Testing agent... ...and maintain scalable AI/ML applications, with... ...monitoring, and data pipelines Develop and implement...Pipeline
- ONEOK is seeking an AI Engineer to design, build, and operate advanced AI systems that support Operations. You will own production AI solutions, including agents, tools, and evaluation pipelines, and contribute reusable frameworks used across the team. The role requires...Pipeline
- ...establishing a modern software engineering practice built around an AI-driven Development... ...deployment, including CI/CD pipeline validation, SAST finding... ...Proficiency: 5+ years building Angular applications, comfortable... ...Discipline: Ability to evaluate, extend, and own...PipelineFlexible hours
InRhythm Inc
Dallas, TX4 days ago - ...We are currently seeking an AI Engineer (Corp Functions & Supply Chain... ...and Supply Chain designs, builds and deploys intelligent systems... ...agents to automate supplier evaluation, negotiation, contract... ...& Architecture: Create RAG pipelines and integrate AI models into...PipelineContract workFor subcontractor
- Job Title: Lead AI Engineer (Agentic AI / GenAI / LLMs) Role Overview... ...frameworks. Define and build a holistic AI framework/platform... ..., prompt engineering, model evaluation, and optimization. Expert... ...architecture patterns, and CI/CD pipelines. Solid understanding of...Pipeline
$110k - $190k
...seeking an Internal AI Forward Deployed Software Engineer to stay ahead of... ...platform enhancements or building new data processes... ...our APIs, data pipelines, and internal... ...driven processes and evaluating their outputs for... ..., and trustworthiness. ~ Identify reusable...PipelineTemporary workWork visaShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Engineer — Build Safe, Trustworthy AI Pipelines. Be the first to apply!
