Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer - Evaluation Analytics

Full-time

BlueCross BlueShield of Tennessee

Role Description

We are hiring an AI Engineer at BCBST! In this role, you will design and implement AI-driven solutions that automate and enhance business and clinical processes, with a strong focus on scaling and operationalizing our Clinical ROI methodology. You’ll work closely with business partners, clinical leaders, and technical teams to translate complex data and AI models into clear, actionable insights that inform decision-making around program effectiveness, cost efficiency, and patient outcomes. Your work will directly support how the organization measures value, improves performance, and makes strategic investments across clinical initiatives.

To be successful in this role, in addition to the core job requirements, you’ll bring hands-on experience applying AI or machine learning to real-world business problems. You will be a strong candidate if you have experience automating business practices using AI, leading or contributing to an AI-driven education or enablement project within an organization, and clearly explaining complex technical concepts to non-technical stakeholders. Strong communication skills and the ability to bridge technical and business perspectives are critical for success in this role.

Note: This is a remote, work-from-home position; however, the final round of interviews will take place on-site in our Chattanooga, TN office. Candidates must be able to work aligned to Eastern Standard Time (EST) hours. Sponsorship is not available for this role.

Responsibilities

  • Ideate, develop and productionalize AI solutions for healthcare payer use cases.
  • Design and implement state-of-the-art AI models and algorithms using Python and GCP Vertex AI.
  • Collaborate with product teams to identify opportunities for applying AI techniques to solve business challenges and automate processes.
  • Conduct research and stay up to date with the latest advancements in AI, continuously improving our techniques and methodologies.
  • Develop scalable and efficient code base for deploying AI models into production environments.
  • Work closely with our internal Lines-of-Businesses to understand their needs, gather requirements, and translate them into actionable insights and solutions.
  • Lead the evaluation and validation of AI models, ensuring their accuracy, reliability, and performance meet business requirements.
  • Communicate findings, results, and recommendations to technical and non-technical stakeholders through presentations, reports, and documentation.

Qualifications

  • Master's degree in STEM (Science, Technology, Engineering or Math) or related field or equivalent work experience required. Master’s and/or PhD degree a plus.
  • 3 years of relevant work experience in analytics, technology, or healthcare (academic experience included), or related equivalent experience.
  • 1 year experience with machine learning or advanced statistical methods is required.
  • Experience handling large datasets to build data science pipelines.
  • Experience with Machine Learning, Deep Learning, Pytorch, Natural Language Processing.

Requirements

  • Proficient in Python.
  • Proficient in Microsoft Office (Outlook, Word, Excel, and PowerPoint).
  • Proven analysis, design, and coding skills, and demonstrated success in leading large and complex projects.
  • Demonstrated ability to interpret and translate technical and/or complex concepts into information meaningful to project team members and/or business personnel.
  • Leadership skills.
  • Must be able to communicate effectively with both technical and non-technical co-workers.
  • Be organized, reliable, and able to manage multiple tasks with exceptional work ethic.

Number of Openings Available

  • 1

Worker Type

  • Employee
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the AI Engineer - Evaluation Analytics in Remote vacancy
  •  ...Job Title AI Evaluation Engineer Location Hybrid / Remote Employment Type Full-time Job Summary...  ...Cloud platforms (AWS, Azure, Google Cloud) Soft Skills Analytical thinking Critical thinking Problem-solving Strong... 
    Suggested
    Full time
    Remote work

    Ova Technologies

    New York, NY
    2 days ago
  • $40 per hour

     ...professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content,...  ..., incident response, detection engineering, DFIR, malware analysis, threat...  ...level) ~ Strong writing and analytical skills ~ A bachelor’s degree is... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Hartford, CT
    23 hours ago
  • $40 per hour

     ...experienced cybersecurity professionals to join their team. You will evaluate AI-generated security content, solve technical problems, and...  ...or similar fields is preferred along with strong writing and analytical skills. Successful applicants will complete a short... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Oregon, WI
    23 hours ago
  • $40 per hour

    A leading AI security firm is seeking experienced cybersecurity professionals in the United States to evaluate AI-generated security content and solve technical problems. The role...  ...of cybersecurity experience and strong analytical skills. A bachelor's degree is preferred... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Kansas City, MO
    1 day ago
  •  ...consultancy is seeking experienced individuals to enhance AI capabilities by evaluating cybersecurity content and solving security-related...  ...US and Canada. A background in cybersecurity and strong analytical skills are essential for success in this position. #J-188... 
    Suggested
    Remote work
    Flexible hours

    DataAnnotation

    Phoenix, AZ
    23 hours ago
  • $40 per hour

     ...cybersecurity professionals for a REMOTE position. You will evaluate AI-generated security content, solve technical problems, and contribute...  ...penetration testing or incident response, along with strong analytical skills. This job offers great flexibility with hourly pay... 
    Hourly pay
    Remote work

    DataAnnotation

    Oregon, WI
    6 days ago
  • $40 per hour

     ...professionals to join their team in a remote capacity. You will evaluate AI-generated security content and solve technical cybersecurity...  ...practices, coding skills, and strong writing and analytical abilities. This role offers flexible scheduling and projects... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Madison, WI
    23 hours ago
  • $40 per hour

     ...professionals to join their remote team. In this role, you will evaluate AI-generated security content, design solutions to cybersecurity...  ...2 years of hands-on experience in cybersecurity and strong analytical skills. This position allows flexible schedules and... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Kansas City, MO
    1 day ago
  • $100 per hour

     ...Description We’re looking for a highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such...  ...model thinks like a great engineer. You will assess how AI coding agents behave in real-world scenarios — focusing on... 
    Full time
    Immediate start

    G2i Inc.

    Remote
    6 days ago
  • $40 per hour

    A leader in AI training for cybersecurity is seeking experienced cybersecurity professionals to evaluate AI-generated content and solve technical problems. This role offers full-time or part-time remote work with the flexibility to choose projects and work hours. Candidates... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    Madison, WI
    23 hours ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated security content and solve cybersecurity problems. This role allows you to work remotely at your own pace, with projects starting at $40+ per hour. Candidates should have 2+ years... 
    Hourly pay
    Remote work

    DataAnnotation

    Wyoming, OH
    3 days ago
  • $40 per hour

    A technology firm specializing in cybersecurity is seeking experienced cybersecurity professionals to help train AI models. In this role, you will evaluate AI-generated security content and solve technical problems to strengthen AI's reasoning. Candidates should have 2... 
    Hourly pay
    Remote work

    DataAnnotation

    Boston, MA
    1 day ago
  •  ...Role: Lead AI & Analytics Engineer Location: Remote- USA Fulltime role Job description: We are looking for a Lead Engineer to build and maintain scalable data pipelines and data platforms that support analytics, business Intelligence, reporting... 
    Full time
    Remote work

    Lorven Technologies

    United States
    3 days ago
  • $40 per hour

    A cybersecurity-focused company is looking for experienced professionals to evaluate AI-generated security content and provide feedback to improve AI systems' understanding of threats. This role, which can be full-time or part-time, allows for flexible project selection... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Boston, MA
    1 day ago
  • $40 per hour

    A leading cybersecurity firm is seeking experienced professionals to join their team in evaluating AI-generated security content. You will solve technical problems and provide feedback to enhance AI capabilities related to real-world threats. The ideal candidate has over... 
    Hourly pay
    Remote work

    DataAnnotation

    Providence, RI
    23 hours ago
  • $100 per hour

     ...Description Make an Impact in Federal AI — Without a Full-Time Commitment....  ...a seasoned AI SME / AI Systems Engineer to support federal clients as they evaluate, design, and implement practical...  ...) and MLOps practices ~Strong analytical and problem-solving skills with... 
    Full time
    Part time
    Work from home
    Flexible hours

    D. Kent Consulting Group, LLC

    Remote
    5 days ago
  • €3,000 - €6,000 per month

    Role Description As an AI Engineer, you will design, develop, and deploy AI-powered solutions...  ...and deploy ML models for predictive analytics, anomaly detection, and automation use...  ...Development of MCP / A2A protocol. ~Evaluation, observability and tracing of LLM apps.... 
    Full time
    Seasonal work
    Work at office
    Remote work
    Flexible hours

    LITIT

    Remote
    2 days ago
  • Role Description We are seeking an AI Engineer with strong HubSpot and systems integration...  ...documentation across integrated systems. ~Evaluate emerging AI technologies, integration...  ...in production environments. ~Strong analytical and problem-solving skills with the... 
    Full time
    Contract work
    For contractors
    Remote work

    WRS Health

    Remote
    23 hours ago
  •  ...business value through machine learning, analytics, generative AI, agentic AI systems, and intelligent...  ...seeking an experienced Agentic AI Engineer who is passionate about emerging AI technologies...  ...AI architectures. ~Design, evaluate, and maintain a seamless generative... 
    Full time
    Temporary work

    Illumination Works LLC

    Remote
    4 days ago
  •  ...and deploying production-grade AI solutions including...  ...observability, guardrails, and evaluation frameworks (RAGAs, TruLens, DeepEval...  ...and maintain high-quality engineering standards. Keep updated with...  ...business impact. Soft Skills Strong analytical and problem-solving skills.... 
    Remote work
    Flexible hours

    Confie

    Huntington Beach, CA
    4 days ago
  • $176k - $265k

     ...Location Type Remote Department Engineering Compensation Zone 1 $195K – $...  ...rebuilding biotech for the AI era. When a breakthrough is...  ...truth datasets, pipelines, and analytics that all of the above depend...  ...memory and state management, evaluation, and observability. Make clear... 
    Full time
    Local area
    Remote work

    Albert Invent

    Washington DC
    4 days ago
  •  ...Job Title: Responsible AI Engineer Job Summary We are seeking a Responsible AI...  ...processes, and engineering practices. Evaluate AI and machine learning systems for...  ...risks or failure patterns. ~ Strong analytical, problem-solving, and documentation... 
    Full time
    Remote work

    Ova Technologies

    United States
    3 days ago
  • $125.25k - $183.7k

     ...About the Role As the Principal AI Engineer, you will act as the technical leader for...  ...Continuous Improvement Technology Evaluation: Continuously assess emerging AI tools...  ..., recommendation systems, supply chain analytics, or manufacturing AI use cases... 

    Harman International Industries

    Novi, MI
    3 days ago
  •  ...AI Engineer The Applied AI role focuses on developing, deploying, and optimizing artificial...  ...that support large-scale AI training, evaluation, and automation workflows. Key...  ...practical engineering solutions. Strong analytical and problem-solving skills. Impact... 
    Remote work

    Futran Tech Solutions Pvt. Ltd.

    United States
    2 days ago
  • $160k - $170k

     ...Description We are seeking a Generative AI Engineer to own the hands-on technical delivery...  ...workflows, structured output patterns, evaluation pipelines, and operational safeguards,...  ..., data governance, ecommerce, or analytics platforms Master's degree in Computer... 
    Full time
    Work at office
    Remote work

    Infinite Electronics International, Inc

    Lewisville, TX
    4 days ago
  •  ...thrive! KēSTA I.T is actively seeking AI Engineer foran immediate contract engagement...  ...procedures, and development processes. • Evaluate emerging technologies, AI tools, and...  ...confidential or regulated data. • Strong analytical, problem-solving, verbal, and written... 
    Permanent employment
    Full time
    Contract work
    Temporary work
    Immediate start
    Remote work
    Work from home

    Kesta IT

    Hartford, CT
    4 days ago
  • $75 - $80 per hour

     ...apply now. We are currently seeking a AI Engineer to join our team in Warren, New Jersey...  ...work closely with our data engineering, analytics, and business teams to deliver LLM-powered...  ...engineering frameworks and systematic evaluation pipelines to ensure LLM output quality,... 
    Hourly pay
    Contract work
    Temporary work
    Remote work
    Flexible hours

    Creative Solutions Services, LLC

    Hackettstown, NJ
    1 day ago
  •  ...Overview Join our Americas Data and AI team and help shape the...  ..., bridging strategy, design, engineering, and change adoption to...  ...and Assurance teams through evaluation frameworks, observability, and...  ...value. What you offer Strong analytical and problem‑solving skills complemented... 
    Work from home
    Flexible hours

    Macquarie Bank Limited

    New York, NY
    4 days ago
  •  ...AI Engineer AI is central to 360Learning's strategy: our AI Squad ships agentic features...  ...right content Conversational BI: Analytics and insights delivered through natural...  ...observability tools (Langfuse or similar) ~ Evaluation of models Solid grasp of... 
    Remote work
    Work from home
    Flexible hours

    360Learning

    United States
    2 days ago
  •  ...for US based applicants only. AI Engineer Rochester, New York Contract...  ...problems. Leads creation of data analytics capability for identifying key performance...  ..., feature engineering, and model evaluation techniques. ~1 year of experience in... 
    Contract work
    Remote work
    Work visa

    Damco Solutions

    United States
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer - Evaluation Analytics. Be the first to apply!