Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Engineer Scala / JVM

Biz Tech Analytics

Posted: 2 days ago Openings: 10 Applicants: 18 Review AI benchmark tasks in Scala: run sbt/ScalaTest in Docker, verify patches/oracles, debug implicits & type‑class issues, and assess functional correctness. Strong sbt + Linux skills required. Employment Type: Part Time, Freelance/Homebased Role Category: Software Development Education B.Tech / B.E. in Computer Science and Engineering (CSE) M.Tech in Computers, MCA in Any Specialization Key Skills #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer Scala / JVM in New York, NY vacancy
  •  ...Review & validate AI benchmark task in Clojure repo. Run Kaocha/clojure.test suites in Docker, verify patches & oracle solution,...  ...Development Education UG: B.Tech / B.E. in Computer Science and Engineering (CSE) PG: MCA in Any Specialization, M.Tech in Computers Key Skills... 
    Suggested
    Part time
    Freelance

    Biz Tech Analytics

    New York, NY
    1 day ago
  • $150k - $250k

     ...About Distyl AI Distyl is an applied AI technology company partnering with the...  ...At Distyl, we build AI systems using Evaluation-Driven Development -an approach where evaluation...  ...behavior in production. AI Evaluation Engineers focus on designing and implementing the... 
    Suggested
    3 days per week

    Distyl AI

    New York, NY
    3 days ago
  •  ...A leading AI development company is seeking proficient programmers to contribute to developing cutting-edge AI systems. Enjoy fully...  ...diverse coding problems for AI training, writing clear code, and evaluating AI-generated solutions. Ideal candidates should be fluent in... 
    Suggested
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  •  ...A leading technology company is seeking AI Developers to design and implement AI/ML features in a remote role. Responsibilities...  ...building AI services, developing data pipelines, and creating evaluations for LLMs. Ideal candidates have mid-senior experience in AI product... 
    Suggested
    Hourly pay
    Remote work

    Rex USA

    New York, NY
    1 day ago
  • $40 per hour

     ...cybersecurity professionals to join our team to help train AI models. In this role, you will evaluate AI-generated security content, solve technical...  ...penetration testing, red teaming, incident response, detection engineering, DFIR, malware analysis, threat intelligence, or... 
    Suggested
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    New York, NY
    4 days ago
  • $40 per hour

    A technology company is seeking a Web Engineer to train AI models remotely, offering either full-time or part-time options. The role involves evaluating AI chatbots' coding challenges and assessing the quality of AI outputs. Applicants should be fluent in English and detail... 
    Hourly pay
    Full time
    Part time
    Remote work

    DataAnnotation

    New York, NY
    4 days ago
  •  ...seeking candidates for the Rubric Academy Fellowship, a remote opportunity that involves completing a self-paced Academy focused on AI evaluation principles. Ideal candidates will possess strong analytical skills and deep subject-matter expertise, enabling them to work... 
    Remote work

    Crossing Hurdles

    New York, NY
    1 day ago
  • $60 per hour

    A leading AI development company seeks proficient programmers to contribute to cutting-edge AI systems while enjoying fully remote...  ...include solving coding problems, writing high-quality code, and evaluating AI-generated code. Ideal candidates should have a bachelor’s degree... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • $40 per hour

    A leading AI training company is seeking a DevOps Engineer to join their remote team. In this role, you will provide coding challenges to AI chatbots and evaluate their outputs for correctness and performance. Candidates should be proficient in Python or JavaScript and... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    3 days ago
  • $40 per hour

    A leading tech company is looking for experienced cybersecurity professionals to evaluate AI-generated security content and help improve AI systems. The role offers the flexibility of remote work, allowing candidates to choose their projects and work schedules. Ideal candidates... 
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    8 days ago
  • $40 per hour

    A leading AI security solutions provider is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve real-world technical problems. In this remote role, candidates will require over 2 years of cybersecurity experience, fluency... 
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $55k - $151.47k

     ...At PwC, our people in data and analytics engineering focus on leveraging advanced...  ...Opportunity As part of the People Tech & AI team you will develop, test, and validate...  ...Power Automate platform Executing LLM evaluation frameworks using defined metrics Working... 
    Full time
    Work experience placement
    H1b
    Remote work

    PwC

    New York, NY
    3 days ago
  •  ...Member of Technical Staff - Evals located in New York, NY, where you will ensure our AI-powered features are high quality and reliable. Your responsibilities include designing evaluation frameworks, building automated tests, and developing tools for seamless evaluations.... 

    Entendre

    New York, NY
    3 days ago
  •  ...A leading AI development company is looking for experienced quantitative professionals to join their remote team. In this role, you will evaluate AI-generated quantitative work, design quantitative problems, and provide valuable feedback for future AI models. Candidates... 
    Extra income
    Full time
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $269.1k - $307.2k

     ...Distinguished AI Engineer Overview: At Capital One, we are creating responsible and reliable...  ...inference, similarity search, guardrails, model evaluation, experimentation, governance, and...  ...experience programming with Python, Go, Scala, or Java Preferred Qualifications: 8... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    1 day ago
  • $40 per hour

    A tech company in the United States is seeking a Web Platform Engineer to enhance AI chatbot models. This role involves evaluating AI outputs and requires proficiency in programming languages such as Python or JavaScript. Candidates should be detail-oriented, experienced... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • A technology consulting firm in the United States seeks a Cloud Platform Engineer to enhance AI models by evaluating their performance and logic. This remote position requires proficiency in at least one programming language and a detail-oriented mindset. Responsibilities... 
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $30 per hour

    A technology company specializing in AI training is seeking a Cloud Platform Engineer to join their team. The position is remote and focuses on training and evaluating AI chatbots. The ideal candidate should be proficient in programming languages like JavaScript, Python... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • A leading cybersecurity firm is seeking experienced professionals to evaluate AI-generated cybersecurity content and solve technical security problems. You will play a significant role in training AI models, providing critical feedback, and improving system accuracy. This... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  • $40 per hour

    A cybersecurity firm is looking for experienced professionals to join its team. This remote role involves evaluating AI-generated security content and solving technical cybersecurity problems. Candidates should have over 2 years of hands-on experience in cybersecurity and... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    4 days ago
  • $40 per hour

    A cybersecurity solutions provider is seeking experienced professionals to evaluate AI-generated security content and solve cybersecurity challenges. You will contribute to the accuracy and reliability of AI systems while working remotely from the US or other selected countries... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    4 days ago
  •  ...powered by state of art Generative AI capabilities to millions of...  ...a cross-functional team of engineers, research scientists, technical...  ...similarity search, guardrails, model evaluation, experimentation, governance,...  ...programming with Python, Go, Scala, or Java* 8 years of... 
    Full time
    Part time

    Capital One

    New York, NY
    3 hours ago
  • $314.8k - $359.3k

     ...Sr. Distinguished AI Engineer At Capital One, we are creating responsible and reliable AI systems...  ..., similarity search, guardrails, model evaluation, experimentation, governance, and...  ...experience programming with Python, Go, Scala, or Java Preferred Qualifications: 9 years... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  •  ...We offer a custom-tailored, white‑glove engineering service fit for our clients, because a digital...  ...their goals. Senior Java Engineer(with Scala) We are seeking a highly skilled Senior...  ...processing. High level of Java (Concurrency, JVM, JMM); Experience building streaming data... 

    RE Partners Consulting

    New York, NY
    1 day ago
  • $170k - $200k

     ...are Metropolis is seeking a Senior AI Engineer to join our Applied AI organization, a team...  ...to maintain quality over time Evaluate and integrate emerging AI tooling (models...  ...Languages + Frameworks: TypeScript, React, Scala (principally), Java (limited) Datastores... 
    Temporary work
    Work at office
    Local area
    Immediate start

    Metropolis Corp

    New York, NY
    2 days ago
  •  ...Responsibilities Review AI benchmark tasks in Elixir repositories: run ExUnit in Docker, verify patches/oracles, debug GenServer...  ...supervision. Education UG: B.Tech / B.E. in Computer Science and Engineering (CSE) PG: M.Tech in Computers, MCA in any specialization (... 
    Part time
    Freelance

    Biz Tech Analytics

    New York, NY
    1 day ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer Overview: At Capital One, we are creating responsible and reliable...  ..., similarity search, guardrails, model evaluation, experimentation, governance, and...  ...experience programming with Python, Go, Scala, or Java Preferred Qualifications:... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • $180k - $200k

     ...technology provides the definitive search engine and marketplace for financial products,...  ...to their business, with advanced AI-backed data and tools through our platform...  ...work Experience developing and testing in Scala or other JVM languages Solid understanding of software... 
    Work at office
    Immediate start
    Flexible hours
    3 days per week

    I did my part and supported the Regular Toilet

    New York, NY
    1 day ago
  • $197.3k - $225.1k

     ...Lead AI Engineer At Capital One, we are creating responsible and reliable AI systems, changing...  ..., similarity search, guardrails, model evaluation, experimentation, governance, and...  ...experience programming with Python, Go, Scala, or Java Preferred Qualifications:... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    13 hours ago
  •  ...JOB TITLE : Senior Software Engineer- P3 - NY LOCATION DETAILS: NY - Onsite Intake- Looking for someone...  ...therefore impacting accounting unification. TECH STACK-----1. Scala. 2. Python. 3. Spark. 4. Databricks. Working alongside 14 others... 

    RIT Solutions, Inc.

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Engineer Scala / JVM. Be the first to apply!