Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Engineer- Instrumentation

$125k - $225k

Primis

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. This company is a leader in AI and agent engineering observability and evaluation, empowering AI engineers to ship high-performing, reliable agents and applications. From prototype to production scale, their platform unifies build, test, and run in a single workspace so teams can move faster with confidence. They are a Series C company backed by top-tier investors, with more than $135M in funding and a rapidly growing customer base of over 150 enterprise and Fortune 500 clients across technology, travel, and manufacturing industries. The Opportunity Join the engineering team building OpenInference — an open-source standard for AI observability, LLM, and agent instrumentation. You’ll help define how organizations instrument, trace, and observe their AI applications across the ecosystem, shaping the future of AI development. This role offers the opportunity to work directly on an open-source repository that supports thousands of developers worldwide, translating community and enterprise needs into practical, scalable instrumentation capabilities. This position requires exceptional technical versatility, strong open-source collaboration skills, and a high degree of ownership from conception to delivery. What You’ll Do Build new LLM and instrumentation libraries for emerging LLM providers and agent frameworks. Maintain and enhance existing instrumentation across Python and TypeScript ecosystems (OpenAI, Anthropic, LlamaIndex, CrewAI, and others). Drive improvements to semantic conventions and OpenTelemetry standards that define AI observability. Collaborate with the global developer community through GitHub, Slack, and conferences, as well as internal product and solution teams. Take complex problems from ideation to completion with full accountability and end-to-end execution. What We’re Looking For 3–5+ years of software development experience shipping production code. Expert-level proficiency in both Python and TypeScript. A community-oriented mindset and passion for open-source development. Strong interest in the AI/LLM ecosystem and emerging technologies. Excellent analytical and problem-solving skills, with the ability to synthesize input from multiple stakeholders. Bonus Points For Experience building SDK clients, instrumentation libraries, or platform APIs. Background in AI/ML observability, evaluation, or developer tools. What Makes This Role Unique You’ll have a direct impact on the AI ecosystem by building instrumentation that powers the next generation of AI applications across thousands of organizations. This position sits at the intersection of open-source community building and enterprise-scale AI systems, helping to define industry standards and stay at the forefront of LLM and agent technologies. Compensation & Benefits The estimated annual salary range is $125,000 – $225,000, plus equity and a comprehensive benefits package that includes medical, dental, vision, 401(k), unlimited paid time off, generous parental leave, and wellness support. The company is remote-first, with optional offices in New York City and the San Francisco Bay Area, and provides a monthly stipend for co-working spaces for remote employees. Culture & Values The team’s mission is to make AI work — and work for people. They aim to advance responsible, inclusive AI through a culture that values diversity, collaboration, and continuous learning. Employees regularly engage with researchers, ethicists, and industry leaders to promote responsible AI practices and participate in events celebrating diverse communities and perspectives. Research indicates that men will apply to a role when they only meet 50-60% of the descriptions, however, when looking at women and other minority groups, they can look for up to a 99% match in order to apply to a role. If you feel you are a fit for our role, please still apply, don’t worry if you don’t tick every single box. We’d still love to hear from you. We encourage underrepresented talent to apply to all our roles & support accessibility needs. #J-18808-Ljbffr Primis

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the AI Engineer- Instrumentation in New York, NY vacancy
  • $150k - $250k

     ...a bourgeoning investment adviser. Overview: DV Trading is building a centralized AI function to deliver production agent applications for teams across the firm. The AI Engineer ships agent-powered tools that business users rely on daily, building on team standards... 
    Suggested
    Worldwide
    Flexible hours

    DV Trading

    New York, NY
    9 days ago
  • $125k - $225k

    A leading AI observability company is seeking a Software Engineer to build instrumentation libraries for AI applications. The ideal candidate has 3-5 years of experience in software development, with expert-level knowledge in Python and TypeScript. This role allows direct... 
    Suggested
    Remote work

    Primis

    New York, NY
    3 days ago
  • $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: ML Engineer (Coding Agent Experience) Type: Contract Compensation:... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    New York, NY
    10 days ago
  • Full Stack Software Engineer, Remote Assist at Stack AV Stack is developing revolutionary AI and advanced autonomous systems designed to enhance safety, reliability, and efficiency of modern operations. Stack’s autonomous technology incorporates cutting-edge advancements... 
    Suggested
    Remote job

    Feedinkoo

    New York, NY
    5 days ago
  •  ...A tech company is seeking proficient programmers for remote roles in AI development. This position allows you to work on diverse coding problems, especially focusing on Android. Strong programming skills in languages like Kotlin, JavaScript, Python, and others are preferred... 
    Suggested
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  • $60 per hour

     ...A leading AI development firm is seeking proficient programmers to contribute to cutting-edge AI systems. As part of their team, you'll enjoy fully remote work from anywhere in the US and a flexible schedule, choosing projects that align with your availability. Responsibilities... 
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  •  ...A technology solutions provider in the United Kingdom is seeking a part-time software engineer to review AI-generated content and validate software concepts. The role requires strong debugging skills and the ability to communicate improvements clearly. Responsibilities... 
    Part time

    Crossing Hurdles

    New York, NY
    3 days ago
  • $55 per hour

     ...Freelance AI Trainer - Civil Engineering & Python 1 day ago – Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English... 
    Part time
    Freelance
    Remote work
    Flexible hours

    Mind Rift

    Brooklyn, NY
    1 day ago
  • $20 per hour

    A remote company specializing in AI training is seeking analytical professionals to teach AI chatbots. This role allows for a flexible schedule where you can choose projects and work at your own pace. Ideal candidates will have strong English skills, a bachelor’s degree... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  •  ...We're looking for an Senior AI Engineer to join a new AI Engineering team building foundational AI capabilities for mental healthcare at Talkiatry. You'll work across the AI lifecycle — from prototyping to production rollout, observability, and continuous improvement —... 

    Talkiatry

    New York, NY
    1 day ago
  • $140k - $225k

     ...Responsibilities and Duties Identify and develop opportunities for AI, including agentic AI, across platform capabilities, while...  ...production-grade REST APIs (e.g., FastAPI). Collaborate with other engineers who are passionate about AI tooling, including Claude Code, Github... 
    Work experience placement

    Nuveen

    New York, NY
    4 days ago
  •  ...Ellipsis is an AI developer tool that automatically reviews code and fixes bugs, and is used by hundreds of companies. Our mission is to build an AI software engineer. The Ellipsis platform already includes: Automatic PR reviews: our GitHub app helps teams merge code ~... 
    Work at office

    SupportFinity

    New York, NY
    4 days ago
  • $200k - $250k

     ...that no other company in our space is operating at. Frontier . AI is moving so fast. Our non-technical users are building their own...  ...AI product that actually works for real customers. We are hiring engineers who can build on the right side of that gap. Why this role... 
    Temporary work
    Flexible hours

    PetsApp

    New York, NY
    5 days ago
  • $209k - $235k

     ...Emergent AI Products is a new team at Pendo, built from the ground up to explore, prototype...  ...clear precedents. As a Sr. AI Software Engineer, you will sit at the intersection of deep...  ...sacrificing quality. Model evaluation: Instrument and evaluate model outputs rigorously by... 
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Pendo LLC

    New York, NY
    5 days ago
  • $150k - $250k

     ...About Distyl AI Distyl is an applied AI technology company partnering with the world’s most ambitious institutions to rearchitect...  ...profitable business. What We Are Looking For Forward Deployed AI Engineers build and operate production AI systems that deliver business value... 
    Work at office
    3 days per week

    Distyl AI, Inc.

    New York, NY
    5 days ago
  •  ...Overview The Role We're hiring for a Full-stack Software Engineer who's obsessed with building products that move the world forward. You...  ...intelligent systems that power Omniflow's core experience — where AI, product design, and engineering come together. What We Look For... 
    Remote work

    Global Finance Teams

    New York, NY
    3 days ago
  • $160k - $300k

     ...A dynamic health technology startup in New York seeks an ML operations engineer to manage the lifecycle of AI systems, from experimentation to production. The role involves optimizing AI performance on biopharma data, implementing ML Ops best practices, and cross-functional... 

    Solstice Health

    New York, NY
    5 days ago
  •  ...AI Software Engineer Location: Remote - United States Req#: 609409 Job Description Numerator is looking for a passionate AI Software Engineer to join our growing Machine Learning team. This is a unique opportunity where you will work with an established platform that... 
    Immediate start
    Remote work
    Flexible hours

    Numerator / Market Track, LLC

    New York, NY
    3 days ago
  • $60 per hour

     ...A leading AI development company seeks proficient programmers to contribute to cutting-edge AI systems. This fully remote position allows you to work from anywhere and offers flexible scheduling. Programming tasks include Android development and various coding challenges... 
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    1 day ago
  • A forward-thinking tech startup is looking for a Senior Software Engineer, AI, to design and develop core AI technology. In this remote-friendly position, you will collaborate with cross-functional teams and drive initiatives from concept to completion. The ideal candidate... 
    Remote work

    Centari

    New York, NY
    2 days ago
  •  ...talk with you about joining Further. Further is a data, cloud, and AI company whose focus is helping companies turn raw data into the...  ...clients. If this sounds exciting to you, let’s chat! SENIOR AI ENGINEER We are hiring a Senior AI Engineer to lead the development of... 
    For contractors
    For subcontractor

    Further Ventures

    New York, NY
    2 days ago
  •  ...generation of digital learning experiences through intelligent, AI-driven solutions. Their mission is to empower learners and...  ...that personalize and enhance learning outcomes. The company’s engineering organization is at the forefront of innovation, integrating AI... 
    Remote work

    Harnham

    New York, NY
    3 days ago
  • $60 per hour

     ...A technology company is looking for proficient programmers to develop cutting‑edge AI systems while enjoying fully remote work flexibility. Responsibilities include designing coding problems to train AI systems, writing high‑quality code, and providing feedback on AI-... 
    Hourly pay
    Remote work

    DataAnnotation

    Brooklyn, NY
    1 day ago
  • $60 per hour

     ...A leading AI development company seeks proficient programmers to contribute to cutting-edge AI projects remotely. This role offers the flexibility to choose projects and set your schedule while earning competitive pay of up to $60 USD/hour. Ideal candidates should be... 
    Remote work

    DataAnnotation

    New York, NY
    1 day ago
  • $142.32k - $213.48k

     ...products that solve complex data quality issues and automate business processes across Citi’s global operations as part of our Data & AI Engineering team. This is a hands‑on engineering role — you will own solutions end‑to‑end, from problem definition through production... 
    Full time

    Citigroup Inc

    New York, NY
    4 days ago
  •  ...Design and build production AI systems — agents, RAG pipelines, and knowledge infrastructure — for enterprise clients. AI Transformation...  ...(US) Full-time About the Role We're looking for a Senior AI Engineer to join our AI Transformation practice. You'll work directly... 
    Full time
    Remote work

    Mashbot, Inc.

    New York, NY
    2 days ago
  • $130k - $160k

    # Forward Deployed AI EngineerFieldNew York CityOn SiteFull Time$130K – $160K • Offers...  ...year.# About this roleThe Applied AI Engineer role at Amigo is a launchpad. You'll ship...  ...to do both.4. **Intensely Measured** We instrument patient outcomes, provider ROI, system performance... 
    Full time
    Visa sponsorship
    Flexible hours

    Amigo AI

    New York, NY
    4 days ago
  • $20 per hour

    A forward-thinking AI company in the United States is seeking independent contractors to help train AI chatbots remotely. You will develop prompts, evaluate outputs, and write responses to enhance AI performance. The ideal candidates are detail-oriented and possess strong... 
    Hourly pay
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    New York, NY
    5 days ago
  •  ...A financial technology startup is seeking a Founding AI Engineer to develop AI systems that enhance event spend management. This role involves managing the AI stack from research to deployment, shaping the AI direction of the startup. Candidates should have a proactive... 
    Remote work

    Fiska

    New York, NY
    3 days ago
  • $130k - $180k

     ...We are seeking a talented Mid-Level AI Software Engineer to join our growing Private Markets AI team. In this role, you will design, develop, and deploy AI-powered capabilities that drive real business impact. You will work closely with business stakeholders, engineering... 
    Work at office
    Local area
    Shift work
    2 days per week

    LGBT Great

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Engineer- Instrumentation. Be the first to apply!