Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Infrastructure Engineer with Equity

$130k - $175k

Uncountable

Thank you for your interest in Uncountable Engineering! Description Uncountable is seeking experienced engineers to lead the transformation of our platform into an AI-first R&D ecosystem. We are building the next generation of tools that empower scientists at Fortune 500 companies to accelerate discovery through Generative AI. As an LLM Applications Engineer, you will be the architect of our LLM infrastructure. You won't just be building interfaces; you will be designing the retrieval systems, agentic workflows, and data pipelines that bridge the gap between complex experimental data and actionable AI insights. Your work will directly modernize how the world’s leading researchers interact with their data. Primary Responsibility Your primary responsibility is to design, build, and scale the LLM infrastructure and user-facing AI features of the Uncountable Web Platform. This is a hybrid role requiring a deep understanding of full-stack development and the unique challenges of deploying LLMs in production. Infrastructure: Implement and optimize RAG (Retrieval-Augmented Generation) pipelines, vector databases, and prompt management systems. Feature Development: Build intuitive, AI-driven UI components that allow scientists to query, analyze, and visualize complex experimental datasets. Integration: Connect LLM capabilities with our core SQL databases and data analysis engines to ensure high-fidelity, grounded AI responses. Salary Range: $130K–$175K + Equity Requirements 2+ years of software development experience with a focus on full-stack web applications. Proven experience with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, or Haystack). Proficiency in Python and JavaScript/TypeScript: Ability to work across the AI backend and the React frontend. Solid Engineering Fundamentals: Experience with API design, asynchronous processing, and performance optimization. Preferred Qualifications B.S. in Computer Science or a related technical field. Experience with LLM Evaluation: Knowledge of how to measure and mitigate "hallucinations" in a scientific/technical context. Familiarity with SQL: Specifically optimizing queries that serve as the context for LLM prompts. Product Mindset: A passion for creating "LLM-first" user experiences that feel seamless rather than bolted-on. Our Current Stack Backend: Flask (Python), Postgres Frontend: React (Typescript), Redux, Sass Benefits Competitive Salary and Equity Health and Dental Insurance 401K with Employer Contribution What's next? Learn more about Interviewing at Uncountable Learn more about our engineering team: Check out our blog #J-18808-Ljbffr Uncountable

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Infrastructure Engineer with Equity in New York, NY vacancy
  • $175k - $300k

     ...if models are aligned with what humanity actually...  ...deploys frontier compute infrastructure fastest will decide...  ...forward. The Production Engineering Team Examples of key...  ...fluent with AI tooling. LLM APIs, MCP servers, and...  ...package (salary + equity). Retirement or pension... 
    Employment Equity
    Local area

    Fluidstack

    New York, NY
    1 day ago
  • $200k - $250k

     ...hiring a Senior Platform Engineer focussed on supporting...  ...and help maintain infrastructure primarily in GCP and you will partner closely with other platform engineers...  ...processes and work to optimize LLM-assisted coding...  ...compensation: $200,000 - $250,000 with Equity #J-18808-Ljbffr... 
    Employment Equity
    Work at office

    Translucent AI

    New York, NY
    1 day ago
  • $215k - $285k

     ...leading AI routing and infrastructure layer that enterprises...  ...We're hiring a Software Engineer on our Platform team to...  ...and serve millions of LLM requests every day. The...  ...is a hands-on IC role with broad surface area and...  ...85,000 plus benefits & equity. Compensation for internationally... 
    Employment Equity
    Full time
    Local area

    OpenRouter

    New York, NY
    1 day ago
  •  ...Equity: Competitive Equity Package Employment Type: Full-time...  ...looking for a Senior Platform Infrastructure Engineer to help scale and optimize the...  .... You will work closely with the CTO and engineering leadership...  ...reliability. Exposure to AI/LLM infrastructure, model-... 
    Employment Equity
    Full time

    Atilax Executive Search

    New York, NY
    1 day ago
  •  ...production data into better AI with every release. About...  ...-on Cloud Security Engineer to own the security...  ...posture of our multi-cloud infrastructure and customer hosted...  ...multi-tenant SaaS, or LLM-heavy workloads (data exfiltration...  ...Competitive salary and equity Wifi & cellphone... 
    Employment Equity
    Flexible hours

    Brain Trust Inc

    New York, NY
    12 hours ago
  • $120k - $160k

     ...Description Uncountable Engineering is seeking driven software engineers with a focus on Generative...  ...for: Building specific LLM powered features end-to...  ...observability, caching, infrastructure for fine‑tuning and inference...  ...Range $120K-$160K + Equity Requirements 2 years of... 
    Employment Equity

    Uncountable Inc

    New York, NY
    4 days ago
  •  ...managers, including private equity funds, real estate funds and...  ...team is seeking a Data and AI Infrastructure Engineer to build secure, scalable...  ...custom models. You will work with data engineers, application...  ...Kubernetes; Experience integrating LLM APIs (Anthropic Claude,... 
    Employment Equity

    RennerBrown

    New York, NY
    1 day ago
  • $179k - $224k

     ...Sr. Software Engineer - AI/ML - AI Platform New York, NY Who We Are...  ...Its open platform integrates with nearly 650 software, data and...  ...4,000 (base salary) + bonus + equity + benefits. Applicants must be...  ...technologies in the modern AI/LLM ecosystem, such as Databricks,... 
    Employment Equity
    H1b
    Worldwide
    Visa sponsorship
    Work visa

    Addepar

    New York, NY
    1 day ago
  • $200k - $220k

     ...enable providers to operate with clarity, control, and...  ...We’re hiring a Staff Engineer, AI Platform to build...  ...wants to build platform infrastructure, not just advise on it....  ...such as agent runtimes, LLM tooling, inference...  ...compensation, including equity Full health, dental, and... 
    Employment Equity
    Remote work
    Flexible hours

    Pivotal Health

    New York, NY
    1 day ago
  • $300k

    Orbis Group is seeking an Infrastructure Software Engineer in New York City, offering up to $300,000 base salary plus equity. In this role, you will design, build, and operate systems that support their rapidly growing AI platform. You will join a small, highly technical... 
    Employment Equity

    Orbis Group

    New York, NY
    2 days ago
  • $200k

    Harnham is seeking a Software Engineer - Infrastructure in New York City to join a fast-growing AI technology...  ..., while collaborating closely with engineers and researchers. This position...  ...range of $200,000 to $440,000 plus equity. Candidates should have strong experience... 
    Employment Equity

    Harnham

    New York, NY
    2 days ago
  • We provide organizations with invaluable foresight, empowering them...  ...About the Role As a Reporting Engineer, you\'ll turn raw simulation...  ...ClickHouse, DuckDB) Have built LLM-powered content generation...  ...a competitive base salary and equity participation, we offer comprehensive... 
    Employment Equity
    Work at office
    Relocation
    Visa sponsorship
    Relocation package
    Flexible hours

    Stealth Startup

    New York, NY
    2 days ago
  • OpenAI is seeking talented engineers to build and optimize the compute...  ...and operating complex infrastructure across accelerators, networks...  ...engineering skills and experience with distributed systems and high-...  ...compensation package, including equity and numerous benefits. #J-188... 
    Employment Equity

    OpenAI

    New York, NY
    2 days ago
  • $175k - $220k

     ...future of generative AI infrastructure. Our platform delivers...  ...highest-quality models with the fastest and most scalable...  ...as the leader in LLM inference speed and are...  ...The Role: As a Software Engineer on our Cloud...  ...also includes meaningful equity in a fast‑growing startup... 
    Employment Equity

    Dormont Manufacturing Co

    New York, NY
    3 days ago
  • $175k - $220k

    Fireworks AI, Inc. is seeking a Training Infrastructure Engineer to design, develop, and maintain...  ...practices in machine learning systems. With a minimum of 4 years in software engineering...  ...range of $175,000 - $220,000, along with equity and comprehensive benefits. #J-18808-... 
    Employment Equity

    Fireworks AI, Inc.

    New York, NY
    19 hours ago
  • $180k - $220k

     ...about code, we’re looking to work with experienced people who can...  ...’ll do Design and evolve our LLM system, Leasa, to do increasingly...  ...company with a genuinely high engineering bar Interest to apply AI...  ...expect: Competitive salary and equity Health coverage and benefits... 
    Employment Equity
    Work at office
    Local area
    3 days per week

    Aigentless

    New York, NY
    2 days ago
  • $109k - $186k

     ...Deployment Engineer To achieve our mission, we must ensure our...  ...demand for reliable internet infrastructure. You Will Have An Impact By...  ...deployment. Collaborating with cross-functional teams: You...  ...eligible to participate in Meter's equity plan. By applying to... 
    Employment Equity

    Meter Service

    New York, NY
    2 days ago
  •  ...projects, collaborate with teams, organize information...  ...meaningful scale. The engineering organization moves...  ...design and build the infrastructure, orchestration frameworks...  ..., Gemini, or similar LLM providers in...  ...Benefits Competitive Equity Package 401(k) Health,... 
    Employment Equity
    Flexible hours

    satoriq

    New York, NY
    2 days ago
  • $175k - $200k

     ...Benefits 401(k) Plan with an Employer Match Paid...  ...Assistance Robust Diversity, Equity and Inclusion program...  ...our external agent infrastructure (the Agency Connect...  ...adoption. Both need a senior engineering owner, and both need...  ...2 years building LLM-backed systems that real... 
    Employment Equity
    Internship

    OUTFRONT Media

    New York, NY
    1 day ago
  • $165k - $225k

     ...passionate Senior / Staff Software Engineer with extensive experience in...  ...next generation of Search infrastructure and AI platform, and owns the...  ...manage the deployment of ML/LLM models in production and...  ...a performance‑based bonus, equity, and a generous benefits program... 
    Employment Equity

    AlphaSense, Inc.

    New York, NY
    2 days ago
  •  ...powers Pantheon’s data infrastructure and delivers analytics...  ...looking for a Staff Software Engineer to take it to the next...  ...Machine Learning and LLM-driven insights. ~...  ...cost) ~Work hands-on with Snowflake (including...  ...competitive compensation and equity plan ~Flexible time... 
    Employment Equity
    Work at office
    Flexible hours

    Remotive

    New York, NY
    13 hours ago
  •  ...need someone to stand up that infrastructure and drive deployments to completion...  ...deployments need them. Partner with DC Operations, ICT, Hardware, and Network Engineering to identify blockers early,...  ...Competitive salary and meaningful equity Join a fast‑growing pre‑series... 
    Employment Equity

    HackerWeb

    New York, NY
    19 hours ago
  • $145k - $180k

     ...We're looking for a Fullstack Engineer to work on LangSmith, our commercial...  ...stack Collaborate closely with product and design teams to...  ...customers Bonus: Experience with AI/LLM-powered applications,...  ...for relevant roles, meaningful equity, benefits, and perks. Actual compensation... 
    Employment Equity
    Work at office
    Flexible hours

    LangChain

    New York, NY
    2 days ago
  •  ...3 years of experience with software design and architecture...  ...Large Language Model (LLM) interfaces into...  ...’s degree or PhD in Engineering, Computer Science, or...  ...+ 20% bonus target + equity + benefits Responsibilities...  ...the core backend infrastructure and services, such as... 
    Employment Equity

    Google

    New York, NY
    2 days ago
  •  ...specialize in the High Technologyprofession with talent in many different areas. A faster...  ...Technology, Health Care, Sales, Engineering, Industrial and Skilled Labor. We offer candidates...  .... Firm specializes in flexible FIX-based equity order management systems and full front-... 
    Employment Equity
    Work at office
    Immediate start
    Relocation
    Work visa
    Flexible hours

    Chembular Manpower

    New York, NY
    3 days ago
  • $76.2k - $111.9k

     ...aftermarket replacement products engineered to save time and money, and...  ...29 different locations, with a family of brands that also...  ...optimize enterprise network infrastructure across LAN, WAN, SD‑WAN, wireless...  ...geographical location, and internal pay equity. Compensation decisions are... 
    Employment Equity
    Full time
    2 days per week

    Allparts Inc

    New York, NY
    4 days ago
  • Pearse Partners is seeking a Senior Analyst or Associate to join their New York team, working exclusively with a leading global infrastructure private equity platform. The role offers full deal team involvement, from origination to asset management, across large-cap and... 
    Employment Equity

    Pearse Partners

    New York, NY
    1 day ago
  •  ...Hamilton Lane Advisors, LLC is seeking an Associate on the Infrastructure and Real Assets Investment Team based in Conshohocken...  ...have 3-5 years of relevant experience in private equity or investment banking, along with strong quantitative and financial modeling skills.... 
    Employment Equity

    HL002 Hamilton Lane Advisors, LLC

    New York, NY
    3 days ago
  •  ...partnership, is looking for an Associate for its Global Infrastructure team located in New York. The role focuses on private equity infrastructure investments, supporting the...  ...investing or investment banking, with strong skills in financial modeling, due diligence... 
    Employment Equity

    InforCapital, partnership

    New York, NY
    1 day ago
  • $144k - $176k

     ...are a dynamic, fast-growing organization with the resources of a large firm and the...  ...we live and work. Job Description The Infrastructure Engineer is responsible for designing, implementing...  ..., geographic location, internal equity, and alignment with market data. This position... 
    Employment Equity
    Permanent employment
    Visa sponsorship
    Free visa

    Virtus Investment Partners

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Infrastructure Engineer with Equity. Be the first to apply!