Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Systems Engineer

HartleyCo

If you've spent the last few years making production LLM systems actually work - not prototyping, not building wrappers - and you want to do that at a company where the AI is the product, this is worth reading. We're working with a YC-backed AI startup that has gone from zero to meaningful ARR faster than most Series A companies do. They're now rebuilding and scaling the core AI infrastructure behind the product and hiring a senior engineer to help lead that. This is not a research role. It's not a platform team role. It's for someone who wants to own hard AI systems problems in production - and work directly with founders who care about shipping, reliability + product quality in equal measure. The role You'll join a small, senior engineering team working without layers or handoffs. The focus: Design and operate agentic workflows and orchestration systems at production scale Build and improve retrieval pipelines and long-running async execution systems Own reliability and observability - eval infrastructure, LLM behaviour monitoring, failure modes at scale Ship fast, iterate on real usage, hold a high bar for what "working" actually means What they're looking for 5+ years of engineering experience, with real time spent on production AI systems Strong backend and systems fundamentals - the AI layer sits on top of real engineering Experience with the unglamorous parts: eval pipelines, latency, reliability, behaviour at scale Product sensibility - this team doesn't have PMs in the middle; you'll need a view on what matters and why What they're not looking for Research or ML backgrounds without production engineering depth Engineers who've integrated LLM APIs but haven't owned what happens when they break People coming from large orgs who need process and structure to move Why this role Early engineer on a small, senior team - high trust, high autonomy AI-native product with real customers and strong retention Direct access to founders - no bureaucracy between you and the decisions Strong Comp + meaningful equity If you know the difference between an LLM system that demos well and one that holds up in production - and you want to build the latter - it's worth a conversation. #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Systems Engineer in New York, NY vacancy
  • HartleyCo in New York is hiring a Senior Engineer to lead the development of production-level AI systems. This role involves designing workflows, improving retrieval pipelines, and ensuring reliability in a high-autonomy environment. You will work directly with the founders... 
    Senior

    HartleyCo

    New York, NY
    4 days ago
  • Upside seeks a Senior CX Systems Engineer in New York to enhance Consumer Operations through AI and automation. You will design solutions that improve customer support, maintain integrations with platforms like Zendesk, and analyze operational performance through data... 
    Senior
    Flexible hours

    Upside

    New York, NY
    15 hours ago
  • $80k - $128k

    Peraton is seeking a Senior Systems Engineer to lead the development of advanced large-language-model capabilities within a cloud-based analytics...  .... This role focuses on guiding innovation in cutting-edge AI, overseeing implementation of RAG pipelines, and fostering collaboration... 
    Senior

    Peraton

    New York, NY
    1 day ago
  •  ...Senior Manager, Applied AI Health System Engineering At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw... 
    Senior

    PwC (US)

    New York, NY
    1 day ago
  • $160k - $240k

    Bloomberg is seeking a Senior Software Engineer in New York to enhance their AI capabilities. This role involves collaborating with teams to develop innovative AI solutions while utilizing deep programming knowledge and strong problem-solving skills. Candidates should... 
    Senior

    Bloomberg

    New York, NY
    2 days ago
  • TwinThread is seeking a Senior Associate, Generative AI Engineer to join the Chief Data and Analytics Office in New York. This role focuses on designing...  ...background in machine learning, optimization, and system design. Competitive compensation and comprehensive benefits... 
    Senior
    Work at office

    TwinThread

    New York, NY
    2 days ago
  •  ...leading global marketing agency is seeking an Associate Director, AI Engineer in New York to develop innovative AI products. The role...  ...experience with LLM frameworks, focusing on designing multi-agent systems and collaborating with teams to deliver high-quality AI... 
    Senior

    Dentsu Aegis Network

    New York, NY
    2 days ago
  • JPMorgan Chase & Co. is looking for an Applied AI ML Engineer‑Senior Associate to enhance operations through AI and machine learning solutions. This role involves collaborating with cross‑functional teams to identify automation opportunities and utilizing expertise in machine... 
    Senior

    JPMorgan Chase & Co.

    New York, NY
    1 day ago
  • Sartre Group in New York City is seeking a Senior Software AI/ML Engineer to join our hedge fund engineering team. This hands-on role focuses on production AI/ML systems, model deployment, and scalable ML infrastructure in a fast-moving financial environment. You will... 
    Senior
    Full time
    Relocation

    TryApplyNow

    New York, NY
    3 days ago
  • D2L is looking for a Senior Software Developer 2 specializing in Artificial Intelligence. The position involves leading product development and integrating AI techniques while fostering continuous learning within the team. The ideal candidate will possess a deep understanding... 
    Senior
    Full time

    D2L

    New York, NY
    3 days ago
  • $60 per hour

     ...A leading AI development firm seeks proficient programmers to contribute to cutting-edge AI systems. This fully remote role allows flexibility in choosing projects and scheduling, with competitive hourly pay up to $60. Responsibilities include designing coding problems... 
    Senior
    Hourly pay
    Remote work

    DataAnnotation

    New York, NY
    4 days ago
  •  ...AI Engineer UNI0NDALE, NY seeking a Senior AI Engineer to design, build, and deploy enterprise AI solutions using Microsoft Azure technologies, including...  ...AI/ML solutions (including RAG and agent-based systems), building data pipelines, integrating AI into... 
    Senior
    Immediate start

    3B Staffing LLC

    New York, NY
    2 days ago
  • $175k

     ...Senior AI Software Engineer New York, NY, United States Assured Guaranty is seeking a Senior AI Software Engineer to build production-grade...  ...or experimentation. The expectation is to deliver working systems quickly, safely, and at enterprise scale. Working... 
    Senior

    Assured Guaranty

    New York, NY
    4 days ago
  • $200k - $300k

     ...Senior / Principal AI Engineer (Generative AI, Multi-Agent Systems) Location: New York City (Hybrid - 3 days onsite) Compensation: $200,000 - $300,000 + equity Contact / Apply: ****@*****.*** About Our Client Our client is building AI systems that... 
    Senior

    NxT Level

    New York, NY
    3 days ago
  •  ...Senior AI Engineer Washington D.C. / New York Senior AI Engineer Hybrid - Washington D.C. (preferred) or New York, NY About The...  ...Partner with engineers to operationalize models into production systems, ensuring scalability and resilience at high data and... 
    Senior
    Flexible hours

    VantageScore®

    New York, NY
    4 days ago
  • $200k - $300k

     ...Senior AI Engineer Chicago; New York Founded 20 years ago and headquartered in Chicago, the DV Group of financial services firms has...  ...Senior AI Engineer defines how the firm builds production agent systems and ships reference implementations that demonstrate the... 
    Senior
    Worldwide
    Flexible hours

    DV Trading

    New York, NY
    3 days ago
  •  ...We’re seeking a future team member for the role of Senior Specialist, AI / Machine Learning Engineer to join our AI Hub team. This role is located in New...  ...services company at the heart of the global financial system, we influence nearly 20% of the world’s investible assets... 
    Senior
    Work experience placement
    Worldwide

    BNY

    New York, NY
    14 days ago
  • $115k

     ...with Barclays to connect them with exceptional professionals for this role. Embark on a transformative journey as a Senior FX Trading System Engineer – AVP. At Barclays, our vision is clear – to redefine the future of banking and help craft innovative solutions. In... 
    Senior
    Hourly pay
    Work at office
    Flexible hours
    Weekend work

    Barclays

    New York, NY
    3 days ago
  •  ...Senior AIML Engineer Location: New York, NY Experience: 10+ Duration: long term We are seeking a Senior AIML Engineer with deep expertise in agentic AI systems, LLM orchestration, and end-to-end model development. The ideal candidate will own the design and deployment... 
    Senior

    Argyle Infotech

    New York, NY
    3 days ago
  • $182.3k - $220k

     ...forward is to give people their health, and the current healthcare system isn't built to do that. It was built to bill, not to serve...  ...clinical operations, and internal tooling. We're hiring a Senior AI Engineer to join a new team we're building from the ground up... 
    Senior
    Local area

    Ro

    New York, NY
    15 hours ago
  •  ...Spara Spara is building AI agents that sell. Our agents engage buyers across...  ...that will be much bigger. Our engineering team is small and senior, and everyone has real influence on what...  ...wants to apply that energy to production systems used by large enterprises. As a... 
    Senior
    Work at office
    Remote work
    Flexible hours
    Shift work
    3 days per week

    Spara LLC

    New York, NY
    4 days ago
  • $120k - $165k

     ...communities. This is a Software Engineering position at the Director level...  ...Market Risk of the Firm. Our systems support daily risk simulations...  ...Market Risk Analytics teams, Senior management, and various regulatory...  ...development of Python-based AI applications and frameworks... 
    Senior
    Temporary work

    Morgan Stanley

    New York, NY
    3 days ago
  • $144.5k - $230k

     ...Senior AI Engineer We are the better way to work in finance. As private equity's value creation partner, we sit at the heart of PE—where...  ...of the market. Our group builds and operationalizes the AI systems that power Accordion's consulting capabilities, from agentic... 
    Senior
    Work at office
    Local area
    Remote work
    2 days per week

    Accordion USA

    New York, NY
    3 days ago
  •  ...Senior Security Engineer - AI New York, NY (Hybrid, 3 days in office) Highly competitive compensation package Join an elite technology and...  ...and deployment of emerging AI agents and LLM-based systems. Collaborate with world-class engineering, research, and... 
    Senior
    Work at office

    Elliot Partnership

    New York, NY
    4 days ago
  • $130k - $170k

     ...Mid-Level AI Software Engineer We are seeking a talented Mid-Level AI Software Engineer to join...  ...build scalable, production-grade AI systems. This is an exciting opportunity to shape...  ..., certifications, experience, skills, seniority, geographic location, business sector,... 
    Senior
    Work at office
    Local area
    Shift work
    2 days per week

    Neuberger Berman

    New York, NY
    4 days ago
  •  ...We are seeking a highly motivated and technically proficient AI Engineer to join our growing Data & Analytics team. In this role, you will...  ...scalable, secure, and compliant data flows between enterprise systems and AI models. Model Development & Orchestration:... 
    Senior
    Work experience placement
    Work at office
    Local area
    Remote work

    Celestica

    New York, NY
    1 day ago
  • $123k - $215.25k

     ...Senior AI Engineer I - Agentic AI New York, NY, United States Charlotte, NC, United States Palo Alto, CA, United States Phoenix...  ...platforms, products, and governance that enable agentic AI systems to operate responsibly and at scale across the enterprise.... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Flexible hours
    Shift work

    American Express

    New York, NY
    4 days ago
  • $230k - $260k

     ...Senior Applied AI Engineer (Mid / Senior / Staff) NYC/hybrid High-Growth Fintech Pre-SeriesC $230,000 to $26...  ...base + equity What if you could build production AI systems that real users rely on every single day, not demos, not... 
    Senior
    Immediate start
    Flexible hours

    ORBIS

    New York, NY
    2 days ago
  •  ...extend liquidity in markets around the world. As an Applied AI ML Engineer-Senior Associate in the Corporate & Investment Bank, you will be...  ...prompt engineering. Familiarity with distributed computing systems, frameworks and techniques like data sharding and DDP... 
    Senior

    J.P. Morgan

    New York, NY
    6 days ago
  • United States Digital Space LLC is looking for a Senior AI Engineer to join their new team in New York. In this hybrid role, you'll build AI features from the ground up, significantly impacting telehealth operations. Your responsibilities include creating orchestration... 
    Senior

    United States Digital Space LLC

    New York, NY
    15 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Systems Engineer. Be the first to apply!