Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Applied AI Inference - Forward Deployed Engineer

$165k - $330k

Baseten

About Baseten Baseten powers mission‑critical inference for the world’s most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. The role As a Forward Deployed Engineer at Baseten, you will partner directly with customers to architect, build, and deploy high‑scale production AI applications on Baseten’s platform. You’ll own the journey with customers from initial exploration to production deployment, translating ambiguous business goals into reliable, observable services with clear quality, latency, and cost outcomes. This role is a great fit for entrepreneurial engineers who want a front‑row view into how modern companies adopt AI at scale and who enjoy working across product, software development, performance engineering, and customer‑facing implementations. To be clear, this is an engineering role with hands‑on coding and software development that also includes aspects of product management, technical customer success, and pre‑sales solution engineering mixed in. Example initiatives Forward Deployed Engineering on the frontier of AI The fastest, most accurate Whisper transcription Deploy production‑ready model servers from Docker images Deploy custom ComfyUI workflows as APIs Responsibilities Develop and maintain software systems and product features using one or more general‑purpose programming languages in a production‑level environment, with a preference for Python due to its relevance in ML projects. Drive customer impact by designing, implementing, and deploying Baseten solutions end‑to‑end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion. Deliver with velocity: turn vague objectives into clear specs and well‑defined PoCs so we can rapidly ship well‑tested services and outcomes for our customers. Optimize and enhance AI/ML projects, contributing to the continuous improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs. Own products and customer projects end‑to‑end, functioning as both an engineer, project manager, and product manager, with a focus on user empathy, project specification, and end‑to‑end execution. Navigate ambiguity and exercise good judgment on tradeoffs and tools needed to solve problems, avoiding unnecessary complexity. Demonstrate pride, ownership, and accountability for your work, expecting the same from your teammates. Requirements Bachelor’s, Master’s, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field. 2+ years of professional work experience in a fast‑paced, high‑growth environment. Demonstrated experience with one or more general‑purpose programming languages in a production‑level environment, with a strong preference for Python. Familiarity with AI/ML pipelines and the lifecycle of ML model development and deployment. Strong communication skills, particularly on complex technical topics. Experience in building or optimizing AI/ML projects is highly valued. Benefits Competitive compensation, including meaningful equity. 100% coverage of medical, dental, and vision insurance for employee and dependents. Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year’s Day!). Paid parental leave. Fertility and family‑building stipend through Carrot. Company‑facilitated 401(k). Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities. Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward‑thinking team, we would love to hear from you. At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable). Compensation Range: $165K - $330K #J-18808-Ljbffr Baseten

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Applied AI Inference - Forward Deployed Engineer in New York, NY vacancy
  • $106.9k - $176.5k

     ...Join EY and help to build a better working world. Forward Deployed Engineer – Applied AI - Senior - Financial Services EY is the only professional...  ..., QLoRA, PEFT, NeMo Framework etc.) Familiarity with inference optimization principles — latency, throughput, and cost... 
    Suggested
    Summer holiday
    Flexible hours

    Ernst & Young

    New York, NY
    2 days ago
  • $250k

    Forward Deployed Software Engineer, Applied AI - Frontier AI Lab Location: New York, NY. In office on average 3x/week; you will split your time between working remotely and being in-office at customers’ offices. The company is a stealth AI neo-lab building and training... 
    Suggested
    Work at office
    Remote work
    3 days per week

    Skyrocket Ventures

    New York, NY
    2 days ago
  • $180k - $264k

     ...Invisible Technologies makes AI work. Our end-to-end AI platform...  ...automates digital workflows, deploys agentic solutions, measures...  ...Role As a Senior Software Engineer, Forward Deployed Engineer (FDE) you'll...  ...Partner will confirm which tier applies to your location. For... 
    Suggested
    Work at office
    Local area
    Remote work
    3 days per week

    Invisible Technologies Inc. Defunct

    New York, NY
    2 days ago
  •  ...agents, enterprises, and even nation states. Our team of AI researchers and company builders come from DeepMind,...  ...We’re looking for a core member of Reflection’s Applied AI team to drive our Forward Deployed Engineering efforts with enterprise customers. This team works... 
    Suggested
    Relocation package

    Reflection

    New York, NY
    2 days ago
  •  ..., and even nation states. Our team of AI researchers and company builders come...  ...lead to build and scale Reflection’s Forward Deployed Engineering function within the AI Solutions team....  ...contributing to our internal codebase for inference, fine‑tuning, and evaluation. Own end... 
    Suggested
    Relocation package

    Reflection AI

    New York, NY
    2 days ago
  •  ...in private equity to build an embedded AI engineering function from the ground up. A well-...  ...investment teams, and hiring one of its first Forward Deployed Engineers to work alongside its...  ...role, a bank strats desk, an applied AI product company, or anywhere you've... 

    Mondrian Alpha

    New York, NY
    2 days ago
  • $175.5k - $180k

     ...place. YOUR IMPACT You’ll deploy and scale a next‑generation AI platform designed to...  ...intersection of software engineering and infrastructure, bringing...  ...resilience to try another way forward. In return for your...  ...science, machine learning, applied statistics, mathematics,... 
    Apprenticeship
    Work at office
    Easy work

    McKinsey & Company

    New York, NY
    2 days ago
  • $150k - $200k

     ...person who scaled Palantir Commercial's engineering org from 5 to 600+ people. They partner...  ...work shoulder‑to‑shoulder with them to deploy AI and frontier technology that drives real...  ...experience in full‑stack software engineering or Forward Deployed Engineering, with a strong CS/... 

    OMW Consulting

    New York, NY
    1 day ago
  •  ...on a large-scale, multibillion dollar Gen AI initiative that leverages LLMs to create...  ...and requires someone who is an effective engineer and communicator. 3+ years of experience as a software engineer, ideally a forward deployed engineer. Prior professional experience working... 

    Focus Capital Markets

    New York, NY
    2 days ago
  • $15 per hour

     ...Maybern is founded by top engineering experts with deep...  ...fund management, and Forward Deployed Engineering is where that...  ...platform: production AI, decision support, forecasting...  ...quantitative systems, applied research, or forward-...  ...across modeling, inference, optimization,... 
    Work at office
    Work from home
    Flexible hours

    Maybern Solutions, Inc

    New York, NY
    14 hours ago
  •  ...Inferred Edge is a boutique engineering firm building custom, AI-first operating systems for our clients. Role Description Leading...  ...and managing integrations Deploying AI use cases and solutions within...  ...clients Adaptability in learning and applying new AI-driven technologies... 
    H1b
    Visa sponsorship

    Inferred Edge

    New York, NY
    1 day ago
  • $5,900 - $10,500 per month

     ...real, critical work with the engineers and customers building the future...  ...problems: helping customers deploy AI‑powered solutions, building...  ...two internship role options. Forward Deployed Software Engineer At...  ...similar Hands‑on experience applying AI (whether through coursework... 
    Work experience placement
    Internship

    Palantir Technologies

    New York, NY
    1 day ago
  • $150k - $200k

    Aigentless is seeking a Forward-Deployed Engineer in New York City to join our dynamic team. In this role, you’ll collaborate with customers and engineers to solve complex technical problems. We are looking for candidates with a strong product sensibility and a commitment... 

    Aigentless

    New York, NY
    2 days ago
  • $200k - $300k

    AustinWorks is seeking a Forward Deployed Engineer to bridge engineering, product, and customer needs in New York. The role involves working closely with engineering teams to implement solutions that deliver significant impact in production environments. Ideal candidates... 

    AustinWorks

    New York, NY
    2 days ago
  • Hiring: Forward Deployed Engineer - AI Cotera is looking to hire a Forward Deployed Engineer out of our New York Office to work with our enterprise team to deploy AI agents. You will be working in Cotera day in/day out to solve problems at the cutting edge of AI. You’ll... 
    Work at office
    Weekend work

    Cotera

    New York, NY
    4 days ago
  • Stealth Startup in New York City seeks a Forward Deployed Engineer to own the technical relationship with enterprise and government clients from pilot through full adoption. You will build custom integrations, data pipelines, and workflows that embed the company's technology... 

    Stealth Startup

    New York, NY
    2 days ago
  • $179.5k - $224.3k

     ...infrastructure for the global AI economy. We are...  ...to production deployment, without the cost...  .... Built by engineers, for engineers. From...  ...orchestration to inference optimization, we own...  ..., networking and applied AI. Listed on Nasdaq...  ...scale. The Team Forward Deployed... 
    Full time
    Work at office
    Relocation

    Nebius

    New York, NY
    2 days ago
  • $270k - $300k

    Forward Deployed Engineer (AI Transformation) | NYC (On-Site) | OTE $270K - $300K+ Are you a highly ambitious, elite Full‑Stack Engineer who feels restricted by the slow pace of big tech? Are you ready to bet on yourself, ship production‑grade AI at frontier speeds, and... 

    Ikuto

    New York, NY
    2 days ago
  • $135k - $200k

     ...and implement solutions using data. Forward Deployed Software Engineer (FDSE) Forward Deployed Software Engineers...  ...implement solutions using data. They apply problem‑solving ability, creativity,...  ...Wrangle massive‑scale data and use AI to accelerate and enhance critical... 
    Work experience placement
    Relocation package

    Palantir Technologies

    New York, NY
    2 days ago
  • $188k - $225.6k

    Senior Software Engineer, Forward Deployed About Scale AI At Scale AI, our mission is to accelerate the development of AI applications. For 8 years, Scale...  ...see our privacy policy for additional information. Apply for this job * indicates a required field First Name *... 
    Full time
    Contract work
    For contractors
    For subcontractor
    Work at office
    Shift work

    Scale AI

    New York, NY
    2 days ago
  • $180k - $260k

    Overview Forward Deployed Software Engineer (NYC/Remote) - On-site or Remote (Pacific Time hours). Our client is a fast-growing tech startup building...  ...As a Forward Deployed Software Engineer, you\'ll be an Applied AI Engineer who builds and deepens the technical... 
    Remote job
    Full time
    Visa sponsorship

    MLabs

    New York, NY
    2 days ago
  •  ...disruptions, locate missing children, and more. Forward Deployed Engineer, Internship Forward Deployed...  ...critical problems by deploying software and AI into the high stakes operations of the...  ...in December 2027 or Spring 2028. To Apply An updated resume / CV - please do so in... 
    Internship
    Shift work

    Palantir Technologies

    New York, NY
    2 days ago
  • $250k - $300k

    A healthcare technology company is seeking a Forward Deployed Engineer to architect reliable and scalable services for healthcare systems. The ideal...  ...as Java and Python, focusing on building and integrating AI designs into production systems. This role offers a competitive... 

    3Y Health

    New York, NY
    4 days ago
  • $135k - $200k

     ...disruptions, locate missing children, and more. The Role Forward Deployed AI Engineers work directly with customers owning Gen AI strategy and implementation...  ...organizations. Do you aspire to be an entrepreneur or an Applied AI leader? We believe Palantir is the best place — with... 
    Work experience placement
    Work at office
    Remote work
    Work from home
    Relocation package
    Flexible hours

    Palantir Technologies

    New York, NY
    1 day ago
  • $180k - $250k

     ...AI Forward Deployed Engineers Most of what makes American healthcare expensive isn't medical care. It's the machinery wrapped around it: middlemen...  ..., bigger opportunities, and rapid career velocity. Apply AI to a problem that matters: Instead of optimizing ads or... 
    Night shift

    Arlo Inc

    New York, NY
    4 days ago
  • $300 per month

     ...Scientific builds and commercializes AI agents for science....  ...team of top researchers and engineers across AI and biology to build an AI scientist. Role As a Forward Deployed AI Engineer, you'll be embedded...  ...gaps and work with our internal Applied AI and engineering teams to... 
    Work at office
    Remote work

    Edison Scientific

    New York, NY
    1 day ago
  • $120k - $160k

     ...Join to apply for the Forward Deployed AI Engineer role at StackAI This range is provided by StackAI. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base Pay Range $120,000.00/yr - $160,000.00/yr Role Overview We’... 
    Full time

    StackAI

    New York, NY
    1 day ago
  •  ...Forward Deployed AI Engineer View all jobsForward Deployed AI EngineerNYC-MetroEngineering/ProductIn officeFull-time### Build the AI workforce that...  ...status, veteran status, or disability status.Ready to apply?Powered byFirst name \*Last name \*Email \*LinkedIn URL \*... 

    Obin AI

    New York, NY
    1 day ago
  • $110k - $160k

     ...you will design, build, and deploy AI-powered systems that accelerate...  ...directly with Product, Engineering, Data, Security, Legal, Compliance...  ...Rewarded: At CLEAR we help YOU move forward - because when you’re at your...  ...reasonable accommodation to apply for a job or perform your job... 
    Flexible hours

    Clear

    New York, NY
    1 day ago
  • $230k - $330k

    Overview As a Senior Forward Deployed Engineer (SFDE) at Parloa, you’ll be on the front lines of enterprise AI adoption - delivering cutting-edge technology into some of the most...  ...Parloa, the role, or our team before you apply? Please feel free to get in touch with our... 
    Work at office
    Flexible hours
    Night shift

    Parloa

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Applied AI Inference - Forward Deployed Engineer. Be the first to apply!