Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Edge Inference Developer Tooling Founder

$250k

Forum Ventures

Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted. The opportunity: Build the software and tooling layer that makes edge hardware usable - frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A few examples: Edge Observability and Developer Tools Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow. Memory Management and Testing for Edge Deployments Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure. Hardware-Agnostic Frameworks A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice. Memory Architectures and Processing-in-Memory For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application-specific memory systems for edge workloads don't yet exist at scale. We're looking for Founders to leverage their domain expertise, and care deeply about the developer experience. You've shipped inference at the edge and hit the wall on memory, latency, or platform lock-in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. are convinced AI can deliver the outcomes better than humans to build full-stack, AI Native services in industries where outcomes depend on expertise, regulation, and trust. While we're actively building out these ideas, Forum Ventures is always open to hearing from founders with bold, original ideas. If you're working on an early-stage B2B SaaS company, even at the idea stage, pitch us still. Your Partners in Co-Creation: Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way. Forum derisks and accelerates the Founder path by: A $250K USD investment, and an end-to-end fundraising playbook and network to raise your seed and Series A A validation partner with proven playbooks, networks, and the systems to validate, unlock your ICP, ignite your sales pipeline, and beyond The support of our experienced operating team - from business design, product development, growth, recruitment, legal and more Executing a winning GTM strategy to get to $50-100K ARR, and the right MVP to ensure early traction A community full of mentors, peers, and leaders $100K worth of business perks About you: Early-stage operator experience, and expertise in the problem space you're building in. The ability to attract, hire and lead world-class teams A demonstrated passion for technology's ability to change the world A desire to be a venture-backed founder Canada or US-based, and the ability to collaborate in North American time zones. Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre-seed or Seed round, please pitch our investment team instead here. Forum Ventures

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Edge Inference Developer Tooling Founder in New York, NY vacancy
  • $190k - $260k

     ...AI company. We build cutting-edge foundation AI models and end-...  ...The team is responsible for developing, deploying, and operating the...  ...influence latency and throughput of inference.Strong understanding or...  ...needs.We may use AI-enabled tools to screen and assess applicants... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    21 days ago
  •  ...Opportunity Baseten powers mission-critical inference for the world's most dynamic AI companies...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    2 days ago
  • $160k - $240k

    Senior Software Engineer - AI Inference Location New York Business Area Engineering...  ...models, both predictive and cutting-edge generative models. We abstract away...  ...roll out new models to millions of users. Developing new inference capabilities such as structured... 
    Suggested
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    a month ago
  •  ...strategy, services, and technology partner. We develop infrastructure, provide life-changing...  ..., alignment, efficiency, and joy. Our EDge product suite is an integrated collection...  ...workflows, smartly integrating critical tools and resources, serving up actionable data... 
    Suggested
    Work at office
    Home office
    Flexible hours

    Noodle

    New York, NY
    4 days ago
  • $200k - $300k

     ...business, so it is everyone's job to make sure our developers have everything they need to do their jobs well.As a member of the AI Tools team, you will be responsible for increasing...  ...by the excitement of being at the cutting edge of automation in every part of our... 
    Suggested
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    a month ago
  • $158.1k - $213.8k

     ...relationships between each of billions of products.* Design and develop intuitive solutions that will help customers make better informed...  ...multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience-... 
    Internship
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    a month ago
  • $141.9k - $190.3k

     ...Job Posting Title:Senior Software Developer - Build Tooling DevelopmentReq ID:10142522Job Description:**This position must sit onsite four (4) days a week in one of our technology offices listed above***Technology is at the heart of Disney’s past, present, and future.... 
    Full time
    Remote work

    Hulu

    New York, NY
    a month ago
  • Qualcomm Technologies, Inc. is seeking a Machine Learning / AI Engineering Intern to help build state‑of‑the‑art ML tools for mobile and embedded platforms. You will join a multi‑disciplinary team and work with popular frameworks while exploring ML hardware accelerators... 
    Summer work
    Internship
    Relocation

    QUALCOMM, Inc.

    New York, NY
    2 days ago
  •  ...pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with...  ...other teams depend on, and raise the quality bar for the developer experience across that whole surface. Because this team is CoreWeave... 
    Permanent employment
    Full time
    Contract work
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    14 hours ago
  • $229.9k - $262.4k

     ...customers interact with Capital One. Design, develop, test, deploy, and support AI software...  ...model training, large language model inference, similarity search, guardrails, model evaluation...  ...-party products, services, educational tools or other information available through... 
    Full time
    Part time
    Local area

    Capital One

    New York, NY
    3 days ago
  • Inference Runtime Software Engineer LM Studio is used by millions of people around the world to run AI on their own computers, and now with...  ...prioritize putting the human in the center, and creating tools that we want to use ourselves, and recommend to our friends and... 
    Work at office
    Work from home
    Flexible hours

    Lm Studio

    New York, NY
    2 days ago
  • $207k - $300k

     ...excellence.Partner with Product Managers, User Experience (UX), and Developer Relations (DevRel) to advance the developer experience,...  ...a complex, matrixed organization.Experience shipping developer tools or IDE extensions (e.g., VS Code) with a strong intuition for developer... 
    Full time

    Google

    New York, NY
    15 days ago
  • $90k - $150k

    Platform Engineer - Commercial Services Tools Veeva Systems is the cloud software leader for the life sciences industry, building the...  ...stack. As a Services Platform Engineer you'll ship real, cutting-edge AI features to production fast — working shoulder-to-shoulder with... 
    Local area
    Remote work
    Flexible hours

    Ostro by Veeva

    New York, NY
    4 days ago
  • $158.1k - $213.8k

     ...join a dynamic team working at the cutting edge of the GenAI revolution by applying AI to AI. You will work on building agents, tools, and models to simplify and accelerate...  ...optimization, ML compiler tuning, distributed inference and training, or ML kernel authoring and... 
    Flexible hours

    Amazon

    New York, NY
    15 days ago
  • $20 - $22 per hour

     ...follows best practices on job sites A self‑motivated learner eager to develop technical skills Someone seeking a long‑term career path WHAT...  ...with daily tasks and project work Maintain and organize tools and equipment on job sites and in service vehicles Track and maintain... 
    Hourly pay
    Apprenticeship
    Work at office

    Aweinc

    New York, NY
    14 hours ago
  •  ...an early-stage, cutting-edge AI startup in New York...  ...work closely with the founders to turn ideas into production...  ...from zero to one Develop modern frontend...  ...AI agents that can use tools, complete workflows, and...  ...security, latency, and AI inference costs Work directly... 
    Work at office
    Local area
    Remote work
    Relocation

    Mangrum Career Solutions LLC

    New York, NY
    a month ago
  • $140k - $150k

     ...risk insights, robust data, and dynamic tools to champion more efficient, transparent financial...  ...impact. Driven by investment in cutting-edge technologies like AI and cloud solutions,...  ..., and event-driven architecture. Develop Java micro-services to support the... 
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch Group

    New York, NY
    4 days ago
  • $176.72k - $265.08k

     ...looking for a Lead Generative AI Developer to join our COO Technology...  ..., and operationalize cutting-edge Generative AI and Large...  ...fine-tuning (LoRA, PEFT), and inference optimization.Cloud Platforms:...  ...accommodation to use our search tools and/or apply for a career opportunity... 
    Full time

    Citigroup

    New York, NY
    a month ago
  • $500 per month

     ...backed by top-tier investors like Founders Fund and General Catalyst. This...  ...technical product serving cutting-edge industries Competitive salary + meaningful...  ...Job Details Job Responsibilities Develop and deploy tailored software solutions, tools, and integrations that address... 
    Local area

    Jobot

    New York, NY
    3 days ago
  •  ...that combines expert advisors with cutting-edge technology - delivering a comprehensive,...  ...wealth management experience.Farther’s founders are leaders and innovators from the private...  ...to portfolio management to advisor tools.You'll join our mobile engineering team working... 

    Farther Advisors

    New York, NY
    a month ago
  •  ...expert advisors with cutting-edge technology - delivering a comprehensive...  ...experience.Farther’s founders are leaders and innovators from...  ...both sides to it with testsTreat developer experience as a first-class...  ...with LLMs — agentic systems, tool calling, streaming responses,... 
    Contract work

    Farther Advisors

    New York, NY
    2 days ago
  • $80k - $158k

    Job Title: Senior Application Delivery & Edge Security Engineer (Remote) City: Minneapolis State/Province: Minnesota Posting Start...  ...knowledge of scripting, automation, or infrastructure automation tools is preferred. ͏ Preferred Skills Hands-on experience with F5... 
    Remote job
    Minimum wage
    Full time
    Local area

    Wipro

    New York, NY
    4 days ago
  • $150k - $175k

     ...Description Full-Stack .NET Developer (Security Camera Platform)...  ...ingestion services to reporting tools and operator-facing features....  ...cloud-hosted versus embedded/edge scenarios. Networking proficiency...  ...). Computer-vision or ML inference integration experience.... 
    Temporary work
    Work at office
    Work from home

    Paths Building Services LLC

    New York, NY
    11 days ago
  • $184.9k - $250.2k

     ...problems, using and building state-of-the-art tooling.About Amazon Annapurna Labs:Amazon...  ...chips. Inferentia delivers best-in-class ML inference performance at the lowest cost in the...  ...join a dynamic team working at the cutting edge of the GenAI revolution by applying AI to... 
    Internship
    Flexible hours

    Amazon

    New York, NY
    a month ago
  • $225k - $300k

     ..., government, and legal. Our tools, Chandra, Surya, Marker, and...  ...,000+ GitHub stars and broad developer mindshare. We're backed by founding...  ...That includes building core inference workflows, creating intuitive...  ...will work closely with the founders and the rest of the team to... 

    Data Lab

    New York, NY
    21 hours ago
  • $150k - $300k

     ...the way work is done. We’re developing AI agents that make powerful...  ...fluent with the latest AI coding tools and are always looking for...  ...logistics, and more) ~ Leading-edge agentic AI tech, solving deep...  ...future ~ Work closely with founders Jessica Wu (ex-Citadel,... 
    Work at office
    Relocation
    Relocation package
    Flexible hours

    Sola

    New York, NY
    a month ago
  • $200k - $300k

     ...drive the invention of new techniques, tooling, and models. You’ll work across the full...  ...lifecycle—from data acquisition to real-time inference and user-facing chat interfaces. If...  ...about your craft, think like a founder, and want to be on the frontier of voice... 
    Relocation package

    Rilla

    New York, NY
    2 days ago
  •  ...that combines expert advisors with cutting-edge technology - delivering a comprehensive,...  ...management experience. Farther’s founders are leaders and innovators from the private...  ...multiplier. We expect engineers to leverage AI tools throughout the development lifecycle –... 

    CarData

    New York, NY
    2 days ago
  •  ...high-caliber team of software developers and deep learning experts,...  ...integrations to platforms and tools related to model monitoring and...  ...Ray, Spark and in training/inference systems such as Ray, vllm/SGLang...  ..., which provides cutting edge data and analytics infrastructure... 

    JP Morgan Chase

    New York, NY
    15 days ago
  • $140k - $200k

     ...traditional HR and management tools have failed to deliver real transformation...  ...You'll be working on cutting-edge AI systems that directly...  ...with modern AI APIs and develop intelligent automation workflows...  ...Makes You Stand Out Former founder or founding engineer... 
    Work at office
    Immediate start

    Emerge Talent

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!