Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Edge Inference Developer Tooling Founder

$250k

Forum Ventures

Edge Ai Founders Opportunity

Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted.

The opportunity: Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A few examples:

Edge Observability and Developer Tools

Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow.

Memory Management and Testing for Edge Deployments

Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure.

Hardware-Agnostic Frameworks

A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice.

Memory Architectures and Processing-in-Memory

For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application-specific memory systems for edge workloads don't yet exist at scale.

We're looking for Founders to leverage their domain expertise, and care deeply about the developer experience.

You've shipped inference at the edge and hit the wall on memory, latency, or platform lock-in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Are convinced AI can deliver the outcomes better than humans to build full-stack, AI Native services in industries where outcomes depend on expertise, regulation, and trust.

While we're actively building out these ideas, Forum Ventures is always open to hearing from founders with bold, original ideas. If you're working on an early-stage B2B SaaS company, even at the idea stage, pitch us still.

Your Partners in Co-Creation:

Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way.

Forum derisks and accelerates the Founder path by:

  • A $250K USD investment, and an end-to-end fundraising playbook and network to raise your seed and Series A
  • A validation partner with proven playbooks, networks, and the systems to validate, unlock your ICP, ignite your sales pipeline, and beyond
  • The support of our experienced operating team - from business design, product development, growth, recruitment, legal and more
  • Executing a winning GTM strategy to get to $50-100K ARR, and the right MVP to ensure early traction
  • A community full of mentors, peers, and leaders
  • $100K worth of business perks

About you:

  • Early-stage operator experience, and expertise in the problem space you're building in.
  • The ability to attract, hire and lead world-class teams
  • A demonstrated passion for technology's ability to change the world
  • A desire to be a venture-backed founder
  • Canada or US-based, and the ability to collaborate in North American time zones.

Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre-seed or Seed round, please pitch our investment team instead here.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Edge Inference Developer Tooling Founder in United States vacancy
  •  ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently...  ...scheduling systems, test infrastructure, developer tools, and reusable software platforms that allow... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ...enterprises, and cutting-edge AI-native startups. OpenAI recently...  ...talk.ResponsibilitiesDesign, develop, test, and maintain production...  ...website or its third-party tools process personal data. For more... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    1 day ago
  • $209.1k - $282.9k

     ...to the next generation of Physical and Edge AI platforms on Arm. Your work will focus...  ...on building platform-level services, developer tooling, and runtime infrastructure that boost...  ...or real-time systems. Exposure to AI/ML inference systems, even from a platform or infrastructure... 
    Suggested
    Work at office
    Local area

    ARM

    Seattle, WA
    23 hours ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced...  ...them.This website or its third-party tools process personal data. For more details,... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced...  ...them.This website or its third-party tools process personal data. For more details,... 
    Suggested

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...Packard Enterprise is the global edge-to-cloud company advancing...  ...HPE AI Essentials, the inference platform used by enterprises...  ...whether each runtime is adopted, developed in-house, or declined· Define...  ..., and profile C++/CUDA using tools such as Nsight· Experience with... 
    Full time
    Work experience placement
    Work at office
    Local area
    Immediate start
    Remote work
    2 days per week

    Hewlett Packard Enterprise

    Durham, NC
    4 days ago
  •  ...is seeking a senior ML/NLP engineer to design and deploy advanced model serving architectures for high-throughput, low-latency inference on edge and mobile devices. You will build tests, prepare datasets, analyze bottlenecks, and integrate optimized serving frameworks... 

    Tether Operations Limited

    New York, NY
    2 days ago
  •  ...deliver industry-leading training and inference speeds; over 10 times faster than...  ..., global enterprises, and cutting-edge AI-native startups. OpenAI...  ...infrastructure, test infrastructure, tooling, and automation that improves developer velocity and engineering productivity... 

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $185.5k - $244.6k

     ...Engineer to join our growing Edge AI team. As a key contributor...  ...you will lead the on-device inference and performance optimization...  ...mismatches on target runtimesBuild tooling for profiling, benchmarking,...  ...at the core of our work, and developing strong, long-term... 
    Work at office

    SimpliSafe

    Boston, MA
    1 day ago
  • Baseten is hiring an Engineer for the Dedicated Inference team to shape developer experience for deploying and operating AI workloads in production. You’ll build CLI, SDKs, APIs, observability, and debugging workflows that customers rely on daily to manage inference deployments... 

    Baseten

    Seattle, WA
    2 days ago
  • $225k - $325k

     ...AI company. We build cutting-edge foundation AI models and end-...  ...The team is responsible for developing, deploying, and operating the...  ...influence latency and throughput of inference.Strong understanding or...  ...needs.We may use AI-enabled tools to screen and assess applicants... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  • Jobgether SRL is seeking an AI Research Engineer (Kernel & Inference Optimization) to advance model-serving architectures for diverse hardware and edge devices. You will blend hands-on research with low-level engineering to push latency, throughput, and memory efficiency... 
    Remote work

    Jobgether SRL

    New York, NY
    4 days ago
  •  ...a 12-week paid summer internship for an AI Applied Engineering Intern in the United States. The role focuses on improving AI inference for edge devices, balancing software engineering with machine learning, and evaluating AI workflows on resource-constrained hardware.... 
    Internship
    Summer internship

    HP

    Vancouver, WA
    10 hours ago
  • $190k - $260k

     ...AI company. We build cutting-edge foundation AI models and end-...  ...The team is responsible for developing, deploying, and operating the...  ...influence latency and throughput of inference.Strong understanding or...  ...needs.We may use AI-enabled tools to screen and assess applicants... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  • Analog Devices, Inc. seeks an Embedded AI Tools Engineer to build deployment infrastructure for intelligent edge SoCs and to optimize AI models for embedded hardware. You will join a core AI tooling team and influence compiler, quantization, pruning, and architecture-aware... 

    Analog Devices

    Wilmington, MA
    2 days ago
  • $165.2k - $223.6k

    The Edge Intelligence team, part of Amazon's Connected Vehicles organization...  ...Applications: Design and develop applications that power in-...  ...device platforms* Edge Inference & ML: Build and optimize on-device...  ...distributed software applications, tools, systems, and services using:... 
    Internship
    Local area
    Flexible hours

    Amazon

    Santa Cruz, CA
    4 days ago
  • $152k - $241.5k

     ...Engineer specializing in Deep Learning Inference for our growing team. As a key...  .... Our team is responsible for developing and maintaining high-performance...  ...accelerators, from datacenter GPUs to edge SoCs. You'll bring to bear open-source tools and plugins—including CUTLASS,... 
    Full time
    Remote work

    Nvidia

    Austin, TX
    1 day ago
  • $250k - $300k

     ...seeking an AI Research Engineer (Inference) to join the HAIL team. HAIL...  ...team at HRT responsible for developing and maintaining our most...  ...excitement of being at the cutting edge of automation in every part...  ...Please be advised: Use of AI tools during interviews or... 
    Work experience placement
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    2 days ago
  •  ...with engineers, contractors, and vendors.Develop secure, high-quality production code; review...  ....Champion firmwide SDLC frameworks, tools, and best practices.Promote a culture of...  ...transformer architecture, ML training, and inference.Experience with Infrastructure as Code.Deep... 
    For contractors

    JP Morgan Chase

    Seattle, WA
    23 hours ago
  •  ...deliver industry-leading training and inference speeds; over 10 times faster than...  ...global enterprises, and cutting-edge AI-native startups. OpenAI...  ...and correctness infrastructure. Develop representative benchmarks, workload replay tools, profiling automation, release qualification... 

    Cerebras Systems

    Sunnyvale, CA
    3 days ago
  •  ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently...  ...release pipelines, dashboards, or internal developer tooling.Experience with performance testing,... 
    Work at office
    Remote work
    3 days per week

    Cerebras Systems

    Sunnyvale, CA
    2 days ago
  • $96.8k - $306.4k

     ...an emerging space where the technology, developer expectations, and best practices are changing...  ...for AI Acceleration across Developer Tools, identifying where AI can materially...  ...tool use, context engineering, retrieval, inference, orchestration, evaluation, and emerging... 
    Temporary work
    Flexible hours

    Oracle Corporation

    Nashville, TN
    23 hours ago
  • $152k - $241.5k

     ...our DLC has been the backbone of NVIDIA’s inference engine, spanning across data centers,...  ...doing:Analyzing deep learning networks and developing compiler optimization algorithms....  ...authoring and performance analysis using tools such as Nsight Compute.A track record of... 
    Full time
    Remote work

    Nvidia

    Austin, TX
    3 days ago
  •  ...Join Our Innovative Team:Are you passionate about the cutting edge of technology and eager to make a real impact? We're looking...  ...future of Generative AI.In this role, you'll be instrumental in developing the tools, frameworks, and services that empower developers to create... 
    Full time
    Remote work

    Mendix

    Rotterdam, NY
    3 days ago
  • $165k - $330k

     ...Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies...  ...research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing... 
    Flexible hours

    Baseten

    Seattle, WA
    2 days ago
  • $190k - $225k

     ...voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio...  ...processes and no gatekeeping on the tools or information you need. For anyone who genuinely...  ...a Software Engineer to help turn cutting-edge AI research into products our customers... 

    AssemblyAI, Inc.

    Seattle, WA
    3 days ago
  •  ...days per week.The role: Principal System Software Engineer, AI Inference ExecutionWhat you will do:The role requires you to be part of the...  ...systems.Experience with Kubernetes, Ray, or other MLOps tools and techniques used from definition to deploymentPrior startup,... 
    3 days per week

    d-Matrix

    Santa Clara, CA
    3 days ago
  • $184k - $287.5k

     ...platform for crafting solutions for AI at-the-edge! NVIDIA is looking for phenomenal people...  ...If you are creative and passionate about developing in embedded space, we want to hear from...  ...for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.NVIDIA is... 
    Full time
    Worldwide

    Nvidia

    Santa Clara, CA
    4 days ago
  • $190k - $230k

     ...the language they speak. We use cutting-edge AI, machine translation, and human-in-the...  ...LILT, we empower our teammates with leading tools, global collaboration, and growth...  ...BI-style dashboards) Our Story Our founders, Spence and John met at Google working on... 
    Full time
    Local area

    LILT

    Remote
    10 days ago
  •  ...individual can thrive.Job DescriptionThe AI Inference Engineer plays a critical role in the AI...  ...data centers to resource-constrained edge devices—with a strong emphasis on maximizing...  ...maintain robust inference engines using tools like vLLM, TGI (Text Generation Inference... 
    Full time
    Local area
    Immediate start

    F5 Networks

    Seattle, WA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!