Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Edge Inference Developer Tooling Founder

$250k

Forum Ventures

Edge Ai Infrastructure

Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted.

The opportunity: Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack.

A few examples:

Edge Observability and Developer Tools

Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow.

Memory Management and Testing for Edge Deployments

Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure.

Hardware-Agnostic Frameworks

A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice.

Memory Architectures and Processing-in-Memory

For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application-specific memory systems for edge workloads don't yet exist at scale.

We're looking for Founders to leverage their domain expertise, and care deeply about the developer experience.

You've shipped inference at the edge and hit the wall on memory, latency, or platform lock-in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Are convinced AI can deliver the outcomes better than humans to build full-stack, AI Native services in industries where outcomes depend on expertise, regulation, and trust.

While we're actively building out these ideas, Forum Ventures is always open to hearing from founders with bold, original ideas. If you're working on an early-stage B2B SaaS company, even at the idea stage, pitch us still.

Your Partners in Co-Creation:

Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way.

Forum derisks and accelerates the Founder path by:

  • A $250K USD investment, and an end-to-end fundraising playbook and network to raise your seed and Series A
  • A validation partner with proven playbooks, networks, and the systems to validate, unlock your ICP, ignite your sales pipeline, and beyond
  • The support of our experienced operating team - from business design, product development, growth, recruitment, legal and more
  • Executing a winning GTM strategy to get to $50-100K ARR, and the right MVP to ensure early traction
  • A community full of mentors, peers, and leaders
  • $100K worth of business perks

About you:

  • Early-stage operator experience, and expertise in the problem space you're building in.
  • The ability to attract, hire and lead world-class teams
  • A demonstrated passion for technology's ability to change the world
  • A desire to be a venture-backed founder
  • Canada or US-based, and the ability to collaborate in North American time zones.

Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre-seed or Seed round, please pitch our investment team instead here.

Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Edge Inference Developer Tooling Founder in United States vacancy
  • A cutting-edge robotics company in California seeks an ML Infrastructure Engineer to build and operate inference systems for their automation stack. Responsibilities include maintaining...  .... Join a team at the forefront of developing humanoid robots to make a significant impact... 
    Suggested

    Rhoda AI

    Palo Alto, CA
    1 day ago
  •  ...A technology company in Georgia is seeking a C++ Engineer to own the inference backbone of its AI stack, focusing on deploying models to edge devices. You'll collaborate closely with researchers and manage a cross-functional team to enhance existing products with AI features... 
    Suggested

    Framework Ventures

    New York, NY
    4 days ago
  •  ...to architect the future of AI at the edge? Join the Akamai Inference Cloud Team! The Akamai Inference...  ...running inference models and empower developers to create advanced AI solutions effectively...  ...technical decisions on frameworks, tools, and approaches for AI workload... 
    Suggested
    Permanent employment
    Work at office
    Remote work
    Work from home
    Worldwide
    Flexible hours

    Akamai

    United States
    4 days ago
  • $180k

     ...the Role The xAI Tooling team (Starfleet) is looking...  ...for designing, developing, and maintaining robust...  ...with, and deploy cutting-edge AI models and...  ...workflows for training, inference, evaluation, and deployment...  ...as a tech lead, former founder, etc. Expertise in... 
    Suggested
    Full time
    Temporary work

    Xai

    Palo Alto, CA
    20 hours ago
  •  ...Senior Machine Learning Engineer (Inference Platform) in the United States....  ...and scalable deployments Develop observability, monitoring, alerting, and debugging tools for production inference systems...  ...Exposure to cutting-edge LLM and AI inference technologies... 
    Suggested
    Remote job
    Full time

    jobgether

    United States
    2 days ago
  • A leading AI research organization in San Francisco seeks an Inference Technical Lead to evaluate silicon platforms and work on model deployment for edge devices. You will collaborate with top machine learning researchers to push the boundaries of model capabilities. This... 

    OpenAI

    Los Angeles, CA
    2 days ago
  • $110k - $270k

     ...targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging...  ...team and business priorities Develop tools to scale and speed up the deployment...  ...were previously the technical co-founders of the Bitcoin computing company... 
    Work at office
    Local area
    Immediate start
    Flexible hours
    2 days per week

    quadric.io

    Burlingame, CA
    4 days ago
  •  ...a C++ Engineer to work on the AI layer that powers local AI on edge devices. The role includes deploying machine learning models using...  ...candidate will have strong C++ skills and experience with inference engines, as well as a relevant degree and a solid track record... 
    Local area

    Framework Ventures

    New York State
    2 days ago
  • $128.7k - $261.3k

     ...About the Team The Model Deployment & Inference Solutions team in GM AV deploys...  ...inference on the vehicle, along with the developer-experience and agentic-tooling layer that makes deployment self-...  .... What Will Give You A Competitive Edge (Preferred Qualifications)... 
    Flexible hours
    Shift work

    General Motors

    New York, NY
    2 days ago
  •  ...Framework Ventures is seeking a C++ Engineer in Town of Norway, Wisconsin, specializing in AI development for edge devices. The role involves working on inference engines like llama.cpp and ONNX, ensuring optimized performance across hardware. You'll deploy machine... 

    Framework Ventures

    Waterford, WI
    20 hours ago
  • $161.5k - $218.5k

     ...run everywhere—from cloud to edge—powering billions of devices...  ...worldwide! We are looking for a Developer Relations Engineer - Edge to...  ...in SDKs, runtimes, and tooling. You will advocate for improvements...  ...across areas like on-device inference, model deployment, data pipelines... 
    Work at office
    Local area
    Worldwide

    Arm Limited

    Austin, TX
    4 days ago
  • Responsibilities We are looking for a Developer Relations Engineer - Edge to Cloud Platforms to help developers...  ...identify friction in SDKs, runtimes, and tooling. You will advocate for improvements across areas like on-device inference, model deployment, data pipelines, and... 

    Semiconductor Engineering

    Austin, TX
    3 days ago
  •  ...to deliver industry-leading training and inference speeds and empowers machine learning users...  ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced...  ...them. This website or its third-party tools process personal data. For more details,... 

    CEREBRAS SYSTEMS INC.

    Sunnyvale, CA
    1 day ago
  • $320k

     ...creativity, intuition and cutting-edge technology. Come be a part of...  ...scale, we are investing in tooling and observability to make the...  ...stack, from model inference through different stages of auction...  ...offline vs. online comparison Develop and maintain diagnostics,... 
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix Inc

    New York, NY
    1 day ago
  •  ...A leading IT solutions provider is seeking a passionate C# .NET Automation Developer to join their dynamic team. In this 100% remote role, you'll develop and maintain automation tools, scripts, and apps, focusing on integrating solutions across platforms. The ideal candidate... 
    Remote work
    Flexible hours

    AutoAdmins, LLC.

    New York, NY
    2 days ago
  • $139.9k - $274.8k

     ...Microsoft and Azure customers-from cutting-edge startups to Fortune 500 enterprises. Our?converged AI fabric?delivers inference capabilities for all LLMs in Microsoft catalog...  ...using modern AI-assisted development tools and workflows to move faster, improve quality... 
    Ongoing contract
    Local area

    Microsoft Corporation

    Redmond, WA
    3 days ago
  •  ...Software Engineer, Developer And Qualification Tools At d-Matrix, we are focused on unleashing the potential of generative AI to power the...  ...developer and diagnostic tools for d-Matrix' cutting edge AI inference accelerators. You will be responsible for the design,... 

    D-Matrix

    United States
    20 hours ago
  •  ...Software Engineer - Dedicated Inference Team Baseten powers mission-critical inference for...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly... 
    Remote work
    Flexible hours

    Baseten

    United States
    20 hours ago
  •  ...Software Engineer - Inference Stack Baseten powers mission-critical inference for the world...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help... 
    Remote work
    Flexible hours

    Baseten

    United States
    20 hours ago
  •  ...The Senior Edge AI Field Applications Engineer within Future Electronics...  ...benchmarking, and real-time edge inference implementation Conduct training sessions on Edge AI technologies, tools, and development frameworks Assist in developing Edge AI demonstration platforms... 
    Temporary work
    Flexible hours

    Future Electronics

    Boston, MA
    1 day ago
  • $152k - $241.5k

     ...limits of real-time large language model inference? Join NVIDIA's TensorRT Edge-LLM team and help shape the next...  .... What you'll be doing: Develop and evolve a state-of-the-art inference...  ...vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA... 
    Remote work

    NVIDIA

    United States
    4 days ago
  •  ...including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied...  ...Experience with observability tools and performance debugging. Familiarity...  ..., luxury fashion, and cutting-edge tech, you'll have the freedom to... 
    Internship
    Immediate start

    SpreeAI

    San Francisco, CA
    4 days ago
  •  ...with generative AI and make cutting-edge knowledge accessible to developers everywhere. THE ROLE: AMD...  ...Optimize and accelerate LLM training and inference on AMD GPUs, improving kernel,...  ...profiling and performance-analysis tools for GPU optimization and system-level... 

    Advanced Micro Devices , Inc.

    Santa Clara, CA
    3 days ago
  • A leading consumer power tools company is seeking a Machine Learning Engineer II in Anderson, SC. This role involves identifying and developing ML features for power tools, working closely with cross-functional teams to deliver data-driven solutions. Candidates should... 

    TTI Group

    Anderson, SC
    1 day ago
  •  ...Tech Lead, Data & Inference Engineer A fast moving and venture backed advertising technology...  .... We collaborate directly with Founders, CTOs, and Heads of AI in those themes who...  ...Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect). ~ Familiarity... 
    Full time

    Catalyst Labs, LLC

    Old Greenwich, CT
    1 day ago
  • $176k - $420k

     ...~ Write Python scripts/tools for training, evaluation, and...  ...environments (e.g., GPU, CPU, edge accelerators) ~ Work...  ...sensors and actuators Develop messaging frameworks (e.g., ROS...  ...C++ systems for real-time ML inference and control and for the humanoid... 
    Hourly pay
    Full time
    Temporary work
    Flexible hours

    Tesla

    Palo Alto, CA
    2 days ago
  • A leading power tools company in South Carolina is seeking an experienced Electrical Machine Learning Engineer II to join its team. This role focuses on developing and validating ML features for outdoor power tools, collaborating with various teams to translate customer... 

    NLP PEOPLE

    Anderson, SC
    20 hours ago
  • $155k - $230k

     ...Your mission is to build the tooling, pipelines, and infrastructure...  ...Python-based training and inference infrastructure, relentlessly...  ...infrastructure for our cutting-edge behavior models, focusing on...  ...deployment. Enable Data Insights: Develop tools and dashboards for data... 
    Hourly pay
    Immediate start

    Boston Dynamics

    Waltham, MA
    1 day ago
  •  ...deploying frontier models for developers and enterprises who are...  ...influence latency and throughput of inference. ~ Strong understanding or...  ...We may use AI-enabled tools to screen and assess applicants...  ...closely with a team on the cutting edge of AI research Weekly... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Cohere

    New York, NY
    4 days ago
  •  ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing... 
    Work experience placement
    Remote work
    Flexible hours

    Baseten

    United States
    20 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!