Edge Inference Developer Tooling Founder
$250kForum Ventures
Edge Ai Founders Opportunity
Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted.
The opportunity: Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A few examples:
Edge Observability and Developer Tools
Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow.
Memory Management and Testing for Edge Deployments
Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure.
Hardware-Agnostic Frameworks
A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice.
Memory Architectures and Processing-in-Memory
For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application-specific memory systems for edge workloads don't yet exist at scale.
We're looking for Founders to leverage their domain expertise, and care deeply about the developer experience.
You've shipped inference at the edge and hit the wall on memory, latency, or platform lock-in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Are convinced AI can deliver the outcomes better than humans to build full-stack, AI Native services in industries where outcomes depend on expertise, regulation, and trust.
While we're actively building out these ideas, Forum Ventures is always open to hearing from founders with bold, original ideas. If you're working on an early-stage B2B SaaS company, even at the idea stage, pitch us still.
Your Partners in Co-Creation:
Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way.
Forum derisks and accelerates the Founder path by:
- A $250K USD investment, and an end-to-end fundraising playbook and network to raise your seed and Series A
- A validation partner with proven playbooks, networks, and the systems to validate, unlock your ICP, ignite your sales pipeline, and beyond
- The support of our experienced operating team - from business design, product development, growth, recruitment, legal and more
- Executing a winning GTM strategy to get to $50-100K ARR, and the right MVP to ensure early traction
- A community full of mentors, peers, and leaders
- $100K worth of business perks
About you:
- Early-stage operator experience, and expertise in the problem space you're building in.
- The ability to attract, hire and lead world-class teams
- A demonstrated passion for technology's ability to change the world
- A desire to be a venture-backed founder
- Canada or US-based, and the ability to collaborate in North American time zones.
Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre-seed or Seed round, please pitch our investment team instead here.
- ...Systems (ACS) is a cutting-edge defense startup... ...and software. We are developing an autonomous gun turret... ...innovation. Backed by our founders’ successful exits from... ...models and reduce inference cost while protecting... ...quantization; contribute to tooling for packaging,...SuggestedLocal area
- ...running large language models and generative AI applications efficiently on NVIDIA edge AI hardware. This role focuses on performance analysis, model validation, and developing inference recipes across multi-node configurations. The candidate will work with CUDA/C++, Triton...SuggestedLocal area
- NVIDIA is building the software stack for fast LLM inference on edge AI hardware in Westford, MA. This role focuses on evaluating open-source... ...and minimize latency. You will own validation workflows, develop recipes, and collaborate with the community and partners to solve...Suggested
$209.1k - $282.9k
...to the next generation of Physical and Edge AI platforms on Arm. Your work will focus... ...on building platform-level services, developer tooling, and runtime infrastructure that boost... ...or real-time systems. Exposure to AI/ML inference systems, even from a platform or infrastructure...SuggestedWork at officeLocal area- ...industry-leading training and inference speeds; over 10 times faster than... ...enterprises, and cutting-edge AI-native startups. OpenAI recently... ...talk.ResponsibilitiesDesign, develop, test, and maintain production... ...website or its third-party tools process personal data. For more...Suggested
- ...opportunity to work with cutting-edge technologies, collaborate with... ...will be as below:• Develop data preparation tasks, while... ...knowledge management. • Leverage tools like SAS and R/Python to create... ...contexts.• Design and implement LLM inference serving stacks using: o vLLM,...Full timeTemporary workRelocation
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently... ...scheduling systems, test infrastructure, developer tools, and reusable software platforms that allow...
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced... ...them.This website or its third-party tools process personal data. For more details,...
- Crusoe is seeking a Senior Software Engineer to build a platform for network tooling that supports edge, backbone, and data center operations at Crusoe Cloud. You will design and implement control plane APIs and systems to manage network configuration, topology, and provisioning...
- Crusoe is seeking a Senior Software Engineer to build a platform for network tooling that supports Crusoe Cloud’s edge, backbone, and data center operations. You will design state management, scale control planes, and ensure reliable, scalable infrastructure. The role emphasizes...
- Crusoe Energy Systems LLC is seeking a Senior Software Engineer to build a platform for network tooling that supports edge, backbone, and data center operations for Crusoe Cloud. You will work on systems that manage network state, provisioning, configuration, and APIs...
$110k - $270k
...run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging... ...prioritiesDevelop tools to scale and speed up the... ...documents to customers and developer... ...previously the technical co-founders of the Bitcoin computing...Full timeWork at officeLocal areaImmediate start2 days per week- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced... ...them.This website or its third-party tools process personal data. For more details,...
- ...deliver industry-leading training and inference speeds; over 10 times faster than... ..., global enterprises, and cutting-edge AI-native startups. OpenAI... ...infrastructure, test infrastructure, tooling, and automation that improves developer velocity and engineering productivity...
$185.5k - $244.6k
...Engineer to join our growing Edge AI team. As a key contributor... ...you will lead the on-device inference and performance optimization... ...mismatches on target runtimesBuild tooling for profiling, benchmarking,... ...at the core of our work, and developing strong, long-term...Work at office- Cloudflare is seeking a high-agency, systems engineer to design and build AI inference infrastructure across its global network. You will tackle sub-second model cold starts, multi-accelerator workload scheduling, and efficient cache management alongside AI/ML engineers...
$110k - $270k
...targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging... ...team and business priorities Develop tools to scale and speed up the deployment... ...were previously the technical co-founders of the Bitcoin computing company...Work at officeLocal areaImmediate startFlexible hours2 days per week- ...AI company. We build cutting-edge foundation AI models and end-... ...The team is responsible for developing, deploying, and operating the... ...influence latency and throughput of inference.Strong understanding or... ...needs.We may use AI-enabled tools to screen and assess applicants...Full timeWork experience placementWork at officeLocal areaRemote workHome office
$152k - $241.5k
...Engineer specializing in Deep Learning Inference for our growing team. As a key... .... Our team is responsible for developing and maintaining high-performance... ...accelerators, from datacenter GPUs to edge SoCs. You'll bring to bear open-source tools and plugins—including CUTLASS,...Full timeRemote work$165.2k - $223.6k
The Edge Intelligence team, part of Amazon's Connected Vehicles organization... ...Applications: Design and develop applications that power in-... ...device platforms* Edge Inference & ML: Build and optimize on-device... ...distributed software applications, tools, systems, and services using:...InternshipLocal areaFlexible hours$250k - $300k
...seeking an AI Research Engineer (Inference) to join the HAIL team. HAIL... ...team at HRT responsible for developing and maintaining our most... ...excitement of being at the cutting edge of automation in every part... ...Please be advised: Use of AI tools during interviews or...Work experience placementWork at officeLocal areaImmediate start- ...performance optimization of the Qualcomm AI Stack across QAIRT/Genie and HW back-end support on the Snapdragon SoC. You will lead in-house tool development, collaborate across OS platforms (Android/Linux/QNX/Windows), and mentor juniors while delivering scalable AI software...
$120k - $140k
...a full stack engineer to drive the development of its cutting-edge tools for the commercial real estate industry. This role involves designing... ...deploying full stack features, collaborating closely with the founder and design team. Ideal candidates are quick learners with a...$262k - $365k
...generative image editing).Enable developers to test/evaluate/deploy across devices (Edge Portal /Model Explorer/Developer... ...performance of on-device model inference via optimizations in the model representation... ...Development Kits (SDKs)/tooling (e.g., TensorFlow Lite,...$207k - $300k
Analyze and optimize AI inference workloads across the application, model, and distributed... ...that drive production systems.Develop investigative tools and metrics (e.g., compute/FLOPs funnels... ...you will be working with the cutting edge AI agents developed by our...- Cloudflare is seeking a high‑agency systems engineer to design and build the AI inference platform that powers real‑time workloads across Cloudflare’s global network. You will tackle sub‑second model cold starts, multi‑accelerator scheduling, and efficient KV cache management...
$170k - $277k
...solving real-world problems with cutting-edge technology and bold thinking. Here, everyone... ...with a passion for building innovative tools, platforms, and infrastructure that... ...building large-scale distributed systems, developer platforms, and cloud-native infrastructure...Full timeWork at officeVisa sponsorshipWork visa$184.7k - $324.8k
...Engineer, Foundation Models Inference - Cloud OS & Inference Santa... ...external partners to bring cutting‑edge model architectures from... ...codesign, systems architecture, and tooling, and help set the technical... ...to progress as you grow and develop within a role. The base pay...WorldwideRelocation- ...deliver industry-leading training and inference speeds; over 10 times faster than... ...global enterprises, and cutting-edge AI-native startups. OpenAI... ...and correctness infrastructure. Develop representative benchmarks, workload replay tools, profiling automation, release qualification...
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently... ...release pipelines, dashboards, or internal developer tooling.Experience with performance testing,...Work at officeRemote work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!
- developer evangelist United States
- erp developer United States
- progress developer United States
- senior rpa developer United States
- junior website developer United States
- ssrs developer United States
- talend developer United States
- uipath developer United States
- creative developer United States
- appian developer United States


