Edge Inference Developer Tooling Founder
$250kForum Ventures
Edge Ai Infrastructure
Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted.
The opportunity: Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack.
A few examples:
Edge Observability and Developer Tools
Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow.
Memory Management and Testing for Edge Deployments
Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure.
Hardware-Agnostic Frameworks
A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice.
Memory Architectures and Processing-in-Memory
For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application-specific memory systems for edge workloads don't yet exist at scale.
We're looking for Founders to leverage their domain expertise, and care deeply about the developer experience.
You've shipped inference at the edge and hit the wall on memory, latency, or platform lock-in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Are convinced AI can deliver the outcomes better than humans to build full-stack, AI Native services in industries where outcomes depend on expertise, regulation, and trust.
While we're actively building out these ideas, Forum Ventures is always open to hearing from founders with bold, original ideas. If you're working on an early-stage B2B SaaS company, even at the idea stage, pitch us still.
Your Partners in Co-Creation:
Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way.
Forum derisks and accelerates the Founder path by:
- A $250K USD investment, and an end-to-end fundraising playbook and network to raise your seed and Series A
- A validation partner with proven playbooks, networks, and the systems to validate, unlock your ICP, ignite your sales pipeline, and beyond
- The support of our experienced operating team - from business design, product development, growth, recruitment, legal and more
- Executing a winning GTM strategy to get to $50-100K ARR, and the right MVP to ensure early traction
- A community full of mentors, peers, and leaders
- $100K worth of business perks
About you:
- Early-stage operator experience, and expertise in the problem space you're building in.
- The ability to attract, hire and lead world-class teams
- A demonstrated passion for technology's ability to change the world
- A desire to be a venture-backed founder
- Canada or US-based, and the ability to collaborate in North American time zones.
Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre-seed or Seed round, please pitch our investment team instead here.
- A cutting-edge robotics company in California seeks an ML Infrastructure Engineer to build and operate inference systems for their automation stack. Responsibilities include maintaining... .... Join a team at the forefront of developing humanoid robots to make a significant impact...Suggested
- ...A technology company in Georgia is seeking a C++ Engineer to own the inference backbone of its AI stack, focusing on deploying models to edge devices. You'll collaborate closely with researchers and manage a cross-functional team to enhance existing products with AI features...Suggested
- ...to architect the future of AI at the edge? Join the Akamai Inference Cloud Team! The Akamai Inference... ...running inference models and empower developers to create advanced AI solutions effectively... ...technical decisions on frameworks, tools, and approaches for AI workload...SuggestedPermanent employmentWork at officeRemote workWork from homeWorldwideFlexible hours
$180k
...the Role The xAI Tooling team (Starfleet) is looking... ...for designing, developing, and maintaining robust... ...with, and deploy cutting-edge AI models and... ...workflows for training, inference, evaluation, and deployment... ...as a tech lead, former founder, etc. Expertise in...SuggestedFull timeTemporary work- ...Senior Machine Learning Engineer (Inference Platform) in the United States.... ...and scalable deployments Develop observability, monitoring, alerting, and debugging tools for production inference systems... ...Exposure to cutting-edge LLM and AI inference technologies...SuggestedRemote jobFull time
- A leading AI research organization in San Francisco seeks an Inference Technical Lead to evaluate silicon platforms and work on model deployment for edge devices. You will collaborate with top machine learning researchers to push the boundaries of model capabilities. This...
$110k - $270k
...targeted to run neural network (NN) inference workloads in a wide variety of edge and endpoint devices, ranging... ...team and business priorities Develop tools to scale and speed up the deployment... ...were previously the technical co-founders of the Bitcoin computing company...Work at officeLocal areaImmediate startFlexible hours2 days per week- ...a C++ Engineer to work on the AI layer that powers local AI on edge devices. The role includes deploying machine learning models using... ...candidate will have strong C++ skills and experience with inference engines, as well as a relevant degree and a solid track record...Local area
$128.7k - $261.3k
...About the Team The Model Deployment & Inference Solutions team in GM AV deploys... ...inference on the vehicle, along with the developer-experience and agentic-tooling layer that makes deployment self-... .... What Will Give You A Competitive Edge (Preferred Qualifications)...Flexible hoursShift work- ...Framework Ventures is seeking a C++ Engineer in Town of Norway, Wisconsin, specializing in AI development for edge devices. The role involves working on inference engines like llama.cpp and ONNX, ensuring optimized performance across hardware. You'll deploy machine...
$161.5k - $218.5k
...run everywhere—from cloud to edge—powering billions of devices... ...worldwide! We are looking for a Developer Relations Engineer - Edge to... ...in SDKs, runtimes, and tooling. You will advocate for improvements... ...across areas like on-device inference, model deployment, data pipelines...Work at officeLocal areaWorldwide- Responsibilities We are looking for a Developer Relations Engineer - Edge to Cloud Platforms to help developers... ...identify friction in SDKs, runtimes, and tooling. You will advocate for improvements across areas like on-device inference, model deployment, data pipelines, and...
- ...to deliver industry-leading training and inference speeds and empowers machine learning users... ...labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced... ...them. This website or its third-party tools process personal data. For more details,...
$320k
...creativity, intuition and cutting-edge technology. Come be a part of... ...scale, we are investing in tooling and observability to make the... ...stack, from model inference through different stages of auction... ...offline vs. online comparison Develop and maintain diagnostics,...Hourly payFull timeImmediate startFlexible hours- ...A leading IT solutions provider is seeking a passionate C# .NET Automation Developer to join their dynamic team. In this 100% remote role, you'll develop and maintain automation tools, scripts, and apps, focusing on integrating solutions across platforms. The ideal candidate...Remote workFlexible hours
$139.9k - $274.8k
...Microsoft and Azure customers-from cutting-edge startups to Fortune 500 enterprises. Our?converged AI fabric?delivers inference capabilities for all LLMs in Microsoft catalog... ...using modern AI-assisted development tools and workflows to move faster, improve quality...Ongoing contractLocal area- ...Software Engineer, Developer And Qualification Tools At d-Matrix, we are focused on unleashing the potential of generative AI to power the... ...developer and diagnostic tools for d-Matrix' cutting edge AI inference accelerators. You will be responsible for the design,...
- ...Software Engineer - Dedicated Inference Team Baseten powers mission-critical inference for... ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly...Remote workFlexible hours
- ...Software Engineer - Inference Stack Baseten powers mission-critical inference for the world... ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help...Remote workFlexible hours
- ...The Senior Edge AI Field Applications Engineer within Future Electronics... ...benchmarking, and real-time edge inference implementation Conduct training sessions on Edge AI technologies, tools, and development frameworks Assist in developing Edge AI demonstration platforms...Temporary workFlexible hours
$152k - $241.5k
...limits of real-time large language model inference? Join NVIDIA's TensorRT Edge-LLM team and help shape the next... .... What you'll be doing: Develop and evolve a state-of-the-art inference... ...vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA...Remote work- ...including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied... ...Experience with observability tools and performance debugging. Familiarity... ..., luxury fashion, and cutting-edge tech, you'll have the freedom to...InternshipImmediate start
- ...with generative AI and make cutting-edge knowledge accessible to developers everywhere. THE ROLE: AMD... ...Optimize and accelerate LLM training and inference on AMD GPUs, improving kernel,... ...profiling and performance-analysis tools for GPU optimization and system-level...
- A leading consumer power tools company is seeking a Machine Learning Engineer II in Anderson, SC. This role involves identifying and developing ML features for power tools, working closely with cross-functional teams to deliver data-driven solutions. Candidates should...
- ...Tech Lead, Data & Inference Engineer A fast moving and venture backed advertising technology... .... We collaborate directly with Founders, CTOs, and Heads of AI in those themes who... ...Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect). ~ Familiarity...Full time
$176k - $420k
...~ Write Python scripts/tools for training, evaluation, and... ...environments (e.g., GPU, CPU, edge accelerators) ~ Work... ...sensors and actuators Develop messaging frameworks (e.g., ROS... ...C++ systems for real-time ML inference and control and for the humanoid...Hourly payFull timeTemporary workFlexible hours- A leading power tools company in South Carolina is seeking an experienced Electrical Machine Learning Engineer II to join its team. This role focuses on developing and validating ML features for outdoor power tools, collaborating with various teams to translate customer...
$155k - $230k
...Your mission is to build the tooling, pipelines, and infrastructure... ...Python-based training and inference infrastructure, relentlessly... ...infrastructure for our cutting-edge behavior models, focusing on... ...deployment. Enable Data Insights: Develop tools and dashboards for data...Hourly payImmediate start- ...deploying frontier models for developers and enterprises who are... ...influence latency and throughput of inference. ~ Strong understanding or... ...We may use AI-enabled tools to screen and assess applicants... ...closely with a team on the cutting edge of AI research Weekly...Full timeWork experience placementWork at officeRemote workFlexible hours
- ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies... ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing...Work experience placementRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!
- jasper report developer United States
- statistical programmer United States
- weekend developer United States
- developer internship United States
- teamcenter developer United States
- senior mulesoft developer United States
- pyspark developer United States
- interface developer United States
- kafka developer United States
- interactive developer United States



