Edge Inference Developer Tooling Founder
$250kForum Ventures
Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted. The Opportunity Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A Few Examples Edge Observability and Developer Tools Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow. Memory Management and Testing for Edge Deployments Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure. Hardware-Agnostic Frameworks A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice. Memory Architectures and Processing-in-Memory For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application‑specific memory systems for edge workloads don't yet exist at scale. We're Looking for Founders You've shipped inference at the edge and hit the wall on memory, latency, or platform lock‑in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Your Partners in Co‑Creation Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way. Forum Derisks and Accelerates the Founder Path by: $250K USD investment, and an end‑to‑end fundraising playbook and network to raise seed and Series A A validation partner with proven playbooks, networks, and systems to validate, unlock ICP, ignite sales pipeline, and beyond Support of experienced operating team — business design, product development, growth, recruitment, legal, and more Executing a winning GTM strategy to get to $50‑100K ARR, and the right MVP to ensure early traction A community full of mentors, peers, and leaders $100K worth of business perks About You Early‑stage operator experience, and expertise in the problem space you're building in. Ability to attract, hire and lead world‑class teams. Demonstrated passion for technology’s ability to change the world. Desire to be a venture‑backed founder. Canada or US‑based, and ability to collaborate in North American time zones. Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre‑seed or Seed round, please pitch our investment team instead. #J-18808-Ljbffr Forum Ventures
$128.7k - $261.3k
...About the Team The Model Deployment & Inference Solutions team in GM AV deploys... ...inference on the vehicle, along with the developer-experience and agentic-tooling layer that makes deployment self-... .... What Will Give You A Competitive Edge (Preferred Qualifications)...SuggestedFlexible hoursShift work- ...A leading IT solutions provider is seeking a passionate C# .NET Automation Developer to join their dynamic team. In this 100% remote role, you'll develop and maintain automation tools, scripts, and apps, focusing on integrating solutions across platforms. The ideal candidate...SuggestedRemote workFlexible hours
- ...Tech Lead, Data & Inference Engineer New York, New York, United States Or refer someone... ...operations. We collaborate directly with Founders, CTOs, and Heads of AI in those themes... ...Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect). ~...SuggestedFull time
- ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies... ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing...SuggestedFlexible hours
- ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies... ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing...SuggestedFlexible hours
- ...optimization, and GPU acceleration. This role involves optimizing inference frameworks for language models, with a strong emphasis on... ...compute shaders. Join a dynamic team committed to delivering cutting-edge solutions for mobile and edge use cases. #J-18808-Ljbffr...
- ...Software Engineer (C#) - Internal Tooling (AI Infrastructure) About the Role What... ...data pipelines and evaluation workflows Develop full-stack tooling and backend services... ...evaluation workflows Identify bottlenecks and edge cases in data and system behavior, and...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$160k - $240k
...Senior Software Engineer - Edge Connectivity Platform Location New York Business Area Engineering and CTO Ref # 1005... ...open source networking technologies , combined with internal tooling and automation. Technical Ownership Engineers on this team...Temporary workFor contractorsWork experience placementWorldwide- ...Beam is an ultrafast AI inference platform. We built a serverless... ...scales out to thousands of GPUs. Developers use our platform to serve... ..., and prominent developer-tool founders, including the founder of Snyk... ...Working with cutting-edge technologies, like GPU checkpoint...Work at office
- ...Framework Ventures is seeking a skilled Machine Learning Engineer to deploy models to edge devices using frameworks like Llama.cpp and ggml. The role involves collaborating with researchers to transition models from research to production and integrating AI features into...
$152.41k - $179.3k
...expected and fully supported. Team and Role The AI Tools team accelerates the adoption of AI and agentic... ...for every engineer. Responsibilities Build cutting-edge infrastructure and tools that empower AI-driven developer workflows. Create and deploy autonomous AI agents...Full timeRemote work$152.41k - $179.3k
...Software Engineer, Backend - AI Tools DevX job at Coinbase. Remote. Ready to be pushed beyond what you think... ...for every engineer. What you'll do: Build cutting-edge infrastructure and tools that empower AI-driven developer workflows. Create and deploy autonomous AI agents...Full timeLocal areaRemote work$128.7k - $261.3k
...General Motors seeks a skilled professional to develop its ML deployment platform within the autonomous... ...automating model deployment from training to on-vehicle inference and enhancing developer experience through robust tooling. Candidates should hold a relevant degree and...$200k - $250k
..., observability, optimization and scaling – for a custom-built inference platform powering a live conversational shopping agent. This is... ...such as AWS, GCP, or Azure, and familiarity with ML lifecycle tooling, including model registries and experimentation platforms. Familiarity...Remote workFlexible hours- ...an AI-first creative partner. Within this, the AI Platform group is responsible for developing scalable infrastructure and tooling that powers machine learning across Canva. Our Inference Platform team sits at the heart of this mission—ensuring that ML models are...Work at officeRemote workFlexible hours
- ...C++ Developer - Internal Tooling & Optimization (AI Training) About the Role What if your C++ expertise could directly shape the infrastructure... ...model training and evaluation workflows Identify edge cases in data and system behavior and drive systematic improvements...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
- ...pioneering the development of cutting-edge multimodal foundation models... ...prominent AI visionaries and founders such as Fei-Fei Li, Silvio... ...FFmpeg, libav, and related tooling. Build and maintain custom... ...video frames for model training/inference. Understands how...Hourly payWork at officeWorldwideVisa sponsorshipFlexible hours
$192.6k - $271.9k
...performance, reliability, and scalability of inference systems. Join us and help influence how... ...rewarded. What you'll be doing Design, develop, and deploy production-grade backend... ...production using monitoring and observability tools like Prometheus and Grafana. Manage and...Work at officeWorldwideRelocation package$155k - $235k
...architect and own the technical direction for our Training and Inference infrastructure. This is a high-leverage role designed for an expert... ...compute frameworks. Familiarity with ML observability tools (Prometheus, Grafana, Weights & Biases, or MLFlow). Experience...Shift work- ...while introducing cutting-edge capabilities. As a... ...Service Bus and Event Grid. Develop and maintain robust... ...the Atlassian suite of tools. Strong debugging and troubleshooting... ...back to 1890 when our founder, Thomas Foster,... ...Foster Group by 2x Inferred from the description for...Full timeInternshipRemote workFlexible hours
- ...they work, nobody notices. When they break, everything breaks. The Edge team exists because networking kept losing the prioritization... ...and you will shape what it looks like - from SDLC, usage of AI tooling, static analysis, chaos engineering, and usage of simulation. We...Full timeFor contractorsInternship
$170k - $221k
...Vercel: Vercel’s Frontend Cloud provides the developer experience and infrastructure to build,... ...customer experience. As a member of the Edge team, you will help to scale and improve... ...product team to identify problems, create tooling and automation. Your role will be dynamic...Remote workWork from homeFlexible hours- ...medical knowledge with cutting-edge AI to build the most advanced... ...Backend coordination for AI tools and decision-making workflows... ...accuracy APIs supporting model inference, data preprocessing, result processing... ...universities Preference for founders, founding engineers, or...Immediate startRemote workWork from homeFlexible hours
- ...training and deploying frontier models for developers and enterprises who are building AI... ...they influence latency and throughput of inference. ~ Strong understanding or working experience... ...Work closely with a team on the cutting edge of AI research Weekly lunch stipend,...Full timeWork experience placementWork at officeRemote workFlexible hours
$197.3k - $225.1k
Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible... ...interact with Capital One. Design, develop, test, deploy, and support AI software... ...third-party products, services, educational tools or other information available through...Full timePart timeLocal areaImmediate start- ...Senior Software Engineer - Testing Tools & Strategy 100% Remote About the Company : Shardeum... ...for delivering the Shardeum Mainnet and developing critical components such as the smart... ...blockchain transactions. Utilize cutting edge AI tools to make testing faster and more...Contract workRemote work
- ...intersection of traditional finance and cutting-edge technology, FalconX addresses the... ...modification, routing, and risk logic. Build tools in Java / Python or Rust to simulate and... ...across low-touch and high-touch systems. Develop self-service systems for trade simulation...Local area
$184.9k - $250.2k
...Inferentia and Trainium. The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is... ...and JAX enabling unparalleled ML inference and training performance. The Inference... ...detailed performance analysis using profiling tools to identify and resolve bottlenecks...Work experience placementInternshipFlexible hours$160k - $240k
...Senior Software Engineer - AI Inference Location New York Business Area Engineering... ...models, both predictive and cutting-edge generative models. We abstract away... ...out new models to millions of users. Developing new inference capabilities such as structured...Temporary workFor contractorsWork experience placement- ..., Franklin Templeton, Founders Fund, Strike Capital,... ...internal standards and tooling that other engineers build... ...at production scale Developer abstractions that make... ...for low‑latency inference Observability, alerting... ...Cloudflare Workers / edge inference experience A...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!
- spring boot developer New York, NY
- remote ruby on rails developer New York, NY
- ms access developer New York, NY
- flash developer New York, NY
- senior tableau developer New York, NY
- senior magento developer New York, NY
- senior sas developer New York, NY
- kernel developer New York, NY
- wpf developer New York, NY
- c developer New York, NY


