Edge Inference Developer Tooling Founder
$250kForum Ventures
Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted. The Opportunity Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A Few Examples Edge Observability and Developer Tools Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow. Memory Management and Testing for Edge Deployments Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure. Hardware-Agnostic Frameworks A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice. Memory Architectures and Processing-in-Memory For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application‑specific memory systems for edge workloads don't yet exist at scale. We're Looking for Founders You've shipped inference at the edge and hit the wall on memory, latency, or platform lock‑in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Your Partners in Co‑Creation Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way. Forum Derisks and Accelerates the Founder Path by: $250K USD investment, and an end‑to‑end fundraising playbook and network to raise seed and Series A A validation partner with proven playbooks, networks, and systems to validate, unlock ICP, ignite sales pipeline, and beyond Support of experienced operating team — business design, product development, growth, recruitment, legal, and more Executing a winning GTM strategy to get to $50‑100K ARR, and the right MVP to ensure early traction A community full of mentors, peers, and leaders $100K worth of business perks About You Early‑stage operator experience, and expertise in the problem space you're building in. Ability to attract, hire and lead world‑class teams. Demonstrated passion for technology’s ability to change the world. Desire to be a venture‑backed founder. Canada or US‑based, and ability to collaborate in North American time zones. Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre‑seed or Seed round, please pitch our investment team instead. #J-18808-Ljbffr Forum Ventures
- ...including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied... ...Experience with observability tools and performance debugging. Familiarity... ..., luxury fashion, and cutting-edge tech, you'll have the freedom to...SuggestedInternshipImmediate start
- ...Tech Lead, Data & Inference Engineer Georgia, Georgia, United States About the Job... ...operations. We collaborate directly with Founders, CTOs, and Heads of AI in those themes... ...Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect). ~ Familiarity...SuggestedFull time
- ...Consumer Devices group focused on developing new methods and models to... ...) for on-device and edge deployment of OpenAI models.... ...for implementing the low-level inference stack, including kernel development... ...AI is an extremely powerful tool that must be created with safety...SuggestedWork at officeRelocation package
$160k - $250k
...Senior Backend Engineer, Inference Platform San Francisco About the Role Together... ...workloads and dedicated endpoints, enabling developers, enterprises, and researchers to harness... ...the open source community, shaping the tools that advance the industry. A culture...SuggestedFull timeLocal area- ...Staff Technical Lead for Inference & ML Performance San Francisco... ...We build the infrastructure, tools, and model access that teams... ...scale without compromise. For developers and enterprises, fal is the foundation... ...to rapidly deliver cutting-edge creative solutions to users,...Suggested
- ...BASETEN Baseten powers mission‑critical inference for the world's most dynamic AI companies... ...research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing...Work experience placementFlexible hours
- ...Baseten Baseten powers mission‑critical inference for the world's most dynamic AI companies... ...research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We're growing...Flexible hours
$131.9k - $178.5k
...career news. Job Summary: The Platform Engineer, AI Tooling on the Developer Experience Team (part of Foundation Engineering group) will... ...misbehaving agents, eval regressions, cost spikes, permission edge cases in MCP servers Participate in design reviews, post-...Work at officeImmediate startWorldwideMonday to FridayFlexible hours- ...workloads on accelerators, understanding transformer models, and leading teams focused on performance-critical software. The position offers relocation assistance and is centered on deploying cutting-edge AI technology responsibly and effectively. #J-18808-Ljbffr OpenAIRelocation package
- A cutting-edge technology company in San Francisco is looking for a Software Engineer to work on backend frameworks and internal tools. You'll operate at the intersection of platform engineering and developer experience, focusing on scalability and reliability. This role...
$175k - $225k
...We're looking for an AI Inference Engineer who lives at the boundary... ...production-ready engines running on edge devices in homes across the... .... ~3+ years of experience developing and deploying computer vision... ...with video streaming tools like ffmpeg and protocols such...Local areaRemote work$230.77k - $323.08k
...for the benefit of Earth. We're working to develop reusable, safe, and low-cost space... ...Principal Software Engineer for Dataplane & Edge Infrastructure, you will serve as the primary... ...in dataplane engineering methodologies, tooling, and deployment processes Evaluate and...Permanent employmentTemporary workLocal area$165k
...intelligence, join us in building what's next. About the Role Inference is now the defining cost and latency bottleneck for frontier AI... ...TensorRT‑LLM, or similar). Hands‑on experience with quantization tooling: GPTQ, AWQ, FP8 via llm‑compressor, or AutoGPTQ. Knowledge of...Local area$405k
...the Safeguards organization and the Cloud Inference team: taking classifiers, detection signals, and enforcement policies developed by Safeguards and making them run reliably... ...path services to data pipelines to internal tooling Think adversarially: you can see a system...Work at officeVisa sponsorshipFlexible hours- ...heterogeneous compute targets, including GPUs, FPGAs, ASICs, and edge SoCs. We support automotive, aerospace, defense, and... ...software engineer to help us build a new generation of transpilation tools enabled by AI and modern verification techniques — bridging the...Remote workRelocation packageFlexible hours
- ...the job FriendliAI is hiring a Python Engineer to build developer tools for our users and internal engineers. The software developed... ...engineer will be the primary way developers integrate with our inference and agent platform. Your work will remove friction for...Local areaWorldwideFlexible hours
- ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies... ...research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing...Full timeFlexible hours
- ...exceptional people to help us get there. The Opportunity Our Edge Inference team compiles Liquid Foundation Models into optimized machine... ...CPU, NPU, and GPU architectures across diverse edge hardware Develop quantization strategies (INT4, INT8, FP8) that maximize compression...
- ...Our team brings together founders from Oculus and... ...complex machine learning inference, scalable agentic workflows... ...systems design to cutting-edge applied AI. At the... ...opportunities to improve developer efficiency within your... ...You might prototype a tool or workflow improvement...Full timeContract workFlexible hours
- ...physical processes. Our co-founders Xerxes and Philip are... ...perception platform across edge devices and cloud infrastructure... ...to deploy perception and inference workloads at scale. Developing observability systems for... ...infrastructure-as-code tools (Terraform, Ansible) and container...
$88.94k - $138.75k
...empower agencies and brands with cutting-edge software that automates digital media operations... ...innovative Engineering team designs and develops new features and integrations for Basis,... ...best engineers in AdTech on the latest tools and technologies.You will also contribute...Remote workFlexible hours$187.5k - $395k
...Software Engineer, Inference Luma's mission is to build multimodal AI to expand human imagination and capabilities. We believe that... ...and optimize model efficiency and deployments Build internal tooling to measure, profile, and track the lifetime of inference jobs and...$170k - $216k
...technical challenges to build services and tools for a broad range of customers Software... ...You will: Build and evolve ML inference infrastructure for simulations. Be responsible... ...experience ~ Experience in developing and maintaining distributed systems....Full timeRemote work$142.2k - $204.6k
...About This Role As a software engineer for GenAI inference, you will help design, develop, and optimize the inference engine that powers Databricks... ...and maintain instrumentation, profiling, and tracing tooling to uncover bottlenecks and guide optimizations Develop...Local areaWorldwide$140k - $225k
...ecosystem across HP's portfolio. Together, we're developing intuitive, adaptive solutions that spark... ...As the Senior Software Engineer, Tooling and Development Infrastructure, you will... ...to influence the development of cutting-edge automation frameworks, foster a culture of...Full timeTemporary workLocal areaFlexible hours- ...Software Engineer, Internal Tools San Francisco, CA On-site Metriport is an... ..., high-performing team of mostly former founders (including two YC alumni). We're engineering... ...it doesn't break quietly. Improving Developer Experience and Onboarding : Automating...Work at officeLocal areaRemote workWork from homeRelocationFlexible hours
$150k - $170k
...Engineer in San Francisco, CA, responsible for ensuring the reliability of systems across cloud and edge environments. The candidate will build and maintain observability tools and improve incident response processes. Qualifications include 3+ years of experience in SRE,...- ...pioneering the development of cutting-edge multimodal foundation models... ...prominent AI visionaries and founders such as Fei-Fei Li, Silvio... ...FFmpeg, libav, and related tooling. Build and maintain custom... ...video frames for model training/inference. Understands how...Hourly payWork at officeWorldwideVisa sponsorshipFlexible hours
- ...Kubernetes accessible for the inference era. You will architect and maintain... ...-impact role at a technical, founder-led startup. Location: San... ...: Work on the cutting edge of AI infrastructure by building... ...methodologies, specifically with tools like ArgoCD, Ansible, and GitLab...
- ...a Machine Learning Engineer specializing in ML Runtime & Optimization to enhance our visual sensing platform. This role involves developing technologies that improve computer vision models critical for smart spaces and cities. Your responsibilities include optimizing core...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!
- spring boot developer San Francisco, CA
- remote ruby on rails developer San Francisco, CA
- ms access developer San Francisco, CA
- flash developer San Francisco, CA
- senior tableau developer San Francisco, CA
- senior magento developer San Francisco, CA
- senior sas developer San Francisco, CA
- kernel developer San Francisco, CA
- c developer San Francisco, CA
- api developer San Francisco, CA


