Edge Inference Developer Tooling Founder
$250kForum Ventures
Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted. The opportunity: Build the software and tooling layer that makes edge hardware usable - frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A few examples: Edge Observability and Developer Tools Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow. Memory Management and Testing for Edge Deployments Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure. Hardware-Agnostic Frameworks A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice. Memory Architectures and Processing-in-Memory For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application-specific memory systems for edge workloads don't yet exist at scale. We're looking for Founders to leverage their domain expertise, and care deeply about the developer experience. You've shipped inference at the edge and hit the wall on memory, latency, or platform lock-in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. are convinced AI can deliver the outcomes better than humans to build full-stack, AI Native services in industries where outcomes depend on expertise, regulation, and trust. While we're actively building out these ideas, Forum Ventures is always open to hearing from founders with bold, original ideas. If you're working on an early-stage B2B SaaS company, even at the idea stage, pitch us still. Your Partners in Co-Creation: Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way. Forum derisks and accelerates the Founder path by: A $250K USD investment, and an end-to-end fundraising playbook and network to raise your seed and Series A A validation partner with proven playbooks, networks, and the systems to validate, unlock your ICP, ignite your sales pipeline, and beyond The support of our experienced operating team - from business design, product development, growth, recruitment, legal and more Executing a winning GTM strategy to get to $50-100K ARR, and the right MVP to ensure early traction A community full of mentors, peers, and leaders $100K worth of business perks About you: Early-stage operator experience, and expertise in the problem space you're building in. The ability to attract, hire and lead world-class teams A demonstrated passion for technology's ability to change the world A desire to be a venture-backed founder Canada or US-based, and the ability to collaborate in North American time zones. Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre-seed or Seed round, please pitch our investment team instead here. Forum Ventures
$190k - $260k
...AI company. We build cutting-edge foundation AI models and end-... ...The team is responsible for developing, deploying, and operating the... ...influence latency and throughput of inference.Strong understanding or... ...needs.We may use AI-enabled tools to screen and assess applicants...SuggestedFull timeWork experience placementWork at officeLocal areaRemote workHome office- ...Opportunity Baseten powers mission-critical inference for the world's most dynamic AI companies... ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. Join us and help...SuggestedFlexible hours
$160k - $240k
Senior Software Engineer - AI Inference Location New York Business Area Engineering... ...models, both predictive and cutting-edge generative models. We abstract away... ...roll out new models to millions of users. Developing new inference capabilities such as structured...SuggestedTemporary workFor contractorsWork experience placement- ...strategy, services, and technology partner. We develop infrastructure, provide life-changing... ..., alignment, efficiency, and joy. Our EDge product suite is an integrated collection... ...workflows, smartly integrating critical tools and resources, serving up actionable data...SuggestedWork at officeHome officeFlexible hours
$200k - $300k
...business, so it is everyone's job to make sure our developers have everything they need to do their jobs well.As a member of the AI Tools team, you will be responsible for increasing... ...by the excitement of being at the cutting edge of automation in every part of our...SuggestedWork at officeLocal areaImmediate start$158.1k - $213.8k
...relationships between each of billions of products.* Design and develop intuitive solutions that will help customers make better informed... ...multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience-...InternshipWorldwideFlexible hours$141.9k - $190.3k
...Job Posting Title:Senior Software Developer - Build Tooling DevelopmentReq ID:10142522Job Description:**This position must sit onsite four (4) days a week in one of our technology offices listed above***Technology is at the heart of Disney’s past, present, and future....Full timeRemote work- Qualcomm Technologies, Inc. is seeking a Machine Learning / AI Engineering Intern to help build state‑of‑the‑art ML tools for mobile and embedded platforms. You will join a multi‑disciplinary team and work with popular frameworks while exploring ML hardware accelerators...Summer workInternshipRelocation
- ...pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with... ...other teams depend on, and raise the quality bar for the developer experience across that whole surface. Because this team is CoreWeave...Permanent employmentFull timeContract workTemporary workCasual workWork at officeFlexible hours
$229.9k - $262.4k
...customers interact with Capital One. Design, develop, test, deploy, and support AI software... ...model training, large language model inference, similarity search, guardrails, model evaluation... ...-party products, services, educational tools or other information available through...Full timePart timeLocal area- Inference Runtime Software Engineer LM Studio is used by millions of people around the world to run AI on their own computers, and now with... ...prioritize putting the human in the center, and creating tools that we want to use ourselves, and recommend to our friends and...Work at officeWork from homeFlexible hours
$207k - $300k
...excellence.Partner with Product Managers, User Experience (UX), and Developer Relations (DevRel) to advance the developer experience,... ...a complex, matrixed organization.Experience shipping developer tools or IDE extensions (e.g., VS Code) with a strong intuition for developer...Full time$90k - $150k
Platform Engineer - Commercial Services Tools Veeva Systems is the cloud software leader for the life sciences industry, building the... ...stack. As a Services Platform Engineer you'll ship real, cutting-edge AI features to production fast — working shoulder-to-shoulder with...Local areaRemote workFlexible hours$158.1k - $213.8k
...join a dynamic team working at the cutting edge of the GenAI revolution by applying AI to AI. You will work on building agents, tools, and models to simplify and accelerate... ...optimization, ML compiler tuning, distributed inference and training, or ML kernel authoring and...Flexible hours$20 - $22 per hour
...follows best practices on job sites A self‑motivated learner eager to develop technical skills Someone seeking a long‑term career path WHAT... ...with daily tasks and project work Maintain and organize tools and equipment on job sites and in service vehicles Track and maintain...Hourly payApprenticeshipWork at office- ...an early-stage, cutting-edge AI startup in New York... ...work closely with the founders to turn ideas into production... ...from zero to one Develop modern frontend... ...AI agents that can use tools, complete workflows, and... ...security, latency, and AI inference costs Work directly...Work at officeLocal areaRemote workRelocation
$140k - $150k
...risk insights, robust data, and dynamic tools to champion more efficient, transparent financial... ...impact. Driven by investment in cutting-edge technologies like AI and cloud solutions,... ..., and event-driven architecture. Develop Java micro-services to support the...Temporary workWork at officeImmediate start2 days per week3 days per week$176.72k - $265.08k
...looking for a Lead Generative AI Developer to join our COO Technology... ..., and operationalize cutting-edge Generative AI and Large... ...fine-tuning (LoRA, PEFT), and inference optimization.Cloud Platforms:... ...accommodation to use our search tools and/or apply for a career opportunity...Full time$500 per month
...backed by top-tier investors like Founders Fund and General Catalyst. This... ...technical product serving cutting-edge industries Competitive salary + meaningful... ...Job Details Job Responsibilities Develop and deploy tailored software solutions, tools, and integrations that address...Local area- ...that combines expert advisors with cutting-edge technology - delivering a comprehensive,... ...wealth management experience.Farther’s founders are leaders and innovators from the private... ...to portfolio management to advisor tools.You'll join our mobile engineering team working...
- ...expert advisors with cutting-edge technology - delivering a comprehensive... ...experience.Farther’s founders are leaders and innovators from... ...both sides to it with testsTreat developer experience as a first-class... ...with LLMs — agentic systems, tool calling, streaming responses,...Contract work
$80k - $158k
Job Title: Senior Application Delivery & Edge Security Engineer (Remote) City: Minneapolis State/Province: Minnesota Posting Start... ...knowledge of scripting, automation, or infrastructure automation tools is preferred. ͏ Preferred Skills Hands-on experience with F5...Remote jobMinimum wageFull timeLocal area$150k - $175k
...Description Full-Stack .NET Developer (Security Camera Platform)... ...ingestion services to reporting tools and operator-facing features.... ...cloud-hosted versus embedded/edge scenarios. Networking proficiency... ...). Computer-vision or ML inference integration experience....Temporary workWork at officeWork from home$184.9k - $250.2k
...problems, using and building state-of-the-art tooling.About Amazon Annapurna Labs:Amazon... ...chips. Inferentia delivers best-in-class ML inference performance at the lowest cost in the... ...join a dynamic team working at the cutting edge of the GenAI revolution by applying AI to...InternshipFlexible hours$225k - $300k
..., government, and legal. Our tools, Chandra, Surya, Marker, and... ...,000+ GitHub stars and broad developer mindshare. We're backed by founding... ...That includes building core inference workflows, creating intuitive... ...will work closely with the founders and the rest of the team to...$150k - $300k
...the way work is done. We’re developing AI agents that make powerful... ...fluent with the latest AI coding tools and are always looking for... ...logistics, and more) ~ Leading-edge agentic AI tech, solving deep... ...future ~ Work closely with founders Jessica Wu (ex-Citadel,...Work at officeRelocationRelocation packageFlexible hours$200k - $300k
...drive the invention of new techniques, tooling, and models. You’ll work across the full... ...lifecycle—from data acquisition to real-time inference and user-facing chat interfaces. If... ...about your craft, think like a founder, and want to be on the frontier of voice...Relocation package- ...that combines expert advisors with cutting-edge technology - delivering a comprehensive,... ...management experience. Farther’s founders are leaders and innovators from the private... ...multiplier. We expect engineers to leverage AI tools throughout the development lifecycle –...
- ...high-caliber team of software developers and deep learning experts,... ...integrations to platforms and tools related to model monitoring and... ...Ray, Spark and in training/inference systems such as Ray, vllm/SGLang... ..., which provides cutting edge data and analytics infrastructure...
$140k - $200k
...traditional HR and management tools have failed to deliver real transformation... ...You'll be working on cutting-edge AI systems that directly... ...with modern AI APIs and develop intelligent automation workflows... ...Makes You Stand Out Former founder or founding engineer...Work at officeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!
- hadoop spark developer New York, NY
- access developer New York, NY
- digital developer New York, NY
- entry developer New York, NY
- senior sas developer New York, NY
- scientific programmer New York, NY
- junior developer no experience New York, NY
- pega developer New York, NY
- netsuite developer New York, NY
- developer relations New York, NY


