Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Edge Inference Developer Tooling Founder

$250k

Forum Ventures

Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted. The Opportunity Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A Few Examples Edge Observability and Developer Tools Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow. Memory Management and Testing for Edge Deployments Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure. Hardware-Agnostic Frameworks A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice. Memory Architectures and Processing-in-Memory For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application‑specific memory systems for edge workloads don't yet exist at scale. We're Looking for Founders You've shipped inference at the edge and hit the wall on memory, latency, or platform lock‑in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Your Partners in Co‑Creation Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way. Forum Derisks and Accelerates the Founder Path by: $250K USD investment, and an end‑to‑end fundraising playbook and network to raise seed and Series A A validation partner with proven playbooks, networks, and systems to validate, unlock ICP, ignite sales pipeline, and beyond Support of experienced operating team — business design, product development, growth, recruitment, legal, and more Executing a winning GTM strategy to get to $50‑100K ARR, and the right MVP to ensure early traction A community full of mentors, peers, and leaders $100K worth of business perks About You Early‑stage operator experience, and expertise in the problem space you're building in. Ability to attract, hire and lead world‑class teams. Demonstrated passion for technology’s ability to change the world. Desire to be a venture‑backed founder. Canada or US‑based, and ability to collaborate in North American time zones. Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre‑seed or Seed round, please pitch our investment team instead. #J-18808-Ljbffr Forum Ventures

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Edge Inference Developer Tooling Founder in New York, NY vacancy
  • $128.7k - $261.3k

     ...About the Team The Model Deployment & Inference Solutions team in GM AV deploys...  ...inference on the vehicle, along with the developer-experience and agentic-tooling layer that makes deployment self-...  .... What Will Give You A Competitive Edge (Preferred Qualifications)... 
    Suggested
    Flexible hours
    Shift work

    General Motors

    New York, NY
    3 days ago
  •  ...A leading IT solutions provider is seeking a passionate C# .NET Automation Developer to join their dynamic team. In this 100% remote role, you'll develop and maintain automation tools, scripts, and apps, focusing on integrating solutions across platforms. The ideal candidate... 
    Suggested
    Remote work
    Flexible hours

    AutoAdmins, LLC.

    New York, NY
    3 days ago
  •  ...Tech Lead, Data & Inference Engineer New York, New York, United States Or refer someone...  ...operations. We collaborate directly with Founders, CTOs, and Heads of AI in those themes...  ...Flink, Kafka) and modern orchestration tools (Airflow, Dagster, Prefect). ~... 
    Suggested
    Full time

    Catalyst Labs, LLC

    New York, NY
    1 day ago
  •  ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    2 days ago
  •  ...BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    2 days ago
  •  ...optimization, and GPU acceleration. This role involves optimizing inference frameworks for language models, with a strong emphasis on...  ...compute shaders. Join a dynamic team committed to delivering cutting-edge solutions for mobile and edge use cases. #J-18808-Ljbffr... 

    Framework Ventures

    New York, NY
    3 days ago
  •  ...Software Engineer (C#) - Internal Tooling (AI Infrastructure) About the Role What...  ...data pipelines and evaluation workflows Develop full-stack tooling and backend services...  ...evaluation workflows Identify bottlenecks and edge cases in data and system behavior, and... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    3 days ago
  • $160k - $240k

     ...Senior Software Engineer - Edge Connectivity Platform Location New York Business Area Engineering and CTO Ref # 1005...  ...open source networking technologies , combined with internal tooling and automation. Technical Ownership Engineers on this team... 
    Temporary work
    For contractors
    Work experience placement
    Worldwide

    Bloomberg

    New York, NY
    1 day ago
  •  ...Beam is an ultrafast AI inference platform. We built a serverless...  ...scales out to thousands of GPUs. Developers use our platform to serve...  ..., and prominent developer-tool founders, including the founder of Snyk...  ...Working with cutting-edge technologies, like GPU checkpoint... 
    Work at office

    Beam

    New York, NY
    4 days ago
  •  ...Framework Ventures is seeking a skilled Machine Learning Engineer to deploy models to edge devices using frameworks like Llama.cpp and ggml. The role involves collaborating with researchers to transition models from research to production and integrating AI features into... 

    Framework Ventures

    New York, NY
    2 days ago
  • $152.41k - $179.3k

     ...expected and fully supported. Team and Role The AI Tools team accelerates the adoption of AI and agentic...  ...for every engineer. Responsibilities Build cutting-edge infrastructure and tools that empower AI-driven developer workflows. Create and deploy autonomous AI agents... 
    Full time
    Remote work

    Framework Ventures

    New York, NY
    3 days ago
  • $152.41k - $179.3k

     ...Software Engineer, Backend - AI Tools DevX job at Coinbase. Remote. Ready to be pushed beyond what you think...  ...for every engineer. What you'll do: Build cutting-edge infrastructure and tools that empower AI-driven developer workflows. Create and deploy autonomous AI agents... 
    Full time
    Local area
    Remote work

    Coinbase

    New York, NY
    3 days ago
  • $128.7k - $261.3k

     ...General Motors seeks a skilled professional to develop its ML deployment platform within the autonomous...  ...automating model deployment from training to on-vehicle inference and enhancing developer experience through robust tooling. Candidates should hold a relevant degree and... 

    General Motors

    New York, NY
    3 days ago
  • $200k - $250k

     ..., observability, optimization and scaling – for a custom-built inference platform powering a live conversational shopping agent. This is...  ...such as AWS, GCP, or Azure, and familiarity with ML lifecycle tooling, including model registries and experimentation platforms. Familiarity... 
    Remote work
    Flexible hours

    Wizard

    New York, NY
    3 days ago
  •  ...an AI-first creative partner. Within this, the AI Platform group is responsible for developing scalable infrastructure and tooling that powers machine learning across Canva. Our Inference Platform team sits at the heart of this mission—ensuring that ML models are... 
    Work at office
    Remote work
    Flexible hours

    Canva

    New York, NY
    3 days ago
  •  ...C++ Developer - Internal Tooling & Optimization (AI Training) About the Role What if your C++ expertise could directly shape the infrastructure...  ...model training and evaluation workflows Identify edge cases in data and system behavior and drive systematic improvements... 
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    2 days ago
  •  ...pioneering the development of cutting-edge multimodal foundation models...  ...prominent AI visionaries and founders such as Fei-Fei Li, Silvio...  ...FFmpeg, libav, and related tooling. Build and maintain custom...  ...video frames for model training/inference. Understands how... 
    Hourly pay
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    TwelveLabs

    New York, NY
    3 days ago
  • $192.6k - $271.9k

     ...performance, reliability, and scalability of inference systems. Join us and help influence how...  ...rewarded. What you'll be doing Design, develop, and deploy production-grade backend...  ...production using monitoring and observability tools like Prometheus and Grafana. Manage and... 
    Work at office
    Worldwide
    Relocation package

    Unity

    New York, NY
    16 hours ago
  • $155k - $235k

     ...architect and own the technical direction for our Training and Inference infrastructure. This is a high-leverage role designed for an expert...  ...compute frameworks. Familiarity with ML observability tools (Prometheus, Grafana, Weights & Biases, or MLFlow). Experience... 
    Shift work

    Paramount

    New York, NY
    1 day ago
  •  ...while introducing cutting-edge capabilities. As a...  ...Service Bus and Event Grid. Develop and maintain robust...  ...the Atlassian suite of tools. Strong debugging and troubleshooting...  ...back to 1890 when our founder, Thomas Foster,...  ...Foster Group by 2x Inferred from the description for... 
    Full time
    Internship
    Remote work
    Flexible hours

    Penn Foster Group

    New York, NY
    3 days ago
  •  ...they work, nobody notices. When they break, everything breaks. The Edge team exists because networking kept losing the prioritization...  ...and you will shape what it looks like - from SDLC, usage of AI tooling, static analysis, chaos engineering, and usage of simulation. We... 
    Full time
    For contractors
    Internship

    Persona

    New York, NY
    3 days ago
  • $170k - $221k

     ...Vercel: Vercel’s Frontend Cloud provides the developer experience and infrastructure to build,...  ...customer experience. As a member of the Edge team, you will help to scale and improve...  ...product team to identify problems, create tooling and automation. Your role will be dynamic... 
    Remote work
    Work from home
    Flexible hours

    GrabJobs

    New York, NY
    4 days ago
  •  ...medical knowledge with cutting-edge AI to build the most advanced...  ...Backend coordination for AI tools and decision-making workflows...  ...accuracy APIs supporting model inference, data preprocessing, result processing...  ...universities Preference for founders, founding engineers, or... 
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Doctronic Inc.

    New York, NY
    4 days ago
  •  ...training and deploying frontier models for developers and enterprises who are building AI...  ...they influence latency and throughput of inference. ~ Strong understanding or working experience...  ...Work closely with a team on the cutting edge of AI research Weekly lunch stipend,... 
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Cohere

    New York, NY
    16 hours ago
  • $197.3k - $225.1k

    Lead AI Engineer (FM Hosting, LLM Inference) Overview At Capital One, we are creating responsible...  ...interact with Capital One. Design, develop, test, deploy, and support AI software...  ...third-party products, services, educational tools or other information available through... 
    Full time
    Part time
    Local area
    Immediate start

    Capital One

    New York, NY
    1 day ago
  •  ...Senior Software Engineer - Testing Tools & Strategy 100% Remote About the Company : Shardeum...  ...for delivering the Shardeum Mainnet and developing critical components such as the smart...  ...blockchain transactions. Utilize cutting edge AI tools to make testing faster and more... 
    Contract work
    Remote work

    Shardeum

    New York, NY
    3 days ago
  •  ...intersection of traditional finance and cutting-edge technology, FalconX addresses the...  ...modification, routing, and risk logic. Build tools in Java / Python or Rust to simulate and...  ...across low-touch and high-touch systems. Develop self-service systems for trade simulation... 
    Local area

    Framework Ventures

    New York, NY
    3 days ago
  • $184.9k - $250.2k

     ...Inferentia and Trainium. The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is...  ...and JAX enabling unparalleled ML inference and training performance. The Inference...  ...detailed performance analysis using profiling tools to identify and resolve bottlenecks... 
    Work experience placement
    Internship
    Flexible hours

    Amazon

    New York, NY
    3 days ago
  • $160k - $240k

     ...Senior Software Engineer - AI Inference Location New York Business Area Engineering...  ...models, both predictive and cutting-edge generative models. We abstract away...  ...out new models to millions of users. Developing new inference capabilities such as structured... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  •  ..., Franklin Templeton, Founders Fund, Strike Capital,...  ...internal standards and tooling that other engineers build...  ...at production scale Developer abstractions that make...  ...for low‑latency inference Observability, alerting...  ...Cloudflare Workers / edge inference experience A... 

    STORD

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!