Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Edge Inference Developer Tooling Founder

$250k

Forum Ventures

Edge AI is a production requirement across automotive, robotics, and industrial verticals, but the infrastructure underneath it doesn't exist. Every team deploying models on edge devices rebuilds memory management, platform abstraction, and monitoring logic from scratch. The hardware is fragmenting across dozens of chipsets and runtimes. No single vendor's tools cover the stack. The developer experience is years behind what cloud teams take for granted. The Opportunity Build the software and tooling layer that makes edge hardware usable — frameworks that abstract across platforms, memory managers that optimize dynamically, observability stacks that surface what's happening inside a deployed model running on a sensor or a vehicle. Start with the highest-cost-of-failure verticals (autonomous vehicles, industrial robotics), then expand into the full edge AI developer stack. A Few Examples Edge Observability and Developer Tools Teams deploying models at the edge have no visibility into what those models are doing in the field. Inference latency, memory pressure, thermal headroom: none of it is legible. When a model degrades, debugging is manual and slow. Memory Management and Testing for Edge Deployments Edge devices operate in conditions data center memory was never designed for: temperature extremes, vibration, extended duty cycles. Memory allocation across a fleet is static and manual. Performance degradation goes undetected until failure. Hardware-Agnostic Frameworks A model that runs on one edge chipset requires substantial rework to run on another. There is no universal SDK, no abstraction layer that makes inference logic portable. Vendor lock-in is the default, not a choice. Memory Architectures and Processing-in-Memory For vision processing, sensor fusion, and real-time control, the cost of moving data between memory and compute is measured in power, latency, and heat. Data center DRAM was not designed for these tradeoffs. Application‑specific memory systems for edge workloads don't yet exist at scale. We're Looking for Founders You've shipped inference at the edge and hit the wall on memory, latency, or platform lock‑in. You've debugged a model that ran fine in the cloud and failed on the device. You know the gap isn't the model. It's the infrastructure underneath it. Your Partners in Co‑Creation Forum's AI Studio brings together ambitious people, brilliant ideas, and capital to build the best B2B SaaS businesses in the world, from 0 to 1. In addition to capital and an idea, we provide founders with access to investor networks, fundraising support, and the resources needed to build transformational companies. We've launched 17 companies since 2023, and we're launching 7 more in 2026. We're designed to help Founders move faster, develop better insights, and build companies that have a higher success rate than startups built in any other way. Forum Derisks and Accelerates the Founder Path by: $250K USD investment, and an end‑to‑end fundraising playbook and network to raise seed and Series A A validation partner with proven playbooks, networks, and systems to validate, unlock ICP, ignite sales pipeline, and beyond Support of experienced operating team — business design, product development, growth, recruitment, legal, and more Executing a winning GTM strategy to get to $50‑100K ARR, and the right MVP to ensure early traction A community full of mentors, peers, and leaders $100K worth of business perks About You Early‑stage operator experience, and expertise in the problem space you're building in. Ability to attract, hire and lead world‑class teams. Demonstrated passion for technology’s ability to change the world. Desire to be a venture‑backed founder. Canada or US‑based, and ability to collaborate in North American time zones. Please note, this is not an employment opportunity with Forum Ventures. If you are currently fundraising your pre‑seed or Seed round, please pitch our investment team instead. #J-18808-Ljbffr Forum Ventures

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Edge Inference Developer Tooling Founder in New York, NY vacancy
  •  ...AI company. We build cutting-edge foundation AI models and end-...  ...The team is responsible for developing, deploying, and operating the...  ...influence latency and throughput of inference.Strong understanding or...  ...needs.We may use AI-enabled tools to screen and assess applicants... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    2 days ago
  • Framework Ventures is seeking an experienced AI model serving engineer to advance inference pipelines across edge and cloud environments in the United States. You will design high‑throughput, low‑latency deployments for multi‑modal models and research novel serving strategies... 
    Suggested

    Framework Ventures

    New York, NY
    4 days ago
  • $250k - $300k

     ...seeking an AI Research Engineer (Inference) to join the HAIL team. HAIL...  ...team at HRT responsible for developing and maintaining our most...  ...excitement of being at the cutting edge of automation in every part...  ...Please be advised: Use of AI tools during interviews or... 
    Suggested
    Work experience placement
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    1 day ago
  • $300k

     ...systems. About the Role The Cloud Inference team scales and optimizes Claude to serve the massive audiences of developers and enterprise companies across AWS, GCP, Azure...  ...regressions  Design interfaces and tooling abstractions across CSPs that enable cost-effective... 
    Suggested
    Full time
    Work at office
    Visa sponsorship
    Flexible hours

    Anthropic

    New York, NY
    16 hours ago
  • $165k - $330k

     ...Baseten Baseten powers mission‑critical inference for the world’s most dynamic AI companies...  ..., flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing... 
    Suggested
    Flexible hours

    Baseten

    New York, NY
    21 hours ago
  • $215k - $260k

     ...leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to...  ...providing a trusted platform that connects AI agents with workplace tools and applications.Why this role:The Data Abstractions & Tools... 
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    3 days ago
  •  ...with an early-stage, cutting-edge AI startup in New York City to...  ...You will work closely with the founders to turn ideas into production-...  ...modelsBuild AI agents that can use tools, complete workflows, and...  ...scalability, security, latency, and AI inference costsWork directly with... 
    Work at office
    Local area
    Remote work
    Relocation

    Client Growth Resources

    New York, NY
    3 days ago
  • $320k

     ...beneficial AI systems. About the Role Our mandate is to make inference deployment boring and unattended. Anthropic serves Claude to...  ...sizes Extend deployment observability — dashboards and tooling that answer "what code is running in production," "where is my... 
    Full time
    Work at office
    Visa sponsorship
    Flexible hours
    Shift work

    Anthropic

    New York, NY
    16 hours ago
  • $160k - $240k

    Senior Software Engineer - AI Inference Location New York Business Area Engineering...  ...models, both predictive and cutting-edge generative models. We abstract away...  ...roll out new models to millions of users. Developing new inference capabilities such as structured... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    2 days ago
  • $200k - $300k

     ...business, so it is everyone's job to make sure our developers have everything they need to do their jobs well.As a member of the AI Tools team, you will be responsible for increasing...  ...by the excitement of being at the cutting edge of automation in every part of our... 
    Work at office
    Local area
    Immediate start

    Hudson River Trading

    New York, NY
    2 days ago
  • $200k - $250k

     ...around the world. Join StubHub's Edge Services team as a Software/Security...  ...to edge security, and building scalable tooling to enable internal teams. The team collaborates...  ...management, and related services. Develop scalable systems for detecting and mitigating... 
    Full time
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Stubhub

    New York, NY
    16 hours ago
  • $320k

     ...creativity, intuition and cutting-edge technology. Come be a part of...  ...scale, we are investing in tooling and observability to make the...  ...stack, from model inference through different stages of auction...  ...vs. online comparison\n\n * Develop and maintain diagnostics, logging... 
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    New York, NY
    9 hours ago
  • $1,000 per month

     ...most. We focus on making cutting-edge treatments like Spravato TMS,...  ...We’re building technology and tools to help clinics offer these...  ...Strong engineering prowess, developed at start-ups. Familiarity with...  ...Intro call with Engineering Founder Interview Thought exercise,... 
    Full time
    Work at office
    Home office
    Flexible hours
    3 days per week

    Big Leap Health

    New York, NY
    16 hours ago
  • $180k

     ...orchestration across prompt engineering, tool use, context management, and evals that keep...  ...can monitor agent performance, handle edge cases, and onboard new customers fast...  ...in the same room ~ Multiple second-time founders to learn from - Justin (CEO) sold Bayes (... 
    Full time
    Immediate start
    Shift work

    Phoebe

    New York, NY
    16 hours ago
  •  ...Collaborate directly with the founder and healthcare professionals...  ...behaviors. • Integrate Deep: Develop and fine-tune integrations...  ...Terraform • Intelligence: Leading-edge LLMs and Voice AI integration...  ...— Voice agents, real-time inference, healthcare-grade accuracy.... 
    Full time

    Taxo

    New York, NY
    16 hours ago
  • $153k - $204k

     ...pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with...  ...other teams depend on, and raise the quality bar for the developer experience across that whole surface. Because this team is CoreWeave... 
    Permanent employment
    Full time
    Contract work
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    1 day ago
  • $158.1k - $213.8k

     ...relationships between each of billions of products.* Design and develop intuitive solutions that will help customers make better informed...  ...multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience-... 
    Internship
    Worldwide
    Flexible hours

    Amazon

    New York, NY
    16 hours ago
  •  ...that combines expert advisors with cutting-edge technology - delivering a comprehensive,...  ...wealth management experience.Farther’s founders are leaders and innovators from the private...  ...to portfolio management to advisor tools.You'll join our mobile engineering team working... 

    Farther Advisors

    New York, NY
    4 days ago
  • $225k

     ...technology that puts our cutting-edge AI research in the hands of...  ...industry-leading AI reliability tooling Interface directly with...  ...and vision for the company Develop and uphold processes and best...  ...we’re backed + advised by the founders of Cognition, Hugging Face, Weights... 
    Full time
    Work at office
    Visa sponsorship

    Haize Labs

    New York, NY
    16 hours ago
  •  ...Department of Defense, our client builds cutting-edge software to solve the most critical...  ...vector databases, LLM integrations, and tool-call frameworks — in support of their AI...  ...infrastructure: embedding pipelines and inference optimization Experience working on software... 
    Full time

    Pc Arena

    New York, NY
    9 hours ago
  •  ...about a 5 days in-office culture. Both founders are technical. Every engineer on the...  ...after that you're debugging a billing edge case that only appears when Colorado Medicaid...  ...with LLM workflows, agents, evals, or developer tooling Experience modeling complex... 
    Full time
    Work at office

    Alpaca Health

    New York, NY
    16 hours ago
  • $180k - $200k

     ...team members to actively engage with AI tools relevant to their role and grow their fluency...  ...the Role:As a Staff Engineer on the Developer Productivity - AI Developer Tools team, you...  ...Communication: You can seamlessly translate bleeding-edge AI capabilities into clear, actionable... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    New York, NY
    1 day ago
  •  ...experiences. The company has developed an AI-powered travel platform...  ...into workplace collaboration tools, allowing employees to seamlessly...  ...collaborate directly with experienced founders and customers, and build...  ...to work on cutting-edge AI technology while helping shape... 
    Full time
    Work at office

    Motion Recruitment

    New York, NY
    16 hours ago
  •  ...AI company. We build cutting-edge foundation AI models and end-...  ...seeking a Platform Experience and Developer PM to own how developers and...  ...from synchronous real-time inference to high-volume asynchronous...  ...with.Developer Experience and Tooling. Own the surfaces that give... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    New York, NY
    1 day ago
  • $120k - $220k

     ...building the robust back-end systems and tooling interfaces needed to deliver on our vision...  ..., you’ll collaborate directly with the founders, define technical priorities, and ensure...  ...process contracts at scale. Build bleeding-edge agentic AI tools to help the Crosby Legal... 
    Full time
    Contract work
    Work at office

    Crosby

    New York, NY
    16 hours ago
  •  ...services, APIs, graph query layers, and customer-facing tools Develop infrastructure that serves inference and network analysis results in real time with high...  ...codebase quickly Collaborate directly with founders and customers to understand the problem deeply and... 
    Full time

    Cobalt Identity Systems

    New York, NY
    16 hours ago
  •  ...combines Rust-speed performance with elegant tools that developers love to use. Leading companies depend...  ...optimize arbitrary user Python code, infers and orchestrates infrastructure...  ...will do Work directly with Chalk’s co-founders Write Python and Rust Design,... 
    Full time
    Work at office
    Flexible hours

    Chalk

    New York, NY
    16 hours ago
  •  ...ll own the data infrastructure, internal tools, and AI-powered workflows that fill our pipeline...  ..., including with and for agents. ~ An edge. You think in systems, not tickets....  ...Startup experience as a technical co-founder or early engineer. Experience working... 
    Full time
    Live in
    Work at office

    Garage

    New York, NY
    16 hours ago
  •  ...the modern enterprise. We're developing agentic AI workflows that help...  ...and previous data company founders. The Role We're seeking...  ...systems Create reporting tools and dashboards that meet enterprise...  ...while learning cutting-edge AI applications. Impact:... 
    Full time
    Immediate start

    Preql Ai

    New York, NY
    16 hours ago
  •  .... Our journey began when our founder recognized a critical vulnerability...  ...constantly innovating at the edge of what’s possible in...  ...gets out of their way. As a Developer Experience Engineer, your job...  ...owning the internal platforms, tooling, and workflows that... 
    Odd job
    Full time
    Local area

    Cape Plc

    New York, NY
    9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Edge Inference Developer Tooling Founder. Be the first to apply!