Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Edge AI Runtime Engineer for Accelerated Inference

EnCharge AI

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems. About the Role EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments. Responsibilities Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators. Implement task scheduling, memory management, and kernel execution strategies for efficient computation. Optimize data movement between host and device using PCIe, DMA, shared memory. Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching. Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution. Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments. Qualifications Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field. 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems. Strong proficiency in C/C++ and low-level systems programming. Deep understanding of task scheduling, concurrency, and memory hierarchy. Experience with hardware-aware optimizations and dataflow architectures. Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO). Experience with low-latency, high-throughput workload execution for AI models. Strong debugging and profiling skills for optimizing AI execution performance. Exposure to AI model deployment pipelines (Triton, TensorFlow Serving). EnchargeAI is an equal employment opportunity employer in the United States. Apply for this job * First Name * Last Name * Preferred First Name Email * Phone Country * Phone * Resume/CV * Enter manually Accepted file types: pdf, doc, docx, txt, rtf Enter manually Accepted file types: pdf, doc, docx, txt, rtf Education School * Select... Degree * Select... Select... End date year LinkedIn Profile Website U.S. Standard Demographic Questions We invite applicants to share their demographic background. If you choose to complete this survey, your responses may be used to identify areas of improvement in our hiring process. How would you describe your gender identity? Select... How would you describe your racial/ethnic background? Select... How would you describe your sexual orientation? Select... Do you identify as transgender? Select... Do you have a disability or chronic condition (physical, visual, auditory, cognitive, mental, emotional, or other) that substantially limits one or more of your major life activities, including mobility, communication (seeing, hearing, speaking), and learning? Select... Are you a veteran or active member of the United States Armed Forces? Select... Voluntary Self-Identification For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file. As set forth in EnCharge AI’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law. If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985. Select... Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years. Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at . How do you know if you have a disability? A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to: Alcohol or other substance use disorder (not currently using drugs illegally) Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS Blind or low vision Cancer (past or present) Cardiovascular or heart disease Celiac disease Cerebral palsy Deaf or serious difficulty hearing Diabetes Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders Epilepsy or other seizure disorder Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome Intellectual or developmental disability Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD Missing limbs or partially missing limbs Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS) Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities Partial or complete paralysis (any cause) Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema Short stature (dwarfism) Traumatic brain injury Disability Status Select... PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete. #J-18808-Ljbffr EnCharge AI

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Edge AI Runtime Engineer for Accelerated Inference in New Bremen, OH vacancy
  •  ...EnCharge AI is a leader in advanced AI hardware...  ...software systems for edge-to-cloud computing. EnCharge...  ...AI is seeking an AI Runtime Engineer to develop and...  ...our next-generation AI accelerator. In this role, you will...  ...deliver optimized AI inference and training performance... 
    Suggested

    EnCharge AI

    New Bremen, OH
    2 days ago
  • NVIDIA is seeking experienced software engineers in Ohio to develop cutting-edge AI inference systems that utilize large-scale models. You will focus on optimizing inference stacks and collaborating across teams to enhance GPU performance in a multi-cloud environment.... 
    Suggested

    NVIDIA

    New Bremen, OH
    3 days ago
  •  ...deliver that foundation for an AI-driven world. We’re a...  ...web applications. With 210+ edge locations, 50+ cloud regions...  ...looking for a talented DevOps Engineer to join our AI Inference Operations Team. As a...  ...workloads, integrate inference runtimes, and test performance at... 
    Suggested
    Remote work
    Flexible hours

    Gcore

    New Bremen, OH
    3 days ago
  • European Tech Recruit is seeking a Senior System Engineer to join a pioneering Cybersecurity firm. This role involves developing a multi-language runtime security platform, focusing on AI agents and application runtime security. The ideal candidate will develop infrastructure... 
    Suggested

    European Tech Recruit

    New Bremen, OH
    3 days ago
  •  ...sind damit die effizientesten Kraftwerke der Welt. Klingt spannend? Dann bewirb dich jetzt als Werkstudent:in (d/w/m) DevOps Engineer (Cloud & Edge) bei uns! Deine Aufgaben Kubernetes & Cloud-Infrastruktur Cluster-Management: Unterstützung des Operations-Teams bei... 
    Suggested
    Internship
    Flexible hours

    Reverion GmbH

    New Bremen, OH
    3 days ago
  • We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency...  ..., and performance teams to push the frontier of accelerated computing for AI. What you’ll be doing: Contribute... 

    NVIDIA

    New Bremen, OH
    3 days ago
  •  ...looking for a highly motivated Agentic AI Solution Engineer to lead the definition and design of...  ...technical stakeholders. You’ll work at the edge of what agentic AI can actually do in...  ...adaptable mindset is valued, offering accelerated learning and professional development.... 

    New Digital Intelligence

    New Bremen, OH
    3 days ago
  •  ...is designed as a broad and accessible entry point into our AI team and is especially suited for strong builders, ambitious MSc graduates, and practical machine learning engineers who want to work on cutting‑edge robotics AI. What you will work on Training and... 

    NovaX Robotics GmbH

    New Bremen, OH
    1 day ago
  •  ...-thinking global organisation focused on AI-native innovation. They work closely with...  ...teams embed directly with clients, combining engineering, product thinking, and strategy to build...  ...‑world AI solutions Access to cutting‑edge tools, platforms, and learning... 

    Eurobase People

    New Bremen, OH
    3 days ago
  • AI Engineer (m/f/d) Germany, United Kingdom Tech stack Python Artificial Intelligence Jupyter Notebook Natural Language Processing...  ...Skills Required Experience in model training, validation, and inference in either Computer Vision or Natural Language Processing. Hands... 
    Full time
    Visa sponsorship

    Resaro AI

    New Bremen, OH
    3 days ago
  •  ...significant capability gains in AI today. It is the...  ...field. RL requires inference, rollout generation,...  ...responsibilities regarding GPU‑accelerated and CPU‑driven...  ...systems and framework engineering needed to run them efficiently...  ...systems or runtime frameworks in production... 

    Segment (Twilio)

    New Bremen, OH
    4 days ago
  • THRYVE, based in the United States, is seeking talented engineers to join their innovative team, focusing on developing cutting-edge AI solutions. You will work on various projects, including the Sparkassen-KIPilot AI assistant aimed at boosting productivity through automation... 
    Remote job
    Flexible hours

    THRYVE

    New Bremen, OH
    2 days ago
  • Visiting Forward Deployed AI Engineer, Internship, Germany - BCG X - München, Germany Locations : München | Berlin | Frankfurt What You’ll...  ...span from fully custom-builds to industry specific leading edge AI software solutions. You’ll be part of our rapidly growing engineering... 
    Internship
    Local area

    Recruit4Mum

    New Bremen, OH
    3 days ago
  • McKinsey & Company, Inc. is looking for a Data Engineer to build foundational data infrastructure for cutting-edge AI applications in Germany. You'll work on designing scalable data pipelines and collaborating with cross-functional teams while tackling real-world challenges... 

    McKinsey & Company, Inc.

    New Bremen, OH
    2 days ago
  •  ...of the solution! Key Responsibilities AI Automation & Agent Strategy Translate the...  ...and mentor a high‑performing team of engineers and architects, fostering a culture of rapid...  ..., focusing on efficiency gains, revenue acceleration, and data accuracy. Continuously... 
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Worldwide

    SoSafe

    New Bremen, OH
    3 days ago
  •  ...GmbH | ABTEILUNG: T/ON-DO1 Data Science SW Engineering | ID: 10603 | Vollzeit | Unbefristet Für...  ...im Fachbereich "Digital Operation" einen AI & Data Solutions Engineer (m/w/d)....  ...Datenpipelines aus MES-, SAP-, Logistik- oder Edge-Systemen. Aufbau und Weiterentwicklung eines... 

    Knorr Bremse Group

    New Bremen, OH
    2 days ago
  • As an AI App Engineer, you’ll be the hands‑on builder behind the intelligent products that make Sumer Sports unique. You’ll own the end‑...  ...can create novel sports analytics tools. Use AI internally to accelerate development (code generation, testing, debugging).... 
    Remote work
    Flexible hours

    sumersports

    New Bremen, OH
    3 days ago
  •  ...Define scalable Azure and On-Prem architectures based on microservices for healthcare-grade products, with strong focus on IoT and edge-to-cloud solutions. Design device connectivity and messaging using Azure IoT Hub and MQTT (telemetry, commands, device twin patterns... 
    Local area

    W3Global

    New Bremen, OH
    3 days ago
  • Lakera, a Check Point Company, seeks a Solutions Engineer to enhance sales velocity and customer success while shaping a secure product...  ...prospects, translating their needs into solutions using cutting-edge AI technologies. The ideal candidate has over 5 years of... 

    Lakera

    New Bremen, OH
    3 days ago
  •  ...for the most ambitious AI research, and the...  ...NVIDIA seeks a Senior Engineering Manager to define and...  ...platform, from single-accelerator workloads to hundreds...  ...training, post-training, inference, and robotics, bridging...  ...(XLA, TileIR, CUDA), runtime, networking, and hardware... 

    DE01 NVIDIA Germany

    New Bremen, OH
    3 days ago
  •  ...verantwortungsvoll und praktisch nutzbar zu machen. Für den weiteren Aufbau unseres KI-Angebots suchen wir eine:n KI-Entwickler:in / AI Engineer , der / die KI-Lösungen entwickelt, die im Mittelstand funktionieren: Prototypen, MVPs, RAG-Anwendungen, KI-gestützte Workflows,... 
    Remote work
    Flexible hours

    COREEN GmbH

    New Bremen, OH
    3 days ago
  •  ...klaren Fokus auf Wirksamkeit und einem ganzheitlichen Transformationsansatz liefern wir, was wir versprechen. einen Forward Deployed AI Engineer (all genders). Du bringst bereits fundierte Praxiserfahrung im AI-Umfeld mit und möchtest AI-Lösungen nicht nur konzipieren,... 
    Summer work
    Flexible hours

    AdEx Partners

    New Bremen, OH
    3 days ago
  •  ...PyTorch for building ML models. Strong understanding of cloud services, especially AWS (SageMaker, EC2, S3). Solid grasp of data engineering concepts and experience with SQL/NoSQL databases. Excellent problem‑solving skills and ability to work independently in a fast‑... 

    Gravity Engineering Services Pvt Ltd.

    New Bremen, OH
    3 days ago
  • AI & Automation Cloud Infrastructure Engineer As an AI & Administration Cloud Infrastructure Engineer, you will shape and constantly develop Jedox's in-...  ...understanding of AI/ML workloads, including training vs. inference, scaling behaviour and resource requirements. Hands‑... 
    Work at office
    Flexible hours

    Jedox

    New Bremen, OH
    3 days ago
  • Nagarro is looking for a skilled Python Developer in the United States with expertise in Generative AI and Agentic AI frameworks. You will design, develop, and deploy AI-powered applications and collaborate with teams to implement smart solutions. The ideal candidate should... 
    Remote job
    Flexible hours

    Nagarro

    New Bremen, OH
    3 days ago
  •  ...dich erwartet: Als Bereichsleiter (m/w/d) im Bereich Automatisierung verantwortest du den gesamten Automatisierungsbereich unserer Engineering Organisation mit verschiedenen Bereichen (Chaptern) und trägst dadurch maßgeblich zum Erfolg des Standorts bei: Du bist... 
    Flexible hours

    Syntegon Technology GmbH

    New Bremen, OH
    3 days ago
  • Jedox is seeking a Senior Python Software Engineer to enhance its AI/ML capabilities within the Enterprise Performance Management platform. The ideal candidate will have over 8 years of experience in software engineering, specifically in AI/ML solutions like time-series... 
    Flexible hours

    Jedox

    New Bremen, OH
    3 days ago
  • GradBay seeks engineering experts to remotely evaluate and improve AI models for a leading research organization in Europe. You will review solutions, challenge calculations, and help AI systems understand real engineering principles. Ideal candidates hold a Master's, PhD... 
    Remote job
    Flexible hours

    GradBay

    New Bremen, OH
    15 hours ago
  • Truelogic Software LLC is seeking a Forward Deployed Engineer to engage deeply with client teams, redesign workflows, and drive technology adoption. This hands-on role involves building AI-powered prototypes to enhance business processes. The ideal candidate will demonstrate... 
    Remote work

    Truelogic Software LLC

    New Bremen, OH
    3 days ago
  • Ein führendes Unternehmen im Bereich Künstliche Intelligenz sucht einen Werkstudenten im AI Engineering. Du arbeitest an der Entwicklung von KI-Features für eine Scouting-Plattform, die weltweit von über 130 professionellen Fußballclubs genutzt wird. Gesucht wird ein Student... 
    Flexible hours

    JAAI | JUST ADD AI GmbH

    New Bremen, OH
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Edge AI Runtime Engineer for Accelerated Inference. Be the first to apply!