Engineering Manager - AI Product

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager – AI Product based in Germany.

Join an opportunity to lead the development of a cutting-edge AI platform that powers innovative products at scale. This role combines technical leadership with hands-on engineering, offering the chance to shape architecture, mentor a talented team, and contribute directly to production-grade AI systems. Working in a collaborative, remote-first environment, you will drive the evolution of modern AI infrastructure while balancing strategic decision-making with active software development. If you enjoy building high-performance AI platforms, leading by example, and delivering meaningful impact in a fast-paced setting, this role offers an exciting next step in your career.

Accountabilities

• Lead, mentor, and develop a small team of AI engineers, fostering a culture of ownership, collaboration, and engineering excellence.
• Define the technical vision and architectural direction of the AI product, ensuring high standards for performance, scalability, reliability, and cost efficiency.
• Contribute hands-on to the design, implementation, and optimization of production AI systems, including model serving, inference pipelines, retrieval systems, orchestration, and evaluation frameworks.
• Oversee the end-to-end AI platform, including GPU infrastructure, model deployment, versioning, embedding pipelines, monitoring, and quality evaluation processes.
• Collaborate closely with Product, Infrastructure, Security, and Backend teams to align priorities, deliver integrated solutions, and support strategic business goals.
• Conduct regular performance reviews, coaching sessions, and technical mentoring while translating long-term objectives into clear execution plans and ensuring successful project delivery.

Requirements

• 7+ years of experience in software engineering, including at least 2 years in an engineering management or technical leadership role.
• Proven experience building and operating production AI/ML platforms or inference infrastructure, with expertise in model serving, GPU workloads, latency optimization, and cost management.
• Strong backend engineering skills, including Python proficiency and experience with distributed systems; knowledge of Go, Rust, or similar languages is considered an advantage.
• Hands-on experience with modern LLM technologies, including model APIs, open-weight models, serving frameworks, vector databases, retrieval systems, and prompt or context engineering.
• Solid understanding of AI quality evaluation, benchmarking, observability, regression testing, and monitoring for non-deterministic systems.
• Experience with cloud environments, preferably AWS, along with Kubernetes, containerization, Infrastructure-as-Code tools, CI/CD pipelines, Linux systems, networking fundamentals, and monitoring solutions.
• Excellent communication, leadership, and decision-making skills, with the ability to balance strategic planning, technical execution, and people management.

Benefits

• Fully remote position with collaboration across the European time zone.
• Opportunity to lead a highly impactful AI product with significant ownership and technical influence.
• Hands-on leadership role combining engineering management with active software development.
• Exposure to cutting-edge AI technologies, including LLMs, inference infrastructure, GPU computing, and distributed systems.
• Close collaboration with cross-functional engineering, infrastructure, product, and security teams.
• Career growth through technical leadership, architecture ownership, and strategic decision-making.