Senior Infrastructure Engineer - AI/ML
Ascent360
Job Overview We are seeking a highly skilled Senior Software Engineer specializing in Machine Learning, with a focus on Natural Language Processing (NLP), to join our dynamic team. The ideal candidate will play a pivotal role in understanding business objectives and leveraging machine learning models to meet these goals effectively. This position requires a blend of expertise in data science and software engineering, along with a passion for staying at the forefront of machine learning advancements. Responsibilities Design, deploy, and maintain scalable and secure infrastructure supporting AI and ML workloads. Build and maintain AWS cloud environments for compute (EC2, ECS/EKS, Lambda), storage (S3, EFS, FSx), and networking (VPC, Transit Gateway, PrivateLink, Route 53, load balancers). Implement security best practices using IAM, KMS, Secrets Manager, GuardDuty, and Security Hub. Support and optimize AI/ML workloads across AWS services (SageMaker, Bedrock, Batch, Step Functions). Develop and maintain Infrastructure as Code (IaC) using Terraform, AWS CDK, and CloudFormation. Manage containerized workloads and orchestration platforms (Docker, EKS, Fargate), including GPU scheduling and scaling. Set up and maintain monitoring and observability frameworks using CloudWatch and OpenTelemetry. Build and manage CI/CD pipelines (CircleCI, GitHub Actions, GitLab CI) for infrastructure automation and ML/Gen AI deployments. Collaborate with ML and Generative AI teams to scale models, optimize performance, and design efficient prompt or inference pipelines. Develop runbooks and SOPs for AI service deployment, troubleshooting, and performance optimization. Ensure security, compliance, and data protection across AI datasets and environments. Required Skills & Experience Strong proficiency in Linux administration and systems-level troubleshooting. Deep expertise in AWS cloud services , with experience in compute, storage, networking, and security domains. Proficiency in container orchestration (Kubernetes/EKS) and infrastructure automation tools. Hands‑on experience with IaC tools such as Terraform, AWS CDK, or CloudFormation. Familiarity with monitoring, logging, and observability stacks (Prometheus, Grafana, OpenTelemetry). Experience implementing CI/CD pipelines for automated deployment and testing. Understanding of AI/ML concepts , including model deployment, inference scaling, and LLM performance tuning. Working knowledge of security best practices , IAM roles, encryption, and compliance controls. Excellent collaboration and communication skills to partner with ML engineers, data scientists, and product teams. Education A Master’s degree in Machine Learning, Computer Science with a preference for specialization in the NLP domain. We are an equal‑opportunity employer that values diversity at all levels. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, national origin, age, sexual orientation, gender identity, disability, or veteran status. #J-18808-Ljbffr
- ...Jedox AG in Ohio is seeking a Senior Python Software Engineer to join their AI team. The role involves contributing to the technical development of AI/ML services, designing robust solutions, and mentoring junior engineers. Candidates should have over 8 years of experience...Senior
- Ascent360 is looking for a Senior Software Engineer specializing in Machine Learning to join our team. The role focuses on designing, deploying, and maintaining secure infrastructure for AI/ML workloads, leveraging AWS services effectively. The ideal candidate should have...Senior
- ...chsten Schritte brauchen wir dich! Aufgaben Was dich erwartet Als Senior Full Stack Developer arbeitest du an einer Anwendung, die täglich... ...bevorzugt) und containerisierten Deployments Erfahrung mit KI/ML-Integration oder Interesse daran, dich in dieses Feld einzuarbeiten...SeniorRemote jobHome officeFlexible hours
- ...Ein führendes Technologieunternehmen sucht einen Senior Data & AI Architect (w/m/d) für die Sovereign Cloud. In dieser Rolle sind Sie verantwortlich für die Entwicklung von End-to-End-Architekturen und die Beratung von Kunden zu sicheren Use Cases. Voraussetzungen sind...SeniorRemote workFlexible hours
- ...THRYVE is looking for a remote DevOps engineer to manage a large-scale AI platform used in complex customer environments, including deployments on Kubernetes and OpenShift. This role prioritizes operational ownership and troubleshooting for production systems with over...SeniorRemote work
- ...Light is looking for a Senior AI Platform Engineer to join its Foundation Team in the United States, Ohio. You will be responsible for architecting the internal 'AI Engine', ensuring high-quality AI feature delivery, and evolving SDKs for product engineers. The ideal candidate...Senior
- s.Oliver Gruppe sucht einen AI Architect, der Architekturstandards für KI-Anwendungen etabliert. Der ideale Kandidat wird zentrale Schnittstelle zwischen Fachbereichen, IT und Management sein und maßgeschneiderte KI-Architekturen erstellen. Gesucht wird eine Person mit...SeniorFlexible hours
- A GrowthTech company is looking for a Senior Software Engineer - Full Stack (m/f/x) to enhance their innovative referral platform. This remote-first... ..., along with a strong enthusiasm for learning and using AI tools. The team is small, allowing for significant influence...SeniorRemote work
- NVIDIA is seeking a Performance Research and Analysis Engineer in Ohio. You will profile and analyze AI workloads on NVIDIA supercomputers, focusing on deep learning, networking performance, and contribute to performance analysis insights with diverse teams. An ideal candidate...Senior
- ...Ein führendes IT-Beratungsunternehmen sucht einen erfahrenen Senior Data & AI Engineer. In dieser Rolle bauen Sie produktionsreife Datenplattformen und nutzen modernste Technologien wie SQL, Python und ETL/ELT-Prozesse, um innovative Lösungen zu entwickeln. Flexible Arbeitszeiten...SeniorFlexible hours
- ...excellent English communication skills, and a curiosity about the product. This position offers the opportunity to influence product direction and adopt cutting-edge AI technology. Join a dynamic environment where you'll be integral to our growth and success. #J-18808-LjbffrSeniorRemote work
€110k per year
STX Next Sp z.o.o is looking for a Principal Solution Architect to lead AI, data, and cloud initiatives. This role involves engaging with clients and translating their needs into scalable strategies, with responsibilities including leading technical design, advising clients...SeniorRemote job- Sportfive Limited is seeking a Global AI Platform Engineer based in Hamburg. This role is responsible for designing, building, and operating an AI platform that streamlines the development and management of AI agents. The ideal candidate will have over 5 years of experience...SeniorFlexible hours
- ...Parloa GmbH is seeking a Principal Applied Scientist to drive our applied AI strategy. This role demands 12+ years in Applied Science, including 5+ years in ML/AI, with strong leadership capabilities. You will enhance AI systems, ensuring impactful implementation and evaluation...Senior
- ...locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.# Senior Data & AI Engineer (w/m/d) Sovereign CloudBerlin, Dortmund, Duesseldorf, Erfurt, Frankfurt, Hamburg, Koeln, Muenchen, Nuernberg, Ratingen,...SeniorWork at officeFlexible hours
- ...Role We are looking for a Senior Python Engineer to join our Platform... ...efficient, and reliable data and ML solutions. You'll help teams... ...of our internal tooling and infrastructure, ensuring it better serves the... ...previous employment with Cleo AI. I accept that if any of the...SeniorShift work
- ...Provectus IT, Inc. is looking for a Senior Solution Manager in Ohio, USA, to drive AI and data solutions strategy and execution. In this role, you'll lead product... ...management experience, with a strong background in AI/ML technologies and advanced proficiency in both English...SeniorRemote work
- ...cloud computing to serve the global AI economy. We create the tools and... ...industries, without massive infrastructure costs or the need to build large in-house AI/ML teams. Our employees work at the... ...experienced and innovative leaders and engineers in the field. Where we work...SeniorFlexible hours
- ...SAP SE is looking for a Senior Applied Scientist for Tabular ML in the United States. In this role, you will engage in advanced AI research and work closely with internal teams to enhance high-value use cases. Candidates should hold a PhD or Master’s degree in Computer...Senior
- ...Principal Machine Learning (Senior/ Expert)/ Development (... ...Machine Learning Engineer (f/m/d) to design and deliver... ...that power large-scale AI and large language... ...will shape cutting-edge infrastructure, mentor world-class... ...-on experience with AI/ML and/or LLM systems in a...Permanent employmentFull timeWorldwideFlexible hours
- ...Scientist - Datasets to conduct research that supports design and manufacturing innovations. You'll develop specialized datasets for AI/ML modeling and lead data collection projects. Ideal candidates have a Master's or PhD, proficiency in Python and C++, and experience...SeniorRemote work
- In deiner Rolle als AI Architect (m/w/d) etablierst du Architekturstandards und technologische Leitplanken für KI- und ML-Anwendungen und unterstützt die nachhaltige Integration von AI in die Unternehmenslandschaft Als zentrale Schnittstelle zwischen Fachbereichen, IT...SeniorFlexible hours
- Israelvcforum is looking for a Senior Full Stack Developer to join the AI Accelerator team. You will lead cross-functional teams and drive technical innovation through the development of AI/ML solutions. This position demands strong stakeholder management and exceptional...Senior
- ...Ein innovatives MedTech-Unternehmen in Deutschland sucht einen (Senior) Software Developer (m/w/d), um die technische Koordination in der Softwareentwicklung zu übernehmen. Sie sollten fundierte Kenntnisse in .NET Core und Angular haben und sind Teil eines spannenden...SeniorFlexible hours
- ...Greater Munich Metropolitan Area 1 week ago Karlsruhe, Baden-Württemberg, Germany 1 week ago Software Test Engineer (m/w/d) mit Karriereambitionen Balingen, Baden-Württemberg, Germany 1 month ago Heidelberg, Baden-Württemberg, Germany 3 months ago Mannheim...SeniorRemote work
- Jobgether is seeking a Principal Architect, AI/ML in Germany to lead the design and delivery of advanced AI solutions. This remote role involves close collaboration with clients and engineering teams, requiring a strong background in AI/ML and cloud technologies. The ideal...Remote job
- ...Cloud-Native-Architekturen (z.B. Docker, Kubernetes, Prometheus), Infrastructure as Code (z.B. Terraform) oder GitOps (z.B. ArgoCD) Du... ...Austausch & Wissenstransfer: 14 interne Communities & Netzwerke (z. B. ML, Green IT, Architektur, IoT) Familienfreundliche Arbeitszeiten...Senior
- ...Position As an AI startup that has delivered product‑market fit, we are scaling. The Product... ...Experience leading and developing product/engineering teams, ideally distributed and... ...engineering on equal footing. Experience with ML/LLM products and handling non‑determinism...SeniorRelocationHome officeVisa sponsorshipFlexible hours
- ...Studium oder in Projekten erste Erfahrungen mit AI- oder Cloud-Technologien gesammelt und... ...Kolleg:innen auf deinem Weg zum AI Engineer. Mitarbeit bei der Entwicklung und Integration... ...auf Basis von APIs, LLMs oder klassischen ML-Ansätzen Unterstützung beim Aufbau von Generative...Flexible hours
- Die ROHDE & SCHWARZ GmbH & Co. KG sucht einen Softwareentwickler für innovative KI-Lösungen im Sicherheitssektor. In dieser Rolle gestalten Sie Softwareentwicklungen und Proof-of-Concepts in enger Zusammenarbeit mit Kunden und verwandeln Anforderungen in leistungsstarke...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Infrastructure Engineer - AI/ML. Be the first to apply!
- security infrastructure engineer New Bremen, OH
- principal infrastructure engineer New Bremen, OH
- lead infrastructure engineer New Bremen, OH
- remote infrastructure engineer New Bremen, OH
- infrastructure developer New Bremen, OH
- senior infrastructure engineer New Bremen, OH
- infrastructure automation engineer New Bremen, OH
- infrastructure engineer New Bremen, OH
- data infrastructure engineer New Bremen, OH
- junior infrastructure engineer New Bremen, OH

