LLM Pre-training & Distributed Engineer (AI Infrastructure)
Hyphen Connect
Boston, USA We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes. Responsibilities Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM. Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors. Automate checkpointing and failure recovery during month-long training runs. Required Skills Deep expertise in 3D parallelism (Data, Tensor, Pipeline). Strong systems engineering background (C++, CUDA, Python). #J-18808-Ljbffr Hyphen Connect
- Hyphen Connect is seeking a highly skilled LLM Pre-training & Distributed Systems Engineer in Boston. This role focuses on orchestrating large-scale machine... ...runs across 1,000+ GPUs and optimizing distributed infrastructure. The ideal candidate will have deep expertise in 3D...Training
$245k - $275k
...Senior Specialty Solutions Engineer-Network AHEAD builds... ...advances in cloud infrastructure, automation and analytics... ...this marketplace. Pre-sales experience is a key... ...cross department training and development, sponsoring... ...additional details. Use of AI: We may use...TrainingWork at office$244k - $366k
...their growth, and the Engineering Department's... ...Director of Production Infrastructure, you'll helm the creation... ...Optimize the use of AI to enhance infrastructure... ...and debug a complex distributed-systems problem alongside... ..., education or training, and work location....Training$131.1k - $163.88k
...Manager, Data Science & AI at XPO... ...Machine Learning Engineering, Applied AI, or MLOps... ...MLOps pipelines (training, CI/CD, deployment... ...solutions , including LLM-powered... ...working across globally distributed teams Strong business... ...take and pass a pre-employment drug test...Training$244k - $366k
...people but by a growing number of AI agents acting on customers'... ...reviews; mentor Staff/ Sr. engineers across pillars through... ...years building and operating distributed data systems (e.g., Kafka/PubSub... ...relevant experience, education or training, and work location. In...Training$148k - $222k
...destiny. Team Overview The Infrastructure Security team makes it simple and easy for engineers to make secure choices... ...enjoy building modern distributed systems, care about... ...experimented with AI in work or personal projects... ..., education or training, and work location. In...TrainingRelocation$140.88k - $153.75k
...TEAM Senior Platform Engineers design and build... ...with Security and Infrastructure to ensure services... ..., pub/sub, and distributed lock coordination... ...review feedback. Use AI coding assistants... ...requirements. Uses LLM assistance to... ...experience, education, training, and skill level....TrainingFull timeContract workWork at officeLocal area1 day per week$97k - $116.5k
...economic sector. Position Summary The Infrastructure Engineer is responsible for developing and driving... ...equivalent combination of education, training, and experience Preferred Relevant cloud... ...Active Directory, AzureAD, Okta, LDAP AI & Emerging Technologies Familiarity...TrainingFull timeWork at office1 day per week$190k - $230k
...Platform unites agentic AI solutions with the... ...organizations. Senior Software Engineer, AI Platform Locations... ..., long‑horizon tasks, LLM‑based models into the... ...implementing distributed system features within... ...compensation, benefits, training, and apprenticeship. HackerOne...TrainingApprenticeshipWork at officeLocal areaRemote workFlexible hoursShift work1 day per week$163k - $237k
...a technical role (e.g., software engineering, solutions consultant, etc.) or equivalent... .... 2 years of experience running AI/ML workloads, such as training, fine-tuning, or serving inference... ...Experience with AI infrastructure: Kubernetes, GPUs/TPUs and the software...TrainingTemporary workWork experience placementWork at officeWorldwide- Senior Data Platform Engineer (AI / Data Fabric / Iceberg Lakehouse) Location: Boston, MA (... ...architecture across stateful, stateless, and distributed processing layers—balancing performance... ...datasets, feature‑ready pipelines, training/inference data services, and...TrainingWork at office
- ...responsible and reliable AI systems, changing... ...investments in technology infrastructure and world‑class talent... ...applied science and engineering teams to deliver our industry... ...foundation model training, large language model... ...state‑of‑the‑art LLM optimization techniques...TrainingLocal area
- Senior Data Engineer - Enterprise Data Enablement The Enterprise... ...solutions, including AI/GenAI/Agentic AI-ready... ...cases, including model training, inference, retrieval,... ...large language model (LLM), and intelligent... ...in data engineering and distributed data processing technologies...TrainingLocal areaMonday to Friday
$151.5k - $222k
...use cases across pre- and post-sales... ...The company’s LLM Observability... ...strong software engineering foundation, with... ...familiar with distributed systems and core... ...via auto, train, or air up to 4... ...platform for the AI era, providing... ...applications, infrastructure, data, models,...Work at office- We're looking for engineers who bring expertise across the AI space, including ML platform... ...Responsibilities As a ML Infrastructure Engineer, you help... ...workflows to support real-time training, testing, and... .... Design and implement distributed cloud GPU training approaches...TrainingPermanent employmentWork at office
$88.97k - $244.51k
Overview The Solution Engineer is a role that we often hire at Salesforce. If you are interested... ...relevant product, sales, and procedural training and certifications to acquire and... ...Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and...TrainingWork at officeRemote workFlexible hours- Overview We’re looking for a Data Engineer to build and maintain the data infrastructure that powers machine learning... ...preprocessing pipelines for ML model training and evaluation Collaborate with... ...Databricks, AWS SageMaker, Vertex AI) Strong Python and SQL skills, with...TrainingFull time
$140k
...investment firm is seeking a Data Engineer, Infrastructure to join its core... ...infrastructure to power advanced AI and investment platforms.... ...architecture across stateful and distributed layers, balancing... ...scalable services for model training and inference * Convert business...Training$132.5k - $302.4k
...people with new skills, training, and support to get... ...senior Data Cloud and AI Architect within Accenture... ...patterns. You contribute from pre-sale through delivery:... ...in Computer Science, Engineering, or equivalent (minimum... ...onshore/offshore distributed teams Compensation at...TrainingWork experience placementLive inWork at officeLocal area- Cisco Careers is seeking a Solutions Engineer - Artificial Intelligence (AI) to enhance the adoption of our AI infrastructure solutions across various industries. Located in Boston... ...include 6+ years in technical pre-sales, a Bachelor's degree, and familiarity...
- ...Senior AWS Cloud Data Engineer to design, build, and... ...scalable, secure, and AI-ready data platforms on... ...feature pipelines, and training/inference data... ...organizational standards. Develop infrastructure using Infrastructure... ...understanding of distributed systems and cloud architecture...Training
$148k - $222k
...Should Join the Developer Infrastructure Team Our core focus is empowering engineers to ship code... ...that all teams follow. AI-Driven Strategy: Spearhead... ...comfortable reasoning about distributed systems, dependency... ...experience, education or training, and work location....Training$174k - $253k
Senior Software Engineer, Infrastructure, YouTube Future of Video Location: Cambridge, MA, USA Level... ...large-scale infrastructure, distributed systems or networks, or experience with... ...experience, and relevant education or training. US: $174,000 - $253,000 (USD) + 15%...Training- ...leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT),... ...Time in the US. Opportunity Deepgram is seeking a Pre-Sales Solutions Engineer to join our Applied Engineering team. While you'll have the...Work at officeRemote workHome officeFlexible hours
- ...Solution Engineer / Technical Specialist (Remote... ...high-performance, distributed data workflows... ...success across the pre-sales cycleowning... ...translate complex infrastructure into clear business... ...troubleshooting Apply AI-assisted tools (... ..., promotions, and training and career...TrainingRemote job
$245k - $275k
...weaving together advances in cloud infrastructure, automation and analytics,... .... Senior Specialty Solutions Engineer - Network The AHEAD Senior... ...leader in this marketplace. Pre‑sales experience is a key component... ...additional details. Use of AI We may use artificial...$244k - $366k
...the bar on operational excellence. Embed AI in the developer experience—from code... ...automation: You’ve brought AI into platform engineering—from copilot‑assisted workflows and intelligent... ..., relevant experience, education or training, and work location. In addition to base...TrainingLocal area- ...behalf of a fast-growing AI startup recognized as... ...for a Senior Cloud Engineer (Multicloud) with deep... ...and scaling production infrastructure across AWS, GCP, and Azure... ...large‑scale, distributed AI systems used by Fortune... ...planning. Support AI training and inference workloads...TrainingLocal areaImmediate startRemote workRelocation package
$218.7k - $249.6k
...Applied Researcher I (AI Foundations, LLM Customization,... ...applied science and engineering teams and continue our... ...high‑performance AI infrastructure. At Capital One, you... ...from design through training, evaluation, validation... ...topics related to the pre‑training of large language...TrainingFull timePart timeLocal areaFlexible hours$125k
Electrical Utility Infrastructure Manager... ...lead times, and distribution upgrade requirements... ...utility responses, engineering feedback, and capacity... ...markets. Manage pre-application meetings... ...utility data, AI tools, and project... ...’s education, training, and experience....TrainingVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Pre-training & Distributed Engineer (AI Infrastructure). Be the first to apply!
- principal infrastructure engineer Boston, MA
- infrastructure engineering manager Boston, MA
- infrastructure automation engineer Boston, MA
- data infrastructure engineer Boston, MA
- infrastructure developer Boston, MA
- infrastructure engineer Boston, MA
- entry level infrastructure engineer Boston, MA
- remote infrastructure engineer Boston, MA
- lead infrastructure engineer Boston, MA
- security infrastructure engineer Boston, MA

