Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Pre-training & Distributed Engineer (AI Infrastructure)

Hyphen Connect

Boston, USA We are seeking a highly skilled LLM Pre-training & Distributed Systems Engineer. This role is essential for orchestrating large-scale machine learning training runs and optimizing distributed infrastructure. The ideal candidate will have a deep understanding of GPU clusters and extensive experience in system engineering to ensure efficient and reliable training processes. Responsibilities Orchestrate distributed training runs across 1,000+ GPUs using PyTorch, DeepSpeed, or Megatron-LM. Optimize networking (InfiniBand/RDMA) and memory management to prevent out-of-memory errors. Automate checkpointing and failure recovery during month-long training runs. Required Skills Deep expertise in 3D parallelism (Data, Tensor, Pipeline). Strong systems engineering background (C++, CUDA, Python). #J-18808-Ljbffr Hyphen Connect

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the LLM Pre-training & Distributed Engineer (AI Infrastructure) in Boston, MA vacancy
  • Hyphen Connect is seeking a highly skilled LLM Pre-training & Distributed Systems Engineer in Boston. This role focuses on orchestrating large-scale machine...  ...runs across 1,000+ GPUs and optimizing distributed infrastructure. The ideal candidate will have deep expertise in 3D... 
    Training

    Hyphen Connect

    Boston, MA
    3 days ago
  • $245k - $275k

     ...Senior Specialty Solutions Engineer-Network AHEAD builds...  ...advances in cloud infrastructure, automation and analytics...  ...this marketplace. Pre-sales experience is a key...  ...cross department training and development, sponsoring...  ...additional details. Use of AI: We may use... 
    Training
    Work at office

    AHEAD

    Boston, MA
    4 days ago
  • $244k - $366k

     ...their growth, and the Engineering Department's...  ...Director of Production Infrastructure, you'll helm the creation...  ...Optimize the use of AI to enhance infrastructure...  ...and debug a complex distributed-systems problem alongside...  ..., education or training, and work location.... 
    Training

    Klaviyo

    Boston, MA
    5 days ago
  • $131.1k - $163.88k

     ...Manager, Data Science & AI at XPO...  ...Machine Learning Engineering, Applied AI, or MLOps...  ...MLOps pipelines (training, CI/CD, deployment...  ...solutions , including LLM-powered...  ...working across globally distributed teams Strong business...  ...take and pass a pre-employment drug test... 
    Training

    XPO Logistics

    Boston, MA
    3 days ago
  • $244k - $366k

     ...people but by a growing number of AI agents acting on customers'...  ...reviews; mentor Staff/ Sr. engineers across pillars through...  ...years building and operating distributed data systems (e.g., Kafka/PubSub...  ...relevant experience, education or training, and work location. In... 
    Training

    Klaviyo

    Boston, MA
    3 days ago
  • $148k - $222k

     ...destiny. Team Overview The Infrastructure Security team makes it simple and easy for engineers to make secure choices...  ...enjoy building modern distributed systems, care about...  ...experimented with AI in work or personal projects...  ..., education or training, and work location. In... 
    Training
    Relocation

    Klaviyo

    Boston, MA
    3 days ago
  • $140.88k - $153.75k

     ...TEAM Senior Platform Engineers design and build...  ...with Security and Infrastructure to ensure services...  ..., pub/sub, and distributed lock coordination...  ...review feedback. Use AI coding assistants...  ...requirements. Uses LLM assistance to...  ...experience, education, training, and skill level.... 
    Training
    Full time
    Contract work
    Work at office
    Local area
    1 day per week

    Bain & Company

    Boston, MA
    3 days ago
  • $97k - $116.5k

     ...economic sector. Position Summary The Infrastructure Engineer is responsible for developing and driving...  ...equivalent combination of education, training, and experience Preferred Relevant cloud...  ...Active Directory, AzureAD, Okta, LDAP AI & Emerging Technologies Familiarity... 
    Training
    Full time
    Work at office
    1 day per week

    Tech Economy

    Boston, MA
    3 days ago
  • $190k - $230k

     ...Platform unites agentic AI solutions with the...  ...organizations. Senior Software Engineer, AI Platform Locations...  ..., long‑horizon tasks, LLM‑based models into the...  ...implementing distributed system features within...  ...compensation, benefits, training, and apprenticeship. HackerOne... 
    Training
    Apprenticeship
    Work at office
    Local area
    Remote work
    Flexible hours
    Shift work
    1 day per week

    hackerone

    Boston, MA
    3 days ago
  • $163k - $237k

     ...a technical role (e.g., software engineering, solutions consultant, etc.) or equivalent...  .... 2 years of experience running AI/ML workloads, such as training, fine-tuning, or serving inference...  ...Experience with AI infrastructure: Kubernetes, GPUs/TPUs and the software... 
    Training
    Temporary work
    Work experience placement
    Work at office
    Worldwide

    Google

    Cambridge, MA
    3 days ago
  • Senior Data Platform Engineer (AI / Data Fabric / Iceberg Lakehouse) Location: Boston, MA (...  ...architecture across stateful, stateless, and distributed processing layers—balancing performance...  ...datasets, feature‑ready pipelines, training/inference data services, and... 
    Training
    Work at office

    NxT Level

    Boston, MA
    3 days ago
  •  ...responsible and reliable AI systems, changing...  ...investments in technology infrastructure and world‑class talent...  ...applied science and engineering teams to deliver our industry...  ...foundation model training, large language model...  ...state‑of‑the‑art LLM optimization techniques... 
    Training
    Local area

    Capital One

    Cambridge, MA
    3 days ago
  • Senior Data Engineer - Enterprise Data Enablement The Enterprise...  ...solutions, including AI/GenAI/Agentic AI-ready...  ...cases, including model training, inference, retrieval,...  ...large language model (LLM), and intelligent...  ...in data engineering and distributed data processing technologies... 
    Training
    Local area
    Monday to Friday

    Citizens

    Boston, MA
    3 days ago
  • $151.5k - $222k

     ...use cases across pre- and post-sales...  ...The company’s LLM Observability...  ...strong software engineering foundation, with...  ...familiar with distributed systems and core...  ...via auto, train, or air up to 4...  ...platform for the AI era, providing...  ...applications, infrastructure, data, models,... 
    Work at office

    United States Digital Space LLC

    Boston, MA
    13 hours ago
  • We're looking for engineers who bring expertise across the AI space, including ML platform...  ...Responsibilities As a ML Infrastructure Engineer, you help...  ...workflows to support real-time training, testing, and...  .... Design and implement distributed cloud GPU training approaches... 
    Training
    Permanent employment
    Work at office

    Analog Devices

    Boston, MA
    3 days ago
  • $88.97k - $244.51k

    Overview The Solution Engineer is a role that we often hire at Salesforce. If you are interested...  ...relevant product, sales, and procedural training and certifications to acquire and...  ...Salesforce uses artificial intelligence (AI) tools to help our recruiters assess and... 
    Training
    Work at office
    Remote work
    Flexible hours

    Salesforce

    Boston, MA
    3 days ago
  • Overview We’re looking for a Data Engineer to build and maintain the data infrastructure that powers machine learning...  ...preprocessing pipelines for ML model training and evaluation Collaborate with...  ...Databricks, AWS SageMaker, Vertex AI) Strong Python and SQL skills, with... 
    Training
    Full time

    Yogi Careers

    Boston, MA
    3 days ago
  • $140k

     ...investment firm is seeking a Data Engineer, Infrastructure to join its core...  ...infrastructure to power advanced AI and investment platforms....  ...architecture across stateful and distributed layers, balancing...  ...scalable services for model training and inference * Convert business... 
    Training
    Boston, MA
    2 days ago
  • $132.5k - $302.4k

     ...people with new skills, training, and support to get...  ...senior Data Cloud and AI Architect within Accenture...  ...patterns. You contribute from pre-sale through delivery:...  ...in Computer Science, Engineering, or equivalent (minimum...  ...onshore/offshore distributed teams Compensation at... 
    Training
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    3 days ago
  • Cisco Careers is seeking a Solutions Engineer - Artificial Intelligence (AI) to enhance the adoption of our AI infrastructure solutions across various industries. Located in Boston...  ...include 6+ years in technical pre-sales, a Bachelor's degree, and familiarity... 

    Cisco Careers

    Boston, MA
    3 days ago
  •  ...Senior AWS Cloud Data Engineer to design, build, and...  ...scalable, secure, and AI-ready data platforms on...  ...feature pipelines, and training/inference data...  ...organizational standards. Develop infrastructure using Infrastructure...  ...understanding of distributed systems and cloud architecture... 
    Training

    Osprey Life Sciences

    Cambridge, MA
    2 days ago
  • $148k - $222k

     ...Should Join the Developer Infrastructure Team Our core focus is empowering engineers to ship code...  ...that all teams follow. AI-Driven Strategy: Spearhead...  ...comfortable reasoning about distributed systems, dependency...  ...experience, education or training, and work location.... 
    Training

    Klaviyo

    Boston, MA
    1 day ago
  • $174k - $253k

    Senior Software Engineer, Infrastructure, YouTube Future of Video Location: Cambridge, MA, USA Level...  ...large-scale infrastructure, distributed systems or networks, or experience with...  ...experience, and relevant education or training. US: $174,000 - $253,000 (USD) + 15%... 
    Training

    Google

    Cambridge, MA
    3 days ago
  •  ...leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT),...  ...Time in the US. Opportunity Deepgram is seeking a Pre-Sales Solutions Engineer to join our Applied Engineering team. While you'll have the... 
    Work at office
    Remote work
    Home office
    Flexible hours

    GrabJobs

    Boston, MA
    5 days ago
  •  ...Solution Engineer / Technical Specialist (Remote...  ...high-performance, distributed data workflows...  ...success across the pre-sales cycleowning...  ...translate complex infrastructure into clear business...  ...troubleshooting Apply AI-assisted tools (...  ..., promotions, and training and career... 
    Training
    Remote job

    Venturefizz Product Management Community

    Boston, MA
    4 hours ago
  • $245k - $275k

     ...weaving together advances in cloud infrastructure, automation and analytics,...  .... Senior Specialty Solutions Engineer - Network The AHEAD Senior...  ...leader in this marketplace. Pre‑sales experience is a key component...  ...additional details. Use of AI We may use artificial... 

    AHEAD

    Boston, MA
    3 days ago
  • $244k - $366k

     ...the bar on operational excellence. Embed AI in the developer experience—from code...  ...automation: You’ve brought AI into platform engineering—from copilot‑assisted workflows and intelligent...  ..., relevant experience, education or training, and work location. In addition to base... 
    Training
    Local area

    Klaviyo

    Boston, MA
    3 days ago
  •  ...behalf of a fast-growing AI startup recognized as...  ...for a Senior Cloud Engineer (Multicloud) with deep...  ...and scaling production infrastructure across AWS, GCP, and Azure...  ...large‑scale, distributed AI systems used by Fortune...  ...planning. Support AI training and inference workloads... 
    Training
    Local area
    Immediate start
    Remote work
    Relocation package

    Pragmatike

    Cambridge, MA
    3 days ago
  • $218.7k - $249.6k

     ...Applied Researcher I (AI Foundations, LLM Customization,...  ...applied science and engineering teams and continue our...  ...high‑performance AI infrastructure. At Capital One, you...  ...from design through training, evaluation, validation...  ...topics related to the pre‑training of large language... 
    Training
    Full time
    Part time
    Local area
    Flexible hours

    Capital One

    Cambridge, MA
    5 days ago
  • $125k

    Electrical Utility Infrastructure Manager...  ...lead times, and distribution upgrade requirements...  ...utility responses, engineering feedback, and capacity...  ...markets. Manage pre-application meetings...  ...utility data, AI tools, and project...  ...’s education, training, and experience.... 
    Training
    Visa sponsorship

    CBRE

    Boston, MA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Pre-training & Distributed Engineer (AI Infrastructure). Be the first to apply!