Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Machine Learning Engineer

AI Chopping Block

About A1 There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting. Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time. Role As a Principal Machine Learning Engineer, you are a deep technical authority responsible for designing and evolving the most critical ML systems in the company. You operate across training, inference, evaluation, and infrastructure, solving the hardest architectural and performance problems. While Technical Leads may own execution at the team level, you set the technical standard and shape how ML systems are built across the organization. This is a hands-on, high-impact role focused on depth. Focus Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment. Design reproducible, high-performance training pipelines across GPU infrastructure. Architect inference systems that balance latency, throughput, cost, and reliability at scale. Design and maintain data systems for high-quality synthetic and real-world training data. Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership. Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies. Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products. Make pragmatic trade-offs and ship improvements quickly, learning from real usage. Work under real production constraints: latency, cost, reliability, and safety Requirements Strong background in deep learning and transformer-based architectures. Hands-on experience training, fine-tuning, or deploying large-scale ML models in production. Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly. Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray). Strong software engineering fundamentals - you write robust, maintainable, production-grade systems. Experience with GPU optimization, including memory efficiency, quantization, and mixed precision. Comfort owning ambiguous, zero-to-one ML systems end-to-end. A bias toward shipping, learning fast, and improving systems through iteration. Ideal Experience Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer. Contributions to open-source ML or systems libraries. Background in scientific computing, compilers, or GPU kernels. Experience with RLHF pipelines (PPO, DPO, ORPO). Experience training or deploying multimodal or diffusion models. Experience with large-scale data processing (Apache Arrow, Spark, Ray). Outcomes ML systems (training, inference, evaluation) are reliable, scalable, and meet defined performance targets. Models deployed to production achieve measurable quality improvements and meet user-impact goals. Production issues are proactively monitored, debugged, and resolved with clear root-cause analysis. Team and cross-functional collaborators benefit from clear guidance, best practices, and scalable ML solutions. Research-to-production cycles are efficient, safe, and continuously improve the product experience. How We Work The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product Interview process If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews. Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite. We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Machine Learning Engineer in Brooklyn, NY vacancy
  • $190k - $220k

     ...solutions available in more than 100 cloud marketplaces. To learn more, visit  . At AvePoint, we are committed to...  ...:   We are seeking an analytical and innovative Senior  Machine Learning Engineer to join our Data & AI team. You will play a key role in developing... 
    Suggested
    Full time
    Worldwide

    Avepoint

    Jersey City, NJ
    7 hours ago
  •  ...Apple Inc. is seeking a Sr. Machine Learning Engineer for the Foundation Models Inference team in Santa Clara, CA. You will collaborate with research and external partners to bring cutting-edge model architectures from prototype to planetary-scale deployment, owning hard... 
    Suggested

    Apple

    Brooklyn, NY
    2 days ago
  • $245k - $319k

     ...Keeping Commerce Human.Salary Range:$245,000.00 - $319,000.00What’s the role?We are looking for a Senior Staff Software Engineer, Machine Learning to be a pivotal technical leader in architecting the next generation of AI/ML models and systems that connect buyers and... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Visa sponsorship
    Flexible hours

    Etsy

    Brooklyn, NY
    7 hours ago
  • $142.32k - $213.48k

     ....00Category: Technology, Applications Development, ProfessionalCompany: CitiWe are seeking a highly skilled and motivated Machine Learning Engineer to join our technology team. The ideal candidate will be responsible for designing, developing, and deploying cutting-edge... 
    Suggested
    Full time

    Citigroup

    Jersey City, NJ
    2 days ago
  •  ...the future of document management through cutting-edge AI and machine learning. Join a collaborative team where your expertise will drive...  ...make a difference across the organization.As a Machine Learning Engineer - Document Digitization (LLMs)-Vice President in our... 
    Suggested

    JP Morgan Chase

    Jersey City, NJ
    1 day ago
  •  ...coding, testing, and troubleshooting within a delivery-focused engineering unit. You’ll refine basic code structures, execute test plans,...  ...a data-first approach, collaboration, and continuous learning while working with AI, ML, and modern development practices. #J... 

    Infosys

    Brooklyn, NY
    2 days ago
  •  .... Read about us in the NYT, Forbes, First Round Review, and more. Hear from our employees directly on our Glassdoor page! Machine Learning Engineer @ Clay Clay's ambition is to build a self-learning revenue engine : a product that gets smarter every time someone uses it... 

    claylabs

    Brooklyn, NY
    7 hours ago
  •  ...The Machine Learning Engineer will lead the development of advanced Machine Learning and Artificial Intelligence solutions that support large-scale business applications and customer experiences. The role will involve designing scalable data pipelines using PySpark, developing... 

    Compunnel

    Brooklyn, NY
    2 days ago
  •  ...Amira Learning is hiring a software/ML engineer to advance automated educational evaluation and personalized learning using speech recognition, NLP, and large language models. You will integrate AI services, develop cloud-native backends, and validate models for diverse... 
    Remote work

    Amira Learning

    Brooklyn, NY
    2 days ago
  • $180k - $225k

     ...field, and have assembled a well-supported and passionate team to do so. What we are looking for: We are looking for a Machine Learning Engineer who will play a critical role in fine-tuning transformer-based models using automation pipelines and implementing real-... 
    For contractors
    Work experience placement
    Remote work

    GrabJobs

    Jersey City, NJ
    7 hours ago
  •  ...Overview TeleWorld Solutions is seeking a Machine Learning Engineer for our team! As a Performance Assurance Machine Learning Engineer, you will work under the coaching of Senior and Lead engineers of the Data Science & Tools Team to analyze Samsung’s deployed network... 
    Work experience placement
    Work at office

    Teleworld Solutions

    Brooklyn, NY
    2 days ago
  •  ...Peak Technologies, Inc. is seeking a Machine Vision Solutions Engineer for a remote position. You will lead installation, integration, and support of advanced industrial systems including machine vision, RFID, conveyors, and robotics across multiple locations. The role... 
    Remote work

    PEAK Technologies

    Brooklyn, NY
    3 days ago
  •  ...Amazon Web Services (AWS) is seeking a Principal Delivery Consultant to lead large-scale Healthcare and Life Sciences transformation programs. You will define and own the technical vision across AI/ML, data platform modernization, and enterprise architecture, guiding multiple... 

    Amazon

    Jersey City, NJ
    2 days ago
  • $216.7k - $303.4k

     ...within Reddit’s Security, Privacy, Assurance, and Corporate Engineering organization protects Reddit’s GenAI usage across employee tools...  ...unauthorized agent actions. We are looking for a Senior Machine Learning Engineer to lead model development for GenAI Security and... 
    For contractors
    Work experience placement
    Remote work
    Flexible hours

    GrabJobs

    Jersey City, NJ
    4 days ago
  •  ...As a Senior Machine Learning Engineer in our Digital Intelligence team, you will have the opportunity to work on exciting end-to-end machine learning problems and solutions. You will collaborate with us to solve large scale relevance and ranking problems, engineer scalable... 
    Work experience placement
    Internship

    JPMorgan Chase

    Jersey City, NJ
    12 hours ago
  •  ...enjoyable with over ~90%* reduced time. Role As Technical Lead, Machine Learning, you own the execution layer of A1's intelligence. You...  ...and scaling policies. Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop... 

    AI Chopping Block

    Brooklyn, NY
    2 days ago
  • $227.5k - $324.99k

     ...ll keep millions of users listening by making great recommendations to each and every one of them.  We are looking for a Machine Learning Engineer to join the Personalization team - an area of hardworking engineers that are passionate about understanding what drives... 
    Remote work
    Flexible hours

    GrabJobs

    Jersey City, NJ
    2 days ago
  •  ...re building it About the Role Fetch is building the future of personalized consumer experiences. We’re looking for a Staff Machine Learning Engineer to serve as the technical lead for a high-impact ML team focused on personalization, relevance, and ranking. In this role,... 
    Full time
    Remote work

    Fetch

    Brooklyn, NY
    13 hours ago
  •  ...Job Duties: Lead the development and optimization of advanced machine learning (ML) models for implementation into existing software and...  ...in software production environments. Collaborate with other engineers, product management, and quality assurance analysts to ensure... 
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours

    Relha LLC

    Brooklyn, NY
    4 days ago
  •  ...Walmart is seeking a Principal Data Scientist to lead the development and deployment of advanced analytical models and ML solutions that drive strategic business decisions. This role requires expertise in data architecture, statistics, and coding, with collaboration across... 
    Principal

    Walmart

    Hoboken, NJ
    12 hours ago
  • $181.1k - $318.4k

    Staff/Sr. Machine Learning Engineer, Foundation Models - AI, Search & Knowledge Platforms San Francisco Bay Area, California, United States Machine Learning and AI Do you feel you think differently, you are eager to break status quo, are bold and ambitious, aren’t afraid... 
    Relocation

    Apple Inc.

    Brooklyn, NY
    3 days ago
  •  ...JPMorganChase seeks a seasoned platform engineering leader to shape reusable frameworks, SDKs, and tools that empower thousands of engineers across the enterprise. You will drive secure, observable, and scalable production-code capabilities and oversee cross-functional... 
    Principal

    JPMorganChase

    Jersey City, NJ
    12 hours ago
  • $128.8k - $214.5k

     ...extraordinary at MANTECH! ***This is for a future opportunity*** MANTECH seeks a motivated, career and customer-oriented Machine Learning Engineer to join our team. The Machine Learning Engineer will leverage their strong technical background and knowledge to support highly... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Work experience placement
    Work at office
    Local area
    Remote work

    Neura Market

    Brooklyn, NY
    2 days ago
  • $123k - $163k

     ...Salary: $123,000 - 163,000 per year Requirements: Proficient software engineering skills with expertise in Python or a similar programming language Experience implementing applied machine learning in production settings Strong foundation in backend development and... 
    Full time

    Kforce Technology Staffing

    Brooklyn, NY
    17 days ago
  • $62k - $100k

     ...future of our industry. Job Description About the Role As an AI Engineering team member, you will be instrumental in advancing new features...  ...and offer employees a comprehensive total rewards package. Learn more about what working at Crowe can mean for you! How You Can... 
    Local area
    Worldwide

    Latitude

    Brooklyn, NY
    3 days ago
  • $128k - $316.8k

    Discover a career that energizes and excites you every day. @2026 TikTok Technology Machine Learning Engineer Graduate (TikTok Vertical Recommendation) - 2027 Start Location: San Jose Employment Type: Regular Job Code: A172736A Share this listing: Responsibilities About... 
    Temporary work
    Internship
    Local area

    TikTok

    Brooklyn, NY
    3 days ago
  • $110k - $220k

     ...Partner closely with business, product, engineering, and operations teams to identify high...  ...years of experience in Data Science, Machine Learning, Advanced Analytics, or related...  ...StockSummaryAbout the Role We are looking for a Principal Data Scientist to lead high-impact... 
    Principal
    Full time
    Temporary work
    Part time

    Walmart

    Hoboken, NJ
    7 hours ago
  • $162k - $387.6k

    Discover a career that energizes and excites you every day. @2026 TikTok Technology Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start (PhD) Location San Jose Employment Type Regular Job Code A101843A Responsibilities Design... 
    Temporary work
    Work experience placement
    Internship
    Local area

    TikTok

    Brooklyn, NY
    2 days ago
  •  ...you’ll have the opportunity to shape the engineering organization and lead major technical...  ...lab uses our datasets and reinforcement learning environments to encode and scale real-world expertise. We’re hiring a Founding Machine Learning Engineer, Quality Intelligence... 

    AfterQuery

    Brooklyn, NY
    6 days ago
  • # Machine Learning Engineer, API MulticloudOn-siteSan FranciscoAll jobsOn-site jobsMachine Learning Engineer Jobs## SkillsMachine LearningDeep LearningPyTorchTensorFlowAWSPythonRustData PipelinesDistributed SystemsModel CustomizationEvaluation SystemsAPIs## DescriptionABOUT... 

    Triwill Group

    Brooklyn, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Machine Learning Engineer. Be the first to apply!