Software Engineer - Kernels

What MatX Is BuildingMatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We primarily use the Rust programming language.What You'll Do HereDesign and optimize kernels that interface directly with our hardwareWork in partnership with our ML Research and Hardware Engineering teamsProvide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stackWho You AreBachelor of Computer Science or equivalent degree5+ years of software development experienceExperience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programmingLanguage: at least one of assembly, C++, C, Zig, or RustThis is a hybrid role that will require you to work from our Mountain View, CA office 3 days a week on Tuesday through ThursdayBonus Points If You HaveExperience implementing kernels for ML models such as TransformersExperience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.Familiarity with how compilers workCompensationThe US base salary for this full-time position is determined based on a variety of factors including role, experience, location, job-related skills, and relevant education and training. Career length is only a guideline for compensation.Early Career - $160,000 - $275,000 + equityMid Career - $175,000 - $400,000 + equitySenior Career - $250,000 - $600,000 + equityWhat We OfferTime off: 4 weeks PTO (accrued) + 12 company Holidays + up to 3 weeks remote workHealth: Company-subsidized Medical (Kaiser or Anthem) for employees & dependents, Guardian Dental and Vision insurances for employee & dependents, and life insurance (employee only), plus HSA and FSA offerings via Lively. Financial Wellbeing: Choose from Roth IRA/ 401K (or both) retirement plans with up to 5% company contribution to 401K (even if you don't contribute). Also, 100% company-paid life insurance (up to $300K) and long-term disability insurances.Professional Development: $1500 Professional Development Budget (per year)Team Meals: MatX provides onsite team lunch & dinner Monday - Friday, with your choice of ordering via WeBox, Specialty’s or via our reimbursement systemCommute on Us: Commute on our company Uber account, or reimburse your train rides. Either way, we pay 100% for your daily commute.MatX E[x]tras: $50/mo to use on the perk you value mostCell & Internet Reimbursement: $35/mo for cellular and $40/mo for wifiMental Wellbeing: 100% paid mental health benefit via SpringHealth and Guardian EAP.Support to Parents: Up to 12 weeks paid parental leave regardless of path to parenthood, 10 weeks pregnancy disability leave, flexible return-to-work hours, and Benepass reproductive health & parental benefit.AI Resources: Up to $20K/month plus a dedicated internal AI Tooling Team to support your productivityAs part of our dedication to the diversity of our team and our focus on creating an inviting and inclusive work experience, MatX is committed to a policy of Equal Employment Opportunity and will not discriminate against an applicant or employee on the basis of race, color, religion, creed, national origin or ancestry, sex, gender, gender identity, gender expression, sexual orientation, age, physical or mental disability, medical condition, marital/domestic partner status, military and veteran status, genetic information or any other legally recognized protected basis under federal, state or local laws, regulations or ordinances.All candidates must be authorized to work in the United States and work from our offices in Mountain View Tuesdays-Thursdays.This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicant's capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.MatX does not accept unsolicited resumes from individual recruiters or third-party recruiting agencies in response to job postings. No fee will be paid to third parties who submit unsolicited candidates directly to our hiring managers or People team and any resumes submitted are deemed to be the property of MatX.LocationMountain View (HQ)Employment TypeFull timeLocation TypeHybridDepartmentSoftware