Deep Learning Engineer - Perception Algorithms

Deep Learning Engineer - Perception Algorithms

Do you have a passion for deep learning and computer vision problems? We are looking for someone who thrives on collaboration and wants to push the boundaries of what is possible today! Join our team of committed deep learning engineers in the Video Computer Vision group! We are a centralized applied research and engineering organization responsible for developing real-time on-device Computer Vision, Machine Perception, and Generative technologies across Apple products. Our shipped technologies power features in ARKit, MeasureApp, RoomScan, Accessibility, and multiple VisionPro features. As a member of the Video Computer Vision group you will develop new technologies in the area of scene understanding and for Apple's next generation products.

We are looking for a skilled Deep Learning Engineer for our team. In this role, you will perform research and development work to design algorithms for challenging real world problems in the domain of scene understanding.

Responsibilities:

• Data curation for improving performance on perception tasks (training and evaluation sets).
• Research, design, train, and evaluate machine learning/deep learning algorithms to address product goals.
• Benchmark and analyze machine learning/deep learning algorithms to understand limitations.
• Optimize algorithms for real time and low power constraints.
• Support algorithm integration into Apple products and ensure quality user experience.
• Collaborate with teams across Apple with multidisciplinary skills.

Minimum Qualifications:

• BS in Computer Science or related field with a minimum of 3 years of relevant industry experience.
• Experience in designing and training deep learning networks for image understanding tasks, e.g. image classification, object detection, semantic segmentation, panoptic segmentation, etc.
• Experience in developing downstream perception algorithms with vision-language models, e.g. CLIP
• Solid mathematical foundation of machine learning and deep learning techniques.
• Strong coding skills in python (with pytorch) and C/C++. Solid mathematical foundation of machine learning and deep learning techniques.

Preferred Qualifications:

• PhD degree with focus on machine learning, computer vision, robotics or MS with a comparable industry career of 3+ years.
• Consistent track record of researching, inventing and/or shipping advanced machine learning algorithms.
• Experience in language-guided image understanding tasks e.g. open-vocabulary image classification, language-guided visual grounding, open-vocabulary semantic segmentation, etc.
• Experience with designing and training with pipelines which consume large (billion scale) data for training efficient vision language models for edge-devices. This includes data curation for training vision language models, writing efficient data loading pipelines, utilizing distributed GPU training framework.
• Experience with advanced task-specific quality optimization techniques (few-shot learning, meta-learning, domain adaptation, knowledge-distillation, fine-grained learning) for improving network performance and handling specific failure cases (long-tailed distributions/under-represented classes) for downstream tasks.
• Experience in designing and optimizing network towards inference efficiency.
• Strong coding skills in ObjectiveC.
• Excellent communication and collaboration skills.

Pay & Benefits:

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $147,400 and $272,100, and your base pay will depend on your skills, qualifications, experience, and location. Apple employees also have the opportunity to become an Apple shareholder through participation in Apple's discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple's Employee Stock Purchase Plan. You'll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program. Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant At Apple, we believe accessibility is a fundamental human right. You'll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong. Learn about accessibility in Apple's workplace Learn about reasonable accommodations for job applicants Apple accepts applications to this posting on an ongoing basis.