Member of Technical Staff - Principal Data Platform Architect

Overview

Microsoft AI is seeking an experienced Principal Data Platform Architect to help design and implement a highly scalable data platform for processing upwards of 50TB/day of data from AI systems. We are looking for someone with technical prowess, a methodical problem-solving approach, proficiency in data platform and data pipeline technologies, and a mastery of templating to architect durable solutions. The role emphasizes positive energy, empathy, and teamwork in a fast-paced environment.

Responsibilities

• Thought leader and owner of the architecture blueprint of the data platform.
• Superior coding skills in SPARK using Scala, Python, and Java.
• Collaborate with Platform, infrastructure, and application engineers as well as AI researchers to build next-generation data platform services and capabilities.
• Ship high-quality, well-tested, secure, and maintainable code.
• Find a path to get things done despite roadblocks, delivering to users quickly and iteratively.
• Enjoy working in a fast-paced, design-driven product development cycle.
• Embody the company culture and values, fostering inclusion and collaboration.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years' experience in software development, data modeling, or data engineering work
• OR Master's Degree in same fields AND 6+ years' experience in software development or data engineering work
• OR equivalent experience.
• 5+ years of hands-on experience building large-scale data processing platforms with more than 100 data pipelines.
• 5+ years building data pipelines using Scala, Python (PySpark), and SQL, with deep understanding of big data technologies (Hadoop ecosystem, Spark, Kafka/Flink, columnar and vector databases, semantic search, RDBMS, key-value stores).
• 5+ years designing and deploying scalable services on public cloud platforms (Azure, AWS, GCP).
• 2+ years architecting distributed systems at scale, with knowledge of bare-metal infrastructure, containers, and networking.

Preferred Qualifications:

• 10+ years of technical engineering experience building data platforms that handle large volumes of data in batch and real-time processing. Coding in Scala, Python, C#, Java, Spark, SQL.
• Ability to identify, analyze, and resolve complex technical issues with a focus on performance, scalability, and user experience.
• Commitment to clean, maintainable, and well-documented code with emphasis on quality, performance, and security.
• Strong interpersonal skills and ability to work with cross-functional teams (product managers, designers, engineers).
• Clear communication of complex technical concepts to both technical and non-technical stakeholders.
• Willingness to learn new technologies and stay up to date with industry trends and best practices in web development and AI.
• Ability to work in a fast-paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
• Proven ability to contribute to a positive, inclusive work environment with knowledge sharing and growth.

Additional Information

Data Engineering IC6 — Typical base pay range across the U.S. is USD $163,000–$296,400 per year. There are location-based variations: USD $220,800–$331,200 per year in the San Francisco Bay Area and New York City metropolitan area. Certain roles may be eligible for benefits and other compensation. More information is available here:

Microsoft will accept applications for the role until September 19, 2025.

EEO Statement

Microsoft is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws. If you need assistance or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Job Metadata

• Seniority level: Not Applicable
• Employment type: Full-time
• Job function: Engineering and Information Technology
• Industries: Software Development

Referrals increase your chances of interviewing at Microsoft. #MicrosoftAI #Copilot