Senior Software Engineer (Python + Distributed systems)
$146.5kScribd
Scribd, Inc. is on a mission to advance human understanding. Our four products - Scribd®, Slideshare®, Everand™, and Fable - help billions of people across the globe move beyond access and into insight, application, and expertise.
Culture at Scribd, Inc. We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer. We believe the best work happens when individual flexibility is balanced with meaningful community connection. Scribd Flex empowers employees to choose the workstyle and location that support their best performance, while committing to intentional in-person moments that strengthen collaboration and culture. Occasional in-person attendance is required for all Scribd, Inc. employees, regardless of location. So what are we looking for in new team members? At Scribd, Inc., we hire for "GRIT." Traditionally defined as the intersection of passion and perseverance toward long-term goals, GRIT reflects the mindset we expect from every employee. For us, it also serves as a practical framework for how we work: setting and achieving Goals, delivering Results within your role, contributing Innovative ideas and solutions, and strengthening the broader Team through collaboration and attitude. This posting reflects an approved, open position within the organization. At Scribd (pronounced "scribbed"), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our three products: Everand, Scribd, and Slideshare. We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer. We love collaborating and investing time in our Scribd community, and we create intentional in-person moments with each other to build culture and connection. And, it is through our flexible work benefit - Scribd Flex - that we enable employees, in partnership with their manager, to choose the work-style that best suits their individual needs and preferences. About the team: The ML Data Engineering team powers metadata extraction, enrichment, and content understanding across all Scribd brands. We process hundreds of millions of documents, billions of images, and deliver high-quality metadata to enable content discovery and trust for millions of users worldwide. Our systems operate at massive scale, supporting diverse datasets like user-generated content (UGC), ebooks, audiobooks, and more. We work at the intersection of machine learning, data engineering, and distributed systems, collaborating closely with applied research and product teams to deploy scalable ML and LLM-powered solutions in production. Role Overview: We're seeking a Senior Software Engineer with deep experience building event-driven, distributed, and scalable systems in Python. In this role, you'll design and optimize large-scale data and service pipelines running on AWS, supporting Scribd's content enrichment and metadata systems. You'll work closely with cross-functional teams to design reliable backend services that integrate machine learning models and LLM-based components when needed. This role offers the opportunity to work on cutting-edge generative AI and metadata enrichment problems at a truly global scale. Tech Stack: Our backend systems are primarily built in Python, leveraging AWS services such as Lambda, ECS, SQS, and ElastiCache for event-driven and distributed processing. We also use Airflow, Spark, Databricks, Terraform, and Datadog for orchestration, data processing, and observability. Key Responsibilities:- Provide technical leadership, mentorship, and guidance to engineers across the organization, driving secure coding best practices.
- Lead the design, implementation, and scaling of event-driven, distributed systems to extract, enrich, and process metadata from large-scale document and media datasets.
- Partner with Data Science, Infrastructure, ML Engineering, and Product teams to architect and deliver robust systems that balance scalability, high performance, and rapid iteration.
- Contribute to the team's engineering strategy, identifying gaps, proposing new initiatives, and improving existing frameworks.
- Build and maintain scalable APIs and backend services for high-throughput content processing.
- Leverage AWS services (ECS, Lambda, SQS, ElastiCache, CloudWatch) to design and deploy resilient, high-performance systems.
- Optimize and refactor existing backend systems for scalability, reliability, and performance.
- Ensure system health and data integrity through monitoring, observability, and automated testing.
- 7+ years of professional software engineering experience with a focus on backend or distributed systems development.
- Strong proficiency in Python (5+ years). Experience with Scala is a plus.
- Expertise in designing and architecting large-scale event-driven and distributed systems
- Strong cloud expertise with AWS services (ECS, Lambda, SQS, SNS, CloudWatch, etc.).
- Experience with infrastructure-as-code tools like Terraform.
- Solid understanding of system performance, profiling, and optimization.
- Experience leading technical projects and mentoring engineers
- Bachelor's degree in Computer Science or equivalent professional experience.
- Bonus: Familiarity with data processing frameworks (Spark, Databricks) and workflow orchestration tools.
- Bonus: Experience integrating ML or LLM-based models into production systems.
Employees must have their primary residence in or near one of the following cities. This includes surrounding metro areas or locations within a typical commuting distance: United States: Atlanta | Austin | Boston | Dallas | Denver | Chicago | Houston | Jacksonville | Los Angeles | Miami | New York City | Phoenix | Portland | Sacramento | Salt Lake City | San Diego | San Francisco | Seattle | Washington D.C. Canada: Ottawa | Toronto | Vancouver Mexico: Mexico City Benefits at Scribd, Inc.
- Scribd Flex (flexible work model)
- Comprehensive health, dental, and vision coverage
- Mental health support and disability coverage
- Generous paid time off, including vacation, sick time, holidays, winter break, volunteer time, and sabbaticals
- Paid parental leave and family support benefits
- Retirement matching and employee equity
- Learning and development programs and professional growth opportunities
- Wellness and home office stipends
- Complimentary access to the Scribd, Inc. suite of products
- Enterprise access to leading AI tools
Get to Know Scribd, Inc.
About Scribd, Inc.
Life at Scribd, Inc. We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing View email address on click.appcast.io about the need for adjustments at any point in the interview process. If you apply for a job with Scribd or otherwise engage with us in connection with employment (including as an employee, contractor, or other personnel), the personal information we process in that context is subject to our Employee and Applicant Privacy Policy, which is available here. Scribd, Inc. is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer (Python + Distributed systems) in San Francisco, CA vacancy
$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment...SeniorSoftwareFull timePart timeInternshipLocal area- ...with deep experience in distributed microservices, and full stack systems to create solutions that... ...mentoring other members of the engineering community, and from time... .../CSS, TypeScript, SQL, Python, and Go, Open Source... ...years of experience in software engineering (Internship...SeniorSoftwareFull timePart timeInternship
$250.8k - $286.2k
Capital One is seeking a Senior Lead Software Engineer specializing in distributed systems. This role involves leading technology projects and developing solutions... ...cloud services and programming languages such as Python and Golang. Capital One offers a competitive salary...SeniorSoftware$146.5k - $228k
...the team: The ML Data Engineering team powers metadata... ...users worldwide. Our systems operate at massive... ...data engineering, and distributed systems, collaborating... ...Overview: We’re seeking a Senior Software Engineer with deep... ...scalable systems in Python. In this role, you’ll...SeniorSoftwareTemporary workLocal areaWorldwideHome officeFlexible hours- ...Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Our Public Cloud engineering teams are responsible for innovating and maintaining... ...~ Deep knowledge of programming in Java, Golang, Python, or Ruby ~ Experience owning and operating multiple...SeniorSoftware
- A leading digital reading company in San Francisco is seeking a Senior Software Engineer with expertise in Python and AWS. This role involves designing scalable event-driven systems and collaborating with cross-functional teams. Ideal candidates will have over 7 years of...SeniorSoftwareFlexible hours
$117.2k - $313.7k
...efforts. Job Category Software Engineering Job Details About Salesforce... ...the future of Salesforce. Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By... ...programming in Java, GoLang, Python, or Ruby ~ Experience owning...SeniorSoftware$117.2k - $313.7k
...efforts. Job Category Software Engineering Job Details About Salesforce... ...the future of Salesforce. Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By... ...programming in Java, GoLang, Python, or Ruby ~ Experience owning...SeniorSoftware- Senior Distributed Systems Engineer (7+ years) Hybrid (3 days onsite) - San Francisco This company is building AI-powered... ...Required Qualifications 7+ years of software engineering experience Strong backend experience (Python, Go, TypeScript, or similar) Deep experience...SeniorSoftware
- A leading tech company based in San Francisco is seeking a Software Engineer to enhance its data and AI platform. The role involves developing high-performance distributed data systems and delivering on ambitious projects such as Delta Lake and performance engineering....SeniorSoftware
$90k
...Distributed Systems Software Engineer, Python / Go Join to apply for the Distributed Systems Software Engineer, Python / Go role at Canonical Continue... ...origin, genetics, disability, age, or veteran status. Seniority level Seniority level Entry level Employment type Employment...SoftwareFull timeFreelanceInternshipLocal areaRemote workWorldwide$293.6k - $335.1k
COMFORT SYSTEMS is seeking a Distinguished Software Engineer to join our innovative team in San Francisco, CA. You will lead technical contributions and mentor... ...in software engineering, particularly in distributed systems and cloud technologies. This role offers a...SeniorSoftware- A leading AI research company in California seeks a distributed systems engineer to design, build, and operate Exascale systems for managing research... ...cloud environments. Responsibilities include developing software to manage data accessibility, ensuring system reliability,...SeniorSoftware
- B Capital in San Francisco is looking for a Senior/Lead/Principal Distributed Systems Software Engineer. The role involves designing and maintaining a distributed... ...experience and deep knowledge of Java, Golang, Python, or Ruby. Key responsibilities include delivering...SeniorSoftware
- ...technology company in San Francisco is looking for a Senior Software Engineer to build scalable infrastructure for large‑scale training... ...and fine-tuning of foundation models. You will design distributed training systems and optimize GPU utilization while collaborating with...SeniorSoftware
$190k - $280k
...San Francisco is seeking a Senior Software Engineer to design and operate infrastructure within a distributed architecture. Responsibilities... ...enhancing control plane systems and improving reliability. Ideal... ...systems and proficiency in Python. The position offers a hybrid...SeniorSoftware- Acceler8 Talent is looking for a Senior Distributed Systems Engineer with over 7 years of experience in software engineering. This hybrid position in San Francisco focuses... .... The role requires strong backend skills in Python, Go, or TypeScript, combined with experience...SeniorSoftware
$175k - $225k
A cutting-edge technology firm is looking for a Senior Backend Engineer to design distributed systems for running AI agents. This role involves managing core... ...engineering experience, is proficient in Go and/or Python, and is familiar with Kubernetes and infrastructure-...Senior$166k - $225k
...improve their business. Founded by engineers — and customer obsessed — we leap... ...SQL query engines. As a software engineer on the Runtime team at Databricks... ...be building the next generation distributed data storage and processing systems that can outperform specialized...SeniorSoftwareLocal areaWorldwide$180k - $215k
As a Backend Engineer on our application team at Windfall, you will be building the system for ingesting and processing our customer data... ...design and build a scalable distributed system capable of supporting... ...Professional backend software engineering experience Expert...SeniorSoftware- Rippling is seeking a Senior Staff Software Engineer to lead initiatives in the development of their... ...impact role involves building scalable distributed systems and enhancing engineering quality... ...experience, expertise in Python, Golang, or Java, and the ability to...SeniorSoftwareWork at office
- Paradigm is seeking a Senior Software Engineer in San Francisco, California. This role requires 7+ years of... ..., particularly in managing and deploying distributed services. Candidates should be skilled in debugging complex systems and should possess familiarity with tools...SeniorSoftware
- Replo is hiring a Senior Backend Engineer to join our San Francisco team. This... ...architecting and implementing backend systems primarily in Typescript/... ...4 years of experience in distributed systems, a product-focused... ...to maintaining clean software practices. The position offers...SeniorSoftwareWork at office3 days per week
- ...assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis,... ...-and-down the stack. We build our software with Go, Python, and Typescript, and expect you to... ...to ship. ~7+ years of software engineering experience comprising of: ~5+ years...SoftwareWork at officeShift work
- Databricks is seeking a Performance Engineer in San Francisco to evaluate and enhance the... ...bottlenecks and set benchmarks to ensure systems meet customer demands. The ideal... ...experience in performance analysis and software development. The position offers competitive...SeniorSoftware
- The Voleon Group is looking for a Senior Software Engineer to join our team in Berkeley, California. This role involves designing and evolving distributed systems that power research and trading workflows across environments. You will collaborate with infrastructure, security...SeniorSoftware
- ...in San Francisco is seeking a Lead Software Engineer to design and develop distributed filesystems for their innovative platform... .... Strong expertise in Java, Python, and SQL is required alongside significant experience in systems design. Benefits include comprehensive...SoftwareRemote job
- Alteryx, Inc. is seeking a Senior Architect to lead the software architecture for our core platform... ...experience in large-scale systems and collaboration with engineering teams. The ideal candidate has... ...experience, is proficient in Java or Python, and has a proven track record...SeniorSoftwareRemote work
$117.2k - $313.7k
...efforts. Job Category Software Engineering Job Details About... ...exciting components/frameworks in distributed filesystems in an ever-... ...drive innovations that improve system scalability, robustness,... ...scripting languages: Java, Python along with Strong SQL...SoftwareImmediate startRemote work- Staff Software Engineer, ML Infra & Distributed Systems About the Role: As a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely... ...in any modern backend language (e.g., Scala, Java, Python, Go, C++); experience with Scala or JVM based...Software
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Software Engineer (Python + Distributed systems). Be the first to apply!
Related searches
- software sales engineer San Francisco, CA
- software engineer full time San Francisco, CA
- facebook software engineer San Francisco, CA
- startup software engineer San Francisco, CA
- intermediate software engineer San Francisco, CA
- research software engineer San Francisco, CA
- software developer no experience San Francisco, CA
- rust software engineer San Francisco, CA
- freelance software developer San Francisco, CA
- work from home software developer San Francisco, CA

