Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer (Python + Distributed systems)

$146.5k
Full-time

Scribd, Inc.

Scribd, Inc. is on a mission to advance human understanding. Our four products — Scribd®, Slideshare®, Everand™, and Fable — help billions of people across the globe move beyond access and into insight, application, and expertise.

Culture at Scribd, Inc.

We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.

We believe the best work happens when individual flexibility is balanced with meaningful community connection. Scribd Flex empowers employees to choose the workstyle and location that support their best performance, while committing to intentional in-person moments that strengthen collaboration and culture. Occasional in-person attendance is required for all Scribd, Inc. employees, regardless of location.

So what are we looking for in new team members? At Scribd, Inc., we hire for “GRIT.” Traditionally defined as the intersection of passion and perseverance toward long-term goals, GRIT reflects the mindset we expect from every employee. For us, it also serves as a practical framework for how we work: setting and achieving Goals, delivering Results within your role, contributing Innovative ideas and solutions, and strengthening the broader Team through collaboration and attitude.

This posting reflects an approved, open position within the organization.

At Scribd (pronounced “scribbed”), our mission is to spark human curiosity. Join our team as we create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our three products: Everand, Scribd, and Slideshare.

We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer.

We love collaborating and investing time in our Scribd community, and we create intentional in-person moments with each other to build culture and connection. And, it is through our flexible work benefit – Scribd Flex – that we enable employees, in partnership with their manager, to choose the work-style that best suits their individual needs and preferences.

About the team:

The ML Data Engineering team powers metadata extraction, enrichment, and content understanding across all Scribd brands. We process hundreds of millions of documents, billions of images, and deliver high-quality metadata to enable content discovery and trust for millions of users worldwide.

Our systems operate at massive scale, supporting diverse datasets like user-generated content (UGC), ebooks, audiobooks, and more. We work at the intersection of machine learning, data engineering, and distributed systems, collaborating closely with applied research and product teams to deploy scalable ML and LLM-powered solutions in production.

Role Overview:

We’re seeking a Senior Software Engineer with deep experience building event-driven, distributed, and scalable systems in Python. In this role, you’ll design and optimize large-scale data and service pipelines running on AWS, supporting Scribd’s content enrichment and metadata systems. You’ll work closely with cross-functional teams to design reliable backend services that integrate machine learning models and LLM-based components when needed. This role offers the opportunity to work on cutting-edge generative AI and metadata enrichment problems at a truly global scale.

Tech Stack:

Our backend systems are primarily built in Python, leveraging AWS services such as Lambda, ECS, SQS, and ElastiCache for event-driven and distributed processing. We also use Airflow, Spark, Databricks, Terraform, and Datadog for orchestration, data processing, and observability.

Key Responsibilities:

  • Provide technical leadership, mentorship, and guidance to engineers across the organization, driving secure coding best practices.

  • Lead the design, implementation, and scaling of event-driven, distributed systems to extract, enrich, and process metadata from large-scale document and media datasets.

  • Partner with Data Science, Infrastructure, ML Engineering, and Product teams to architect and deliver robust systems that balance scalability, high performance, and rapid iteration.

  • Contribute to the team’s engineering strategy, identifying gaps, proposing new initiatives, and improving existing frameworks.

  • Build and maintain scalable APIs and backend services for high-throughput content processing.

  • Leverage AWS services (ECS, Lambda, SQS, ElastiCache, CloudWatch) to design and deploy resilient, high-performance systems.

  • Optimize and refactor existing backend systems for scalability, reliability, and performance.

  • Ensure system health and data integrity through monitoring, observability, and automated testing.

Requirements:

  • 7+ years of professional software engineering experience with a focus on backend or distributed systems development.

  • Strong proficiency in Python (5+ years). Experience with Scala is a plus.

  • Expertise in designing and architecting large-scale event-driven and distributed systems

  • Strong cloud expertise with AWS services (ECS, Lambda, SQS, SNS, CloudWatch, etc.).

  • Experience with infrastructure-as-code tools like Terraform.

  • Solid understanding of system performance, profiling, and optimization.

  • Experience leading technical projects and mentoring engineers

  • Bachelor’s degree in Computer Science or equivalent professional experience.

  • Bonus: Familiarity with data processing frameworks (Spark, Databricks) and workflow orchestration tools.

  • Bonus: Experience integrating ML or LLM-based models into production systems.

At Scribd, Inc., your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role, level, and geographic location. San Francisco is our highest geographic market in the United States. In the state of California, the reasonably expected salary range is between $146,500 [minimum salary in our lowest geographic market within California] to $228,000 [maximum salary in our highest geographic market within California].

In the United States, outside of California, the reasonably expected salary range is between $120,000 [minimum salary in our lowest US geographic market outside of California] to $217,000 [maximum salary in our highest US geographic market outside of California].

In Canada, the reasonably expected salary range is between $153,000 CAD[minimum salary in our lowest geographic market] to $202,000 CAD[maximum salary in our highest geographic market].

We carefully consider a wide range of factors when determining compensation, including but not limited to experience; job-related skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership, and a comprehensive and generous benefits package.

Working at Scribd, Inc.

Are you currently based in a location where Scribd, Inc. can employ you?
Employees must have their primary residence in or near one of the following cities. This includes surrounding metro areas or locations within a typical commuting distance:


United States :

Atlanta | Austin | Boston | Dallas | Denver | Chicago | Houston | Jacksonville | Los Angeles | Miami | New York City | Phoenix | Portland | Sacramento | Salt Lake City | San Diego | San Francisco | Seattle | Washington D.C.

Canada :

Ottawa | Toronto | Vancouver

Mexico :

Mexico City

Benefits at Scribd, Inc.

  • Scribd Flex (flexible work model)

  • Comprehensive health, dental, and vision coverage

  • Mental health support and disability coverage

  • Generous paid time off, including vacation, sick time, holidays, winter break, volunteer time, and sabbaticals

  • Paid parental leave and family support benefits

  • Retirement matching and employee equity

  • Learning and development programs and professional growth opportunities

  • Wellness and home office stipends

  • Complimentary access to the Scribd, Inc. suite of products

  • Enterprise access to leading AI tools

Get to Know Scribd, Inc.
About Scribd, Inc.
Life at Scribd, Inc.

We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing View email address on jobs.jobcopilot.com about the need for adjustments at any point in the interview process.

Scribd, Inc. is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer (Python + Distributed systems) in San Francisco, CA vacancy
  • $117.2k - $313.7k

     ...future of AI, and you are the future of Salesforce.Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public...  ...experienceDeep knowledge of programming in Java, GoLang, Python, or RubyExperience owning and operating multiple... 
    Senior
    Software
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $148.5k - $223.9k

     ...immediate opportunities for senior software developers who want...  ...in developing distributed filesystems in an ever...  ...review, mentoring junior engineers, and providing...  ...scripting languages: Java, Python along with Strong SQL...  ...distributed systems at scale. - Proficiency... 
    Senior
    Software
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    3 days ago
  • $117.2k - $313.7k

     ...immediate opportunities for Lead software engineers who want their lines of code...  ...components/frameworks in distributed filesystems in an ever-...  ...drive innovations that improve system scalability, robustness, and...  ...scripting languages: Java, Python along with Strong SQL skills... 
    Senior
    Software
    Full time
    Immediate start
    Remote work

    Salesforce

    San Francisco, CA
    2 days ago
  • $117.2k - $313.7k

     ...efforts. Job Category Software Engineering Job Details About Salesforce...  ...the future of Salesforce. Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By...  ...programming in Java, GoLang, Python, or Ruby ~ Experience owning... 
    Senior
    Software

    Salesforce.Com Inc

    San Francisco, CA
    1 day ago
  • $166k - $225k

     ...improve their business. Founded by engineers — and customer obsessed — we leap...  ...SQL query engines. As a software engineer on the Runtime team at Databricks...  ...be building the next generation distributed data storage and processing systems that can outperform specialized... 
    Senior
    Software
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    2 days ago
  • $90k

    Distributed Systems Software Engineer, Python / Go Join to apply for the Distributed Systems Software Engineer, Python / Go role at Canonical Continue with...  ..., genetics, disability, age, or veteran status. Seniority level Seniority level Entry level Employment type Employment... 
    Software
    Full time
    Freelance
    Internship
    Local area
    Remote work
    Worldwide

    Canonical

    San Francisco, CA
    6 days ago
  •  ...Description Distributed Systems Software Engineer - Public Cloud (Senior/Lead/Principal) Note: By applying to the Public Cloud - Distributed Systems Software...  ...~ Deep knowledge of programming in Java, Golang, Python, or Ruby ~ Experience owning and operating... 
    Senior
    Software
    Full time

    Salesforce

    San Francisco, CA
    more than 2 months ago
  • $200k - $260k

     ...assembled authentication, integrations, distributed systems, and AI experts from Okta, Redis,...  ...-and-down the stack. We build our software with Go, Python, and Typescript, and expect you to...  ...to ship. ~7+ years of software engineering experience comprising of: ~5+ years... 
    Software
    Work at office
    Shift work

    Arcade

    San Francisco, CA
    2 hours ago
  • $117.2k - $223.9k

     ...Join our team of talented engineers and help us advance the...  ...a proactive and skilled Software Security Engineer to...  ...security, and the security of distributed and scalable distributed systems. This role requires...  ...experience in Go, Java, or Python with a solid grasp of... 
    Software
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $190k - $230k

     ...About This RoleWe’re seeking a Senior Systems Engineer to play a key role in...  ...Bring to the Team10+ years of software engineering experience,...  ...developmentStrong proficiency in Python and API development (REST,...  ...designing scalable, distributed systems in cloud environments... 
    Senior
    Software
    Temporary work

    Crusoe

    San Francisco, CA
    15 hours ago
  • $172.5k - $260.1k

     ...achieve the global scale involves network software that provides optimized and secure...  ...this with global scale and traffic distribution to enhance our end user experience.Edge is hiring a backend Java engineer with distributed systems, micro-services, and public cloud experience... 
    Software
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...About the Role Join a startup building an agentic data lakehouse platform. As a Senior Software Engineer, Distributed Data Systems, you'll work on a greenfield project to build scalable data infrastructure that transforms enterprise data into actionable insights at scale... 
    Senior
    Software
    Full time

    Clera

    San Francisco, CA
    more than 2 months ago
  • $139k - $257.55k

     ...consistency, reusable design systems, and collaboration workflows that...  ...looking for forward-thinking engineers who are excited to explore...  ...scalable full-stack applications, distributed systems, and modern web platforms with strong software engineering fundamentals.... 
    Senior
    Software
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    San Francisco, CA
    15 hours ago
  • $227.2k - $324.5k

    About the Role:As a Staff Software Engineer on the ML Infrastructure team,...  ...low-latency ML model serving systems that support Deep Learning,...  ...throughput, and low latency distributed systems using ScalaBuild reusable...  ...(e.g., Scala, Java, Python, Go, C++); experience with Scala... 
    Software
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    1 day ago
  • $172.5k - $285.8k

     ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce...  ...this with global scale and traffic distribution to enhance our end user experience....  ...Java engineer with distributed systems, micro-services, and public cloud experience... 
    Software
    Full time

    Salesforce

    San Francisco, CA
    8 days ago
  • $153k - $376k

     ...of everything we build. As a Software Engineer on our Infrastructure team,...  ...design, build, and operate the systems that power our real-time...  ...’re looking for experienced distributed systems engineers across a variety...  ...such as Go, TypeScript, Python, Rust, or Ruby.Strong system... 
    Software
    Minimum wage
    Full time
    Local area
    Remote work
    Worldwide
    Flexible hours

    Figma

    San Francisco, CA
    1 day ago
  • $152k

     ...are seeking an experienced Senior Systems Engineer to own our macOS platform and...  ..., and change standards.Software Delivery: Own our AutoPkg-based...  ...general-purpose languages (Python, Swift, Bash, Go) and...  ...scales understanding across a distributed team.Nice-to-haveJamf Certified... 
    Senior
    Software
    Full time
    Work at office
    Local area
    Remote work
    Shift work

    Chime

    San Francisco, CA
    1 day ago
  • $159.2k - $301.6k

    The Opportunity We are looking for a Senior AI Systems Engineer with deep C++ expertise to help build...  ...engineering, applied AI, and production software architecture. You will design and...  ...observability and tracing for AI systems or distributed systems. Experience with privacy-... 
    Senior
    Software
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide

    Adobe Systems

    San Francisco, CA
    2 days ago
  • $117.2k - $260.1k

     ...highly durable and available distributed storage for public clouds....  ...live and breathe transactional systems, distributed systems and...  ...highly qualified and energetic Senior/Lead SoftwareEngineer who...  ...distributed systems. The Senior/Lead Software Engineer will be responsible both for... 
    Senior
    Software
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  • $180k - $220k

     ...most critical services. Those systems are at the core of our text...  .... This role reports to the Senior Engineering Manager of Realtime...  ...scale, reliable and performant distributed systems. Collaborate with...  ...Familiar with open source software, and not afraid to dig into... 
    Software
    Full time
    Relocation
    Relocation package

    Discord

    San Francisco, CA
    9 days ago
  • $131k - $164k

     ...insight into their complex systems. As we continue to expand our...  ...New Relic is looking for a Senior Revenue Operations Manager...  ...technical and automation engine behind our Go-To-Market (GTM...  ...Relic.New Relic develops and distributes encryption software and technology that... 
    Senior
    Software
    Work at office
    Remote work
    Flexible hours

    New Relic

    San Francisco, CA
    2 days ago
  • $150k - $240k

     ...for the AI economy. Our software helps the world's largest...  ...The Role As a Software Engineer focusing on Distributed Systems at Verse, you will work in...  ...and write a lot of Go, Python, and Protobuf Build, test...  ...track record for Senior or Staff level software development... 
    Software
    Remote work
    Flexible hours

    Verse

    San Francisco, CA
    21 days ago
  •  ...high quality agentic search systems, addressing tail latency, throughput...  ...fragmented systems, mentor senior engineers, and align technical and...  ..., and operations.Strong distributed-systems expertise across performance...  ...of every team. Our software products help teams all over... 
    Senior
    Software
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    3 days ago
  •  ...Time$120k - $170kSenior Support Engineer Location: San Francisco,...  ...environment supporting a technical software platform, troubleshooting product issues, debugging with Python, and helping build scalable...  ...communication channels with ticketing systems. Diagnose and resolve product... 
    Senior
    Software

    Motion Recruitment

    San Francisco, CA
    1 day ago
  • $180k - $240k

     ...Senior Systems Engineer We are looking for a Senior Systems Developer to lead...  ...operation of large-scale distributed systems powering high-performance...  ...at the intersection of software and infrastructure,...  ...programming languages (e.g., Python, Java, C/C++, Go) ~ Proven... 
    Senior
    Software
    Flexible hours

    Nscale

    San Francisco, CA
    4 days ago
  • $203.8k - $239.8k

    Overview West Monroe is seeking a Senior Principal to lead our Distributed Energy Resource Management Systems (DERMS) capability within the Energy & Utilities practice...  ...degree required; advanced degree (e.g., MBA, Engineering, MIS) preferred Experience integrating AI... 
    Senior
    Local area
    Immediate start
    Flexible hours

    West Monroe

    San Francisco, CA
    1 day ago
  • $180k - $230k

    San Francisco, CAProduct Systems Engineering - Product Systems /Full time...  ...traditional space mission.As a Senior Product Systems Engineer at...  ...across ground, space, software, and hardware. You will define...  ...-heavy systems, including distributed components, APIs, processing... 
    Senior
    Software
    Full time
    Temporary work

    Loft Orbital

    San Francisco, CA
    15 hours ago
  • $272k - $336k

     ...billions in simulation across 15+ U.S. states. Waymo's Systems Engineering team works together to blend software and hardware systems in groundbreaking new ways....  ...ability to extract and process data from massive, distributed relational/non-relational databases ~ Proven... 
    Senior
    Software
    Odd job
    Full time
    Remote work

    Waymo

    San Francisco, CA
    20 hours ago
  • $160k - $210k

     ...This position has responsibility for all accounting financial systems and works directly with the Finance department managers, supervisors...  ...processes.Update, modify, test, and/or repair existing software systems and propose innovative solutions to problems.Provide functional... 
    Senior
    Software
    Full time
    Local area
    Worldwide
    Flexible hours

    King & Spalding

    San Francisco, CA
    15 hours ago
  •  ...Distributed Systems Engineer @ Dedalus Labs Mission Dedalus Labs is an AI research neolab building infrastructure for AI agents. We’re...  ...compute layer that powers the next generation of autonomous software. Our platform spans distributed storage, virtualization, orchestration... 
    Software
    Work at office
    Visa sponsorship
    Relocation package

    Dedalus Labs

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer (Python + Distributed systems). Be the first to apply!