Software Engineer II (Backend + Data pipelines)
$126kScribd
Scribd, Inc. is on a mission to advance human understanding. Our four products—Scribd®, SlideShare®, Everand™, and Fable—help billions of people across the globe move beyond access and into insight, application, and expertise.
Culture at Scribd, Inc.
We support a culture where our employees can be real and be bold; where we debate and commit as we embrace plot twists; and where every employee is empowered to take action as we prioritize the customer. We believe the best work happens when individual flexibility is balanced with meaningful community connection. Scribd Flex empowers employees to choose the workstyle and location that support their best performance, while committing to intentional in-person moments that strengthen collaboration and culture. Occasional in-person attendance is required for all Scribd, Inc. employees, regardless of location.
About The Team
The ML Data Engineering team powers metadata extraction, enrichment, and content understanding across all Scribd brands. We process hundreds of millions of documents, billions of images, and deliver high-quality metadata to enable content discovery and trust for millions of users worldwide. Our systems operate at massive scale, supporting diverse datasets like user-generated content (UGC), ebooks, audiobooks, and more. We work at the intersection of machine learning, data engineering, and distributed systems, collaborating closely with applied research and product teams to deploy scalable ML and LLM-powered solutions in production.
Role Overview
We’re seeking a Software Engineer II with strong backend development experience and a passion for solving complex data challenges at scale. In this role, you’ll design, build, and optimize distributed systems that extract, enrich, and process metadata for a wide range of content. You’ll work closely with ML engineers, product managers, and cross‑functional partners to integrate machine learning models and LLM-based services into production pipelines and deliver impactful, high-performance solutions. This role offers the opportunity to work on cutting‑edge generative AI and metadata enrichment problems at a truly global scale.
Tech Stack
Our team uses various technologies. The following are the ones that we use on a regular basis: Python, Scala, Ruby on Rails, Airflow, Databricks, Spark, APIs, AWS (Lambda, ECS, SQS, ElastiCache, SageMaker, CloudWatch, Datadog) and Terraform.
Key Responsibilities
- Design and build scalable systems to extract, enrich, and process metadata from millions of documents, images, and audio content.
- Leverage LLMs to integrate capabilities like summarization, classification, extraction, and enrichment into metadata pipelines.
- Collaborate with cross‑functional teams, including ML engineers and product managers, to deliver scalable, efficient, and reliable metadata solutions.
- Optimize and refactor existing systems for performance, scalability, and reliability.
- Ensure data accuracy, integrity, and quality through automated validation and monitoring.
- Participate in code reviews, ensuring best practices are followed and maintaining high‑quality standards in the codebase.
- Manage and maintain data pipelines, security, and infrastructure.
Requirements
- 5+ years of professional software engineering experience
- Proficiency in Python, Scala, Ruby, or similar languages
- Experience designing and building distributed systems at scale
- Hands‑on experience building, deploying, and optimizing solutions using ECS, EKS, or AWS Lambda
- Experience with infrastructure‑as‑code tools like Terraform (or similar)
- Experience working with a public cloud provider (AWS, Azure, or Google Cloud)
- Familiarity with data processing frameworks like Spark or Databricks for large‑scale workloads
- Proven ability to test, profile, and optimize systems for performance, scalability, and reliability
- Bachelor’s degree in Computer Science or equivalent professional experience
- Bonus: Experience working with LLMs or integrating ML models into production systems
At Scribd, Inc., your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role, level, and geographic location. San Francisco is our highest geographic market in the United States.
In the state of California, the reasonably expected salary range is between $126,000 (minimum salary in our lowest geographic market within California) to $196,000 (maximum salary in our highest geographic market within California).
In the United States, outside of California, the reasonably expected salary range is between $103,500 (minimum salary in our lowest US geographic market outside of California) to $186,500 (maximum salary in our highest US geographic market outside of California).
In Canada, the reasonably expected salary range is between $131,500 CAD (minimum salary in our lowest geographic market) to $174,500 CAD (maximum salary in our highest geographic market).
We carefully consider a wide range of factors when determining compensation, including but not limited to experience; job-related skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership, and a comprehensive and generous benefits package.
Working at Scribd, Inc.
Are you currently based in a location where Scribd, Inc. can employ you?
Employees must have their primary residence in or near one of the following cities. These include surrounding metro areas or locations within a typical commuting distance:
- United States: Atlanta | Austin | Boston | Dallas | Denver | Chicago | Houston | Jacksonville | Los Angeles | Miami | New York City | Phoenix | Portland | Sacramento | Salt Lake City | San Diego | San Francisco | Seattle | Washington D.C.
- Canada: Ottawa | Toronto | Vancouver
- Mexico: Mexico City
Benefits At Scribd, Inc.
- Scribd Flex (flexible work model)
- Comprehensive health, dental, and vision coverage
- Mental health support and disability coverage
- Generous paid time off, including vacation, sick time, holidays, winter break, volunteer time, and sabbaticals
- Paid parental leave and family support benefits
- Retirement matching and employee equity
- Learning and development programs and professional growth opportunities
- Wellness and home office stipends
- Complimentary access to the Scribd, Inc. suite of products
- Enterprise access to leading AI tools
Get to Know Scribd, Inc.
About Scribd, Inc.
Scribd, Inc. – no additional text needed as it is covered earlier.
Life at Scribd, Inc.
We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing View email address on click.appcast.io about the need for adjustments at any point in the interview process.
Equal Employment Opportunity
Scribd, Inc. is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.
#J-18808-Ljbffr$140k - $190k
...traders with award-winning software and brokerage services... ...a Sr. Software Engineer II to join our NT Connect... ...build, and evolve the backend services that underpin... ...test coverage, CI/CD pipelines, release readiness, and... ...authentication, authorization, data isolation, encryption,...PipelineDataWork at officeWorldwideMonday to FridayFlexible hours$100k - $150k
...March 2025) Day to Day As a Software Engineer II on the Meta Profile team, you... ...natural-language generation pipelines and services that synthesize job and job seeker data into a single source of truth... ...in one or more modern backend programming languages (e.g.,...PipelineDataWork experience placementLocal area$114.5k - $188k
...Software Engineer II Iterable is the leading AI-powered customer engagement... ...to activate customer data, design seamless cross-channel... ...which builds and maintains the pipeline responsible to getting messages... ...Collaborate with frontend, backend, product, and design to...PipelineDataContract workLocal areaImmediate startRemote workWorldwideHome officeFlexible hours$150k - $190k
...time. The Role As a Senior Software Engineer II on the Data Products team, you will act as a technical... ..., and test complex production backend web services in TypeScript, serving... ...quality and system reliability. • Data Pipelining: Build and maintain pipelines to...PipelineData3 days per week$89.4k - $116.4k
...internal frameworks and pipelines your team depends on. Your... ...and sustainable engineering aren't just buzzwords, but... ...our customers do. As a Software Engineer, Test & Infrastructure II, you will be doing both... .... Contribute to Test Data & Metrics: Work with SQL...PipelineDataTemporary workWork experience placementRemote workRelocation packageFlexible hours- A digital media company is looking for a Software Engineer II in Chicago to work on scalable distributed systems that manage and enrich metadata... ...software engineering experience and a strong background in backend development. The position offers flexibility and competitive...PipelineData
$125k
...As part of the Growth Engineering organization, our... ...personalization, and data-informed design to continuously... ...a talented Frontend Software Engineer II to join our Signup &... ...'ll work alongside backend engineers to build... ...Experience with CI/CD pipelines and automated...PipelineDataFull timeWork at officeLocal areaRemote workHome officeFlexible hours$126k
...features within ingestion pipelines, metadata services, and content... ...with guidance from senior engineers and the EM on scope and... ...4+ years of professional software engineering experience, including... ...systems. Experience with backend services, data pipelines, or content-...PipelineDataFull timeLocal areaHome officeFlexible hours$153k - $191k
...Ellis is seeking a Cloud & Datacenter Engineer Sr. II-our most senior individual contributor... ...and evolve the firm's global cloud and data center platforms. This is a high-impact... ...Microsoft Azure, Terraform, and CI/CD pipelines in large-scale production environments....PipelineDataWork at officeWorldwideFlexible hours$82k - $123k
...Role description Lead Backend Developer Lead II - Software Engineering Who We Are: Born digital, UST transforms... ..., Fargate/ECS/EKS, and managed data services as appropriate. •... ...integration. • Experience with CI/CD pipelines and deployment automation. •...PipelineDataFull timeTemporary workPart timeWork at officeLocal areaFlexible hours- ...IT Software Engineer 4 - Java Backend Location: Peoria, IL or Chicago office - Hybrid; must go in office... ...Cucumber and their integration into CI/CD pipelines. Datastores such as DynamoDB,... ...computer science fundamentals like data structures and algorithms....PipelineDataWork at officeLocal areaRelocationShift workWeekend work
$100k - $125k
...Software Engineer II Chicago, IL (Hybrid) Vibes' mobile-first platform creates personal, revenue... ...connect with their customers using a data-rich and API-packed solution that... ...based applications, with a focus on both backend Ruby on Rails and frontend React development...DataFull timeTemporary workWork experience placementSummer holidayWork at officeRemote workFlexible hours$78.9k - $131.6k
...are looking for a Fullstack Software Engineer to join our Account Management... ...built with Vue.js to robust backend services developed in TypeScript... ...As a Software Engineer II, you will: Embrace an AI... ...based architecture and reactive data models. Work extensively with...DataFull timeWork at officeLocal area2 days per week$154k - $200k
This is Adyen Adyen provides payments, data, and financial products in a single solution... ...of choice. At Adyen, everything we do is engineered for ambition. For our teams, we create... ...their ambitions faster. iOS Engineer II Adyen is looking for a full-time iOS developer...DataFull timeWork at officeFlexible hours$125k - $160k
...Job Title: Software Engineer II Location: 100% Remote (US Based Only) *We cannot sponsor or transfer any visas, of any kind now or in the future... ...interviews and other evaluations About Ocient: Ocient is a data analytics software solutions company that enables always‑on,...DataWork experience placementH1bWork at officeLocal areaRemote workVisa sponsorship$191k - $227k
...Software Engineer II - Technical Leadership Track Chicago, IL (Elmhurst) About The Job McMaster-Carr is a leading e-commerce company... ...eligible for work authorization sponsorship by McMaster-Carr. Data We Collect We may collect professional, education and...DataRelocation package$140k - $190k
...Sr. Software Engineer II, Mobile Chicago or Remote* JOIN US ON OUR MISSION TO BECOME THE #1 RETAIL TRADING PLATFORM IN THE WORLD Welcome... ...~ Understanding of RESTful APIs, WebSockets, and offline data handling ~ Familiarity optimizing performance, reliability,...DataWork at officeRemote workWorldwideMonday to FridayFlexible hours- ...Role - Java Backend Developer Location - Chicago, IL 60606 - Hybrid (Onsite... ...Work extensively with SQL databases for data modeling, querying, and optimization... ...backend services Contribute to CI/CD pipelines and DevOps practices Required Skills...PipelineData
- ...development assignments. Working on backend services in Client's Digital... .... Mentors and assists software engineers, providing technical... ...their integration into CI/CD pipelines. o Datastores such... ...Science fundamentals, such as data structures and algorithms....PipelineDataShift workWeekend work
$105.75k - $141k
...Senior Software Engineer - Backend APIs and Services Innovation. Sustainability. Productivity. This is how we are Breaking New Ground in our mission... ..., focusing on the use of consistent high-quality data across various platforms. They also mentor junior engineers...DataFlexible hours- ...We are seeking a Senior Engineer with deep expertise in Apache Solr... ...performance, relevancy, and indexing pipelines in a cloud-based environment.... ...with Apache Solr and backend development (Java or similar)... ...distributed systems and large-scale data processing Exposure to...PipelineData
- ...Unlocked Packages, Change Sets, or DevOps CI/CD pipelines is essential. • 5 years of experience in... ...understanding of Salesforce architecture, data model, and security model. • Experience... ...Developer I certification (Developer II or Sales Cloud Consultant is a plus). Skills...PipelineData
- ...Sr. Software Engineer – Android Location: Preference 1: Dallas, TX Preference... ...across presentation, domain, and data layers. Architect scalable... ...testing) integrated into CI/CD pipelines. Collaborate with product, design, and backend teams to deliver user-focused and...PipelineData
- ...Global is seeking a skilled Machine Learning Engineer based in Chicago, IL. In this role, you'll develop software using machine learning for back end applications... ...ideal for candidates with experience in building ML pipelines and data processing systems. #J-18808-Ljbffr...PipelineData
- ...Job Title: Python Backend Developer (Azure) Location: Chicago, IL (... ...and manage RESTful APIs for data exchange and integration. Implement CI/CD pipelines and automate deployments using... ...with frontend developers, DevOps engineers, and architects to deliver high...PipelineDataLong term contractContract work
- ...current with new technologies. Requirements: Experience with C# API experience Openness to work with new tools/technology Pluses: AI or LLM experience Experience with building and maintaining data pipelines Perks: Medical/Dental/Vision PTO 401k Matching Hybrid flexibility...PipelineDataWork at office
$130k - $160k
...TechnologyRecruitment Advisor II, Information Technology at... ...SummaryWe're looking for a skilled Data Engineer to join our team. This role... ...maintenance of various data pipelines and integration platforms,... ...pipelines and supporting existing software using a variety of modern...PipelineDataFreelanceRemote work$65k - $75k
...Business Development Representative II – Logistics Division Company: Paul Logistics... ...business opportunities, managing a strong sales pipeline, and working cross-functionally to align... ...in Microsoft Excel and capable of using data to inform decision-making ~ Excellent...PipelineDataFull timeMonday to FridayFlexible hours- ...A technology company is seeking a Senior Software Engineer II to develop and lead critical backend systems for its Stream Governance products. You'll design and... ...leadership, and innovation within a diverse team committed to making an impact in data streaming. #J-18808-Ljbffr...DataRemote work
$140k - $165k
...As a Senior Fullstack Engineer at Visibly, you will be a... ...excels at building complex backend services, managing large-scale data in the cloud, and... ...Management: Build robust data pipelines to handle large-scale... ...+ years of professional software engineering experience,...PipelineDataRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer II (Backend + Data pipelines). Be the first to apply!
- software sales engineer Chicago, IL
- software engineer full time Chicago, IL
- facebook software engineer Chicago, IL
- startup software engineer Chicago, IL
- intermediate software engineer Chicago, IL
- research software engineer Chicago, IL
- software developer no experience Chicago, IL
- rust software engineer Chicago, IL
- work from home software developer Chicago, IL
- software developer Chicago, IL

