Senior Data Engineer

Annual base salary: $156,000 - $180,000 per year , depending on experience. Additional compensation: Cash bonus potential and equity. Employment type: Full-Time About the Role This opportunity is for a Senior Data Engineer to take ownership of a large-scale daily data ingestion engine supporting a revenue management platform for the flexible rental market. This is a full-time, remote position based in the United States . The platform tracks calendar, availability, and pricing information for more than 14 million listings worldwide , ingesting updated future-calendar data for every listing each day. This creates a highly dynamic, multi-terabyte dataset that directly supports the pricing algorithms used by the core product. The role works within a Ruby on Rails and Resque environment supported by AWS RDS for PostgreSQL, Amazon Aurora, and Athena. The Senior Data Engineer will oversee and improve existing ingestion workflows, integrate new data sources, optimize database and processing performance, and ensure that data is delivered reliably to the core application. This position requires full ownership of the reliability, speed, scalability, observability, and cost efficiency of business-critical data infrastructure. The daily synchronization process is essential to the product, making dependable pipeline performance and rapid issue resolution central to this role. What You’ll Do Architect, optimize, and oversee daily ingestion pipelines that process calendar data for more than 14 million listings. Tune and scale AWS RDS PostgreSQL and Amazon Aurora databases to support high-throughput read and write operations and multi-terabyte storage requirements. Improve background job orchestration to ensure data is processed efficiently and delivered on schedule. Design and build reliable ETL processes that integrate new and complex data sources into the existing data ecosystem. Collaborate with application engineers to make multiple versions and aggregations of data easily accessible to the core application. Apply DevOps best practices to maintain and improve AWS infrastructure, CI/CD pipelines, and infrastructure-as-code workflows. Build comprehensive monitoring, alerting, dashboards, and observability tools that identify anomalies and bottlenecks before they affect customers or business operations. Proactively identify opportunities to improve the performance, scalability, reliability, and cost efficiency of data infrastructure. Troubleshoot complex issues involving distributed systems, large datasets, databases, background processing, and cloud infrastructure. Design safeguards and repeatable processes that detect difficult-to-find data issues before they affect downstream systems. Evaluate technical tradeoffs and determine when to implement a long-term architectural solution or a practical short-term fix. Communicate data engineering constraints, system behavior, and architectural decisions clearly to engineering and product stakeholders. Qualifications 5+ years of experience in Data Engineering or Backend Engineering involving high-velocity, multi-terabyte datasets. 10+ years of overall engineering experience within technology companies. Advanced knowledge of relational databases, particularly PostgreSQL and Amazon Aurora. Experience tuning databases, optimizing complex queries, and managing large-scale indexing strategies. Strong programming skills in Ruby and Ruby on Rails, or expert-level experience in a similar language such as Python with a strong willingness to learn Ruby. Experience operating background processing frameworks at scale, such as Resque, Sidekiq, Celery, or similar technologies. Hands-on experience with AWS cloud services. Experience provisioning infrastructure with Terraform, CloudFormation, or similar infrastructure-as-code tools. Experience building, maintaining, or improving CI/CD pipelines. Strong data modeling skills, including the ability to balance fast ingestion with efficient application queries. Demonstrated ability to identify performance bottlenecks in complex distributed systems and implement effective solutions. Experience working independently, communicating asynchronously, and managing priorities effectively in a remote environment. Strong systems thinking and an understanding of how background processing, PostgreSQL, and AWS infrastructure interact. Ability to remain calm and methodical while resolving critical pipeline and data infrastructure issues. Strong written and verbal communication skills, including the ability to explain complex technical concepts in clear language. A practical approach to engineering decisions, with the ability to balance technical quality, delivery speed, and business needs. Strong attention to detail and a process-driven approach to data quality, monitoring, and issue prevention. Benefits and Opportunities Opportunity to own large-scale data pipelines within a growing SaaS environment. Direct impact on product reliability, data availability, and customer experience. Autonomy to shape projects and influence the direction of future technical development. Collaborative small-team environment with highly visible individual contributions. Cash bonus potential and equity. Full medical, dental, and vision benefits for U.S. employees. Fidelity 401(k) plan for U.S. employees. Unlimited paid time off. Remote-first working environment focused on sustainable performance and work-life balance. Recruitment notice: all communication only happens from authorized email addresses ending in @7seventy.net . We never ask for payments or sensitive documents. Suspect a scam? Email View email address on click.appcast.io #J-18808-Ljbffr