Senior Data Engineer

Senior Data EngineerAre you looking to join a highly motivated team working for social impact? At Beam we're on a mission to shift $10 Billion to high-impact nonprofits.About the roleAs a Senior Data Engineer on our Engineering team with a focus on data development, you will be working with a team of talented developers responsible for helping create and maintain the data platform, infrastructure, and processes that power the internal and external facing business intelligence that drives Beam's mission. Our data platform processes more than 7TB of data every 90 minutes, delivering complex analytics to our partners and actionable data to our internal stakeholders. You will have the opportunity to work with a wide range of open source data technologies, building new features, supporting existing functionality through bug fixing and enhancements, and will have a significant impact on a core part of our business.We're a highly collaborative team motivated by impact and our high growth environment. This is an opportunity for someone excited to have a high level of impact on Beam's continued success.Our data tech stackApache Spark running pysparkKubernetes running on EKS; managed using k9s, Helm and eksctlApache Airflow as our workflow orchestratorTesting automation via pytestuv as our Python package managerSnowflake as our data warehouseS3 as our distributed object storage / data lakeWhat you'll doDesign and plan new platform data solutions through collaboration with our Head of Engineering, our Engineering and product teams, and internal stakeholders using RFC and Tech Spec documentsCollaborate with your peers to execute and implement high-quality softwareCollaborate with your peers to assist in planning and execution of new software features, bringing a focus on data platform requirementsDrive the execution of your work from spec document to delivery through our SDLCGrow your skillset and be a force multiplier by sharing knowledge through code reviews, pair programming, 1-1 conversations, and broader team trainingsDevelop subject matter expertise in the Beam data ecosystem and our reporting platform through code development, directly supporting our Client Strategy team, Business Operations, and our partnersUnderstand and strive to balance tech debt with practicality while designing solutionsGain knowledge of the nonprofit giving and e-commerce enablement spacesFoster a team culture around Beam's values of community, inclusivity, care, accountability and supportStrive for continuous improvement through goal setting, feedback, and other growth opportunitiesWhat we're looking for4+ years as a Data Engineer or Senior Data Engineer utilizing Python and SQL to develop data intensive applications or insights, or 5+ years of experience as a Software Engineer using Python and SQL, working in a primarily Python codebaseExperience working on production-level data systems in a collaborative team environmentProficient with Python and SQLProficient with relational databases, particularly PostgreSQLExperience with Apache Airflow for task orchestrationExperience using a Business Intelligence tool, like TableauFamiliar with fundamental development principles and processes such as observability, performance optimization, continuous integration, automated testing, and cloud infrastructureFamiliar with distributed computing architecture, data warehouse and data lake storage patternsStrong communication skills with the ability to explain and advocate for technical projects to non-technical rolesNice to havesExperience in an early startupExperience with setting up and administrating a Business Intelligence tool, like TableauExperience with Apache SparkExperience with managing a Kubernetes clusterBachelor's degree in Computer Science or related technical or analytical field (or equivalent training, fellowship, or work experience)Compensation and perksExpected annual compensation range: $176,000-198,000 USDBase salary $160,000-180,000 USDUp to 10% annual bonus based entirely on individual performanceStock options50% match on 401k contributions of up to 6% of base salary$100 monthly wellness stipend$750 annual professional development budgetSee a full list of perks at - RemoteWe are a remote-first company, so our team works from wherever they are. We also have office space in New York, currently in Hearst Tower, where you're free to come work from as well. We have no plans to require in-office work.