Senior Data Engineer

Senior Data Engineer role at Trepp, Inc. Trepp's Data Platform Team is looking for individuals with strong backgrounds in programming to undertake challenging projects in our NYC office. The Data Platform Team powers all products at Trepp by using distributed data technologies built on our data lake. The Core Team is dedicated to establishing a robust foundation through architecture reviews, managing observability frameworks, and continuously assessing our processes and technology. The team oversees the maintenance of data ingestion and pipeline frameworks, while also developing new frameworks to empower developers. As a member of the Data Platform Core Team, you’ll be using open source and cloud technologies to drive innovation on our data platform. You will get the chance to work with teams across different lines of business and other engineering teams to tackle complex problems and design scalable solutions. You will be an integral part of a team which is responsible for platform stability and foundational work. Responsibilities Become a Subject Matter Expert (SME) on our frameworks to assist in developing roadmaps and prioritizing initiatives. Identify opportunities to improve the platform through technical discussions and project proposals. Leverage project planning skills to transform high-level ideas into design and implementation. Demonstrate leadership ability to back decisions with research and the “why,” and articulate several options, the pros and cons for each, and a recommendation. Implement best practices in Data Engineering to drive innovation and enhance our platform as we scale. Basic Qualifications Bachelor’s Degree At least 5 years of experience in application development At least 3 years of experience in big data technologies At least 1 year of experience with cloud computing (AWS, Microsoft Azure, Google Cloud) Experience with Agile and SDLC, Git workflows, and CI/CD Preferred Qualifications 5+ years of experience in application development including Python, SQL, Scala, or Java 3+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 5+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark) 2+ years of experience working on real-time data and streaming applications 3+ years of data warehousing experience (Redshift or Snowflake) 2+ years of experience with UNIX/Linux including basic commands and shell scripting Salary Range Base salary starting from $185k plus bonus eligible Benefits and Perks Base + target bonus compensation structure 401(k) (with employer match) Life insurance, long term disability, short term disability all covered by the company Flexible paid time off (PTO) Sixteen (16) weeks paid primary caregiver leave Four (4) weeks paid parental leave Wellness subsidy Laptop + WFH equipment Pre-tax commuter benefit with company subsidy (For NYC-office based employees only) Fun company events and volunteering opportunities Workplace Policy NYC, PA, and London office-based positions: Trepp’s offices follows a 3-2 hybrid-working policy with the expectation of in-office work on Tuesday-Thursday and the option to work from home on Monday and Friday. Seniority level Mid-Senior level Employment type Full-time Job function Industries: Information Services, Technology, Information and Media, and Financial Services Trepp is an equal opportunity employer. We do not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, national origin, or disability. #J-18808-Ljbffr