Sr. Data Engineer

Senior Data Engineer

The Senior Data Engineer will build and maintain data lake and data warehousing solutions for a B2B multi-tenant SaaS solution. Position requires a demonstrated ability to design processes from end to end and a strong technical understanding of modern data pipelines and strategies. In depth knowledge of multiple data sources, data design patterns, ETL transformation, SQL and performance tuning are required.

Essential Duties & Responsibilities:

Participate in the entire data pipeline lifecycle, focusing on building data lakes, data warehouses and related processes Lead code and design reviews with junior and peer developers Write clean code to develop data pipelines and necessary infrastructure as code Collaborate with cross functional teams to understand requirements and effectively design appropriate solutions. Monitor and troubleshoot performance, scalability, and security issues, making improvements as needed Participate in the evaluation of new technologies and tools that can improve performance of our system Participate in data governance process Contribute to the design and documentation of our data lake platform Proficient in test automation solutions for data and ability to optimize performance Gather technical and design requirements Communicate effectively with technical and non-technical team members to ensure alignment and successful execution of projects. Participate in cross-functional initiatives, promoting a culture of data-driven decision-making and continuous improvement. Participate in an on call rotation

Recommended Experience & Education Minimum Years of Experience

Typically requires a minimum of 5 years of related experience; or 3 years and an advanced degree

Education Level Bachelor's degree in engineering, computer science, math, data engineering or

Knowledge, Skills, & Qualifications Required

Experience in the development of modern data architecture, analytics, data governance, AI/ML, or related areas. Experience with AWS big data technologies including EMR, Glue, S3, EKS, Lambda, Athena, RDS, MKS/Kafka/Kinesis In-depth knowledge of the entire data engineering process (design, development, deployment) Exposure with relational and NoSQL databases such as PostgresQL, Cassandra, DynamoDB, MongoDb etc and data modeling principles Experience with DevOps, including CI/CD pipelines, containerized deployment/Kubernetes, and infrastructure-as-code/AWS Cloud Formation/Terraform. Proficient in SQL (SQL Server, Postgres) and Python Identify opportunities for process improvement as well as efficiency in solutions Teamwork skills with a problem-solving attitude and willing to take a variety of approaches Strong experience with legacy data warehouse and ETL pipelines Demonstrated ability to mentor junior team members Excellent analytical and time management skills, with a proven ability to deliver value independently Strong written and verbal communication skills, with demonstrated experience providing technical input to technical and non-technical stakeholders Ability to participate in on-call rotation.

Preferred

Experience with multi-tenant, B2B2C SaaS offerings FinTech industry experience Understanding of MPP Data Warehouse (Redshift, Greenplum)

Physical Demands Ability to lift a minimum of 5 pounds to a maximum of 10 pounds unassisted Ability to stand, sit, stoop, walk, stretch, reach, and use full range of body motions Manual dexterity as required for specific equipment

The salary range for this position is: TBD