Senior Data Engineer

Responsibilities Design, build, and maintain robust data pipelines and data lake architecture for both batch and real‑time streaming use cases, including high‑volume, low‑latency data processing Improve observability, alerting, and SLOs across data systems so pipelines are easier to monitor and issues are caught early Optimize ETL/ELT workflows for performance, scalability, and fault tolerance Develop dbt workflows to onboard Evaluation Partners and create end‑of‑day reporting for partner analysis Build and support event‑driven architectures and scalable platform components Contribute to the orchestration and automation of workflows Integrate complex financial APIs and third‑party data sources into internal systems Collaborate with analytics, product, and ML engineers to develop and deploy reliable data products Work on feature pipelines and model‑ready data to support ML engineers Promote high standards in code quality, testing, and platform reliability Participate in Agile ceremonies and foster a collaborative, growth‑oriented team culture Requirements Bachelor's degree in Computer Science, Engineering, or a related field 5+ years of experience in data engineering, platform engineering, or backend development Strong skills in SQL and Python for building and testing data solutions Hands‑on experience with GCP and GCP data products (BigQuery, Cloud SQL, Cloud Storage, etc.) Experience with AWS cloud services (S3, Glue, Athena, Kinesis) in addition to GCP; bonus for EMR Experience with CI/CD pipelines, infrastructure‑as‑code, and version‑controlled deployment workflows (e.g., Terraform, GitOps) Hands‑on dbt experience building and maintaining dbt projects (models, tests, macros, documentation, CI) Proficiency with workflow orchestration tools (e.g., Airflow, Prefect) Knowledge of data lake architecture, including file formats (Parquet, Avro) and open table formats (Apache Iceberg) Familiarity with event‑driven and service‑oriented architecture A track record of building automated, well‑tested, and observable data systems Comfortable working both independently and collaboratively in a fast‑paced Agile environment Certifications & Qualifications Bachelor's degree in Computer Science Bachelor's degree in Engineering #J-18808-Ljbffr Jobtailor