Data Engineer
TriOptus LLC
Data Model and Structure Definition:
- Design and develop conceptual, logical, and physical data models for data sets across a variety of financial data sets.
- Collaborate with product management and the economic research team to understand data requirements and translate them into effective data models.
- Ensure data models are aligned with business goals and effectively support transactional, analytical and operational needs.
- Design and implement ETL processes to integrate data from various sources into the data lakes.
- Ensure data quality, consistency, and integrity throughout the data lifecycle.
- Develop and maintain documentation for data models and ETL processes.
- 5+ years' experience working within AWS technologies (S3, Redshift, RDS, etc.).
- 3+ years' experience working with dbt.
- 3+ years of experience with orchestration tooling (Airflow, Prefect, Dagster).
- Strong programming skills in languages such as Python or Java.
- Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka, Delta Lake, Iceberg, Arrow, Data Fusion).
- Familiarity with data governance tooling such as Monte Carlo, Atlan.
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills.
- Ability to work collaboratively in a team environment.
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- junior big data engineer Philadelphia, PA
- data visualization developer Philadelphia, PA
- senior data center engineer Philadelphia, PA
- senior data engineer Philadelphia, PA
- data engineering intern summer Philadelphia, PA
- big data developer Philadelphia, PA
- sr data engineer Philadelphia, PA
- big data devops engineer Philadelphia, PA
- software data engineer Philadelphia, PA
- senior cloud data engineer Philadelphia, PA
