Data Engineer
TriOptus LLC
Data Model and Structure Definition:
• Design and develop conceptual, logical, and physical data models for data sets across a variety of financial data sets.
• Collaborate with product management and the economic research team to understand data requirements and translate them into effective data models.
• Ensure data models are aligned with business goals and effectively support transactional, analytical and operational needs.
• Design and implement ETL processes to integrate data from various sources into the data lakes.
• Ensure data quality, consistency, and integrity throughout the data lifecycle.
• Develop and maintain documentation for data models and ETL processes. Minimum Requirements:
• 5+ years' experience working within AWS technologies (S3, Redshift, RDS, etc.).
• 3+ years' experience working with dbt.
• 3+ years of experience with orchestration tooling (Airflow, Prefect, Dagster).
• Strong programming skills in languages such as Python or Java.
• Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka, Delta Lake, Iceberg, Arrow, Data Fusion).
• Familiarity with data governance tooling such as Monte Carlo, Atlan.
• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills.
• Ability to work collaboratively in a team environment. Required Skills : Data Analysis Basic Qualification : Additional Skills : Data Engineer Background Check : No
Drug Screen : No
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in Philadelphia, PA vacancy
- ...Lead Engineer - Design and build robust, scalable ETLELT pipelines using PySpark to ingest data from diverse sources (databases, logs, APIs, files). - Transform and curate raw transactional and log data into analysis-ready datasets in the Data Hub and analytical data...Suggested
- ...Extract data from noisy, inconsistent sources Validate and reconcile outputs across multiple inputs Ensure correctness... ...intelligence Core Requirements Strong Python and backend/data engineering experience Experience building production data pipelines...Suggested
- ...Senior Data Engineer As a Senior Data Engineer, you will work with the team to build complex data pipelines using a new cutting-edge Data Ingestion Platform as well as several new and exciting products in the Big Data/Advanced Analytics space. You will operate in a...Suggested
- ...Data Engineer Philadelphia, PA Experience: 5-9 years • Experience in big data, ETL project. • Demonstrable experience with big data tools: Hadoop, Apache Spark, Kafka • Demonstrable experience with data pipeline and workflow management tools: NiFi etc. •...Suggested
$139.32k
...18.00 - $139,318.00 / Yearly Hours Per Week 40 Number Of Positions 1 Shift First Shift (Day) Job Description Data Engineer Sansar Tec LLC - Haddon Heights, NJ. Collaborate w/Agile teams to dsgn & dvlp data engg sol. Build distributed, low latency,...SuggestedFull timeShift workDay shift$91.7k - $163.7k
...Connecting. Growing together Position in this function may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL) development, storage...Minimum wageFull timeFor contractorsWork experience placementWork at officeLocal area- ...Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower...Full timeRemote workFlexible hours
- ...and generous perks, Perpay is the best place to be in Philadelphia right now. About the Role: Our data team is organized across three groups: Data Engineering, Data Science, and Strategic Analytics. Data Engineering owns the warehouse, the orchestration layer,...Odd jobFull timeWork at officeLocal areaRelocation packageWeekend work
- ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...
$100k
...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...Full timeH1b$65.5k - $134k
.... Senior Analyst - Financial Services Organization – AI and Data – Service Delivery Center EY is the only professional services... ...(trading, risk, compliance, or banking) Knowledge of prompt engineering and in-context learning optimization Familiarity with model...Summer holidayFlexible hours- Senior Data Engineer As a Senior Data Engineer, you will enable data-driven decision-making by collecting, transforming, and visualizing data. You will design, build, maintain, and troubleshoot data processing systems with an emphasis on security, reliability, fault tolerance...Work experience placement
- Overview We are hiring a Data Engineer to join our Data Technologies team. This team partners with middle-and back-office application teams to design, build, and support next-generation data platforms and pipelines that ingest, process, and transform large-scale data into...
$70k - $90k
...Associate Data Engineer Our purpose is to help a billion people find the right job! Phenom is an AI-Powered talent experience platform that is redefining the HR tech space. We have grown into a global organization with offices in 6 countries and over 1,600 employees...Full timeInternshipH1bWork at officeWork visaFlexible hours3 days per week$94.43k - $202.75k
...services firms. Spark your curiosity and ignite your career at The Lighthouse. KPMG is currently seeking a Senior Associate, Data Engineer for our Consulting practice. Responsibilities: Assist with technical design and development activities and lead a small workstream...Local areaVisa sponsorship$76.2k - $174.1k
...working world. Manager - Financial Services Organization - AI and Data - Service Delivery Center EY is the only professional... ...majors Minimum of 5 years of related work experience in AI/ML engineering or MLE/ML Ops Experience working with business, management,...Work experience placementSummer holidayFlexible hours- Tential Solutions is seeking a Senior Data Engineer to facilitate data-driven decision-making in Dresher, United States. This role emphasizes building and maintaining data processing systems with a focus on security, reliability, and efficiency. Key responsibilities include...
- Tokio Marine North America Services (TMNAS) is seeking an experienced data engineer to design, develop, and maintain data pipelines across TMNAS business units. You will implement ETL/ELT processes and collaborate with analysts, architects, and engineers to ensure high-...
- First Insurance Company of Hawaii is seeking an experienced data engineer to design, implement and maintain data pipelines and ETL/ELT solutions that support analytics across TMNAS business units. You will collaborate with data analysts and engineers to ensure high-quality...
- ...Google Cloud Data Engineer Are you ready to step up to the New and take your technology expertise to the next level? Join and help transform leading organizations and communities around the world. The sheer scale of our capabilities and client engagements and the way...Work experience placement
- ...Title: Azure Data Engineer Location: Remote w/ 1 Monthly on-site meeting to Philadelphia, PA required (University City Section) ~ Must reside in Pennsylvania, New Jersey, Maryland or Delaware only (for benefits purposes once converted) Type of...Remote work
- ...Job Title: Senior Azure Data Engineer Location: Philadelphia, PA (Hybrid Work) Position: Contract Requirements Required Skills: Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse Analytics, Azure Arc, DevOps...Contract work
$95k - $115k
...approximately 23.9 million customers worldwide.* For more information, visit transamerica.com. Job Description Summary The Senior Data Engineer will support creation of the Book of Record by building AWS-based data pipelines, enabling a single source of truth. The role...Full timeContract workWork at officeRemote workWorldwideWork visaRelocation package3 days per week$108k - $135k
...customers. Job Summary: Leads and/or participates in designing, developing and maintaining data pipelines, data integration solutions and ETL/ELT processes utilizing data engineering tools and platforms to support analytics and reporting across TMNAS Business Units....Full timeWork at office$1,100 per month
...better future. We are recruiting multiple associate‑level Software Engineers to join our Software Engineering teams across the following... ...Stack, Front‑End/UI, Back‑End, Software Quality/Test Automation, Data Engineering, Data Science, DevOps, and Video Interview Process....Full timeInternshipVisa sponsorship$88.54k - $127.16k
...healthcare experience. Here, industry depth meets media scale, where data becomes direction, where creativity and storytelling bring... .... Be found. Overview The Data Manager of Data Engineering will work in a hands-on and supportive role in our Technology and...Temporary workFreelanceFlexible hours- ...Manager For The Data & Ai Team Valorem Reply is an award-winning digital transformation firm focused on delivering solutions around... ...Ability to create working environments for data engineers and scientists, and general knowledge of ML, AI, LLMs, and MLOps...
- ...Role Descriptions: 1. Data Pipeline & OperationsBuild| manage| and monitor ETL/ELT pipelines for data ingestion and transformation... ...-functional CollaborationWork with business| analytics| and engineering teams to understand data needsTranslate business requirements into...
$112.29k - $161.28k
...Data Engineer PHM is the leading health media agency in the US, built for the modern healthcare experience. Here, industry depth meets media scale, where data becomes direction, where creativity and storytelling bring truth to life, and where orchestration replaces...Temporary workFreelanceFlexible hours- Susquehanna International Group, LLP is seeking a Data Engineer to join its Data Technologies team in Bala Cynwyd, PA. You will design, build, and support data pipelines that ingest and transform large-scale data into business-ready datasets for middle- and back-office...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data engineer analytics Philadelphia, PA
- remote data engineer Philadelphia, PA
- junior data engineer remote Philadelphia, PA
- senior cloud data engineer Philadelphia, PA
- aws data engineer Philadelphia, PA
- director data engineering Philadelphia, PA
- big data developer Philadelphia, PA
- senior data integration developer Philadelphia, PA
- data engineer machine learning Philadelphia, PA
- data center engineer Philadelphia, PA

