Sr Data Engineer
Omni Inclusive
Data Solutions Designer
Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization.
Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services especially Python & Pyspark
Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation, exploration) of the data.
Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts, and demonstrating it to stakeholders.
Experience to work on Collibira for DQ and data governance is plus
Knowledge on dbt to model and build out layers in dbx is plus
AWS experience on s3,redshift,glue etc is also required
Databricks – Pyspark, Python, SQL
Unity catalog
Collibira DQ
AWS Services ex. Glue,s3,redshift,lambda etc
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Sr Data Engineer in Lansdale, PA vacancy
- ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA4 days ago - ...Sr. Big Data Data Engineer Horsham, PA/Remote/Hybrid C2H role Work hours (ex. 9am-5pm day/night shifts rotating shifts etc)? 9AM - 5PM EST Interview process – Initial Phone Screen – Team Interview – Hands-on Development Exercise Must have skills – Data Analysis...SeniorRemote workNight shiftRotating shiftDay shift
Samprasoft
Horsham, PA5 days ago - Senior Data Engineer As a Senior Data Engineer, you will enable data-driven decision-making by collecting, transforming, and visualizing data. You will design, build, maintain, and troubleshoot data processing systems with an emphasis on security, reliability, fault tolerance...SeniorWork experience placement
- Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...Senior
- ...Data Engineer Primary & Secondary Skill SQL/Python/Data Engineer/AWS Data Engineers who can build scalable, reliable data pipelines and infrastructure, requiring mastery in SQL, Python/Scala, cloud platforms (AWS), and big data technologies (Spark, Kafka, Hadoop). Key...Suggested
Omni Inclusive
Lansdale, PA4 days ago - ...Insight Global is currently seeking a Data Engineer for a large pharmaceutical client. This person will be joining a large team responsible for the build and maintenance of a large data catalogue solution. This person will be responsible for building ETL/data pipelines...
Insight Global
Lower Gwynedd, PA1 day ago - ...Software Development Life Cycle (SDLC) methodologies, including Agile and Waterfall. The individual will also contribute to modern data initiatives, including AI-enabled solutions and iPaaS-based integrations, while adhering to SDLC and database development best practices...Senior
Worldwide Insurance Services LLC
King of Prussia, PA4 days ago $95.9k - $167.9k
...purposeful work and meaningful impact every day. Learn more about what makes us different and how you can make your mark as a Senior Data Engineer at MMA. Marsh McLennan Agency (MMA) provides business insurance, employee health & benefits, retirement, and private client...SeniorMinimum wageLocal areaRemote workNight shiftMarsh LLC
Conshohocken, PA2 days ago$132.9k - $182.7k
...evolve, grow, and succeed - today and into tomorrow. As an Electrical Engineer in our Advanced Manufacturing group, you’ll contribute to projects that enable the heart of our clients’ successful data center facilities engineering, design and construction. In this role,...SeniorFull timeFor contractorsWork at officeRemote workFlexible hours- Position Title:Senior Data Scientist, Software EngineeringPosition Duties/Requirements: Research, design, and implement advanced machine... ...data pipelines for large-scale data processing, feature engineering, and model development, ensuring robustness and scalability across...SeniorWork from home
- Job Title: Data Engineer We are seeking a Data Engineer with strong experience in Databricks. The ideal candidate will possess the following qualifications: Experience: Good experience in Databricks. Data Analytics: Strong Data Analytics experience, knowledge of data modeling...
- Snowflake Data Engineer (HL7 / Healthcare Data) Role Overview Design and implement Snowflake-based data platform using Medallion Architecture Work on HL7, DICOM, and SQL Server data pipelines Skills Snowflake Mssql .Net Healthcare Background (hl7) Key Responsibilities...
$120.4k - $158.03k
...-effective and transformative projects to the electric vehicle, data center, consumer goods and products, metals, pulp and paper and... ...and every location.We're looking for a high-energy, Senior HVAC Engineer to focus on our Data Center market. Join us, and you’ll impact our...SeniorFull timeRemote work- ...employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub... ...Innovative Medicine is recruiting for a Sr Director, Head of Data Science & Digital... ....Lead a core team of data scientists and engineers to support PSTS in reaching its strategic...SeniorFull timeLocal area
- DescriptionWe are looking for a Data Engineer to drive the design and delivery of scalable data solutions that support critical business objectives within the oil and gas sector. This position is based in King of Prussia, Pennsylvania, and combines technical execution with...
- ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
$102k - $177.1k
...dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data... ...case by case basis.Role OverviewWe are seeking a Principal Data Engineer to provide technical leadership within Global Medical Safety (GMS...Full timeContract workLocal areaImmediate startRemote work$117k - $201.25k
...dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data... ...Data Scientist to leverage advanced machine learning, robust data engineering techniques, and domain expertise to drive impactful decisions and...Full timeLocal areaImmediate startWorldwide$117k - $201.25k
...dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data... ...Medicine is recruiting for a Principal Data Scientist (Knowledge Graph Engineer) - Immunology, who will play a pivotal role to standardize and connect...Full timeTemporary workLocal areaRemote work- ...Job Description Insight Global is currently seeking a Data Engineer for a large pharmaceutical client. This person will be joining a large team responsible for the build and maintenance of a large data catalogue solution. This person will be responsible for building...
Insight Global
Ambler, PA2 days ago $50k - $85k
...partners to scale safely across lending, card services, and embedded finance. The Role We are seeking a solution-oriented Data Engineer with deep expertise in Azure Synapse, SQL Server, and Power BI . In this role, you will design and deliver end-to-end data...Bing Recruitment
Conshohocken, PAmore than 2 months ago- ...Data Engineer Apex Systems is looking for a Data Engineer to join a Test Data Management Team at our client in Horsham, PA. We are looking for someone with strong SQL experience as the core skill. They need to have some Python and ideally some experience with Java as...
Software Technology Inc
Horsham, PA4 days ago - ...Senior Data Engineer As a Senior Data Engineer, you will work with the team to build complex data pipelines using a new cutting-edge Data Ingestion Platform as well as several new and exciting products in the Big Data/Advanced Analytics space. You will operate in a...
Software Technology Inc
Blue Bell, PA4 days ago - ...Our client is currently seeking a DATA ENGINEERPermanent Fulltime Opportunity, W2 Only Conshohocken, PA POSITION SUMMARY: The"Data Engineer"plays a"crucial role"in designing, developing, and maintaining"scalable data pipelines"and architectures using"...Full timeWork at office
The Judge Group
Conshohocken, PA2 days ago - ...Job Description Job Description Data Engineer - Snowflake migration Onsite Hybrid (regional monthly) We are seeking a hands-on ETL Data Engineer to design, build, and optimize enterprise data solutions in a modern cloud environment. This role requires someone...
Liberty Personnel Services, Inc
Plymouth Meeting, PA2 days ago $210.4k - $331.1k
...planning cycles: identify risks, develop and execute mitigation plans, and track performance metrics and outcomesEnsure immunology data integrity across organization (Book of Business, CTMS, etc.) Build and sustain strong cross-functional relationships (country operations...SeniorFull timeFor contractorsLocal areaWorldwideFlexible hours- ...and provide budgeting/financial flexibility by offering contingent labor as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and Hire, Multiple positions open.Position will design and...Contract workWork at officeImmediate startFlexible hours
$140k - $150k
...Piper Companies is seeking a Lead Data Engineer to support a company focused on enterprise digital transformation and advanced cloudbased... ...initiatives. This position is hybrid in Ft. Washington, PA . The Sr Data Engineer will provide strategic direction for...Piper Companies
Fort Washington, PA2 days ago- ...Job Description Day-to-Day: • Serve as a senior technical lead within the Data Engineering organization • Oversee data intake processes and determine how new data sources are integrated into the enterprise environment • Design, build, and maintain Microsoft Fabric...Immediate start
Insight Global
Fort Washington, PA4 days ago - ...Data Engineer Mandatory Skills: Snowflake, Matillion, Python, ETL • Master's Degree in Computer Science, a related field or equivalent work experience. • Snowflake Certification is required. • 10+ years of experience as a data engineer or similar work experience....Work experience placement
Omni Inclusive
Collegeville, PA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Data Engineer. Be the first to apply!
Related searches
- senior application administrator Lansdale, PA
- senior performance engineer Lansdale, PA
- srs Lansdale, PA
- senior Lansdale, PA
- senior operations technician Lansdale, PA
- data collection researcher Lansdale, PA
- clinical data Lansdale, PA
- clinical data coordinator remote Lansdale, PA
- data tech Lansdale, PA
- health data Lansdale, PA