Sr Data Engineer
Omni Inclusive
Data Solutions Designer
Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization.
Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services especially Python & Pyspark
Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation, exploration) of the data.
Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts, and demonstrating it to stakeholders.
Experience to work on Collibira for DQ and data governance is plus
Knowledge on dbt to model and build out layers in dbx is plus
AWS experience on s3,redshift,glue etc is also required
Databricks – Pyspark, Python, SQL
Unity catalog
Collibira DQ
AWS Services ex. Glue,s3,redshift,lambda etc
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Sr Data Engineer in Lansdale, PA vacancy
- ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA1 day ago - ...Sr. Big Data Data EngineerHorsham, PA/Remote/HybridC2H role Work hours (ex. 9am-5pm day/night shifts rotating shifts etc)? 9AM - 5PM ESTInterview... ...architecture, design, and specification using in-depth engineering skills and knowledge to solve complex development problems...SeniorRemote workNight shiftRotating shiftDay shift
Samprasoft
Horsham, PA3 days ago - Merck & Co. in West Point, PA seeks a Sr. Scientist/Engineer focused on Container Closure Integrity analytical work to support late-stage development and global manufacturing of packaging/device products. You will develop/validate CCI methods, transfer techniques, and...Senior
- We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and data ingestion processes using modern Big Data technologies. The ideal candidate will have strong experience in data aggregation, transformation, validation, quality management...Senior
$117k - $201.25k
...dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data... ...partner closely with scientists, safety experts, data scientists, AI engineers, and platform teams to create knowledge assets that support...SuggestedFull timeLocal areaImmediate start- Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...Senior
- ...Data Engineer Primary & Secondary Skill SQL/Python/Data Engineer/AWS Data Engineers who can build scalable, reliable data pipelines and infrastructure, requiring mastery in SQL, Python/Scala, cloud platforms (AWS), and big data technologies (Spark, Kafka, Hadoop). Key...
Omni Inclusive
Lansdale, PA1 day ago $1,000 per month
...well positioned to build the future of inclusive finance through cutting-edge technology and customer-centric solutions. Senior Data Engineer Join our Data Platform & Analytics team and help shape the trusted data foundation that powers analytics, strategy, and...SeniorTemporary workWork at officeImmediate startRemote workFlexible hoursCredit Genie
Plymouth Meeting, PA5 days ago- Job Title: Data Engineer We are seeking a Data Engineer with strong experience in Databricks. The ideal candidate will possess the following qualifications: Experience: Good experience in Databricks. Data Analytics: Strong Data Analytics experience, knowledge of data modeling...
$132.9k - $182.7k
...evolve, grow, and succeed - today and into tomorrow. As an Electrical Engineer in our Advanced Manufacturing group, you’ll contribute to projects that enable the heart of our clients’ successful data center facilities engineering, design and construction. In this role,...SeniorFull timeFor contractorsWork at officeRemote workFlexible hours- Position Title:Senior Data Scientist, Software EngineeringPosition Duties/Requirements: Research, design, and implement advanced machine... ...data pipelines for large-scale data processing, feature engineering, and model development, ensuring robustness and scalability across...SeniorWork from home
- Coforge is seeking a Senior Data Engineer (Agentic Retrieval & Memory) in Oaks, PA for a full-time role. You will design agent memory interfaces across session state, short-term history, and long-term memory, and select optimal stores for each tier. You will integrate with...SeniorFull timeTemporary work
- Role: Senior Data Engineer (Agentic Retrieval & Memory) Mode of Hire: Full time RESPONSIBILITIES Design and build the agent memory interface across the tiers an agent actually needs: working or session state within a run, short-term conversation history, and long-term...SeniorFull timeTemporary work
$120.4k - $158.03k
...-effective and transformative projects to the electric vehicle, data center, consumer goods and products, metals, pulp and paper and... ...and every location.We're looking for a high-energy, Senior HVAC Engineer to focus on our Data Center market. Join us, and you’ll impact our...SeniorFull timeRemote work- Peoplesoft Analytics Developer2 We are seeking a highly skilled Data Integration Architect to support Business As Usual (BAU) operations focused on legacy system integrations, data transformations, and conversions. This role will be responsible for designing, building,...
- Vish Consulting Services (VISHUSA) in Oaks, PA, is seeking a Senior Data Engineer specializing in Agentic Retrieval, memory systems, and enterprise AI platforms. The role focuses on building intelligent data retrieval systems, memory architectures, and LLM-driven enterprise...Senior
- ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
- We are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In this role, you will build and enhance modern data pipelines and warehouse structures that support reporting, analytics, and business decision...
- Job Title: Senior Data Engineer (Agentic Retrieval & Memory Systems) | Vish Consulting Services (VISHUSA) | Oaks, Pennsylvania, USA Recruiting Company: Vish Consulting Services (VISHUSA) Job Location: Oaks, Pennsylvania, USA (Hybrid) Job Type: Contract (C2C) Application...SeniorContract workH1bImmediate start
$102k - $177.1k
...dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data... ...case by case basis.Role OverviewWe are seeking a Principal Data Engineer to provide technical leadership within Global Medical Safety (GMS...Full timeContract workLocal areaImmediate startRemote work- ...Data Engineer Apex Systems is looking for a Data Engineer to join a Test Data Management Team at our client in Horsham, PA. We are looking for someone with strong SQL experience as the core skill. They need to have some Python and ideally some experience with Java as...
Software Technology Inc
Horsham, PA1 day ago - ...Senior Data Engineer As a Senior Data Engineer, you will work with the team to build complex data pipelines using a new cutting-edge Data Ingestion Platform as well as several new and exciting products in the Big Data/Advanced Analytics space. You will operate in a...
Samprasoft
Blue Bell, PA2 days ago - ...Our client is currently seeking a DATA ENGINEERPermanent Fulltime Opportunity, W2 Only Conshohocken, PA POSITION SUMMARY: The"Data Engineer"plays a"crucial role"in designing, developing, and maintaining"scalable data pipelines"and architectures using"...Full timeWork at office
The Judge Group
Conshohocken, PA4 days ago - ...Job Summary We are seeking a Snowflake Data Engineer with strong expertise in Snowflake, DBT, and Airflow to design, build, maintain, and optimize enterprise data warehouse and data engineering solutions. The role requires deep hands-on experience with Data Vault 2....Work experience placement
Compunnel
Oaks, PA5 days ago $117k - $201.25k
...an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data ScienceJob Category:Scientific/TechnologyAll Job Posting Locations:Cambridge...Full timeTemporary workLocal areaRemote work- ...and provide budgeting/financial flexibility by offering contingent labor as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and Hire, Multiple positions open.Position will design and...Contract workWork at officeImmediate startFlexible hours
- ...Principal Data Scientist - Immunology Johnson & Johnson Innovative Medicine is currently seeking a Principal Data Scientist - Immunology... ...is recruiting for a Principal Data Scientist (Knowledge Graph Engineer) - Immunology, who will play a pivotal role to standardize and...Local areaRemote work
J&J Family of Companies
Spring House, PA2 days ago $109k - $174.8k
...dignity of our employees and recognize their merit.Job Function: Data Analytics & Computational SciencesJob Sub Function: Data... ...sequence, construct, assay, and biophysical data.Work with data engineers to specify the features, labels, and levels of aggregation that...SeniorFull timeTemporary workWork at officeLocal areaRemote workShift work- Scorpion Therapeutics in Spring House, PA, seeks a leader to shape scientific data products for AI-enabled drug discovery and development. You will design interoperable data assets connecting discovery, preclinical, clinical, safety, and real-world evidence, and build...
- ...Data Engineer Mandatory Skills: Snowflake, Matillion, Python, ETL • Master's Degree in Computer Science, a related field or equivalent work experience. • Snowflake Certification is required. • 10+ years of experience as a data engineer or similar work experience....Work experience placement
Omni Inclusive
Collegeville, PA3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Data Engineer. Be the first to apply!
Related searches
- senior Lansdale, PA
- senior tech Lansdale, PA
- senior performance tester Lansdale, PA
- senior implementation project manager Lansdale, PA
- senior manager diversity & inclusion Lansdale, PA
- srs Lansdale, PA
- senior application administrator Lansdale, PA
- senior leadership Lansdale, PA
- senior operations technician Lansdale, PA
- senior performance engineer Lansdale, PA