Senior Data Engineer
Diverse Lynx
Job Description
Job Description
ROLE_DESCRIPTION -
Payrate 60/hr
We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale data processing systems. The ideal candidate will play a critical role in building and maintaining scalable, efficient, and secure ETL pipelines within the AWS ecosystem. Key Responsibilities:
" Design, develop, and maintain robust ETL workflows to extract, transform, and load data from various sources to AWS Redshift and other cloud-based systems.
" Leverage AWS Lambda to build serverless computing solutions for real-time data processing and automation.
" Work with AWS data storage and processing services, including S3, Redshift, Athena, and Glue, to support data processing pipelines.
" Utilize Python and PySpark to create and Eligible to workimize data transformation logic and analytical queries.
" Collaborate with cross-functional teams to understand data requirements and provide efficient data solutions.
" Monitor and Eligible to workimize cloud-based infrastructure for performance, reliability, and cost efficiency.
" Troubleshoot and resolve data pipeline issues, ensuring minimal downtime and high data accuracy.
" Implement automation and monitoring tools to enhance reliability. Required Skills and Qualifications:
" Proven experience working with AWS services, including Lambda, Redshift, S3, Athena, Glue, and CloudWatch.
" Strong knowledge and hands-on experience with Python and PySpark for data transformation and processing.
" Expertise in building and Eligible to workimizing ETL pipelines in a cloud environment.
" In-depth understanding of relational databases, data warehousing, and performance tuning in Redshift.
" Strong problem-solving and troubleshooting skills.
" Familiarity with infrastructure as code tools like AWS CloudFormation.
" Experience with version control (e.g., Git) and CI/CD pipelines.
" Solid understanding of data security, data privacy, and compliance frameworks.
" Ability to work in an agile, fast-paced environment.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Malvern, PA vacancy
- SID Global Solutions is seeking a data analytics professional to work with large-scale datasets and perform data mining, ETL, and visualization tasks. The role emphasizes SQL expertise, data storytelling, and reporting using tools like QuickSight/Tableau/PowerBI. The ideal...Senior
- Vanguard is seeking an experienced Data Engineer to join the B2B AI and Data Engineering team. In this hands-on role, you will design, build, and operate scalable data pipelines and data products that support analytics, AI, and critical business functions. You will provide...SuggestedFull time
Vanguard
Malvern, PA2 days ago - ...Title Responsibilities Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required Skills...Suggested
Kaav Inc.
Malvern, PA14 hours ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize... ...classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy...Suggested
Samprasoft
Malvern, PA1 day ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....Suggested
Trinity Technology Solutions
Malvern, PA3 days ago - ...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots...
RIT Solutions, Inc.
Malvern, PA14 hours ago - The Boeing Company in Ridley Park, PA, is seeking an Experienced Quality Engineer for Core Quality. The role emphasizes data-driven analytics, RCCA, and quality improvements across programs including MH-139. Onsite work is required, with a focus on integrating QMS requirements...Senior
- ...Job Description Our firm has been engaged by a growing, data-centric healthcare technology and services organization that... ...its enterprise data environment and is looking to add a Senior Director of Data Engineering & Architecture to define technical direction, strengthen...SeniorFull timeRemote work
Spinnaker Search
Wayne, PA22 days ago - ...as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and... ...21Best RegardsPramod Galande:)SummaryType: ContractFunction: EngineeringExperience level: Mid-Senior LevelIndustry: PharmaceuticalsContract workWork at officeImmediate startFlexible hours
Artech
Collegeville, PA3 days ago - ...4 years of experience in software design, development and release. Well versed with agile development methodologies. Experience in Data Ingestion, Streaming and Big Data technologies. Excellent communication and stakeholder management Ability to work with distributed...Permanent employmentFull timeH1b
- ...software company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills...Permanent employmentFull time
- ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Permanent employmentFull timeH1b
- As a Data Science Engineer at Qlik, you'll be an integral part of the Global Support team, dedicated to empowering customers to deploy data science solutions using our automated machine learning platform, Qlik AutoML. You'll play a crucial role in educating customers on...Remote job
- ...mission-critical workloads. Establish architectural standards, engineering patterns, and best practices for AI deployment and operations.... ...degradation, model failures, and system outages. Serve as the senior technical escalation point for the team's most challenging...Full time
Vanguard
Malvern, PA1 day ago - ..., PA, US 2 days ago Requisition ID: 1885 Senior Scientist / Principal Scientist - Pharmaceutical... ..., Quality Assurance, Manufacturing, Engineering, and Project Management. Strong... ...independently design experiments, analyze data, troubleshoot technical issues, and document...SeniorFull timeContract workImmediate start
- Senior EngineerLocation – Malvern, PA - HybridDuration – 6+ monthsInterview – VideoNo AssessmentKEY SKILLSAWS, SQL, PYTHON MUST HAVE TRUE HANDS-ON EXPERIENCE WITH AI AGENTS Must have extensive ai exp - preferably ClaudeSenior
RIT Solutions
Malvern, PA3 days ago - ...pharmaceutical quality control operations at a client site. This is a senior-level, hands-on role focused on sterility assurance,... ...results and lead root cause analysis and CAPA implementation. Ensure data integrity and follow Good Documentation Practices (GDP) and ALCOA++...SeniorFull timeMonday to FridayShift workDay shift
- Job Description: Job title: WFH-TEMP - .NET FULL STACK DEVELOPER Job summary: Cognizant Technology Solutions is seeking a Full Stack Dot Net Developer to join our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking...Permanent employmentTemporary workWork from homeShift work
- ...Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
- ...Job Title - Senior Engineer Location - Malvern, PA - Hybrid Duration - 6+ months Interview - Video Job Description - No Assessment KEY SKILLS - AWS, SQL, PYTHON MUST HAVE TRUE HANDS-ON EXPERIENCE WITH AI AGENTS Must have extensive...Senior
RIT Solutions, Inc.
Malvern, PA2 days ago - Bentley Systems, Incorporated is seeking an HR AI Solutions Partner in a hybrid Exton, PA role. You will collaborate with HR teams to translate pain points into practical AI-enabled solutions, from initial conversations to production-ready tooling. The role emphasizes hands...Senior
$92k - $112k
...Job Description **Tax Senior - Wayne, PA** Pay: $92,000 - $112,000 + bonus potential Run your own engagements at a nationally ranked CPA firm. Hiring a Tax Senior on Philadelphia's Main Line, hybrid with 3 days onsite. What you'll do: - Plan...SeniorSummer workgpac
Paoli, PA2 days ago$175k - $225k
Jobot is partnered with a Devon-based law firm to grow its tax practice. Shape complex transactions and advise sophisticated clients within a collaborative team environment. The role offers a salary of $175,000 - $225,000 per year, with competitive compensation and comprehensive...Senior- Frontage Laboratories Inc. is seeking a Senior/Principal Scientist to lead formulation and process development from early development... ...across Analytical Development, QA, Manufacturing, Engineering, and PM. The candidate will develop oral solid dosage forms, including...SeniorImmediate start
- The Boeing Company in Ridley Park, PA is seeking an Experienced Quality Engineer to drive data-driven quality improvements on the MH-139 program. You will apply SQL/Python analytics, create dashboards with Tableau/PowerBI, and lead root-cause analysis to strengthen quality...Day shift
- ...Senior Designer The ideal candidate for this senior designer position possesses exceptional design talent, style, and extensive experience (10 Yrs+) preferably in luxury residential design managing all aspects of high-end residential projects, from concept development...SeniorFor contractors
Business of Home
Berwyn, PA14 hours ago $149.2k - $248.6k
...Collaborate with Care Gaps & Segmentation Team Leader to communicate generated insights Provide mentorship & coaching to Data Scientists & Data Engineering Leverage cross-team collaboration and asset-specific experience to develop and disseminate analytical best‑practices...SeniorWork experience placementRemote workRelocation packageFlexible hours- ...Job Description Job Description Job Title: Senior Workday Integration Engineer Duration- Fulltime Permanent Location: Malvern PA / Charlotte NC (Onsite From Day 1) Job Description: Senior Workday Integration Engineer 7 years of HR technology experience...SeniorPermanent employmentFull time
Q1 Technologies, Inc
Malvern, PA3 days ago - Penn Medicine, University of Pennsylvania Health System, is seeking a Respiratory Therapist III to provide specialized care to patients with respiratory conditions. This full-time role emphasizes teamwork and effective communication within a multidisciplinary healthcare...SeniorFull time
- AXA XL, the P&C and specialty risk division of AXA, is seeking a senior construction underwriter in the United States to tailor high-touch risk solutions for large clients and work with industry experts to deliver customized coverage. You will evaluate risk, manage producer...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- etl data engineer Malvern, PA
- finance data engineer Malvern, PA