Sr. Data Engineer
Akaasa Technologies
Senior Data Engineer-
Assessment required
Hybrid Malvern, PA
Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions. Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability. Qualifications: Bachelor's degree in Computer Science or related field. Strong hands-on experience with Apache Spark and Glue. Proven ability to work with Python-based data pipelines. Experience with Git and GitHub Actions is mandatory. Required Qualifications Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline. 5-7+ years of enterprise Data Engineering experience. Strong Python development experience. Advanced SQL programming skills. Extensive experience with Apache Spark and PySpark. Strong experience with Databricks application. Hands-on experience with AWS data services including: o S3 o AWS Glue o Athena o Lambda o Step Functions o EventBridge Experience building enterprise ETL and ELT pipelines. Strong understanding of distributed data processing. Experience working with large-scale cloud data platforms. Strong knowledge of dimensional data modeling. Experience implementing CI/CD pipelines. Familiarity with Agile/Scrum methodologies. Excellent communication and stakeholder management skills. Preferred Qualifications Financial Services or Asset Management industry experience. Knowledge of Apache Iceberg, Delta Lake, or Hudi. Experience with Airflow. Knowledge of Kafka or Kinesis streaming. Experience supporting AI/ML and advanced analytics platforms. AWS Professional or Specialty Certifications.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer in Malvern, PA vacancy
- Responsibilities Data Engineering & Pipeline Development: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and automation initiatives. Ensure data quality, integrity, and performance across systems. Requirements Gathering and Technical...SeniorWork at office
- ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data lake using Oracle database technologies. Candidate should be expert in improving extraction time and DB performance tuning...Senior
ClifyX
Conshohocken, PA4 days ago - ...Data Engineer We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Python, AWS Glue, ETL processes, and Attunity. This role is crucial for driving data initiatives...SeniorWork experience placementWork at officeFlexible hours
Artech
Malvern, PA10 hours ago - ...office for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design,... ...engineering strategy with enterprise business objectives.The Sr. Manager plays a key leadership role in maturing engineering...SeniorFull timeWork at officeRemote workWorldwide
- ...Job Description Job Description THE OPPORTUNITY AKUVO is seeking a hands-on Senior Data & Machine Learning Engineer to build and own the production lifecycle of our proprietary predictive models and scores. This is a depth role: you are an exceptional model builder...SeniorLocal areaRemote work
AKUVO LLC
Malvern, PA27 days ago $190k
...Senior Lead Data & AI Engineer Malvern, PA, USA Up to $190,000/ year Machine Learning Engineer Artificial Intelligence Engineer Platform Engineer Data Engineer Vanguard is seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect...SeniorHackajob
Malvern, PA20 hours ago- Vanguard is seeking a data engineering professional to design and maintain scalable data pipelines and ETL processes. You will partner with stakeholders to translate needs into technical specs, build data models, and implement integrations across systems. You will develop...Senior
- ...Job Description Job Description THE OPPORTUNITY AKUVO is seeking a Principal Data & Machine Learning Engineer to serve as the senior-most technical owner across AKUVO’s data platform, machine-learning models, and the services behind AKUVO IQ. This is a breadth...Local areaRemote work
AKUVO LLC
Malvern, PA27 days ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA10 hours ago $60 - $67 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in Malvern, PA. The ideal candidate is responsible for designing, building, and optimizing scalable data platforms, real-time streaming pipelines, and cloud-native data solutions . Rate Range: $6...Hourly payContract workTemporary workLocal areaAkkodis
Malvern, PA20 hours ago- ...Responsibilities ~ Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced Data Modeling principles Required...
Procyon TS
Malvern, PA3 days ago - ...Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS...
Purple Drive
Malvern, PA4 days ago - ...Data Engineer Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark, SQL, and cloud-native services. Build, optimize, and support ETL/ELT processes, ensuring high-quality, reliable, and performant...
Randstad
Malvern, PA3 days ago - ...Data Engineer Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates...
Kaav Inc.
Malvern, PA3 days ago - ...Job Title We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Responsibilities Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting...
Syntricate Technologies
Malvern, PA2 days ago - ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of...
Samprasoft
Malvern, PA10 hours ago - Build Data Products That MatterDesign and build scalable data platforms, pipelines, and services that power analytics, business decisions... ..., scalability, reliability, observability, and security.Engineer Smarter with AILeverage AI-assisted development tools to accelerate...Full timeTemporary work
- ...Data Engineers 4 new openings assessmen required hybrid in NC or PA Skills are Kafka, AWS services, Python JD Seeking 4 Data Engineers/Developers to join a high-intensity, fast-paced environment supporting the onboarding and integration...
Akaasa Technologies
Malvern, PA2 days ago $39.38 - $44.38 per hour
...Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark... ...business requirements. Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues...Hourly payTemporary workWork experience placementMalvern, PA25 days ago- ...Senior Databricks Data Engineer Location: Chicago-IL - Hybrid 3 days at On-site Duration: 6 months Role Descriptions: Key Responsibilities Pipeline Development Design, implement, and optimize scalable ETL/ELT pipelines using Databricks (PySpark, SQL, Delta...Flexible hours
Donato Technologies, Inc
Malvern, PA2 days ago $132.9k - $182.7k
...evolve, grow, and succeed - today and into tomorrow. As an Electrical Engineer in our Advanced Manufacturing group, you’ll contribute to projects that enable the heart of our clients’ successful data center facilities engineering, design and construction. In this role,...SeniorFull timeFor contractorsWork at officeRemote workFlexible hours- ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- CACI International Inc. in King of Prussia, PA seeks a Senior Data Engineer to support AI/ML algorithm development across NLP, time-series analytics, and LLM-based projects. You’ll join a multidisciplinary team of researchers and developers to design ETL pipelines and scalable...Senior
- ...Software Development Life Cycle (SDLC) methodologies, including Agile and Waterfall. The individual will also contribute to modern data initiatives, including AI-enabled solutions and iPaaS-based integrations, while adhering to SDLC and database development best practices...Senior
Worldwide Insurance Services
King of Prussia, PA7 days ago - ...than 100 miles from the office for the remote option.)Job SummarySeeking a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive data visibility, automation, and decision-making. This role will...SeniorFull timeWork at officeRemote workWorldwide
- Role: Senior Data Engineer (Agentic Retrieval & Memory) Mode of Hire: Full time RESPONSIBILITIES Design and build the agent memory interface across the tiers an agent actually needs: working or session state within a run, short-term conversation history, and long-term...SeniorFull timeTemporary work
- ...LC-MS platform. Assess, evaluate and implement new technologies or instruments in the GLP labs to improve the analysis efficiency or data quality.Set-up, utilize, and maintain complex instrumentation Follow safety precautionsEducation and Requirements:Prior working...SeniorTemporary workWork experience placement
- ...least 4 years of experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed...Permanent employmentFull timeH1b
- A leading insurance company is seeking a Data Operations & Database Engineer to design and monitor ETL/ELT pipelines, manage databases, and partner with other data professionals. Ideal candidates will have over 7 years of experience in data engineering, with strong SQL...Senior
- ...will deliver over 1 billion gallons of propane from 1,800+ distribution points across the United States.Position SummaryThe Lead Data Engineer is a hands-on technical leader responsible for leading data engineering initiatives, managing a team of 1-3 direct reports, and...For contractors
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer. Be the first to apply!
Related searches
- data science developer Malvern, PA
- data developer Malvern, PA
- senior data center engineer Malvern, PA
- etl data engineer Malvern, PA
- data engineer Malvern, PA
- finance data engineer Malvern, PA
- data engineer analytics Malvern, PA
- data center engineer Malvern, PA
- aws data engineer Malvern, PA
- data engineer machine learning Malvern, PA