Big Data Engineer

Procyon TS

Malvern, PA

Responsibilities

Ability to run and deploy jobs, view creation and deployment, testing, analyzing, and cleansing large data files

Qualifications

Expert in SQL
AWS S3 and Glue experience
Advanced Data Modeling principles

Required Skills : Data Warehouse

Basic Qualification :

Additional Skills : Big Data

Background Check : No

Drug Screen : No

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy

Big Data Engineer
Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
Big data
Syntricate Technologies
Malvern, PA
14 hours ago
Big Data Engineer
...Big Data EngineerLocation: Malvern, PADuration: 12+ monthsInterview Process: Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkHands-on experience working with Trading/Investment dataStrong experience in building and orchestrating...
Big data
Veracity
Malvern, PA
7 hours ago
Big Data Engineer
$49.46 - $54.46 per hour
...Data Engineer Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services. Location: Malvern, Pennsylvania. Job type: Contract...
Big data
Hourly pay
Contract work
Randstad
Malvern, PA
2 days ago
Big Data Engineer
...Big Data Engineer Hybrid - Malvern, PA Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency...
Big data
RIT Solutions
Malvern, PA
3 days ago
Big Data Engineer
...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Big data
Samprasoft
Malvern, PA
8 hours ago
Big data engineer
$49.46 - $54.46 per hour
job summary: Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services location: Malvern, Pennsylvania job type...
Big data
Hourly pay
Contract work
Temporary work
Work experience placement
Randstad
Malvern, PA
14 hours ago
Big Data Engineer
...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team... ...passive as well as active mandates, to conduct data-driven analyses and build tools to help... ...and investment data Experience in big data technologies such as Spark and developing...
Big data
Samprasoft
Malvern, PA
4 days ago
Senior Data Engineer
...We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and data ingestion processes using modern Big Data technologies. The ideal candidate will have strong experience in data aggregation, transformation, validation, quality management...
Big data
Techvilla Solutions
Paoli, PA
3 days ago
Data Engineer, Specialist
Core ResponsibilitiesProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality... ...processing, automation and transformation.Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka for real-...
Big data
Full time
Work experience placement
Vanguard
Malvern, PA
5 days ago
Big Data Engineer
...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...
Big data
Permanent employment
Full time
H1b
Sonsoft
King of Prussia, PA
4 days ago
Big Data Engineer - Ingestion & Streaming (Kafka, Spark)
...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...
Big data
Permanent employment
Full time
Sonsoft Inc
King of Prussia, PA
1 day ago
Data Scientist, Specialist
...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...
Big data
Full time
Vanguard
Malvern, PA
4 days ago
Data Engineer
Find a JobJoin IDR Internal TeamStaffing ServicesConsultantsAbout UsBlog
IDR Internal Data Resources
Malvern, PA
2 days ago
Senior Data Scientist
...Senior Data ScientistThis is a hybrid role based in the Malvern, PA office. (3 days in... ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is reliable... ...languages such as Python and SQL, and big data technologies like Databricks.Strong...
Big data
Work at office
CubeSmart Self Storage
Malvern, PA
8 hours ago
Data Engineer
...Data EngineerData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using Azure Data Factory... ...operationalize ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML...
MHK TECH INC
Malvern, PA
14 hours ago
Data Engineer
...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA
14 hours ago
Data Engineer
Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.
Local area
Syntricate Technologies
Malvern, PA
14 hours ago
Sr Data Engineer
...Data EngineerPython, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure: CloudFormation... ...data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production...
Saxon Global
Malvern, PA
14 hours ago
Senior Data Engineer (Hybrid)
...Senior Data Engineer (Hybrid)Location: Wilmington, DE / Berwyn, PADuration: 18 Months, quarterly incrementsJob Description:Senior Data Engineer to support a large-scale enterprise data modernization initiative focused on migrating critical banking and enterprise data assets...
Serigor Inc
Berwyn, PA
3 days ago
ETL Data Engineer
...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA
14 hours ago
Data Engineer
...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in...
RIT Solutions
Malvern, PA
14 hours ago
AWS Data Engineer
...Role Description: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics...
Syntricate Technologies
Malvern, PA
1 day ago
Senior Data Engineer
...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA
14 hours ago
AWS Data Engineer
...Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS...
Purple Drive
Malvern, PA
3 days ago
Data Engineer
Data Engineer Assessment required Hybird Malvern, pa Responsibilities Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications Python, SQL, AWS Services
Akaasa Technologies
Malvern, PA
3 days ago
Data Engineers
...Opening ! Hybrid onsite ROPES TEST / BROWN- I will send. Description- Design, develop, and maintain high-volume data transformation logic primarily using AWS Glue jobs written in Python . Develop custom code and potentially AWS Lambda...
Relocation
VSG Business Solutions LLC
Malvern, PA
2 days ago
Head of Data Engineering & Analytics
...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...
Full time
Vishay
Malvern, PA
6 days ago
Senior Manager, AI and Data Engineering
The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across...
Full time
For contractors
Work at office
Vanguard
Malvern, PA
4 days ago
Databricks Architect
...Malvern, PA Must Have Technical/Functional Skills: AWS Data Services – S3, Redshift, Glue, Lambda, Athena. Data Modeling –... ...Architecture – Amazon S3, Lake Formation, Data Lake best practices. Big Data & Processing – Spark/PySpark, Amazon EMR. ETL/ELT...
Big data
United IT
Malvern, PA
3 days ago
Databricks Architect
$70 - $73 per hour
...Salary Range: $70- $73 an hour on W2/C2C Job Description: Data Architect with strong expertise in designing and implementing... ...Warehousing - Amazon Redshift and enterprise data warehouse design. Big Data Processing - Apache Spark, PySpark, Amazon EMR. ETL/ELT...
Big data
Artech
Malvern, PA
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!