Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Veracity

Big Data Engineer - Malvern, PA

Duration - 12+ months

Interview Process - Video interview

Must Have -

Expert in Python

Strong expertise in SQL, Presto, HIVE, and Spark

Must have hands-on experience working with Trading/Investment data

Strong experience in building and orchestrating data pipelines

Proficiency in developing serverless architectures using AWS services

Experience with both relational and NoSQL databases

Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
  • Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality data
    Big data

    Syntricate Technologies

    Malvern, PA
    2 hours ago
  •  ...Big Data EngineerLocation: Malvern, PADuration: 12+ monthsInterview Process: Video interviewMust Have:Expert in PythonStrong expertise in SQL, Presto, HIVE, and SparkHands-on experience working with Trading/Investment dataStrong experience in building and orchestrating... 
    Big data

    Veracity

    Malvern, PA
    1 day ago
  •  ...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real...  ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops... 
    Big data

    Samprasoft

    Malvern, PA
    1 day ago
  •  ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team...  ...passive as well as active mandates, to conduct data-driven analyses and build tools to help...  ...and investment data Experience in big data technologies such as Spark and developing... 
    Big data

    Samprasoft

    Malvern, PA
    5 days ago
  •  ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS... 
    Big data

    RIT Solutions

    Malvern, PA
    4 days ago
  •  ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to... 
    Big data
    Permanent employment
    Full time
    H1b

    Sonsoft

    King of Prussia, PA
    5 days ago
  •  ...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile... 
    Big data
    Permanent employment
    Full time

    SonSoft

    King of Prussia, PA
    2 days ago
  • DescriptionWe are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In...  ...across teams and manage changing priorities.• Familiarity with big data or analytics technologies such as Apache Spark, Hadoop,... 
    Big data

    Robert Half

    Conshohocken, PA
    3 days ago
  •  ...ONLY QUALITY PROFILES MATCHING TO THE JOB DESCRIPTION Role: Data Engineer Skills: Digital : BigData and Hadoop Ecosystem - MapR~Digital...  ...Experience Required: 6- 8 Years Role Descriptions: Big Data| Spark| AWS| Databricks| Docker| Kubernetes and other Data... 
    Big data

    Q1 Technologies

    West Chester, PA
    16 hours ago
  • $49.46 per hour

    job summary: Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services   location: Malvern, Pennsylvania job type... 
    Big data
    Hourly pay
    Contract work
    Temporary work
    Work experience placement
    Malvern, PA
    7 days ago
  •  ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,...  ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization... 
    Big data
    Full time

    Vanguard

    Malvern, PA
    5 days ago
  •  ...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days...  ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is...  ...programming languages such as Python and SQL, and big data technologies like Databricks.... 
    Big data
    Work at office

    CubeSmart Self Storage

    Malvern, PA
    16 hours ago
  •  ...Data EngineerPython, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure: CloudFormation...  ...data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production... 

    Saxon Global

    Malvern, PA
    3 hours ago
  •  ...Job Title: Data Engineer Duration- Fulltime Permanent Location: Malvern, PA, 19355 / Charlotte, NC, 28262 (Hybrid /requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday) (Local Only) Job Description: Data Engineer Python, Glue ETL, Attunity... 
    Permanent employment
    Full time
    Local area

    Q1 Technologies

    Malvern, PA
    16 hours ago
  •  ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal... 

    InterSources

    Malvern, PA
    3 days ago
  •  ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing.... 

    Trinity Technology Solutions

    Malvern, PA
    14 hours ago
  •  ...Data Engineer Address:301 Lindenwood Dr Ste 330, Malvern, Pennsylvania Remote: 3 days onsite Hours: 8-5 Position Type: FULL-TIME KEY RESPONSIBILITIES Data Architecture & Pipeline Development Design, construct, and maintain robust data... 
    Full time
    Remote work

    MHK TECH INC

    Malvern, PA
    14 hours ago
  •  ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources... 

    RIT Solutions

    Malvern, PA
    4 days ago
  •  ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading... 

    Kaav Inc.

    Malvern, PA
    3 hours ago
  •  ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr.... 
    Contract work
    Local area
    Immediate start

    Syntricate Technologies

    Malvern, PA
    1 day ago
  •  ...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement... 

    Syntricate Technologies

    Malvern, PA
    2 hours ago
  •  ...Job Title: Data Engineer Location: Malvern, PA Duration:6 Months Experience Required: 10 & Above Job Description: Technical skill sets : Python, Pyspark, AWS Lambda, S3,AWS glue, Kinesis,SQL, Apache Flink, Confluent Kafka, AI-LLM, Gen-AI , Java is optional... 

    I-Flow

    Malvern, PA
    14 hours ago
  •  ...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in... 

    RIT Solutions

    Malvern, PA
    3 hours ago
  •  ...Data Engineer Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates data from a variety of... 

    Samprasoft

    Malvern, PA
    5 days ago
  • Build Data Products That MatterDesign and build scalable data platforms, pipelines, and services that power analytics, business decisions...  ..., scalability, reliability, observability, and security.Engineer Smarter with AILeverage AI-assisted development tools to accelerate... 
    Full time
    Temporary work

    Vanguard

    Malvern, PA
    3 days ago
  •  ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture... 
    Full time

    Vishay

    Malvern, PA
    2 days ago
  • $82.1k - $172.4k

    Job Title: Data EngineerJob Category: ScienceTime Type: Full timeMinimum Clearance Required to Start: TS/SCI with PolygraphEmployee Type...  ...End: 12/31/2026 The Opportunity: We are looking for a Data Engineer/Scientist looking for new challenging problems. You will support... 
    Full time
    Contract work
    Work experience placement
    Flexible hours

    CACI International

    King of Prussia, PA
    3 days ago
  •  ...worldwide. Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that...  ...the office for the remote option.)Job SummaryWe are seeking a Data Engineer to join our Data Product Engineering team responsible for... 
    Full time
    Work at office
    Remote work
    Worldwide

    Comcast

    West Chester, PA
    5 days ago
  •  ...We are seeking a Lead Marketing Strategy Data Analyst to join the team. This role will...  ...optimization algorithms and modeling using big data cloud platforms· Understanding of A/...  ..., Sales, MarTech, Data Science, Data Engineering and other Analytics teamsThe ideal candidate... 
    Big data
    Full time
    Work experience placement

    Vanguard

    Malvern, PA
    4 days ago
  •  ...Long term contract Role Descriptions: We are looking for an AWS Developer Lead with experience in data engineering. Candidates should possess knowledge and interest in big data technologies and have a background in data engineering. Designing and maintaining AWS data... 
    Big data
    Long term contract

    AceStack LLC

    Malvern, PA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!