Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Samprasoft

Trading Analytics And Strategy Engineer

Client’s Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.

The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.

As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.

Qualifications
  • Proficiency in Python programming
  • Strong expertise in SQL, Presto, HIVE, and Spark
  • Knowledge of trading and investment data
  • Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
  • Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
  • Strong experience in building and orchestrating data pipelines
  • Experience in building APIs Write, maintain, and execute automated unit tests using Python
  • Follow Test-Driven Development (TDD) practices in all stages of software development
  • Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
  • Proficiency in developing serverless architectures using AWS services
  • Experience with both relational and NoSQL databases
  • Skills in designing and implementing data models, including normalization, denormalization, and schema design
  • Knowledge of data warehousing solutions like Amazon Redshift
  • Strong analytical skills with the ability to troubleshoot data issues
  • Good understanding of source control, unit testing, test-driven development, and CI/CD
  • Ability to write clean, maintainable code and comprehend code written by others
  • Strong communication skills
  • Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
  •  ...Big Data Engineer Sonsoft, Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled... 
    Big data
    Permanent employment
    Full time
    H1b

    SonSoft

    King of Prussia, PA
    19 hours ago
  • $48.46 per hour

    job summary: Responsibilities Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications Python, SQL, AWS Services   location: Malvern, Pennsylvania job type: Solutions salary: $48.46 - 54.... 
    Big data
    Hourly pay
    Temporary work
    Work experience placement
    Malvern, PA
    13 days ago
  •  ...December 31, 2025. The Opportunity We are seeking a talented ETL Data Engineer with strong experience in Python and Azure Synapse Analytics to...  ...a team environment with shifting priorities. Familiarity with big data technologies, machine learning, and data analysis... 
    Big data
    Work experience placement
    Shift work

    Hamilton Lane

    Conshohocken, PA
    1 day ago
  •  ...predictive, and prescriptive analytics to support data-driven business decision making. Role...  ...on defined problems such as feature engineering, model fitting, calibration, and...  ...workflows and version control.  ~ Exposure to big-data frameworks (Spark, etc.).... 
    Big data

    Vanguard

    Malvern, PA
    21 days ago
  •  ...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days...  ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is...  ...programming languages such as Python and SQL, and big data technologies like Databricks.... 
    Big data
    Work at office

    CubeSmart Self Storage

    Malvern, PA
    3 days ago
  •  ...exceptional professionals for this role. Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions. We... 

    Vanguard

    Malvern, PA
    9 days ago
  •  ...Data Engineer Please note that Bentley Systems will not sponsor applicants for employment authorization for this position. Candidates must be authorized to work in the United States without sponsorship now or in the future. Location: Anywhere in the United States (Office... 
    Work at office
    Remote work
    Worldwide

    Bentley Systems

    Exton, PA
    4 days ago
  •  ...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots... 

    RIT Solutions, Inc.

    Malvern, PA
    13 hours ago
  •  ...Title: Data Engineering Director Location: Kings of Prussia, PA (Hybrid role) Type: Fulltime Salary – (Best possible) Requirements...  ...related discipline. Preferred Skills: Experience with big data technologies such as Hadoop, Spark, or Kafka.... 
    Big data
    Full time

    TWO95 International, Inc

    King of Prussia, PA
    more than 2 months ago
  •  ...Advice & Wealth Management Technology (AWMT) is seeking a Data Engineering Manager to lead a team delivering scalable data platforms and products that power personalized financial advice. Responsibilities Lead a team of data engineers to build and operate scalable, reliable... 
    Visa sponsorship

    The Vanguard Group

    Exton, PA
    3 days ago
  •  ...Vanguard’s trusted brand to life through data-driven, personalized marketing. To elevate...  ...algorithms and modeling using big data cloud platforms · Understanding of...  ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teams The ideal candidate... 
    Big data
    Work experience placement

    Vanguard

    Malvern, PA
    20 days ago
  •  ...connect them with exceptional professionals for this role. The Lead Data Analyst is responsible for driving data-driven decision-making...  ...platforms such as AWS, GCP, or Azure, including data lakes and big data processing tools.  ~ Ability to translate complex data insights... 
    Big data
    Work experience placement

    Vanguard

    Malvern, PA
    7 days ago
  •  ...connect them with exceptional professionals for this role. Senior Data Scientist — Investment Management Fintech Strategies (IMFS)...  ...in real-world market environments. Raise the bar on engineering quality by mentoring quant strategists and data scientists on... 

    Vanguard

    Malvern, PA
    14 days ago
  • $55.7k - $100.2k

     ...Specialist, Actuarial Data Engineer The Role at a Glance As a Specialist, Actuarial Data Engineer, you will lead the design and implementation of new technology solutions of the Actuarial Architecture & Transformation team. You will develop data & analytics solutions... 
    Work experience placement

    Lincoln Financial Services

    Radnor, PA
    13 hours ago
  • $115k

     ...platform and a thoughtful team, we deliver the most trusted solution in the market. As an Analytics Engineer II , you will be a driving force in bridging the gap between raw data and actionable business insights. You will take ownership of the end-to-end data lifecycle,... 
    Flexible hours

    Clerri

    Wayne, PA
    3 days ago
  • $100k - $125k

    Role Overview The DBT SME serves as the senior engineer for data transformation within a modern data stack built on dbt and Snowflake. This role is responsible for implementing dbt transformation models, enforcing modeling best practices, and ensuring that dbt and traditional... 
    Temporary work
    Flexible hours

    NTT DATA

    King of Prussia, PA
    4 hours ago
  •  ...Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS Glue, PySpark... 

    Purple Drive

    Malvern, PA
    8 days ago
  • $51.78 per hour

    job summary: Role Overview: We are seeking a mid-level Data Engineer (3-5 years of experience) to join our Brokerage and Investment team. You will act as a senior engineer, engaging directly with business analysts and stakeholders to translate complex requirements... 
    Hourly pay
    Temporary work
    Work experience placement
    Malvern, PA
    5 days ago
  • Job Description: Job title: WFH-TEMP - .NET FULL STACK DEVELOPER Job summary: Cognizant Technology Solutions is seeking a Full Stack Dot Net Developer to join our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking...
    Permanent employment
    Temporary work
    Work from home
    Shift work

    TechDigital Group

    Collegeville, PA
    3 days ago
  • When you work for AmeriGas, you become a part of something BIG! Founded in 1959, AmeriGas is the nation’s premier propane company,...  ...distribution points across the United States. Position Summary The Lead Data Engineer is a hands‑on technical leader responsible for leading data... 
    For contractors

    UGI

    King of Prussia, PA
    4 hours ago
  •  ...award-winning technology team that turns big ideas into cutting-edge products, platforms...  ...technology stack Develop and manage data pipelines to extract, transform, and integrate...  ...~ Bachelor's degree in Computer Science, Engineering, Data Science, or related field (or... 
    Full time
    Work experience placement
    Worldwide

    Comcast

    West Chester, PA
    1 hour ago
  • $131k - $155k

     ...various unanticipated locations in the US: Job Title-Data Scientist Write well documented code that can be shared...  ...in job offered, Data Analyst, Software Consultant, IT Engineer, or related occupation. Requires travel/relocation to various... 
    Relocation

    Surya Systems

    Exton, PA
    19 hours ago
  •  ...tools (or) SQL Server tools/services like SSRS/SSAS/TSQL/MDX · Support ETL/Reports Validation, test automation and test data generation · Support Big Data Testing, Hadoop, MapR etc.. · SUPERB communication skills (speaking, listening, writing and interpreting) · Comfortable... 
    Big data
    Immediate start

    Artech Information System LLC

    Wayne, PA
    4 days ago
  •  ...research and insights across Investment Management. This role partners closely with quantitative researchers, data scientists, and investment teams to engineer, deploy, and operate production-grade machine learning models that drive research, analytics, and business insights... 
    Work experience placement

    Vanguard

    Malvern, PA
    2 days ago
  •  ...exceptional professionals for this role. As a Principal AI/ML Engineer in the EAiR team, you will be at the forefront of scaling and...  ...pipelines. Establishes best practices and drives innovation in data preparation and consumption. Expert in end-to-end data and model... 
    Work experience placement

    Vanguard

    Malvern, PA
    20 days ago
  •  ...findings and ideas in plain language; Being able to work in teams towards a shared goal; Ability to change direction quickly based on data analysis; Discovering and solving problems; Proactively seeking clarification of requirements and direction; take responsibility... 
    Big data

    Spruce Infotech

    King of Prussia, PA
    3 days ago
  •  ...tools (or) SQL Server tools/services like SSRS/SSAS/TSQL/MDX · Support ETL/Reports Validation, test automation and test data generation · Support Big Data Testing, Hadoop, MapR etc.. · SUPERB communication skills (speaking, listening, writing and interpreting) · Comfortable... 
    Big data
    Immediate start

    Artech Information System LLC

    Wayne, PA
    3 days ago
  • $102k - $177.1k

     ...respect the diversity and dignity of our employees and recognize their merit. Job Function: Data Analytics & Computational Sciences Job Sub Function: Data Engineering Job Category: People Leader All Job Posting Locations: Mooresville, Indiana, United States of... 
    Full time
    Local area
    Immediate start
    Remote work

    Johnson & Johnson Innovative Medicine

    West Chester, PA
    6 hours ago
  •  ...growing Inc 500 Companies in the US, providing enhanced IT consulting, and engineering solution services from past 16 years. Saxon global specializes in Business Intelligence, Mobility, Big Data & Cloud and provides IT tools and services to help organizations across industry... 
    Big data
    Contract work

    Saxon Global

    Wayne, PA
    3 days ago
  • $140k

     ...Principal Data Platform Engineer Location: King of Prussia, PA Position Type: Full Time Compensation: $140,000 Per Year Summary This position is for a senior individual contributor who will define and manage the technical vision and architecture of an enterprise... 
    Full time

    Mitchell Martin

    King of Prussia, PA
    19 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!