Big Data Engineer
Samprasoft
Trading Analytics And Strategy Engineer
Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.
The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.
As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications
- Proficiency in Python programming
- Strong expertise in SQL, Presto, HIVE, and Spark
- Knowledge of trading and investment data
- Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
- Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
- Strong experience in building and orchestrating data pipelines
- Experience in building APIs Write, maintain, and execute automated unit tests using Python
- Follow Test-Driven Development (TDD) practices in all stages of software development
- Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
- Proficiency in developing serverless architectures using AWS services
- Experience with both relational and NoSQL databases
- Skills in designing and implementing data models, including normalization, denormalization, and schema design
- Knowledge of data warehousing solutions like Amazon Redshift
- Strong analytical skills with the ability to troubleshoot data issues
- Good understanding of source control, unit testing, test-driven development, and CI/CD
- Ability to write clean, maintainable code and comprehend code written by others
- Strong communication skills
- Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data filesQualificationsExpert in SQLAWS S3 and Glue experienceAdvanced... ...principlesRequired Skills : Data WarehouseBasic Qualification :Additional Skills : Big DataBackground Check : NoDrug Screen : No...Big data
Kaav Inc.
Malvern, PA4 days ago - Job TitleRequired Skills: Python, Spark, AWS services, Glue, IACResponsibilitiesWork with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality dataBig data
Syntricate Technologies
Malvern, PA4 days ago - ...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems, and... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and...Big data
RIT Solutions
Malvern, PA4 days ago $49.46 - $54.46 per hour
...Data EngineerResponsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services. Location: Malvern, Pennsylvania. Job type: Contract...Big dataHourly payContract workRandstad
Malvern, PA4 days ago- ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...Big data
RIT Solutions
Malvern, PA2 days ago - ...We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and data ingestion processes using modern Big Data technologies. The ideal candidate will have strong experience in data aggregation, transformation, validation, quality management...Big data
Techvilla Solutions
Paoli, PA2 days ago - Core ResponsibilitiesProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality... ...processing, automation and transformation.Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka for real-...Big dataFull timeWork experience placement
- ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...Big dataPermanent employmentFull timeH1b
- ...ONLY QUALITY PROFILES MATCHING TO THE JOB DESCRIPTION Role: Data Engineer Skills: Digital : BigData and Hadoop Ecosystem - MapR~Digital... ...Experience Required: 6- 8 Years Role Descriptions: Big Data| Spark| AWS| Databricks| Docker| Kubernetes and other Data...Big data
Q1 Technologies
West Chester, PA4 days ago $49.46 per hour
job summary: Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services location: Malvern, Pennsylvania job type...Big dataHourly payContract workTemporary workWork experience placement- ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...Big dataFull time
- Find a JobJoin IDR Internal TeamStaffing ServicesConsultantsAbout UsBlog
- ...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days... ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is... ...programming languages such as Python and SQL, and big data technologies like Databricks....Big dataWork at office
CubeSmart Self Storage
Malvern, PA4 days ago - ...Data EngineerData Architecture & Pipeline DevelopmentDesign, construct, and maintain robust data pipelines using Azure Data Factory... ...operationalize ML models using Azure Machine Learning. Support feature engineering, model versioning, and deployment pipelines. Utilize Azure ML...
MHK TECH INC
Malvern, PA4 days ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA4 days ago - Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.Local area
Syntricate Technologies
Malvern, PA4 days ago - ...Senior Data Engineer Assessment required hybrid - Malvern, PA Technical Stack & Requirements: • Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. • Infrastructure: CloudFormation...
RIT Solutions, Inc.
Malvern, PA3 days ago - ...Senior Data Engineer (Hybrid)Location: Wilmington, DE / Berwyn, PADuration: 18 Months, quarterly incrementsJob Description:Senior Data Engineer to support a large-scale enterprise data modernization initiative focused on migrating critical banking and enterprise data assets...
Serigor Inc
Berwyn, PA2 days ago - ...Data EngineerWe are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal candidate will be a hands...
InterSources
Malvern, PA4 days ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA23 hours ago - ...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Software Technology Inc
Malvern, PA4 days ago - ...Job TitleWe are looking for strong AWS Data Engineers who are passionate about Cloud technology.ResponsibilitiesDesign and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.Implement...
Syntricate Technologies
Malvern, PA4 days ago - ...Data EngineerClient: Vanguard Location: Malvern, PA or Charlotte, NC or Phoenix, AZ (3 days onsite) - need to be onsite day one Duration: 1 year Video Interview is okayResponsibilitiesData Engineers will be data mining, writing code, and creating tables/environments in...
RIT Solutions
Malvern, PA4 days ago - ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA2 days ago - ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA4 days ago - ...Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS...
Purple Drive
Malvern, PA2 days ago - Data Engineer Assessment required Hybird Malvern, pa Responsibilities Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications Python, SQL, AWS Services
Akaasa Technologies
Malvern, PA2 days ago - ...Opening ! Hybrid onsite ROPES TEST / BROWN- I will send. Description- Design, develop, and maintain high-volume data transformation logic primarily using AWS Glue jobs written in Python . Develop custom code and potentially AWS Lambda...Relocation
VSG Business Solutions LLC
Malvern, PA1 day ago - ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across...Full timeFor contractorsWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- aws data engineer Malvern, PA
- data science developer Malvern, PA
- data engineer machine learning Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- senior data center engineer Malvern, PA
- finance data engineer Malvern, PA
- etl data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA