Big Data Engineer
Samprasoft
Trading Analytics And Strategy Engineer
Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.
The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.
As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications
- Proficiency in Python programming
- Strong expertise in SQL, Presto, HIVE, and Spark
- Knowledge of trading and investment data
- Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
- Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
- Strong experience in building and orchestrating data pipelines
- Experience in building APIs Write, maintain, and execute automated unit tests using Python
- Follow Test-Driven Development (TDD) practices in all stages of software development
- Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
- Proficiency in developing serverless architectures using AWS services
- Experience with both relational and NoSQL databases
- Skills in designing and implementing data models, including normalization, denormalization, and schema design
- Knowledge of data warehousing solutions like Amazon Redshift
- Strong analytical skills with the ability to troubleshoot data issues
- Good understanding of source control, unit testing, test-driven development, and CI/CD
- Ability to write clean, maintainable code and comprehend code written by others
- Strong communication skills
- Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience Advanced... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : No Procyon TSBig data
- ...Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark... ...business requirements. Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues...Big data
Zuven technologies Inc
Malvern, PA2 days ago - ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...Big data
RIT Solutions
Malvern, PA4 days ago - Big Data Engineer Hybrid - Malvern, P Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data consistency and integrity...Big data
- ...Hi , This is Praveen from Pronixinc Role: AWS Big Data Engineer with Databricks (Mid, Sr and SME level role)- W2 Only Location: Malvern, PA (Hybrid 3 days in office and 2 days remote) Duration: long term Contract 1+ year (likely to be extended multiple years...Big dataLong term contractWork at officeRemote work
Pronix - US
Malvern, PA2 days ago - ...Advanced Data Solutions Specialist Provides advanced data solutions by using software to process, store, and serve data to others.... ...processing, automation and transformation. Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka for real-...Big dataWork experience placement
Hackajob
Malvern, PA1 day ago - Role : Data Engineer with Python Location: Malvern, PA (Onsite) Contract Job Summary We are seeking a Data Engineer with strong Python expertise... ...(PostgreSQL, MySQL, SQL Server, etc.). Experience with big data tools such as Apache Spark, Hadoop, or Kafka. Knowledge of...Big dataContract work
- ...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...Big dataPermanent employmentFull time
- ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Big dataPermanent employmentFull timeH1b
- ...experience in software design, development and release. Well versed with agile development methodologies. Experience in Data Ingestion, Streaming and Big Data technologies. Excellent communication and stakeholder management Ability to work with distributed teams. Exposure...Big dataPermanent employmentFull timeH1b
- Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data... ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data ClifyXBig data
- Role Summary We are seeking a highly skilled Senior Data Engineer (or Lead Data Engineer ) to design, build, and optimize scalable data pipelines... ...environments. The ideal candidate will bring deep expertise in Big Data technologies , Azure cloud platforms , and data...Big data
- ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA2 days ago - ...Data engineer 5-8 years of exp hybird - malvern, pa or plano, tx, or charlotte, nc assessment required Description Details Client is seeking a data engineer for the Data & Analytics engineering team, driving innovation in scalable, personalized...
RIT Solutions, Inc.
Malvern, PA4 days ago - NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop...
- Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and code....
- Data Lake 2.0 Developer Data Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away from... ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data...
- ...Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
- Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking...
- Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...
- Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability...
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...
- ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around 1...Contract workImmediate startRemote work
- ...Position : AWS Data Engineering Technical Lead Location: Malvern PA (onsite day 1 for hybrid model) Length: 1+ year (likely to be extended multiple years) Video interview is okay JOB DETAILS - Tech lead experience - Working with Unstructured...
Pronix - US
Malvern, PA2 days ago - ...Data Engineer - Assessment required Hybird Malvern, pa Job Description Duties: Build out an extensive transaction stitching application to helps track the journey of money flowing through a client's account over the lifetime of the funds. Skills...
Akaasa Technologies
Malvern, PA2 days ago $190k
Senior Lead Data & AI Engineer Malvern, PA, USA Up to $190,000/ year Machine Learning Engineer Artificial Intelligence Engineer Platform Engineer Data Engineer Vanguard is seeking an expert Lead Data & AI Engineer with 9 to 12+ years of experience to architect and deploy...- ...Malvern, PA Must Have Technical/Functional Skills: AWS Data Services – S3, Redshift, Glue, Lambda, Athena. Data Modeling –... ...Architecture – Amazon S3, Lake Formation, Data Lake best practices. Big Data & Processing – Spark/PySpark, Amazon EMR. ETL/ELT...Big data
United IT
Malvern, PA4 days ago - We are looking for a Snowflake Data Engineer to build modern data solutions that support analytics, AI, and enterprise decision-making. This role will focus on creating reliable pipelines, scalable data models, and secure data products within a Snowflake environment. The...
Robert Half
Villanova, PA3 days ago - ...manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy. As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern...Big data
- ...teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable... ...security, and operational excellence. The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed...For contractorsWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Malvern, PA
- data developer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- finance data engineer Malvern, PA
- data science developer Malvern, PA
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- etl data engineer Malvern, PA
- data center engineer Malvern, PA