Big Data Engineer
Samprasoft
Trading Analytics And Strategy Engineer
Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.
The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.
As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications
- Proficiency in Python programming
- Strong expertise in SQL, Presto, HIVE, and Spark
- Knowledge of trading and investment data
- Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
- Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
- Strong experience in building and orchestrating data pipelines
- Experience in building APIs Write, maintain, and execute automated unit tests using Python
- Follow Test-Driven Development (TDD) practices in all stages of software development
- Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
- Proficiency in developing serverless architectures using AWS services
- Experience with both relational and NoSQL databases
- Skills in designing and implementing data models, including normalization, denormalization, and schema design
- Knowledge of data warehousing solutions like Amazon Redshift
- Strong analytical skills with the ability to troubleshoot data issues
- Good understanding of source control, unit testing, test-driven development, and CI/CD
- Ability to write clean, maintainable code and comprehend code written by others
- Strong communication skills
- Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
$39.38 - $44.38 per hour
...Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark... ...business requirements. Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues...Big dataHourly payTemporary workWork experience placement- ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...Big dataPermanent employmentFull timeH1b
- ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...Big dataFull time
- ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....SuggestedContract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA1 day ago - ...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots...Suggested
RIT Solutions, Inc.
Malvern, PA2 days ago - ...Job Description Job Description THE OPPORTUNITY AKUVO is seeking a hands-on Senior Data & Machine Learning Engineer to build and own the production lifecycle of our proprietary predictive models and scores. This is a depth role: you are an exceptional model builder...Local areaRemote work
- ...Job Description : Data Engineer for a financial client of ours based in Malvern PA.This is a Hybrid role 3days/week from Malvern. We are looking for consultants who can make it for an In-person interview. There is no scope of virtual interviews. At least...
- ...Data Engineer Assessment required Hybrid Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure: CloudFormation/Terraform, CI/CD with...
- ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- ...Job Description Job Description THE OPPORTUNITY AKUVO is seeking a Principal Data & Machine Learning Engineer to serve as the senior-most technical owner across AKUVO’s data platform, machine-learning models, and the services behind AKUVO IQ. This is a breadth...Local areaRemote work
- DescriptionWe are looking for a Data Engineer to drive the design and delivery of scalable data solutions that support critical business objectives within the oil and gas sector. This position is based in King of Prussia, Pennsylvania, and combines technical execution with...
- Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...
- ...advanced analytics, predictive modeling, and data science techniques. The ideal candidate... ...algorithms and modeling using big data cloud platforms· Understanding of A/... ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teamsSpecial FactorsSponsorshipVanguard...Big dataFull timeWork experience placement
- ...advanced analytics, predictive modeling, and data science techniques. The ideal candidate... ...algorithms and modeling using big data cloud platforms· Understanding of A/... ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teamsThe ideal candidate...Big dataFull timeWork experience placement
- Role SummaryThe Data Analyst, Senior Specialist role analyzes complex datasets to provide actionable insights, optimize processes, and... ...functional teams and leading data-driven projects.Familiarity with big data tools or platforms (e.g., Hadoop, Spark) is a plus.Knowledge...Big dataFull timeWork experience placement
- ...unit, integration and end-end testing. Be able to understand big picture from requirements in order to architect robust design solutions... ..., AWS S3, Splunk, and AWS Analytics. Good to have - Big data related AWS technologies like HIVE, Spark, ETL, AWS Glue, Presto,...Big data
Samprasoft
Malvern, PA4 days ago - ...When you work for AmeriGas, you become a part of something BIG! Founded in 1959, AmeriGas is the nation’s premier propane company... ...distribution points across the United States. Position Summary The Lead Data Engineer is a hands‑on technical leader responsible for leading data...For contractors
UGI
King of Prussia, PA4 days ago - ...provide budgeting/financial flexibility by offering contingent labor as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and Hire, Multiple positions open.Position will design and implement...Contract workWork at officeImmediate startFlexible hours
- ...Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that... ...for the remote option.)Job SummaryThis role leads the Data Center Engineering organization, with accountability for the design, reliability...Full timeWork at officeRemote workWorldwide
- ...highly skilled, trusted, and dynamic security architects and engineers tasked with securing the firm's most critical network environments... ...Vulnerability Assessment, Investigations, Cyber “Hunt” Teams, Big Data Analysis, Crisis Management, and Exercises.Engaging with audit...Big dataFull timeTemporary workLocal areaRemote workFlexible hours
- .... Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions that... ...a highly skilled Full Stack Developer with a strong data engineering background to design and deliver end-to-end solutions that drive...Full timeWork at officeRemote workWorldwide
$50k - $85k
...partners to scale safely across lending, card services, and embedded finance. The Role We are seeking a solution-oriented Data Engineer with deep expertise in Azure Synapse, SQL Server, and Power BI . In this role, you will design and deliver end-to-end data...- ...Software Development Life Cycle (SDLC) methodologies, including Agile and Waterfall. The individual will also contribute to modern data initiatives, including AI-enabled solutions and iPaaS-based integrations, while adhering to SDLC and database development best practices...
- ...Job Title: Data Center Network Engineer Location: Multiple locations (Wayne, PA; Plano, TX; Scottsdale, AZ; Charlotte, NC) Schedule: Hybrid 3 days a week onsite (Tues-Thurs), 2 days remote W2/ 6 monthsContract to Perm Role Overview We are seeking a...Permanent employmentRemote work3 days per week
Apolis
Wayne, PA1 day ago - ...tools (or) SQL Server tools/services like SSRS/SSAS/TSQL/MDX· Support ETL/Reports Validation, test automation and test data generation· Support Big Data Testing, Hadoop, MapR etc..· SUPERB communication skills (speaking, listening, writing and interpreting)· Comfortable...Big dataImmediate start
- ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...Big dataPermanent employmentFull timeH1b
- Job Description: Job title: WFH-TEMP - .NET FULL STACK DEVELOPER Job summary: Cognizant Technology Solutions is seeking a Full Stack Dot Net Developer to join our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking...Permanent employmentTemporary workWork from homeShift work
$115k
...platform and a thoughtful team, we deliver the most trusted solution in the market. As an Analytics Engineer II , you will be a driving force in bridging the gap between raw data and actionable business insights. You will take ownership of the end-to-end data lifecycle,...Flexible hours$96.9k - $176.2k
...Requisition #: 76240The Role at a GlanceWe are seeking a highly skilled data professional to join the Actuarial Data & Transformation Center of Excellence as a Senior Analytics Architect and Engineer. This role will lead the development of scalable data and analytics...Work experience placementWork at officeWork from home3 days per week- Global Risk and Security (GR&S) at Vanguard enables business strategy, protects client and Vanguard interests (e.g., assets and data), and stewards a strong risk culture. Our teams leverage enterprise-wide insights, deep expertise, and trusted advice so that across Vanguard...Full timeWork experience placementVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
