Big Data Engineer
Samprasoft
Trading Analytics And Strategy Engineer
Client's Trading Analytics and Strategy (TAS) team works with our global trading desks to optimize their trading strategies, saving millions of dollars for clients every year.
The team works with our trader and portfolio manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy.
As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern, robust, and scalable platform which will enable the TAS team to meet the increasing demands from the various trading desks.
Qualifications
- Proficiency in Python programming
- Strong expertise in SQL, Presto, HIVE, and Spark
- Knowledge of trading and investment data
- Experience in big data technologies such as Spark and developing distributed computing applications using PySpark
- Experience with libraries for data manipulation and analysis, such as Pandas, Polars and NumPy Understanding of data pipelines, ETL processes, and data warehousing concepts
- Strong experience in building and orchestrating data pipelines
- Experience in building APIs Write, maintain, and execute automated unit tests using Python
- Follow Test-Driven Development (TDD) practices in all stages of software development
- Extensive experience with key AWS services/components including EMR, Lambda, Glue ETL, Step Functions, S3, ECS, Kinesis, IAM, RDS PostgreSQL, Dynamodb, Timeseries database, CloudWatch Events/Event Bridge, Athena, SNS, SQS, and VPC
- Proficiency in developing serverless architectures using AWS services
- Experience with both relational and NoSQL databases
- Skills in designing and implementing data models, including normalization, denormalization, and schema design
- Knowledge of data warehousing solutions like Amazon Redshift
- Strong analytical skills with the ability to troubleshoot data issues
- Good understanding of source control, unit testing, test-driven development, and CI/CD
- Ability to write clean, maintainable code and comprehend code written by others
- Strong communication skills
- Proficiency in data visualization tools and ability to create visual representations of data, particularly using Tableau
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue experience... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : No...Big data
Kaav Inc.
Malvern, PA9 hours ago - ...Big Data Engineer Hybrid - Malvern, P Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data...Big data
RIT Solutions, Inc.
Malvern, PA19 hours ago - ...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...Big dataPermanent employmentFull time
- ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Big dataPermanent employmentFull timeH1b
- ...experience in software design, development and release. Well versed with agile development methodologies. Experience in Data Ingestion, Streaming and Big Data technologies. Excellent communication and stakeholder management Ability to work with distributed teams. Exposure...Big dataPermanent employmentFull timeH1b
- Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building a data... ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data ClifyXBig data
- ...Stop Driving. Ready to get in the driver's seat? Join us! As a Data Engineer II , you will be joining a fast-paced, high functioning team to... ...do Implement best practices around software development and big data engineering Develop and implement robust and scalable data...Big dataWork experience placementWork at officeRemote work3 days per week
- Vanguard is seeking an experienced Data Engineer to join the B2B AI and Data Engineering team. In this hands-on role, you will design, build, and operate scalable data pipelines and data products that support analytics, AI, and critical business functions. You will provide...Full time
Vanguard
Malvern, PA1 day ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA2 days ago - ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale data... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
- Senior Data Engineer - 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services, API...
- Senior Data Engineer Assessment required Hybrid - Malvern, PA Technical Stack & Requirements: Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker. Infrastructure: CloudFormation/Terraform, CI...
- Request ID: 111240-1 Title: Senior Data Engineer Locations: Malvern, PA Interview Mode: Onsite Duration: 06+ Months with Possible Extension. Pay Range: $60-$65/Hour on W2/C2C (All inclusive) We are seeking an experienced AWS Data Engineer with expertise in ETL processes...Local area
- Data Engineer Location: Malvern, PA - Hybrid Important Submission Requirement Candidates must take and pass a technical assessment before submission . Only submit candidates who are willing and available to complete the assessment. Position Overview Vanguard is seeking...
- Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting together large, intricate...
- Experience in the below technologies. ETL using EMR & Glue require working experience. SQL/PYSPARK/PYTHON/Jupyter Notebooks/GitHub functions/ CI/CD Knowledge on cloud Services: EMR/GLUE/S3/EC2/Service Catalog/PostgreSQL/Lambda/cloudFormation/SNS/EventBridge Knowledge ...Work experience placement
- ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required to work in EST starting around 1...Contract workImmediate startRemote work
- Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our...
- Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability...
$71.96 - $75.75 per hour
...designing and delivering enterprise-scale data platforms, cloud modernization... ...solutions, and collaborate with business, engineering, and enterprise stakeholders to enable data... ...Catalog, DLT, Databricks SQL, MLflow •Big Data: Spark, PySpark, Scala, Kafka, Streaming...Big dataVarite, Inc
Malvern, PA3 days ago- Data Engineer Hybrid Role (in office Tues-Wed-Thurs) is based in Malvern, PA (HQ) Responsibilities Designs, develops, and optimizes ETL processes, data pipelines, database solutions, and cloud-based data infrastructure to support scalable, reliable data processing and analytical...Work at office
- The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day...Big dataFull time
- Lead Data Engineer / Data Architect - Innovation & POC Lead Location: Exton, PA | Onsite Experience: 10+ Years Role Summary Lead enterprise data engineering and architecture initiatives, focusing on technology innovation, POCs, platform evaluation, and strategic architecture...
- ...Architect Malvern, PA Must Have Technical/Functional Skills: • AWS Data Services - S3, Redshift, Glue, Lambda, Athena. • Data Modeling -... ...- Amazon S3, Lake Formation, Data Lake best practices. • Big Data & Processing - Spark/PySpark, Amazon EMR. • ETL/ELT Development...Big data
- ...growing Inc 500 Companies in the US, providing enhanced IT consulting, and engineering solution services from past 16 years. Saxon global specializes in Business Intelligence, Mobility, Big Data & Cloud and provides IT tools and services to help organizations across industry...Big data
- ...provide budgeting/financial flexibility by offering contingent labor as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and Hire, Multiple positions open.Position will design and implement...Contract workWork at officeImmediate startFlexible hours
Artech
Collegeville, PA3 days ago - As a Data Science Engineer at Qlik, you'll be an integral part of the Global Support team, dedicated to empowering customers to deploy data science solutions using our automated machine learning platform, Qlik AutoML. You'll play a crucial role in educating customers on...Remote job
- ...generation and agentic workflow automation. Collaborate across data science and engineering teams to deploy scalable solutions with appropriate... ...similar technologies, plus strong technical knowledge of cloud, big data, scalable data processing, SQL, and NoSQL databases...Big data
- ...office. (3 days in office) The Senior Data Scientist plays a critical role within... ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is... ...programming languages such as Python and SQL, and big data technologies like Databricks....Big dataWork at office
- Data Engineer Location - West Chester, PA Onsite. Azure Senior Data Lead with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python Job Summary: The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- etl data engineer Malvern, PA
- finance data engineer Malvern, PA