Big Data Engineer
RIT Solutions
Big Data Engineer
Hybrid - Malvern, PA
Responsibilities
Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
Troubleshoots software and processes for data consistency and integrity.
Integrates data from a variety of sources for business partners to generate insight and make decisions.
Translates business specifications into design specifications and code.
Responsible for writing programs, ad hoc queries, and reports.
Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
Partners with internal clients to gain a basic understanding of business functions and informational needs.
Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
Tests code thoroughly for accuracy of intended purpose.
Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
Provides tool and data support to business users and fellow team members.
Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
Participates in special projects and performs other duties as assigned.
Qualifications
1-3 years Data Engineering Experience with SQL, Python & AWS
Experience with CI/CD and Jira. Experience with Data Quality
Experience with setting up lineage
Undergraduate degree or equivalent combination of training and experience.
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : NoBig data
Procyon TS
Malvern, PA5 days ago $48.46 - $54.46 per hour
...ETL Developer Responsibilities: Building and maintaining ETL pipelines, Data Analysis, Reimaging Technical Architecture for Analytics Qualifications: Python, SQL, AWS Services Location: Malvern, Pennsylvania Job Type: Solutions Salary: $48.46 - 54.46 per...Big dataHourly payRandstad
Malvern, PA5 days ago$39.38 - $44.38 per hour
...contractor will be responsible for supporting and maintaining the data pipeline platform that powers performance reporting data... ...performance, and operational issues. Collaborate with product, engineering, and business teams to support data integration, reporting, and...Big dataHourly payContract workTemporary workFor contractorsWork experience placementRandstad
Malvern, PA3 days ago- ...Trading Analytics And Strategy Engineer Client’s Trading Analytics and Strategy (TAS) team... ...passive as well as active mandates, to conduct data-driven analyses and build tools to help... ...and investment data Experience in big data technologies such as Spark and developing...Big data
Samprasoft
Malvern, PA2 days ago - ...Big Data Engineer Sonsoft, Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled...Big dataPermanent employmentFull timeH1b
SonSoft
King of Prussia, PA16 hours ago - ...December 31, 2025. The Opportunity We are seeking a talented ETL Data Engineer with strong experience in Python and Azure Synapse Analytics to... ...a team environment with shifting priorities. Familiarity with big data technologies, machine learning, and data analysis...Big dataWork experience placementShift work
Hamilton Lane
Conshohocken, PA1 day ago - ...predictive, and prescriptive analytics to support data-driven business decision making. Role... ...on defined problems such as feature engineering, model fitting, calibration, and... ...workflows and version control. ~ Exposure to big-data frameworks (Spark, etc.)....Big data
Vanguard
Malvern, PA21 days ago - ...Senior Data Scientist This is a hybrid role based in the Malvern, PA office. (3 days... ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is... ...programming languages such as Python and SQL, and big data technologies like Databricks....Big dataWork at office
CubeSmart Self Storage
Malvern, PA3 days ago - ...exceptional professionals for this role. Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions. We...
Vanguard
Malvern, PA9 days ago - ...Data Engineer Please note that Bentley Systems will not sponsor applicants for employment authorization for this position. Candidates must be authorized to work in the United States without sponsorship now or in the future. Location: Anywhere in the United States (Office...Work at officeRemote workWorldwide
Bentley Systems
Exton, PA4 days ago $85.78k - $105.83k
...AWS Data Scientist Choosing Capgemini means choosing a company where you will be empowered... ...close collaboration with business and engineering teams. Required Skills &... ...or Solutions Architect) Experience with big data technologies such as Spark Exposure...Big dataPermanent employmentFull timeContract workLocal areaCapgemini
Malvern, PA2 days ago- ...Data Analytical Engineer SEEKING A SENIOR CANDIDATE hybrid - Malvern. PA Job Description Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots...
RIT Solutions, Inc.
Malvern, PA5 days ago - ...Title: Data Engineering Director Location: Kings of Prussia, PA (Hybrid role) Type: Fulltime Salary – (Best possible) Requirements... ...related discipline. Preferred Skills: Experience with big data technologies such as Hadoop, Spark, or Kafka....Big dataFull time
- ...Advice & Wealth Management Technology (AWMT) is seeking a Data Engineering Manager to lead a team delivering scalable data platforms and products that power personalized financial advice. You will own delivery, engineering standards, and talent development while...Visa sponsorship
Vanguard Group, Inc.
Malvern, PA4 days ago - ...Vanguard’s trusted brand to life through data-driven, personalized marketing. To elevate... ...algorithms and modeling using big data cloud platforms · Understanding of... ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teams The ideal candidate...Big dataWork experience placement
Vanguard
Malvern, PA20 days ago - ...connect them with exceptional professionals for this role. The Lead Data Analyst is responsible for driving data-driven decision-making... ...platforms such as AWS, GCP, or Azure, including data lakes and big data processing tools. ~ Ability to translate complex data insights...Big dataWork experience placement
Vanguard
Malvern, PA7 days ago - ...unit, integration and end-end testing. Be able to understand big picture from requirements in order to architect robust design solutions... ..., AWS S3, Splunk, and AWS Analytics. Good to have - Big data related AWS technologies like HIVE, Spark, ETL, AWS Glue, Presto,...Big data
Samprasoft
Malvern, PA1 day ago - ...Data Scientist Develops complex queries and performs extensive programming to access, transform, and prepare data for statistical modeling... ..., data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...Big data
Vanguard
Malvern, PA4 days ago - ...Job Title Responsibilities: # Analyzes data, assesses trends and develops actionable insights and recommendations in support of... ...querying languages (SQL) ~ Experience working within a cloud-based, big data environment (AWS preferred) ~ Highest standards of...Big dataWork experience placement
Samprasoft
Malvern, PA2 days ago $55.7k - $100.2k
...Specialist, Actuarial Data Engineer The Role at a Glance As a Specialist, Actuarial Data Engineer, you will lead the design and implementation of new technology solutions of the Actuarial Architecture & Transformation team. You will develop data & analytics solutions...Work experience placementLincoln Financial Services
Radnor, PA5 days ago- ...Data Analyst, Senior Specialist The Data Analyst, Senior Specialist role analyzes complex datasets to provide actionable insights,... ...functional teams and leading data-driven projects. Familiarity with big data tools or platforms (e.g., Hadoop, Spark) is a plus....Big dataWork experience placement
Vanguard
Malvern, PA2 days ago - ...connect them with exceptional professionals for this role. Senior Data Scientist — Investment Management Fintech Strategies (IMFS)... ...in real-world market environments. Raise the bar on engineering quality by mentoring quant strategists and data scientists on...
Vanguard
Malvern, PA14 days ago $115k
...platform and a thoughtful team, we deliver the most trusted solution in the market. As an Analytics Engineer II , you will be a driving force in bridging the gap between raw data and actionable business insights. You will take ownership of the end-to-end data lifecycle,...Flexible hoursClerri
Wayne, PA3 days ago$100k - $125k
Role Overview The DBT SME serves as the senior engineer for data transformation within a modern data stack built on dbt and Snowflake. This role is responsible for implementing dbt transformation models, enforcing modeling best practices, and ensuring that dbt and traditional...Temporary workFlexible hours- ...Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS Glue, PySpark...
$51.78 per hour
job summary: Role Overview: We are seeking a mid-level Data Engineer (3-5 years of experience) to join our Brokerage and Investment team. You will act as a senior engineer, engaging directly with business analysts and stakeholders to translate complex requirements...Hourly payTemporary workWork experience placement- ...Data Center Network Engineer Location: Multiple locations (Wayne, PA; Plano, TX; Scottsdale, AZ; Charlotte, NC) Schedule: Hybrid 3 days a week onsite (Tues-Thurs), 2 days remote W2/ 6 months Contract to Perm Role Overview: We are seeking a hands-on Data Center...Permanent employmentContract workRemote work3 days per week
Apolis
Wayne, PA4 days ago - When you work for AmeriGas, you become a part of something BIG! Founded in 1959, AmeriGas is the nation’s premier propane company,... ...distribution points across the United States. Position Summary The Lead Data Engineer is a hands‑on technical leader responsible for leading data...For contractors
- Job Description: Job title: WFH-TEMP - .NET FULL STACK DEVELOPER Job summary: Cognizant Technology Solutions is seeking a Full Stack Dot Net Developer to join our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking...Permanent employmentTemporary workWork from homeShift work
- ...Tiger Analytics is looking for experienced Data Scientists to join our fast-growing advanced analytics consulting firm. Our consultants... ...experience. Partner with cross-functional teams including engineering, product, and business stakeholders to identify process and...Local area
Tiger Analytics
Malvern, PA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- aws data engineer Malvern, PA
- data engineer Malvern, PA
- finance data engineer Malvern, PA
- senior data center engineer Malvern, PA
- data engineer analytics Malvern, PA
- data engineer machine learning Malvern, PA
- data developer Malvern, PA
- data center engineer Malvern, PA
- data science developer Malvern, PA
- big data Malvern, PA