Big Data Engineer
RIT Solutions, Inc.
Big Data Engineer
Hybrid - Malvern, P
Responsibilities
Hybrid - Malvern, P
Responsibilities
- Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
- Troubleshoots software and processes for data consistency and integrity.
- Integrates data from a variety of sources for business partners to generate insight and make decisions.
- Translates business specifications into design specifications and code.
- Responsible for writing programs, ad hoc queries, and reports.
- Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
- Partners with internal clients to gain a basic understanding of business functions and informational needs.
- Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
- Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
- Tests code thoroughly for accuracy of intended purpose.
- Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
- Provides tool and data support to business users and fellow team members.
- Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
- Participates in special projects and performs other duties as assigned.
- 1-3 years Data Engineering Experience with SQL, Python & AWS
- Experience with CI/CD and Jira. Experience with Data Quality
- Experience with setting up lineage
- Undergraduate degree or equivalent combination of training and experience.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : NoBig data
Procyon TS
Malvern, PA20 hours ago - Job Title Required Skills: Python, Spark, AWS services, Glue, IAC Responsibilities ~ Work with Analytics and Business - derive requirements, build Engineering pipelines aligned to standards, trouble shoot data discrepancies and ensure quality dataBig data
Syntricate Technologies
Malvern, PA1 day ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team... ...passive as well as active mandates, to conduct data-driven analyses and build tools to help... ...and investment data Experience in big data technologies such as Spark and developing...Big data
Samprasoft
Malvern, PA2 days ago $39.38 - $44.38 per hour
...Responsibilities Design, develop, and maintain scalable data pipelines and data products on the AWS data platform using PySpark... ...business requirements. Collaborate with product owners, data engineers, and stakeholders to deliver data products, troubleshoot issues...Big dataHourly payTemporary workWork experience placementRandstad
Malvern, PA3 days ago- ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...Big data
RIT Solutions
Malvern, PA1 day ago - ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...Big dataPermanent employmentFull timeH1b
- ...Data Engineer Location: West Conshohocken PA Duration: 6 + months Job Description: Candidate should have previous experience building... ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data...Big data
ClifyX
Conshohocken, PA1 day ago - ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...Big dataFull time
- ...predictive, and prescriptive analytics to support data-driven business decision making. Role... ...on defined problems such as feature engineering, model fitting, calibration, and validation... ...and version control. Exposure to big-data frameworks (Spark, etc.). Special Factors...Big data
Vanguard
Malvern, PA20 hours ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Texas State Library and Archives Commision
Malvern, PA3 days ago - ...analytic processing. Troubleshoots software and processes for data consistency and integrity. Integrates complex and large-scale... ...consultant for the client. Educates and develops junior data engineers on the team while applying quality control to their work....
Kaav Inc.
Malvern, PA20 hours ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA2 days ago - ...Job Title: Data Engineer Duration- Fulltime Permanent Location: Malvern, PA, 19355 / Charlotte, NC, 28262 (Hybrid /requiring 3 days onsite Mandate (Tuesday, Wednesday, and Thursday) (Local Only) Job Description: Data Engineer Python, Glue ETL, Attunity...Permanent employmentFull timeLocal area
Q1 Technologies
Malvern, PA3 days ago $55 - $58 per hour
...Job Title: AWS Data Engineer Request-ID:98323-1 Location: Malvern, PA Duration: 6+ months Pay Range: $55.00- 58.00 /Hour We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate...Artech
Malvern, PA3 days ago- ...Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS...
Purple Drive
Malvern, PA1 day ago - ...Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture). Infrastructure: CloudFormation/Terraform,... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
Saxon Global
Malvern, PA3 days ago - ...Senior Data Engineer We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust AWS utilities that enable our data engineers and analysts to seamlessly query across multiple data sources...
RIT Solutions
Malvern, PA1 day ago - ...exceptional professionals for this role. Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions. We are...
Vanguard
Malvern, PA1 day ago - ...Job Description Overview We are seeking a highly experienced Data Engineer with 5+ years of experience. This role is critical to hitting product rollout deadlines, as the team's work is a hard, direct dependency for other product feature rollouts. The ideal...
InterSources
Malvern, PA20 hours ago - ...Position- Data Engineer Duration-Contract Location- Malvern PA (Day 1 onsite) Local Only JD Aws Redshift is mandatory With sql, python If someone worked with Apache Iceberg would be great Regards, Pallavi Verma Sr....Contract workLocal areaImmediate start
Syntricate Technologies
Malvern, PA4 days ago $49.46 - $54.46 per hour
...job summary: At least 5 years of Data Engineering experience with AWS platform using robust technical skills in Python, SQL, PySpark, Glue ETL, AWS Lambda, S3, Redshift, AWS Airflow Robust problem-solving skills, communication skills, and ability to learn quickly...Hourly payContract workTemporary workWork experience placementRandstad
Malvern, PA3 days ago- ...AXA XL, a global leader in insurance, seeks a data-driven Pricing Analytics & Models professional to enable pricing actuaries and underwriters with robust data flows and insightful BI dashboards. The role focuses on building scalable data models, dashboards, and reporting...
AXA Group
Exton, PA1 day ago - ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- ...Title: Data Engineering Director Location: Kings of Prussia, PA (Hybrid role) Type: Fulltime Salary – (Best possible) Requirements... ...related discipline. Preferred Skills: Experience with big data technologies such as Hadoop, Spark, or Kafka....Big dataFull time
- Application Engineer III - AWS Data EngineerAbout the RoleJoin Vanguard's mission to deliver investment success for all investors. We're seeking an AWS Data Engineer to help shape and evolve an enterprise data platform that manages assets and cash flow data across our lines...Full time
- Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...
- DescriptionWe are looking for a Data Engineer to drive the design and delivery of scalable data solutions that support critical business objectives within the oil and gas sector. This position is based in King of Prussia, Pennsylvania, and combines technical execution with...
- ...with six leading retail brands - QVC, HSN, Ballard Designs, Frontgate, Garnet Hill and Grandin Road.Your Opportunity, Your TeamThe Data Engineer supports QVC and will collaborate with an Agile team to build data pipelines and models, exposing analytics through APIs and...Full timeLocal areaRemote workRelocation package
- ...advanced analytics, predictive modeling, and data science techniques. The ideal candidate... ...algorithms and modeling using big data cloud platforms· Understanding of A/... ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teamsSpecial FactorsSponsorshipVanguard...Big dataFull timeWork experience placement
- ...advanced analytics, predictive modeling, and data science techniques. The ideal candidate... ...algorithms and modeling using big data cloud platforms· Understanding of A/... ...Marketing, Sales, MarTech, Data Science, Data Engineering and other Analytics teamsThe ideal candidate...Big dataFull timeWork experience placement
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data developer Malvern, PA
- data science developer Malvern, PA
- finance data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- etl data engineer Malvern, PA
- data engineer Malvern, PA
- aws data engineer Malvern, PA
- senior data center engineer Malvern, PA
- data center engineer Malvern, PA
- data engineer analytics Malvern, PA