Big Data Engineer
RIT Solutions
Big Data Engineer
Hybrid - Malvern, PA
Responsibilities
Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
Troubleshoots software and processes for data consistency and integrity.
Integrates data from a variety of sources for business partners to generate insight and make decisions.
Translates business specifications into design specifications and code.
Responsible for writing programs, ad hoc queries, and reports.
Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
Partners with internal clients to gain a basic understanding of business functions and informational needs.
Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
Tests code thoroughly for accuracy of intended purpose.
Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
Provides tool and data support to business users and fellow team members.
Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
Participates in special projects and performs other duties as assigned.
Qualifications
1-3 years Data Engineering Experience with SQL, Python & AWS
Experience with CI/CD and Jira. Experience with Data Quality
Experience with setting up lineage
Undergraduate degree or equivalent combination of training and experience.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : NoBig data
Procyon TS
Malvern, PA5 days ago - ...Big Data Engineer Hybrid - Malvern, P Responsibilities Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing. Troubleshoots software and processes for data...Big data
RIT Solutions, Inc.
Malvern, PA1 day ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team... ...passive as well as active mandates, to conduct data-driven analyses and build tools to help... ...and investment data Experience in big data technologies such as Spark and developing...Big data
Samprasoft
Malvern, PA2 days ago - ...Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services Qualifications Expert knowledge of Python, SQL, PySpark...Big data
Zuven technologies Inc
Malvern, PA2 days ago - ...High-Level Data Engineer Position Data engineer Malvern PA hybrid assessment required. Minimum 8-10 years of experience. Location – preferred Charlotte (but can be in Malvern). Role – level 4 big data engineer, Python developer. Required skillset – Python, SQL, AWS...Big data
RIT Solutions
Malvern, PA1 day ago - ...We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines and data ingestion processes using modern Big Data technologies. The ideal candidate will have strong experience in data aggregation, transformation, validation, quality management...Big data
Techvilla Solutions
Devon, PA1 day ago - Core ResponsibilitiesProvides advanced data solutions by using software to process, store, and serve data to others. Tests data quality... ...processing, automation and transformation.Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka for real-...Big dataFull timeWork experience placement
- ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...Big dataPermanent employmentFull timeH1b
- Role Overview The Data Engineer, Specialist is responsible for designing, developing, and maintaining scalable data pipelines and infrastructure... ...in cloud-based data warehouses such as AWS Redshift, Google Big Query, or Azure Synapse, ensuring scalability and cost-...Big data
- ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Big dataPermanent employmentFull timeH1b
- ...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...Big dataPermanent employmentFull time
- ...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data... ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data...Big data
ClifyX
Conshohocken, PA3 days ago - ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...Big dataFull time
- ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA3 days ago - ...Overview: Job Description - AWS Data Engineer (Python, AWS Glue, PySpark & Attunity) Job Title AWS Data Engineer - Python, AWS Glue, PySpark & Attunity Job Summary We are seeking an experienced AWS Data Engineer with strong expertise in Python, AWS...
Purple Drive
Malvern, PA1 day ago - ...Role Description: We are looking for strong AWS Data Engineers who are passionate about Cloud technology. Your work will be to: Design and Develop Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics...
Syntricate Technologies
Malvern, PA4 days ago - ...Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
V-Soft Consulting Group
Malvern, PA2 days ago - ...Sr. Data EngineeringThe Sr. Data Engineering will manage the data pipeline development from data ingestion to transformation, implementing the Architect’s data models and ensuring high-quality data flow through the bronze, silver, and gold layers. This role involves leading...
Kaav Inc.
Malvern, PA3 days ago - NO VISA CANDIDATES / NO AGENCIES / NO THIRD PARTIES Position Summary We are seeking a highly skilled Data Engineer to design, build, and govern enterprise data platforms that support operational applications, business analytics, and AI initiatives. This role will develop...
- ...Data Engineer - Assessment required Hybird Malvern, pa Job Description Duties: Build out an extensive transaction stitching application to helps track the journey of money flowing through a client's account over the lifetime of the funds. Skills...
Akaasa Technologies
Malvern, PA2 days ago - Overview: We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with cloud-based architecture, data engineering, and working with large-scale...
Programmers.io
Malvern, PA2 days ago - ...data engineer 5-8 years of exp hybird - malvern, pa or plano, tx, or charlotte, nc assessment required Description Details Advice and Wealth Management Technology ( AWMT ) is seeking a data engineer for the Data & Analytics engineering...
Akaasa Technologies
Malvern, PA2 days ago - ...VSH). Learn more at . Do you want to help us build the DNA of tech.? Vishay Italy is currently seeking applicants for Head of Data Engineering & Analytics. In this position, you will be accountable for defining, governing, and evolving the enterprise‑wide data architecture...Full time
- The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic intelligence that enable enterprise data integration, activation, analytics, personalization, and decision-making across...Full timeFor contractorsWork at office
- ...Malvern, PA Must Have Technical/Functional Skills: • AWS Data Services - S3, Redshift, Glue, Lambda, Athena. • Data Modeling... ...Architecture - Amazon S3, Lake Formation, Data Lake best practices. • Big Data & Processing - Spark/PySpark, Amazon EMR. • ETL/ELT...Big data
United IT Solutions
Malvern, PA4 days ago $70 - $73 per hour
...Salary Range: $70- $73 an hour on W2/C2C Job Description: Data Architect with strong expertise in designing and implementing... ...Warehousing - Amazon Redshift and enterprise data warehouse design. Big Data Processing - Apache Spark, PySpark, Amazon EMR. ETL/ELT...Big dataArtech
Malvern, PA4 days ago- ...manager partners, across asset classes and passive as well as active mandates, to conduct data-driven analyses and build tools to help shape our trading strategy. As an Engineer on the full stack team, you will be dedicated to help design, implement, and maintain a modern...Big data
- Data Engineer - AIDay to Day job Duties: (what this person will do on a daily/weekly basis)Design and build scalable ingestion, transformation, and processing pipelines for AI/ML.Develop and maintain data storage, such as vector databases, that support Retrieval-Augmented...
- ...unit, integration and end-end testing. Be able to understand big picture from requirements in order to architect robust design solutions... ..., AWS S3, Splunk, and AWS Analytics. Good to have - Big data related AWS technologies like HIVE, Spark, ETL, AWS Glue, Presto,...Big data
Samprasoft
Malvern, PA2 days ago - ...Data Engineer - Contract to Hire (Hybrid, No Sponsorship) Location: Wayne, PA | Plano, TX | Charlotte, NC | Scottsdale, AZ Job Type: Contract to Hire (Hybrid, 3 days on-site/week) Eligibility: US Citizens/Green Card Holders only (no sponsorship provided) About...Permanent employmentContract workLocal area3 days per week
Indotronix International Corporation
Wayne, PA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- finance data engineer Malvern, PA
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- data center engineer Malvern, PA
- data engineer analytics Malvern, PA
- data developer Malvern, PA
- etl data engineer Malvern, PA
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- sr information security engineer Malvern, PA