Big Data Engineer
RIT Solutions
Big Data Engineer
Hybrid - Malvern, PA
Responsibilities
Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
Troubleshoots software and processes for data consistency and integrity.
Integrates data from a variety of sources for business partners to generate insight and make decisions.
Translates business specifications into design specifications and code.
Responsible for writing programs, ad hoc queries, and reports.
Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
Partners with internal clients to gain a basic understanding of business functions and informational needs.
Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
Tests code thoroughly for accuracy of intended purpose.
Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
Provides tool and data support to business users and fellow team members.
Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
Participates in special projects and performs other duties as assigned.
Qualifications
1-3 years Data Engineering Experience with SQL, Python & AWS
Experience with CI/CD and Jira. Experience with Data Quality
Experience with setting up lineage
Undergraduate degree or equivalent combination of training and experience.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data filesQualificationsExpert in SQLAWS S3 and Glue experienceAdvanced... ...principlesRequired Skills : Data WarehouseBasic Qualification :Additional Skills : Big DataBackground Check : NoDrug Screen : No...Big data
Kaav Inc.
Malvern, PA4 days ago - ...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems, and... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and...Big data
RIT Solutions
Malvern, PA4 days ago $49.46 - $54.46 per hour
...Data EngineerResponsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services. Location: Malvern, Pennsylvania. Job type: Contract...Big dataHourly payContract workRandstad
Malvern, PA4 days ago$49.46 - $54.46 per hour
job summary: Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services location: Malvern, Pennsylvania job type...Big dataHourly payContract workTemporary workWork experience placementRandstad
Malvern, PA4 days ago- ...Data Engineer With PythonWe are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines... ...databases (PostgreSQL, MySQL, SQL Server, etc.).Experience with big data tools such as Apache Spark, Hadoop, or Kafka.Knowledge of...Big data
AceStack LLC
Malvern, PA4 days ago $60 - $67 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in Malvern, PA. The ideal candidate is responsible for designing, building... ...related field. ~10+ years of experience in Data Engineering, Big Data, and cloud-based data platform development. ~ Strong...Big dataHourly payContract workTemporary workLocal areaAkkodis
Malvern, PA4 days ago- ...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...Big dataPermanent employmentFull timeH1b
- ...mandates, both passive and active, to conduct data-driven analyses and develop tools that shape trading strategies. As a Full Stack Engineer, you will design, implement, and maintain... ...of trading and investment data. Big Data Technologies: Experience with Spark and...Big data
RIT Solutions, Inc.
Wayne, PA1 day ago - ...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...Big dataPermanent employmentFull time
- ...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data... ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data...Big data
ClifyX
Conshohocken, PA4 days ago - DescriptionWe are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In... ...across teams and manage changing priorities.• Familiarity with big data or analytics technologies such as Apache Spark, Hadoop,...Big data
- ...Role: Data Engineer Location: West Chester,PA-- 100% ONSITE FROM DAT1 Duration: 6 months Experience Required: 6- 8 Years Note:... ...Digital : Databricks~Digital : PySpark Role Descriptions: Big Data| Spark| AWS| Databricks| Docker| Kubernetes and other Data...Big data
I-Flow
West Chester, PA3 days ago $45 - $49 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in West Chester, PA. The ideal candidate with expertise designing, developing... ...include: Design, develop, and maintain scalable Big Data and ETL solutions using Spark, PySpark, Databricks, AWS,...Big dataHourly payContract workTemporary workLocal areaAkkodis
West Chester, PA2 days ago- ...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...Big dataFull time
- ...Data EngineerWe are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Python, AWS Glue, ETL processes, and Attunity. This role is crucial for driving data initiatives...Work experience placementWork at officeFlexible hours
Artech
Malvern, PA4 days ago - ...Job Title: Senior Data Engineer Location : Malvern, PA Duration:6 Months Experience Required: 8-10 Request ID:82529-1 Description : Please prioritize candidates with Vanguard experience. ROLE_DESCRIPTION - Build and maintain event-driven...
I-Flow
Malvern, PA2 days ago - ...Data EngineerResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real... ...consultant for the client.Educates and develops junior data engineers on the team while applying quality control to their work. Develops...
Kaav Inc.
Malvern, PA4 days ago - ...Job TitleResponsibilitiesProvides expert level data solutions by using software to process, store, and serve data to others.Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure.QualificationsProvides expert...
Samprasoft
Malvern, PA4 days ago - ...exceptional professionals for this role. Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions. We are...
Vanguard
Malvern, PA3 days ago - ...Data Engineering LeadLocation: Malvern, PA ContractSummary: We are seeking an experienced Tech lead- Data Engineer (15+ years) with a strong background in Java, AWS, Python, PySpark, and event-driven architectures. You will design and build scalable batch and streaming...
AceStack LLC
Malvern, PA4 days ago - Job TitleResponsibilitiesCustomization and development of the Polaris applications. They may work on the design, coding, testing, debugging, and implementation in the project.QualificationsJava, Python and AWS. Knowledge of AWS services.
Samprasoft
Malvern, PA4 days ago $55 - $58 per hour
...Job Title: AWS Data Engineer Request-ID:98323-1 Location: Malvern, PA Duration: 6+ months Pay Range: $55.00- 58.00 /Hour We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate...Artech
Malvern, PA4 days ago- ...Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust...
RIT Solutions, Inc.
Malvern, PA1 day ago - ...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA3 days ago - ...Request ID: 98311-1 Title: Data Engineer Locations : Malvern, PA / Charlotte, NC - Hybrid Duration: 6 Months Pay Range: $65 - $70/Hour on W2/C2C (All inclusive) Introduction We are seeking a highly skilled professional to join our team. The ideal...Work experience placementWork at officeImmediate startFlexible hours
Artech
Malvern, PA3 days ago - ...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...Contract workImmediate startRemote work
3B Staffing LLC
Malvern, PA2 days ago - ...Data Lake 2.0 DeveloperData Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away from... ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data...
Samprasoft
Malvern, PA4 days ago - ...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...
Samprasoft
Malvern, PA3 days ago - ...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA2 days ago - ...AWS Data EngineerLocation: Malvern, PA, 19355Job Type: FulltimeSalary: $120,000-$130,000 a year+ benefitsKey Technical SkillsPythonAWS Glue (Glue ETL)PySparkAttunity / Qlik ReplicateAWS Services: Amazon S3, IAM, Lambda, CloudFormationRoles & ResponsibilitiesDesign, develop...
Diverse Lynx
Malvern, PA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data center engineer Malvern, PA
- etl data engineer Malvern, PA
- data engineer analytics Malvern, PA
- data engineer machine learning Malvern, PA
- finance data engineer Malvern, PA
- data engineer Malvern, PA
- data developer Malvern, PA
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- aws data engineer Malvern, PA