Big Data Engineer

RIT Solutions, Inc.

Malvern, PA

Big Data Engineer
Hybrid - Malvern, P

Responsibilities

Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
Troubleshoots software and processes for data consistency and integrity.
Integrates data from a variety of sources for business partners to generate insight and make decisions.
Translates business specifications into design specifications and code.
Responsible for writing programs, ad hoc queries, and reports.
Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
Partners with internal clients to gain a basic understanding of business functions and informational needs.
Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
Tests code thoroughly for accuracy of intended purpose.
Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
Provides tool and data support to business users and fellow team members.
Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
Participates in special projects and performs other duties as assigned.

Qualifications

1-3 years Data Engineering Experience with SQL, Python & AWS
Experience with CI/CD and Jira. Experience with Data Quality
Experience with setting up lineage
Undergraduate degree or equivalent combination of training and experience.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy

Big Data Engineer
...creation and deployment, testing, analyzing, and cleansing large data filesQualificationsExpert in SQLAWS S3 and Glue experienceAdvanced... ...principlesRequired Skills : Data WarehouseBasic Qualification :Additional Skills : Big DataBackground Check : NoDrug Screen : No...
Big data
Kaav Inc.
Malvern, PA
4 days ago
Big Data Engineer
...Big Data EngineerHybrid - Malvern, PAResponsibilitiesWrites ETL (Extract / Transform / Load) processes, designs database systems, and... ...performs other duties as assigned.Qualifications1-3 years Data Engineering Experience with SQL, Python & AWSExperience with CI/CD and...
Big data
RIT Solutions
Malvern, PA
4 days ago
Big Data Engineer
$49.46 - $54.46 per hour
...Data Engineer Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services. Location: Malvern, Pennsylvania. Job type: Contract...
Big data
Hourly pay
Contract work
Randstad
Malvern, PA
1 day ago
Big data engineer
$49.46 - $54.46 per hour
job summary: Responsibilities Data Engineer with experience designing scalable data pipelines, ETL workflows, and cloud-based analytics solutions. Robust expertise in Python, SQL, PySpark, Databricks and AWS services location: Malvern, Pennsylvania job type...
Big data
Hourly pay
Contract work
Temporary work
Work experience placement
Randstad
Malvern, PA
4 days ago
Data Engineer
...Data Engineer With PythonWe are seeking a Data Engineer with strong Python expertise to design, build, and maintain scalable data pipelines... ...databases (PostgreSQL, MySQL, SQL Server, etc.).Experience with big data tools such as Apache Spark, Hadoop, or Kafka.Knowledge of...
Big data
AceStack LLC
Malvern, PA
4 days ago
Data Engineer
$60 - $67 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in Malvern, PA. The ideal candidate is responsible for designing, building... ...related field. ~10+ years of experience in Data Engineering, Big Data, and cloud-based data platform development. ~ Strong...
Big data
Hourly pay
Contract work
Temporary work
Local area
Akkodis
Malvern, PA
4 days ago
Big Data Engineer
...experience in software design, development and release.Well versed with agile development methodologies.Experience in Data Ingestion, Streaming and Big Data technologies.Excellent communication and stakeholder managementAbility to work with distributed teams.Exposure to...
Big data
Permanent employment
Full time
H1b
Sonsoft
King of Prussia, PA
3 days ago
Big Data Engineer
...mandates, both passive and active, to conduct data-driven analyses and develop tools that shape trading strategies. As a Full Stack Engineer, you will design, implement, and maintain... ...of trading and investment data. Big Data Technologies: Experience with Spark and...
Big data
RIT Solutions, Inc.
Wayne, PA
1 day ago
Big Data Engineer - Ingestion & Streaming (Kafka, Spark)
...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...
Big data
Permanent employment
Full time
SonSoft
King of Prussia, PA
5 days ago
Sr. DATA Engineer
...Data EngineerLocation: West Conshohocken PADuration: 6 + monthsJob Description: Candidate should have previous experience building a data... ...data. Candidate should have data warehousing and ETL experience. Candidate should have experience in dealing with Big Data...
Big data
ClifyX
Conshohocken, PA
4 days ago
Data Engineer
DescriptionWe are looking for a Data Engineer to join a growing team in Conshohocken, Pennsylvania within the financial services industry. In... ...across teams and manage changing priorities.• Familiarity with big data or analytics technologies such as Apache Spark, Hadoop,...
Big data
Robert Half
Conshohocken, PA
1 day ago
Data Engineer
...Role: Data Engineer Location: West Chester,PA-- 100% ONSITE FROM DAT1 Duration: 6 months Experience Required: 6- 8 Years Note:... ...Digital : Databricks~Digital : PySpark Role Descriptions: Big Data| Spark| AWS| Databricks| Docker| Kubernetes and other Data...
Big data
I-Flow
West Chester, PA
3 days ago
Data Engineer
$45 - $49 per hour
...Akkodis is seeking a Data Engineer for a Contract with a client in West Chester, PA. The ideal candidate with expertise designing, developing... ...include: Design, develop, and maintain scalable Big Data and ETL solutions using Spark, PySpark, Databricks, AWS,...
Big data
Hourly pay
Contract work
Temporary work
Local area
Akkodis
West Chester, PA
3 days ago
Data Scientist, Specialist
...performs extensive programming to access, transform, and prepare data for statistical modeling.Leads and executes deep dive diagnostic,... ...pipelines, data wrangling, and statistical techniques; experience in big data environments (Spark/Hadoop); familiarity with visualization...
Big data
Full time
Vanguard
Malvern, PA
3 days ago
Senior Data Engineer
...Job TitleResponsibilitiesProvides expert level data solutions by using software to process, store, and serve data to others.Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure.QualificationsProvides expert...
Samprasoft
Malvern, PA
4 days ago
Data Engineer
...exceptional professionals for this role. Join us in a high-impact, high-visibility role where you will pioneer world-class Data & AI engineering solutions, building the next generation of intelligent, agent-driven systems that power real-time business decisions. We are...
Vanguard
Malvern, PA
3 days ago
Data Engineer
...Data Engineer As a Data Engineer, you’ll build sophisticated solutions that support a wide range of advanced data driven capabilities. Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data...
Samprasoft
Malvern, PA
3 days ago
Data Engineer/Developer
...Data Engineer Troubleshoots software and processes for data consistency and integrity. Integrates complex data from a variety of sources for business partners to generate insight and make decisions. Translates business specifications into design specifications and...
Samprasoft
Malvern, PA
3 days ago
Senior Data Engineer
...Request ID: 98311-1 Title: Data Engineer Locations : Malvern, PA / Charlotte, NC - Hybrid Duration: 6 Months Pay Range: $65 - $70/Hour on W2/C2C (All inclusive) Introduction We are seeking a highly skilled professional to join our team. The ideal...
Work experience placement
Work at office
Immediate start
Flexible hours
Artech
Malvern, PA
3 days ago
Senior Data Engineer
...Data EngineerWe are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience in data engineering, with a strong focus on Python, AWS Glue, ETL processes, and Attunity. This role is crucial for driving data initiatives...
Work experience placement
Work at office
Flexible hours
Artech
Malvern, PA
4 days ago
Senior Data Engineer
...Job Title: Senior Data Engineer Location : Malvern, PA Duration:6 Months Experience Required: 8-10 Request ID:82529-1 Description : Please prioritize candidates with Vanguard experience. ROLE_DESCRIPTION - Build and maintain event-driven...
I-Flow
Malvern, PA
2 days ago
Data Engineer
...Data Engineer Duties And Responsibilities Data engineers create and maintain an optimal data infrastructure. They combine raw information to create machine-readable formats. These are the major duties and responsibilities of a data engineer: Putting...
3B Staffing LLC
Malvern, PA
2 days ago
Data Engineer
Job TitleResponsibilitiesCustomization and development of the Polaris applications. They may work on the design, coding, testing, debugging, and implementation in the project.QualificationsJava, Python and AWS. Knowledge of AWS services.
Samprasoft
Malvern, PA
4 days ago
Data Engineer
...Data Engineer Hybrid Malvern, P 2 OPENINGS SSESSMENT REQUIRED Senior Data Engineer Job Summary We are seeking a talented Senior Data Engineer to join our infrastructure support team. This role is focused on designing and developing robust...
RIT Solutions, Inc.
Malvern, PA
1 day ago
Data Engineer
...Data Engineering LeadLocation: Malvern, PA ContractSummary: We are seeking an experienced Tech lead- Data Engineer (15+ years) with a strong background in Java, AWS, Python, PySpark, and event-driven architectures. You will design and build scalable batch and streaming...
AceStack LLC
Malvern, PA
4 days ago
AWS Data Engineer
$55 - $58 per hour
...Job Title: AWS Data Engineer Request-ID:98323-1 Location: Malvern, PA Duration: 6+ months Pay Range: $55.00- 58.00 /Hour We are seeking a highly experienced Senior AWS Data Engineer with expertise in Python, AWS Glue, ETL, and Attunity (Qlik Replicate...
Artech
Malvern, PA
4 days ago
Senior Data Engineer
...Senior Data Engineer – 7+ Years of Experience We are seeking a highly experienced Senior Data Engineer with 7+ years of expertise in designing, building, and optimizing robust data solutions. The ideal candidate must possess top-tier skills in Python, AWS services,...
Samprasoft
Malvern, PA
3 days ago
SENIOR DATA ENGINEER
...ROLE SENIOR DATA ENGINEER INDUSTRY Pharma, Development & Manufacturing DURATION CONTRACT, probable extension LOCATION REMOTE (off-shore or near-shore), Malvern, PA 19355 INTERVIEW MS TEAMS conversation the candidate will be required...
Contract work
Immediate start
Remote work
3B Staffing LLC
Malvern, PA
2 days ago
Data Engineer
...Data Lake 2.0 DeveloperData Lake 2.0 is a multi-year program aimed at modernizing legacy analytics platforms. As we move away from... ...a modernized platform that will be in use by Analysts and Data Engineers. The deliverables will help data consumers and users manage “Data...
Samprasoft
Malvern, PA
4 days ago
Data Engineer
Data EngineerDuration: ContractLocation: Malvern PA (Day 1 onsite) Local OnlyJob Description:AWS Redshift is mandatoryWith SQL, PythonIf someone worked with Apache Iceberg would be greatRegards,Pallavi VermaSr. Technical Recruiter | Syntricate Technologies Inc.
Local area
Syntricate Technologies
Malvern, PA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!