Big Data Engineer
RIT Solutions, Inc.
Big Data Engineer
Hybrid - Malvern, P
Responsibilities
Hybrid - Malvern, P
Responsibilities
- Writes ETL (Extract / Transform / Load) processes, designs database systems, and develops tools for real-time and offline analytic processing.
- Troubleshoots software and processes for data consistency and integrity.
- Integrates data from a variety of sources for business partners to generate insight and make decisions.
- Translates business specifications into design specifications and code.
- Responsible for writing programs, ad hoc queries, and reports.
- Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse.
- Partners with internal clients to gain a basic understanding of business functions and informational needs.
- Gains working knowledge in tools, technologies, and applications/databases in specific business areas and company-wide systems.
- Participates in all phases of solution development. Explains technical considerations at related meetings, including those with business clients.
- Tests code thoroughly for accuracy of intended purpose.
- Reviews end product with the client to ensure adequate understanding. Provides data analysis guidance as required.
- Provides tool and data support to business users and fellow team members.
- Tests and implements new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production.
- Participates in special projects and performs other duties as assigned.
- 1-3 years Data Engineering Experience with SQL, Python & AWS
- Experience with CI/CD and Jira. Experience with Data Quality
- Experience with setting up lineage
- Undergraduate degree or equivalent combination of training and experience.
Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Malvern, PA vacancy
- ...creation and deployment, testing, analyzing, and cleansing large data files Qualifications Expert in SQL AWS S3 and Glue... ...Skills : Data Warehouse Basic Qualification : Additional Skills : Big Data Background Check : No Drug Screen : NoBig data
Procyon TS
Malvern, PA11 hours ago - ...Trading Analytics And Strategy Engineer Client's Trading Analytics and Strategy (TAS) team... ...passive as well as active mandates, to conduct data-driven analyses and build tools to help... ...and investment data Experience in big data technologies such as Spark and developing...Big data
Samprasoft
Malvern, PA1 day ago - ...company in King of Prussia, PA is seeking a candidate with over 4 years of experience in software design, specializing in Data Ingestion, Streaming, and Big Data technologies. The role requires a Bachelor’s degree or equivalent experience in IT and strong skills in Agile...Big dataPermanent employmentFull time
- ...software design, development, and release. This full-time, permanent position requires strong analytical skills and familiarity with Big Data technologies and agile methodologies. Ideal candidates will possess a Bachelor’s degree or equivalent experience and must have...Big dataPermanent employmentFull timeH1b
- ...experience in software design, development and release. Well versed with agile development methodologies. Experience in Data Ingestion, Streaming and Big Data technologies. Excellent communication and stakeholder management Ability to work with distributed teams. Exposure...Big dataPermanent employmentFull timeH1b
- Vanguard is seeking an experienced Data Engineer to join the B2B AI and Data Engineering team. In this hands-on role, you will design, build, and operate scalable data pipelines and data products that support analytics, AI, and critical business functions. You will provide...Full time
Vanguard
Malvern, PA2 days ago - ...Details given below:- Role:-ETL Data Engineer Malvern, PA Charlotte, NC Phoenix, AZ JD:- • Writes ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing....
Trinity Technology Solutions
Malvern, PA2 days ago $71.96 - $75.75 per hour
...designing and delivering enterprise-scale data platforms, cloud modernization... ...solutions, and collaborate with business, engineering, and enterprise stakeholders to enable data... ...Catalog, DLT, Databricks SQL, MLflow •Big Data: Spark, PySpark, Scala, Kafka, Streaming...Big dataVarite, Inc
Malvern, PA3 days ago- The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics. They will be responsible for conducting both recurring and ad hoc analysis for business users. Responsibilities Understand the day-to-day...Big dataFull time
- ...growing Inc 500 Companies in the US, providing enhanced IT consulting, and engineering solution services from past 16 years. Saxon global specializes in Business Intelligence, Mobility, Big Data & Cloud and provides IT tools and services to help organizations across industry...Big data
- ...provide budgeting/financial flexibility by offering contingent labor as a variable cost.Job DescriptionLooking for a Sr. Network / Data Engineers with the Largest Pharma company in USA.Immediate Interview and Hire, Multiple positions open.Position will design and implement...Contract workWork at officeImmediate startFlexible hours
Artech
Collegeville, PA3 days ago - As a Data Science Engineer at Qlik, you'll be an integral part of the Global Support team, dedicated to empowering customers to deploy data science solutions using our automated machine learning platform, Qlik AutoML. You'll play a crucial role in educating customers on...Remote job
- ...office. (3 days in office) The Senior Data Scientist plays a critical role within... ...Governance Collaborate with IT and data engineering teams to ensure data infrastructure is... ...programming languages such as Python and SQL, and big data technologies like Databricks....Big dataWork at office
- Job Description: Job title: WFH-TEMP - .NET FULL STACK DEVELOPER Job summary: Cognizant Technology Solutions is seeking a Full Stack Dot Net Developer to join our team of IT professionals in a permanent role. If you meet our background requirements and skills and are looking...Permanent employmentTemporary workWork from homeShift work
- ...Job Description Job Description ROLE_DESCRIPTION - Payrate 60/hr Overview: We are seeking an experienced AWS Data Engineer with expertise in ETL processes, AWS Lambda, Redshift, and proficiency in Python and PySpark. This role requires hands-on experience with...
- ...Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.... ...Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level...
- SID Global Solutions is seeking a data analytics professional to work with large-scale datasets and perform data mining, ETL, and visualization tasks. The role emphasizes SQL expertise, data storytelling, and reporting using tools like QuickSight/Tableau/PowerBI. The ideal...
- The Boeing Company in Ridley Park, PA is seeking an Experienced Quality Engineer to drive data-driven quality improvements on the MH-139 program. You will apply SQL/Python analytics, create dashboards with Tableau/PowerBI, and lead root-cause analysis to strengthen quality...Day shift
- ...Description Job Description Our firm has been engaged by a growing, data-centric healthcare technology and services organization that... ...environment and is looking to add a Senior Director of Data Engineering & Architecture to define technical direction, strengthen the...Full timeRemote work
Spinnaker Search
Wayne, PA22 days ago - ...and the ability to thrive in a fast-paced Agile environment. Responsibilities include ETL/Reports validation, test automation, and Big Data testing using Hadoop. Lead experience is a plus. The position is for a duration of 12 months. #J-18808-Ljbffr Artech Information...Big data
- ...platforms (i.e. DW, ETL, and Reporting). Build new OLAP data model designs and ETL processes. Estimate engineering effort, plan implementation, and rollout system... .... Strong understanding of data warehousing or big data platform concepts like ETL best practices,...Big data
ClifyX
King of Prussia, PA1 day ago - ...Overview This is a hybrid role - 2 days remote and 3 days in the Malvern, PA office. CubeSmart is seeking a Manager, Data Engineering to lead the team responsible for building and evolving the enterprise data platform that powers analytics, reporting, AI, and...Work at officeRemote work
- ...tools (or) SQL Server tools/services like SSRS/SSAS/TSQL/MDX · Support ETL/Reports Validation, test automation and test data generation · Support Big Data Testing, Hadoop, MapR etc.. · SUPERB communication skills (speaking, listening, writing and interpreting) · Comfortable...Big dataImmediate start
- ...manage capital and looking for an intern to help with data science, data sourcing, and data engineering, who are responsible for the discovery, management, and... ...Data engineering proficiency is desired using AWS/big data services (i.e., EMR, Glue, Redshift) Experience creating...Big dataInternship
- ...Azure Senior Data Lead with Azure Data Factory (ADF),Azure Databricks,SQL,Oracle PL/SQL,Python Job Summary The Senior Technical... ...Stay uptodate with the latest trends and technologies in data engineering and analytics. Skill Requirements 1. Proficiency in...
Omni Inclusive
West Chester, PA4 days ago - ...findings and ideas in plain language; Being able to work in teams towards a shared goal; Ability to change direction quickly based on data analysis; Discovering and solving problems; Proactively seeking clarification of requirements and direction; take responsibility...Big data
- ...growing Inc. 500 Companies in the US, providing enhanced IT staffing, consulting, and engineering solution services. Saxon global specializes in Business Intelligence, Mobility, Big Data & Cloud and provides IT tools and services to help organizations across industry...Big dataContract workFor contractors
Saxon Global
Wayne, PA1 day ago - ...scalable, resilient, and reusable AI systems capable of supporting mission-critical workloads. Establish architectural standards, engineering patterns, and best practices for AI deployment and operations. Drive technical decisions around model serving, inference...Full time
Vanguard
Malvern, PA1 day ago $58 - $65 per hour
A leading healthcare payor is seeking an Azure Data Engineer to spearhead data innovation efforts. This role includes designing and implementing end-to-end data solutions using Azure Databricks, converting SQL workflows to Python pipelines, and ensuring data quality and...- SAP Next Gen is seeking a working student to contribute to data engineering initiatives in Newtown Square. You’ll build production data pipelines, create and optimize data models, and develop REST APIs and integrations using Azure services, Power BI, and SAP Analytics...Internship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Malvern, PA
- data science developer Malvern, PA
- data center engineer Malvern, PA
- data developer Malvern, PA
- data engineer machine learning Malvern, PA
- aws data engineer Malvern, PA
- data engineer Malvern, PA
- data engineer analytics Malvern, PA
- etl data engineer Malvern, PA
- finance data engineer Malvern, PA