Data Engineer

Vforce Infotech is looking for a Data Engineer in Edison, NJ (onsite) to design, develop, and maintain scalable data pipelines and platforms that support advanced analytics, business intelligence, and machine learning initiatives. Responsibilities Develop, implement, and optimize ETL (Extract, Transform, Load) pipelines to move data from multiple sources into centralized data warehouses and data lakes , using Informatica , Talend , or custom scripting. Design and maintain scalable data models and schemas using dimensional modeling to improve query performance in SQL environments including Microsoft SQL Server , Oracle , and cloud-based platforms such as Azure Data Lake and AWS Redshift . Build and manage big data systems with Hadoop ecosystem components including Apache Hive and Spark to process large volumes of structured and unstructured data. Partner with cross-functional teams to integrate linked data sources and apply data management best practices across public cloud platforms including Azure Data Lake and AWS Cloud . Develop RESTful APIs and automate workflows using Bash (Unix shell scripting) or Python to improve data access and pipeline automation. Support business intelligence by creating dashboards, reports, and visualizations using tools such as Looker to communicate insights to stakeholders. Contribute in agile development cycles to improve the data infrastructure, focusing on high availability , security , and compliance with organizational standards. Requirements Proven experience designing and implementing large-scale big data systems using Hadoop , Spark , Hive , or similar frameworks. Strong SQL skills, including experience with Microsoft SQL Server , Oracle , and cloud-based options such as Azure Data Lake and cloud databases. Hands-on ETL experience using tools such as Informatica or Talend , with knowledge of cloud-native ETL solutions considered a plus. Knowledge of data modeling techniques, including dimensional modeling for data warehousing. Programming experience with languages including Python and Java for data engineering software development tasks. Experience with AWS and Azure , particularly public cloud storage solutions and big data services. Understanding of analytics concepts such as model training , query management , analysis practices, and business intelligence tools like Looker . Familiarity with shell scripting (Bash) , RESTful API development, and Linux/Unix environments for automation. Technologies ETL, Informatica, Talend, custom scripting Dimensional modeling, SQL Microsoft SQL Server, Oracle, Azure Data Lake, AWS Redshift Hadoop, Apache Hive, Spark RESTful APIs, Bash, Python Looker, AWS, Azure, AWS Cloud Linux/Unix Role Summary Vforce Infotech is seeking a Data Engineer to help drive data-driven decision-making across the organization. The role focuses on building and maintaining scalable data pipelines and systems for advanced analytics, business intelligence, and machine learning. The position emphasizes leveraging big data platforms, cloud technologies, and modern data management practices to deliver actionable insights and support a data-centric culture. Experience Proven experience designing and implementing large-scale big data systems using Hadoop, Spark, Hive, or similar frameworks. Strong proficiency in SQL and experience with Microsoft SQL Server, Oracle, and cloud-based options such as Azure Data Lake or cloud databases. Hands-on ETL development experience with tools such as Informatica or Talend, with familiarity with cloud-native ETL solutions noted as a plus. Solid understanding of data modeling techniques, including dimensional modeling for data warehousing. Expertise in programming languages such as Python and Java for data engineering tasks. Experience working with cloud platforms (AWS, Azure) with emphasis on public cloud storage solutions and big data services. Knowledge of analytics concepts including model training, query management, analysis skills, and business intelligence tools such as Looker. Familiarity with Bash, RESTful API development, and Linux/Unix environments for automation. Compensation and Location Location: Edison, NJ (onsite) Salary: USD 60,000 - 80,000 per year #J-18808-Ljbffr Vforce Infotech