Big Data Engineer

VDart

Job Title: Big Data Engineer

Location: Basking Ridge, NJ (5-day onsite/week)

Duration : 6 Months

Job Responsibilities:

Design and lead end-to-end data integration
Perform performance tuning, diagnose, and resolve complex big data and streaming technical issues.
Design and implement scalable solutions across the technology stack, including data processing, database, web services, network, and security layers.
Perform integration testing and provide support to QA teams on large-scale projects.
Contribute to requirements analysis, project estimation, system design, coding, and testing.
Evaluate and implement appropriate third-party libraries and software to enhance product capabilities.
Stay current with emerging techniques and trends in big data and AI/ML.

Job Requirement:

5+ years of hands-on experience designing and implementing data applications in production using Java, Python, or Scala on big data platforms, with deep expertise in big data technologies and data optimization techniques.
5+ years of hands-on experience with streaming technologies, specifically with a strong focus on Kafka, and various open-source software platforms (e.g., Apache ecosystem, Linux).
Proven ability to optimize data flow and design efficient, scalable data pipelines, including data lakes and warehouses on containerized clusters.
Strong understanding of distributed data architecture concepts (e.g., caching, MapReduce, stream processing).
Solid knowledge of data security, governance, and compliance.
Proficiency in programming languages: Java, Python, Scala, and SQL.
Strong analytical capabilities, creativity, and critical thinking skills.
Effective written and verbal communication, with the ability to facilitate team collaboration.

Apply

Vacancy posted 1 hour ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in Basking Ridge, NJ vacancy

Data Engineer
...3 Technology|Cloud Platform|GCP Data Analytics Technical Skills 4... ...Technical Skills 5 Technology|Big Data|Oracle BigData Appliance Salary... ...117943 Overview The Infosys Engineering unit is dedicated to amplifying product-centric...
Big data
Full time
Temporary work
Relocation
Infosys
Basking Ridge, NJ
1 day ago
Big Data Engineer
...Job role : Big Data Engineer Duration : 6 Month Contract to hire Location : Remote primary once a month onsite (in the beginning) to Parsippany, NJ Job Responsibilities: Client is seeking a Big Data Engineer to build and operate our...
Big data
Contract work
Remote work
VDart
Parsippany, NJ
4 days ago
Data Engineer
$50 - $55 per hour
...understanding of software development life cycle. Experience in performance tuning and optimization techniques. Knowledge of big data concepts and tools is a plus. Relevant certifications in Apache Spark, Scala, or Python are a plus. Responsibilities:...
Big data
Cynet Systems
Raritan, NJ
3 days ago
Lead Data Engineer
...environment 7. Strong organizational and leadership abilities 8. Experience in performance tuning and optimization techniques 9. Knowledge of big data concepts and tools is a plus Certifications: Relevant certifications in apache spark, scala, or python are a plus
Big data
Omni Inclusive
Whippany, NJ
2 days ago
Data Engineer
...ETL Talend Developer (Data Engineer)Design and implement cloud-native architectures that will allow business requirements to be met with a... ...any one of the technical platforms (JAVA, Microsoft, Azure, AWS, Big data Stack etc.,).Understand the enterprise architecture roadmap...
Big data
Keylent Inc
Berkeley Heights, NJ
2 days ago
Data Engineer (Hybrid)
$96.5k - $183.5k
...Data Engineer AbbVie's mission is to discover and deliver innovative medicines and solutions that solve serious health issues today and... ...C++, C#, Swift/Objective C, or JavaScript ~ Experience with Big Data Management, Master Data Management tools & SQL Preferred...
Big data
Temporary work
Work at office
Local area
Immediate start
Remote work
Monday to Friday
AbbVie
Florham Park, NJ
2 days ago
Lead Data Engineer
...position sits within the newly consolidated Data and Analytics (D&A) organization... ...data infrastructure, data governance, data engineering, data modeling, data analysis to business... ...framework. The Lead Data Engineer serves as a big data development expert within the D&A...
Big data
Temporary work
Work at office
Local area
3 days per week
MetLife
Bridgewater, NJ
3 days ago
Data Engineer
$189.6k
...test potential use cases for the business. Involve in application development during application design for highly complex data project. Re-engineer python/Pyspark functions to perform suppression on customer data based on business logic. Optimize ETL workflows using...
Full time
Relocation
Shift work
Day shift
Ascendion Inc.
Basking Ridge, NJ
1 day ago
Data Engineer - Hybrid
...intelligence needs and the associated enabling technology requirements. Lead the technology activities to enable the delivery of meaningful, actionable, data-driven capability in alignment with business strategies. Develop and lead the execution of the data and analytics......
The Dignify Solutions, LLC
Warren, NJ
3 days ago
Data Engineer
Build Your own Job Description! Data Engineers at Incedo build and maintain the data systems and convert raw data into usable information for analytics and business decision-making that impact Fortune 20 customers. To succeed in the Data Engineering position, you should...
Qode
Florham Park, NJ
20 hours ago
Data Engineer
$80.42k - $106.05k
...Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues around the world, and where you'll be able to reimagine...
Permanent employment
Full time
Contract work
Local area
Flexible hours
Capgemini
Bridgewater, NJ
2 days ago
Data Engineer
...Data Engineer Location Madison, NJ (Hybrid) Seeking an Associate Principal experienced in Python, Java, and Azure Data Factory to lead advanced data solutions. Job Description Design and implement data pipelines with Azure Data Factory Build scalable...
United IT
Madison, NJ
4 days ago
Senior Data Engineer
$80.42k - $106.05k
...Senior Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues around the world, and where you'll be able to reimagine...
Permanent employment
Full time
Contract work
Local area
Flexible hours
Capgemini
Bridgewater, NJ
2 days ago
Databricks Data Engineer
...Role description We are looking for a highly motivated Data Engineer with strong expertise in Databricks and modern data engineering practices The ideal candidate should have handson experience in building scalable data pipelines notebooks implementing CICD processes...
LTM
Raritan, NJ
4 days ago
Data Engineer
$130k
...Data Engineer Location: Warren, NJ (Hybrid from day 1) Fulltime: $130 K Experience in data engineering tools like Spark, Hadoop, Azure Data pipelines, Azure Data factory, Azure Data Lake Storage, Databricks, Delta Lake, Python, SQL Server, and experience with...
Full time
E-Solutions
Warren, NJ
3 days ago
Senior Data Scientist
$130k - $160k
...Senior Data Scientist At Nestlé Health Science, we believe that nutrition, science, and... ...solve critical business problems using big data technologies like Databricks, Azure ML... ...experience as a Data Scientist, Machine Learning Engineer, or Applied Scientist, specializing in...
Big data
Remote work
Nestle Health Science
Bridgewater, NJ
3 days ago
AI/ML Engineer
...AI/ML Engineer Location: Plano, TX or Houston, TX or Morris Plains, NJ, (Hybrid) Duration... ...SQL queries to extract and analyze data) Has a thorough understanding of the technology... ...Cloud Platform, is a plus. Experience with big data technologies, such as Apache Spark,...
Big data
Contract work
Immediate start
Damco
Morris Plains, NJ
4 days ago
Lead Data Engineer
$103.33k - $128.66k
...Lead Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by?a collaborative community of colleagues around the world, and where you'll be able to reimagine...
Permanent employment
Full time
Contract work
Local area
Flexible hours
Capgemini
Bridgewater, NJ
2 days ago
Lead Data Engineer
...Data Engineer Must have skills Azure Cloud, MS Fabric, ADF, Azure SQL, Snyapse, DBT Preferred skills Data Mesh implementation, Insurance domain Designs, builds, and maintains scalable data pipelines and architectures, leading a team to deliver robust data solutions...
Omni Inclusive
Warren, NJ
4 days ago
Data Security Engineer
$109k - $182.4k
...Data Security Engineer Calling all innovators - find your future at Fiserv. We're Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world. We connect financial institutions, corporations, merchants and consumers...
Temporary work
H1b
Work at office
Monday to Friday
BentoBox
Berkeley Heights, NJ
5 days ago
Lead Data Engineer
$110.84k - $145k
...Lead Data Engineer Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine...
Local area
Flexible hours
Capgemini
Whippany, NJ
1 hour ago
Principal Data Engineer
...Principal Data Engineer Location: Warren, NJ. (2-3 days in-office) Duration: 6+ months Mode of interview: 2 videos Key Responsibilities Lead the architecture, design, and delivery of scalable enterprise data platforms using Azure Databricks, Delta Lake,...
Work at office
Echo IT Solutions
Warren, NJ
4 days ago
Ab Initio Data Engineer
...Qualifications ~ Bachelor’s degree in Computer Science, Engineering, or related technical field. ~7+ years of ETL development experience... ...Enterprise Meta ~ Environment (EME) ~ Conduct ~ It ~ Data Profiler and Continuous Flows Strong understanding of...
Permanent employment
Temporary work
PB consulting
Berkeley Heights, NJ
a month ago
Lead Data Migration Engineer
$103.33k - $128.66k
...About The Role Stock Plan Services, an equity compensation services division of client, is seeking an experienced Lead Data Migration Engineer who can lead enterprise-wide data migration strategy, architecture, and execution. Drives large-scale migrations across...
Full time
Local area
Flexible hours
Capgemini
Bridgewater, NJ
a month ago
Senior Manager, Artificial Intelligence Data Engineer
...Data Engineer Global Development is embarking on a Digital Transformation project incorporating AI, machine learning, and automation to help us reduce cycle times, improve quality allowing us to focus on more meaningful work. We focus on developing and improving data...
Worldwide
Regeneron
Warren, NJ
2 days ago
Data Scientist
...The Data Scientist will work in the client group as part of the Data Science Team, and focus on a variety of Data Science projects across the board leveraging data from multiple internal R&D Systems and external Data Vendors enabling Data Driven culture across all R&D...
2 days per week
3 days per week
Aequor Technologies
Basking Ridge, NJ
20 hours ago
Data Scientist
$55 - $65 per hour
...Our client, a leader in the telecom industry, is seeking a Data Scientist to join their team. As a Data Scientist, you will be part of the Data Analytics Department supporting innovative AI/ML model deployment and lifecycle management. The ideal candidate will demonstrate...
Weekly pay
Temporary work
Flexible hours
Manpower Group Inc.
Basking Ridge, NJ
3 days ago
Technical Program Manager
...Application Development and Production support for a portfolio of data and analytics applications Must have about 10+ years of... ...contribute in Solution Design and Solution Architecture for implementing Big Data Projects Mandatory Requirements Hands on experience...
Big data
The Dignify Solutions, LLC
Raritan, NJ
3 days ago
Quantitative Data Engineer
$150k - $250k
This position is part of our Data Technology team and will help implement, enhance, and manage our quantitative models. Primary responsibilities... ...repository and financial data platforms. The Quantitative Data Engineer will work closely with quantitative research and portfolio...
Jacobs Levy Equity Management
Florham Park, NJ
more than 2 months ago
Data Analyst
...Data Analyst Onsite to start and then hybrid (3 days onsite, 2 remote) in Raritan NJ supporting J&J Supply Chain 1 year+ contract... ...financial markets and investment principles. o Familiarity with big data technologies like Hadoop or Spark. Technical Skills:...
Big data
Contract work
Remote work
Software Technology Inc
Raritan, NJ
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!