Big Data Developer

Full-time

Techvilla Solutions

We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.

Key Responsibilities

Develop, maintain, and optimize big data applications and data processing pipelines.
Work with Kafka and Apache Spark for real-time and batch data processing.
Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
Write and optimize complex SQL queries using Hive and Impala.
Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
Use Splunk for log analysis, monitoring, and troubleshooting.
Manage and monitor batch workflows and job scheduling using AutoSys.
Work in Linux-based environments for development, deployment, and operational support.
Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
Ensure data quality, reliability, scalability, and performance of big data applications.

Required Technical Skills

Strong hands-on experience with Kafka, Spark, Scala, and SQL.
Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
Proficiency in data analysis and data wrangling for large datasets.
Experience in performance analysis, tuning, troubleshooting, and issue resolution.
Hands-on experience with Splunk and AutoSys.
Strong knowledge of Linux-based infrastructures.
Experience in distributed data processing and big data technologies.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Big Data Developer in Jersey City, NJ vacancy

Big Data Developer
$80k - $130k
...Big Data Developer Must have technical/functional skills: strong experience in Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys. Data analysis and data wrangling skills when dealing with huge volume. Performance analysis, troubleshooting, and resolution...
Big data
Flexible hours
Tata Consultancy Services
Jersey City, NJ
3 days ago
Big Data Developer
...Role: Senior Big Data Developer Work Location: Jersey City, NJ Local only Duration: 6+ Months Job Description Responsible for programming and software development using various programming languages and related tools and frameworks, reviewing code...
Big data
Daily paid
Local area
Relocation
3B Staffing LLC
Jersey City, NJ
3 days ago
Senior Java Big Data Developer - AVP
$121.2k - $181.8k
...solver who seeks passion in your work, come join us. We’ll enable growth and progress together.Citibank is seeking a Senior Java Big Data Developer to design and build core components of the Regulatory Reporting Hub, a Franchise Critical Application that enables the bank...
Big data
Full time
Citigroup
Jersey City, NJ
2 days ago
Big Data Engineer (Only USC & GC)
...of Software Development, Software Consultancy, and Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional...
Big data
Permanent employment
Full time
H1b
Sonsoft
Jersey City, NJ
2 days ago
Senior Big Data Engineer
...and python. They will play a key role in developing and implementing technical solutions using... ...1. Develop and implement data processing frameworks using Apache spark.... ...with the latest trends and advancements in big data technologies. Skill Requirements...
Big data
Omni Inclusive
Jersey City, NJ
1 day ago
Senior Data Engineer
Job-ID: 21623Category: Data ManagementLocation: Jersey City, New Jersey, United StatesWorkplace: Work From... ...HomePosted: 2026-10-16Job Role: Data Engineering-Big Data EngineeringExperience (In Years): 3-6Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake...
Big data
EXL Service
Jersey City, NJ
5 days ago
Data Engineer - Python/PySpark
...Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey... ...building scalable ETL/ELT pipelines in big data environments- Strong understanding of... ...databasesKey Responsibilities*Design, develop, and maintain scalable data pipelines- Process...
Big data
Full time
3 days per week
SRI Tech
Jersey City, NJ
6 days ago
Hadoop and PySpark Data Engineer
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...to uphold the software quality standards Develop user training programs, documentation, and... ...(Cloudera). Experience in working with a Big Data implementation in production environment...
Big data
Full time
Temporary work
Relocation
Infosys Technologies
Jersey City, NJ
4 days ago
Data Engineer
...Django Backend Lead Developer We are seeking an experienced Django Backend Lead Developer to join our team. The ideal candidate will... ...background in backend development, cloud technologies, and big data processing. This role involves leading technical projects, mentoring...
Big data
BAMM Staffing
Jersey City, NJ
5 days ago
Lead Data Engineer
...Hi, Position: Lead Data Engineer Experience Required: 12 years+... ...project risks, dependencies, and issues; develop and execute mitigation plans. Ensure... ...scale projects. ~ Strong expertise in Big Data concepts , distributed systems, and...
Big data
Full time
Centraprise
Jersey City, NJ
5 days ago
Lead Software Engineer- Python / Big Data / AWS/ ETL Pipelines
...approaches to build solutions or break down technical problems Develops secure high-quality production code, and reviews and debugs code... ...and drives the technology roadmap, focusing on next-generation data, analytics, and automation platforms Leads the adoption and...
Big data
Testing Site - JPMC
Jersey City, NJ
1 day ago
Lead Data Engineer
...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions... ...Snowflake, SQL, Python, Spark, AWS-Glue, Big Data Concepts Responsibilities:... ...translate them into technical solutions. Develop and maintain data pipelines, ensuring data...
Big data
Work experience placement
Work at office
3 days per week
Inizio Partners
Jersey City, NJ
2 days ago
Lead Data Engineer
...Lead Data Engineer (Forward Deployed) As a Lead Data Engineer (Forward Deployed) at JPMorganChase... ...anomaly detection, pattern analysis, or big data frameworks such as Hadoop/Spark... ...on smart, driven people like you to develop applications and provide tech support for...
Big data
Contract work
Work at office
Chase
Jersey City, NJ
5 days ago
Principal Software Engineer | Risk Technology Data Strategy, Engineering & Architecture
...Job responsibilities Architect and implement complex, scalable data engineering/ coding frameworks and solutions using modern... ...and skills Deep hands-on experience with Spark/PySpark, other big data processing technologies Experience with modern data technologies...
Big data
Testing Site - JPMC
Jersey City, NJ
1 day ago
AWS Lead Data Engineer (InPerson Interview mandate)
...contract Role Summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader... ..., and data ingestion pipelines on AWS. Proven experience with ETL/ELT processes, data modeling, and big data frameworks....
Big data
Full time
Contract work
Work at office
Arkhya Tech Inc.
Newark, NJ
1 day ago
Data Engineer
...Azure Data Engineer Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service... ...Factory, Azure Databricks, and other Azure services. Fluent with Big Data technologies like Spark, Kafka and Hive. Expert level skills...
Big data
InterSources
Weehawken, NJ
5 days ago
Senior Data Engineer
...to work one-on-one with application and infrastructure developers to build and enhance the data infrastructure and application patterns that power mission... ...Hands‑on experience with ETL, distributed compute, and big data frameworks such as Spark, Glue, Hadoop/EMR, Impala,...
Big data
Full time
EXL
Newark, NJ
1 day ago
Lead AWS Data Engineer
...Lead AWS Data Engineer Contract Opportunity with a Major Investment Firm Location... ...requirements into scalable technical solutions Develop and maintain robust ETL/ELT processes and... ...Strong understanding of data modeling and big data technologies ~ Experience mentoring...
Big data
Long term contract
Contract work
Local area
3 days per week
JSR Tech Consulting
Newark, NJ
5 days ago
(USA) Senior, Data Scientist
$117k - $234k
.../PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: As a Senior Data Scientist in the team, you will have the unique opportunity to leverage the power of technology, big data and analytics to improve the lives of the 100M+ households that shop at Walmart...
Big data
Full time
Temporary work
Part time
Walmart
Hoboken, NJ
6 days ago
Lead Data Scientist - Finance Technology
...challenges across multiple technologies and applications. As a Lead Data Scientist in our Finance Technology team, you will play a pivotal... ...building ML models in a cloud environment. Experience with Big Data Platforms such as Hadoop. Outstanding written/verbal...
Big data
Testing Site - JPMC
Jersey City, NJ
1 day ago
AWS Data Engineer
...AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration: 24 months Must... ...for Data Journey USBIE ~ Experience developing and deploying application code using SQL,... ...scripts ~ Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment...
Big data
Damco
Newark, NJ
5 days ago
Data Engineer - Hybrid
...Data Engineer Position Looking for data engineers with 9+ years of experience. Experience developing and deploying application code using SQL, Python, spark. 3 to 5 years' experience... ...shell scripts. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment...
Big data
Cedent Life Talent
Newark, NJ
5 days ago
Sr. Data Engineer
...Role: Sr. Data Engineer Hybrid model( Client location, Newark, NJ) Visa: GC, Citizen Required Qualifications:... ...pipelines in AWS. Knowledge of ETL/ELT, data modeling, and big data technologies. Familiarity with data warehousing concepts...
Big data
ClifyX
Roseland, NJ
2 days ago
AWS Lead Data Engineer
...Job Description Position: AWS Lead Data Engineer Location: Newark, NJ – Hybrid... ...provide technical leadership and design, develop, and optimize scalable data solutions on AWS... ...Data Warehouses, ETL/ELT, Data Modeling, and Big Data frameworks Experience with DevOps...
Big data
SpikeIT Global Solutions, Inc.
Newark, NJ
22 days ago
Hadoop and PySpark Data Engineer
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...to uphold the software quality standards Develop user training programs, documentation, and... ...(Cloudera). Experience in working with a Big Data implementation in production environment...
Big data
Full time
Temporary work
Relocation
Infosys Technologies
Newark, NJ
4 days ago
Data Analytics Engineer
...Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in... ...Key Responsibilities • Design, develop, and maintain scalable ETL/ELT pipelines...
Big data
Diverse Lynx
Secaucus, NJ
4 days ago
(USA) Principal, Data Scientist
$132k - $264k
...interact with multiple teams within the company to develop scalable, robust technical solutions. The data scientist role will be part of the data science team... ..., Kubeflow, model deployment.Strong experience with big data platforms Hadoop (Hive, Map Reduce, HQL, Scala)...
Big data
Full time
Temporary work
Part time
Flexible hours
Walmart
Hoboken, NJ
6 days ago
Senior Big Data Engineer
...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior... ...of our data initiatives. Responsibilities: Design, develop, and implement scalable data pipelines and ETL processes using...
Big data
Zortech Solutions
Elizabeth, NJ
5 days ago
AWS Lead Data Engineer
...summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team... ...-based data lakes and data warehouses. 6. Develop and enforce standards for data quality,... ...ETL or ELT processes, data modeling, and big data frameworks. 16. Demonstrated ability...
Big data
For subcontractor
Work at office
Local area
Shift work
Omni Inclusive
Newark, NJ
4 days ago
Senior AWS Data Engineer
...About the job Senior AWS Data Engineer Role Overview: Lead the design, development... ...-based data lakes and data warehouses. Develop and enforce standards for data quality,... ...with ETL, distributed compute, and big data frameworks such as Spark, Glue, Hadoop...
Big data
Inizio Partners
Newark, NJ
19 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!