Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Elizabeth, NJ vacancy
$121.2k - $181.8k
...solver who seeks passion in your work, come join us. We’ll enable growth and progress together.Citibank is seeking a Senior Java Big Data Developer to design and build core components of the Regulatory Reporting Hub, a Franchise Critical Application that enables the bank...Big dataFull timeCitigroup
Jersey City, NJ3 days ago- ...of Software Development, Software Consultancy, and Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional...Big dataPermanent employmentFull timeH1b
Sonsoft
Jersey City, NJ3 days ago - We are seeking a skilled Data Engineer with 5-7 years of experience in designing developing and maintaining scalable data pipelines and data platforms The ideal candidate... ...data warehousing cloud technologies SQL and big data ecosystems The role involves working closely...Big data
LTM
Jersey City, NJ3 days ago - ...Full TimeCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey... ...Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of... ...databasesKey Responsibilities*Design, develop, and maintain scalable data pipelines-...Big dataFull time3 days per week
SRI Tech
Jersey City, NJ2 days ago - Job-ID: 22196Category: Data ManagementLocation: Jersey City, New Jersey, United StatesWorkplace... ...will be responsible for designing, developing, and maintaining scalable data pipelines... ...Knowledge of ETL/ELT, data modeling, and big data technologies.Familiarity with data...Big data
EXL Service
Jersey City, NJ4 days ago - ...Description Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience... .... Key Responsibilities " Design, develop, and maintain scalable ETL/ELT pipelines using...Big data
Diverse Lynx
Secaucus, NJ5 days ago $82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...to uphold the software quality standards Develop user training programs, documentation, and... ...Cloudera). • Experience in working with a Big Data implementation in production environment...Big dataFull timeTemporary workRelocationInfosys Technologies
Jersey City, NJ22 hours ago- JPMorgan Chase in New Jersey seeks a Lead Software Engineer within Corporate Technology to drive design, development, and troubleshooting of trusted tech products across multiple business functions. You will contribute to secure, scalable production code and collaborate...Big data
Testing Site - JPMC
Jersey City, NJ2 days ago - ...Microsoft Fabric Data Engineer Newark, New Jersey, United States Data Management and... ...and ETL (Extract, Transform, Load) Develop and implement data integration processes using... ...it into data warehouses or data lakes. Big Data and Analytics Utilize big data...Big data
5 Star Global Recruitment Partners
Newark, NJ3 days ago - ...AWS Lead Data EngineerInterview Process: at least 2 rounds Round 1 – Virtual technical... ...Candidate should have grown from a Data Engineer/Developer into a Lead role.Although this is a... ...ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to...Big dataWork at office3 days per week
Anveta
Newark, NJ3 days ago - ...Technical/Functional Skills • 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development. • 5+ years of hands-on experience... ...skills. Roles Responsibilities • Design, develop, and maintain data pipelines using Databricks, Python,...Big data
PB consulting
Linden, NJ2 days ago $70 - $75 per hour
...opportunity to work one-on-one with application and infrastructure developers to build and enhance the AI/ML infrastructure and application... ...Groups, KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark,...Big dataFull timeContract workRemote work$32.36 - $50.56 per hour
We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team The... ...will be responsible for designing developing and maintaining scalable data pipelines and... ...AWS Knowledge of ETLELT data modeling and big data technologies Familiarity with data...Big data- Job ID: 28709035Reference Number: 26-00594Title: Sr. Data Engineer/ Data ArchitectLocation: Iselin, NJ, 08830Posted Date: 2026-06-23Contact... ...Strong understanding of data modeling, data warehousing, and big data processing Experience with data quality, monitoring, and pipeline...Big dataFull time
HAN Staffing
Iselin, NJ6 days ago $117k - $234k
.../PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: As a Senior Data Scientist in the team, you will have the unique opportunity to leverage the power of technology, big data and analytics to improve the lives of the 100M+ households that shop at Walmart...Big dataFull timeTemporary workPart timeWalmart
Hoboken, NJ2 days ago$82.6k - $162.8k
...growth through innovation. Work You’ll Do As a hands-on Core Data Engineer III on the AI & Data team, you will own the human-facing... ...offering provides a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights...Live inLocal areaDeloitte
Jersey City, NJ4 days ago- ...Data Scientist Integrated Resources, Inc., is led by a seasoned team with combined decades... ...and working with technologists to develop the process to transform raw data into business... ...language or similar • Knowledge of big data platforms such as Hadoop, Aster, etc....Big dataFull timeImmediate start
Integrated Resources
Newark, NJ3 days ago - ...Job Description Job Description Contract Cloud Data Engineer MUST be local to Iselin, NJ,... ...for ingestion, transformation, and loading. Develop and deploy Spark/PySpark programs and Databricks jobs for big data workloads. Write robust Python and SQL code...Big dataContract workLocal area
Shulman Fleming & Partners
Iselin, NJ2 days ago $132k - $264k
...interact with multiple teams within the company to develop scalable, robust technical solutions. The data scientist role will be part of the data science team... ..., Kubeflow, model deployment.Strong experience with big data platforms Hadoop (Hive, Map Reduce, HQL, Scala)...Big dataFull timeTemporary workPart timeFlexible hoursWalmart
Hoboken, NJ2 days ago- ...We are looking for a passionate EDI Developer who will be predominantly involved in developing solutions by creating new and modifying... ...Maintain detailed documentation of EDI processes, API specifications, data mapping and integration workflows. Configure and implement...Full time
Infotree Global Solutions
Secaucus, NJ1 day ago $108k - $216k
...Position Summary... What you'll do... Role summary: As a Senior Data Scientist in the team, you will have the unique opportunity to leverage the power of technology, big data and analytics to improve the lives of the 100M+ households that shop at Walmart every...Big dataFull timeTemporary workPart timeWalmart
Hoboken, NJ1 day ago$125.4k - $182.6k
...Sr. Data Scientist The North America Data Analytics team at Chubb is seeking a Sr. Data... ...Machine Learning capabilities, you will develop solutions to complex business problems which... ...functions ~ Hands-on experience with big data technologies and cloud (Databricks /...Big dataFull timeTemporary workLocal areaChubb
Jersey City, NJ2 days ago- ...solve critical business problems.Drive availability of relevant data, tools, and infrastructure to facilitate for experimental and development... ..., and natural language processing, preferred.Familiarity with Big Data processing and platforms desirable.Strong knowledge in at...Big dataFull timeTemporary workFor contractorsWork experience placementFor subcontractorLocal areaImmediate start
Financial Industry Regulatory Authority
Woodbridge, NJ4 days ago - ...Python Developer E*Pro /Sensiple Consulting service offerings include contingent Staff Augmentation of IT professionals, Permanent... ...deadlines and a dynamic environment ~ Hands on experience with Big Data technologies strongly desired ~ BigData technology...Big dataPermanent employmentContract workTemporary workWork experience placement
E-Pro
Jersey City, NJ1 day ago - ...Sumsub Inc. is hiring a Senior Analytics Engineer to fortify the data foundation behind its anti-fraud capabilities. You will design and evolve data models used for fraud analytics and measure detection performance across products and clients. You will work hands-on...Remote work
Sumsub Inc.
Union, NJ22 hours ago - ...Onsite a Week) Contract: 6-24 months to perm Must have: Python, RDS (must have), Spark, and SQL Nice to have : Pyspark Experience with Big Data platforms/tools (Linux, HDFS, Hive, Hortonworks, Spark, Scala, Python, Java, Kafka, etc.) Experience with API’s, reading from and/...Big dataPermanent employmentContract work3 days per week
DATAEXL INFORMATION LLC
Woodbridge, NJ2 days ago $143k - $286k
...Segment: Home OfficeWe are seeking a Staff Data Scientist with a strong foundation in... ...will be responsible for architecting and developing new Machine Learning models to enhance Customer... ...to support project goals.Utilize big data analytics and advanced data science...Big dataFull timeTemporary workPart timeWalmart
Hoboken, NJ22 hours ago$105.79k - $141.05k
...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and... ...defensive, business, and executive stakeholders. ~ Experience developing security tools, exploits, payloads, automations, and new Red Team...Full timeTemporary workRemote workLumen
Elizabeth, NJ22 hours ago$65 per hour
...Role : Senior Data Engineer (Big Data Lead) Location: PA/NJ Job Description Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems Participate in all aspects of the software...Big data- ...Job Description Looking for data engineers with 9+ years of experience. 1. Experience developing and deploying application code using SQL, Python, spark. 2.... ...shell scripts. 6. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment....Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
