Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Paramus, NJ vacancy
- ...Big Data Developer Location: Strongsville OH / Pittsburgh PA / Dallas TX Duration: Full Time Job Description: Bigdata Hadoop & ecosystem, Scala/Python, PySpark. Oracle PL/SQL, CI/CD, Excellent communication, Data Lake, Informatica, Teradata. Roles...Big dataFull time
JConnect Infotech
Passaic, NJ3 days ago - ...Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in... ...Key Responsibilities • Design, develop, and maintain scalable ETL/ELT pipelines...Big data
Diverse Lynx
Secaucus, NJ1 day ago - ...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior... ...of our data initiatives. Responsibilities: Design, develop, and implement scalable data pipelines and ETL processes using...Big data
Zortech Solutions
Passaic, NJ2 days ago - ...disciplines, such as Computer Science or Mathematics. Candidates must possess strong skills in SQL, Java, and Python, and experience in data extraction using technologies like MapReduce. The role involves building machine learning models and presenting findings clearly....Big data
$60 - $62 per hour
...FlashSystem, and Pure Storage FlashArray Expert knowledge of enterprise data protection platforms, including: Dell Avamar, Dell Data Domain,... ...of a centralized enterprise storage inventory system, (2) Develop integrations between the inventory platform and enterprise...SuggestedHourly payRemote workFlexible hours- ...helping our customers become smarter shippers - shipping to their customers faster, cheaper, and with fewer delivery exceptions. We use big data, automation, and advanced analytics to help our customers remove inefficiencies in their global transportation spend. The IT...Big dataWork at officeLocal areaRemote workVisa sponsorshipFree visa
- ...Job Description Job Description Data Architecture and Governance Lead Our client... ...implementing data architecture strategies, developing enterprise-wide data models, and... ...PowerDesigner, Erwin). - Knowledge of big data technologies (e.g., Hadoop, MongoDB)...Big data3 days per week
Highbridge Consulting LLC
Paramus, NJ4 days ago - Software Guidance & Assistance, Inc., (SGA), is searching for a Java/Data Developer for a contract assignment with one of our premier financial... ...out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year...Contract work
- ...Tableau Developer 3days/week onsite –Open at these locations : (Tampa FL / Irving TX / Rutherford... ..., Sybase, Oracle, SQL Server, MongoDB, data warehousing, performance tuning,... ...using Tableau dashboards using Sybase / Big Data as backend technologies. Integrate...Big dataFull timeContract work
Dexian
Rutherford, NJ4 days ago - ...of care. The organization combines trusted educational content, data, and innovative technology to support more informed healthcare experiences... ...through transformation into analytics-ready datasets. Develop and improve orchestration workflows to ensure reliable and...Contract work3 days per week
Covenant HR
Montvale, NJ3 days ago - ...TSR Consulting is currently seeking a highly motivated Senior Data Engineer for a hybrid opportunity in Rutherford, NJ Role: Senior Data Engineer Duration: 6+ Months Location: Rutherford, NJ We are looking for a Senior Data Engineer with strong experience...Temporary work
TSR Consulting
Rutherford, NJ2 days ago - ...information technology company at the forefront of the tech transformation. From custom software development to cloud hosting, from big data to cognitive computing, we help companies harness and leverage today’s most cutting-edge digital technologies to create value and...Big data
- ...enterprise functions. Design scalable AI and data solution architectures that connect... ...is a major plus. Experience developing, maintaining, and releasing production enterprise... ...to senior leadership. Understanding of big data concepts and practical data science...Big dataFull time
Marlabs
Englewood, NJ2 days ago - ...Job Requirements .30354-1 Required Skillset: 5+ years of experience in application support, technical leadership, or data-platform troubleshooting Hands-on Azure data engineering and Python experience Working knowledge of Databricks and PySpark, including...
- ...TSR Consulting is currently seeking a highly motivated Senior Data Engineer for a hybrid opportunity in Rutherford, NJ Role: Senior Data Engineer We are looking for a Senior Data Engineer with strong experience in Python, PySpark, SQL, and Data Modeling to build and optimize...Temporary work
TSR Consulting
Rutherford, NJ2 days ago - ...Immediate need for a talented Data Engineer. This is a 06+months contract opportunity with long-term potential and is located in East... ...plan, and paid sick leave (depending on work location). Design and develop scalable data solutions and pipelines. Create and maintain...Contract workLocal areaImmediate start
Pyramid Consulting
East Rutherford, NJ1 day ago $60 - $72 per hour
Support and modernize production data systems in a hybrid role focused on stability, troubleshooting, and Azure data engineering. Responsibilities... ...data pipelines, large datasets, and production data incidents Develop and maintain solutions in Azure data engineering using Python...Hourly payMonday to Friday$95.77k - $133.63k
...issues with transparency. Qualifications: 2+ years of relevant experience with Python, PySpark, Apache Spark, Iceberg, Starburst, big data, Airflow Nice to have: AWS, Snowflake and Databricks exposure Intermediate level experience in Applications Development role Consistently...Big dataFull time- ...a Principal Early Supplier Involvement Engineer to drive hardware co-design, manufacturability, and supply chain readiness for our Data Center AI Infrastructure platform. You will bridge System Architects with Mechanical, Thermal, Electrical Engineering teams and suppliers...
$80k - $300k
...communities. The Role Crossix is positioned at the center of big data, innovative technology, media, and life sciences. Our mission... ...and solve business problems. What You'll Do Develop a thorough understanding of Crossix offerings, competitive advantages...Big dataWork at officeLocal areaRemote workWork from homeFlexible hours3 days per weekVeeva Systems
Lyndhurst, NJ3 days ago$80k - $300k
...Crossix Enterprise Sales Crossix is positioned at the center of big data, innovative technology, media, and life sciences. Our mission... ...obstacles and solve business problems. What You'll Do Develop a thorough understanding of Crossix offerings, competitive advantages...Big dataLocal areaFlexible hours- Join Our Mission At Veolia North America We resource the world and help our customers solve their environmental and sustainability challenges. By joining our team, you'll be part of the ecological transformation across energy, water, and waste. Environmental Technician...
Veolia North America
Haworth, NJ2 days ago - ...a senior AI/ML engineering leader to build an AI-ready research data ecosystem for vaccine discovery. The role combines data architecture... ...data discoverability, interoperability, and AI readiness Develop machine learning and predictive modeling approaches leveraging multimodal...
Pfizer
Pearl River, NY25 days ago - ZT Systems is seeking a Data Engineer to own data flow from manufacturing and business systems to dashboards and reports. You will map data lineage end to end, protect integrity of key metrics, and support SOX compliance as a public company. You will bridge IT and business...
- ...mechanical engineering team designing, analyzing, and validating hardware platforms for AI computing, data centers, and client systems in New Jersey. You will develop mechanical components and assemblies, perform FEA and structural analysis, and support validation to ensure...
- ZT Systems seeks a Data Engineer to own data flow from manufacturing and business systems to dashboards and reports. You’ll map data lineage end to end, protect metric integrity, and support SOX compliance as a public company. You’ll collaborate with IT, Finance, Operations...
- HYTORC Middle East FZE seeks a data analytics engineer to support the analytics and reporting platform. You will build Databricks ingestion pipelines and transform layers, monitor jobs, and create star schemas with robust governance. Proficiency in SSRS and Sigma-based...
- ...Mechanical Engineer to drive operational excellence across Americas. You will serve as a SME for critical cooling infrastructure in data centers, review MOPs, lead investigations, and push energy-efficient improvements across the portfolio. You will collaborate with site...
- Equiliem in Secaucus, NJ is seeking a Data Center Critical Operations Engineer II for a Tue-Sat 2:00 p.m.-10:30 p.m. shift. The role operates, maintains, and troubleshoots critical facility systems to support reliable data center operations. You will work with electrical...Hourly payRelocation packageShift work
$85.2k - $159.3k
...EY and help to build a better working world.Position Summary:The Data Engineering Senior Analyst enables Talent Insights & Analytics... ...enterprise ETL tools to support Talent reporting and analytics.Develop and optimize Databricks notebooks and workflows for data ingestion...Summer holidayLocal areaRemote workFlexible hoursEY (Ernst & Young)
Secaucus, NJ1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
