Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Clifton, NJ vacancy
- ...We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala...Big data
Techvilla Solutions
Lodi, NJ2 days ago - ...Big Data Developer Location: Strongsville OH / Pittsburgh PA / Dallas TX Duration: Full Time Job Description: Bigdata Hadoop & ecosystem, Scala/Python, PySpark. Oracle PL/SQL, CI/CD, Excellent communication, Data Lake, Informatica, Teradata. Roles...Big dataFull time
JConnect Infotech
Passaic, NJ1 day ago - ...Only On W2 Big Data DeveloperJersey City- NJLong Term ContractHadoop, Java/Scala, Spark Big Data Developer – (Count : 1)10 Plus Years Overall IT Experience, Big Data Developer with experience in building Java/Scala, Spark based applicationAt least 5 Years of strong Development...Big data
Syntricate Technologies
Jersey City, NJ2 days ago $95k - $120k
...Kafka, Spark, Scala, SQL, Hive, Impala, Hadoop, Splunk, Autosys. Data analysis and data wrangling skills when dealing with huge volume.... ...Performance analysis, troubleshooting, and resolution including Cloudera Big Data ecosystem. Experience with Linux-based infrastructures....Big dataFlexible hoursTata Consultancy Services
Jersey City, NJ19 hours ago- ...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior... ...of our data initiatives. Responsibilities: Design, develop, and implement scalable data pipelines and ETL processes using...Big data
Zortech Solutions
Passaic, NJ5 days ago $121.2k - $181.8k
...solver who seeks passion in your work, come join us. We’ll enable growth and progress together.Citibank is seeking a Senior Java Big Data Developer to design and build core components of the Regulatory Reporting Hub, a Franchise Critical Application that enables the bank...Big dataFull timeCitigroup
Jersey City, NJ16 hours ago- ...of Software Development, Software Consultancy, and Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional...Big dataPermanent employmentFull timeH1b
Sonsoft
Jersey City, NJ2 days ago - We are seeking a skilled Data Engineer with 5-7 years of experience in designing developing and maintaining scalable data pipelines and data platforms The ideal candidate... ...data warehousing cloud technologies SQL and big data ecosystems The role involves working closely...Big data
LTM
Jersey City, NJ16 hours ago - ...experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled... ...Engineer, Big Data Engineer to build scalable data pipelines, develop ML models, and integrate big data systems. You'll work with structured...Big data
Omni Inclusive
Jersey City, NJ2 days ago - ...Full TimeCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey... ...Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of... ...databasesKey Responsibilities*Design, develop, and maintain scalable data pipelines-...Big dataFull time3 days per week
SRI Tech
Jersey City, NJ16 hours ago - ...contract Role Summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader... ..., and data ingestion pipelines on AWS. Proven experience with ETL/ELT processes, data modeling, and big data frameworks....Big dataFull timeContract workWork at office
Arkhya Tech Inc.
Newark, NJ1 day ago - ...to work one-on-one with application and infrastructure developers to build and enhance the data infrastructure and application patterns that power mission... ...Hands‑on experience with ETL, distributed compute, and big data frameworks such as Spark, Glue, Hadoop/EMR, Impala,...Big dataFull time
EXL
Newark, NJ1 day ago - ...Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration... ...for Data Journey USBIE ~ Experience developing and deploying application code using SQL,... ...scripts ~ Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment...Big data
Damco Solutions
Newark, NJ4 days ago - ...Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in... ...Key Responsibilities • Design, develop, and maintain scalable ETL/ELT pipelines...Big data
Diverse Lynx
Secaucus, NJ4 days ago - ...Job Title: Senior AWS Data Engineer Location: Newark, NJ / Remote Duration... ...work with application and infrastructure developers to enhance AI/ML infrastructure, ensuring... ...IAM expertise ~ Familiarity with ETL/big data (Glue, Spark, EMR), relational DBs,...Big dataRemote work
3B Staffing LLC
Newark, NJ4 days ago - ...Microsoft Fabric Data EngineerNewark, New Jersey, United StatesAbout the JobMicrosoft Fabric... ...data management, ETL/ELT processes, and big data technologies. You will be... ...Synapse Analytics, and Azure SQL Database.Develop Data Pipelines: Build, maintain, and orchestrate...Big dataFull timeLocal area
Fortis Hayes
Newark, NJ2 days ago - ...required in a relevant field. • 8+ years of experience working in a data engineering role supporting an on-prem Data Lake; experience... ...skills and working knowledge of data structures, algorithms and big data tools (Spark, Hadoop, Python, SQL, NoSQL, Hive); Must...Big data
PALNAR
Newark, NJ2 days ago $70 - $75 per hour
...opportunity to work one-on-one with application and infrastructure developers to build and enhance the AI/ML infrastructure and application... ...Groups, KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark,...Big dataFull timeContract workRemote work$32.36 - $50.56 per hour
We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team The... ...will be responsible for designing developing and maintaining scalable data pipelines and... ...AWS Knowledge of ETLELT data modeling and big data technologies Familiarity with data...Big data$176.72k - $265.08k
...Senior Python Lead with 10+ years of hands-on experience to design, develop, and deliver critical, scalable, highly available, and... ...Desirable Qualifications:Polyglot Programming Exposure (e.g., Java).Big Data Technologies (Apache Spark, Hadoop, Kafka) and data warehousing...Big dataFull timeLocal areaCitigroup
Rutherford, NJ16 hours ago- Software Guidance & Assistance, Inc., (SGA), is searching for a Java/Data Developer for a contract assignment with one of our premier financial... ...out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year...Contract work
$82.6k - $162.8k
...growth through innovation. Work You’ll Do As a hands-on Core Data Engineer III on the AI & Data team, you will own the human-facing... ...offering provides a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights...Live inLocal areaDeloitte
Jersey City, NJ3 days ago- We are looking for a Data Engineer to join a Chemicals Manufacturing organization in New Jersey in a contract-to-permanent capacity.... ...systems into structured data layers for analytics and reporting.• Develop curated and semantic data models that support business...Permanent employmentContract work
Robert Half
Saddle Brook, NJ4 days ago $117k - $234k
.../PermanentCompany: WalmartBusiness Segment: Home OfficeRole summary: As a Senior Data Scientist in the team, you will have the unique opportunity to leverage the power of technology, big data and analytics to improve the lives of the 100M+ households that shop at Walmart...Big dataFull timeTemporary workPart timeWalmart
Hoboken, NJ16 hours ago- ...TSR Consulting is currently seeking a highly motivated Senior Data Engineer for a hybrid opportunity in Rutherford, NJ Role: Senior Data Engineer Duration: 6+ Months Location: Rutherford, NJ We are looking for a Senior Data Engineer with strong experience...Temporary work
TSR Consulting
Rutherford, NJ5 days ago - ...Tableau Developer 3days/week onsite –Open at these locations : (Tampa FL / Irving TX / Rutherford... ..., Sybase, Oracle, SQL Server, MongoDB, data warehousing, performance tuning,... ...using Tableau dashboards using Sybase / Big Data as backend technologies. Integrate...Big dataFull timeContract work
Dexian
Rutherford, NJ2 days ago $132k - $264k
...interact with multiple teams within the company to develop scalable, robust technical solutions. The data scientist role will be part of the data science team... ..., Kubeflow, model deployment.Strong experience with big data platforms Hadoop (Hive, Map Reduce, HQL, Scala)...Big dataFull timeTemporary workPart timeFlexible hoursWalmart
Hoboken, NJ16 hours ago$95.77k - $133.63k
...control issues with transparency.Qualifications:2+ years of relevant experience with Python, PySpark, Apache Spark, Iceberg, Starburst, big data, Airflow Nice to have: AWS, Snowflake and Databricks exposureIntermediate level experience in Applications Development...Big dataFull timeCitigroup
Rutherford, NJ16 hours ago- Overview of the Role: Citi, the leading global bank, has approximately 200 million customer accounts and does business in more than 160 countries and jurisdictions. Citi provides consumers, corporations, governments, and institutions with a broad range of financial products...Big dataFull time
Citigroup
Jersey City, NJ21 hours ago - ...TSR Consulting is currently seeking a highly motivated Senior Data Engineer for a hybrid opportunity in Rutherford, NJ Applying for this role is straight forward Scroll down and click on Apply to be considered for this position. Role: Senior Data Engineer Duration...Temporary work
TSR Consulting
Rutherford, NJ23 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
