Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in East Orange, NJ vacancy
- ...We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala...Big data
Techvilla Solutions
West Orange, NJ2 days ago - ...Only On W2 Big Data DeveloperJersey City- NJLong Term ContractHadoop, Java/Scala, Spark Big Data Developer – (Count : 1)10 Plus Years Overall IT Experience, Big Data Developer with experience in building Java/Scala, Spark based applicationAt least 5 Years of strong Development...Big data
Syntricate Technologies
Jersey City, NJ3 days ago - ...Big Data Developer Location: Strongsville OH / Pittsburgh PA / Dallas TX Duration: Full Time Job Description: Bigdata Hadoop & ecosystem, Scala/Python, PySpark. Oracle PL/SQL, CI/CD, Excellent communication, Data Lake, Informatica, Teradata. Roles...Big dataFull time
JConnect Infotech
Passaic, NJ2 days ago - ...Job title: AWS Data Engineer Location: Hybrid 2 days onsite (Newark, NJ) Duration... ...for Data Journey USBIE ~ Experience developing and deploying application code using SQL,... ...scripts ~ Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment...Big data
Damco Solutions
Newark, NJ10 hours ago - ...contract Role Summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader... ..., and data ingestion pipelines on AWS. Proven experience with ETL/ELT processes, data modeling, and big data frameworks....Big dataContract workWork at office
Arkhya Tech Inc.
Newark, NJ33 minutes ago - ...Job Title: Senior AWS Data Engineer Location: Newark, NJ / Remote Duration... ...work with application and infrastructure developers to enhance AI/ML infrastructure, ensuring... ...IAM expertise ~ Familiarity with ETL/big data (Glue, Spark, EMR), relational DBs,...Big dataRemote work
3B Staffing LLC
Newark, NJ10 hours ago - ...to work one-on-one with application and infrastructure developers to build and enhance the data infrastructure and application patterns that power mission... ...Hands‑on experience with ETL, distributed compute, and big data frameworks such as Spark, Glue, Hadoop/EMR, Impala,...Big data
EXL
Newark, NJ33 minutes ago - ...Microsoft Fabric Data EngineerNewark, New Jersey, United StatesAbout the JobMicrosoft Fabric... ...data management, ETL/ELT processes, and big data technologies. You will be... ...Synapse Analytics, and Azure SQL Database.Develop Data Pipelines: Build, maintain, and orchestrate...Big dataFull timeLocal area
Fortis Hayes
Newark, NJ3 days ago - ...Job Title: AWS Data Engineer Location: Newark, DE Job description: Job... ...candidate will be responsible for designing developing and maintaining scalable data pipelines... ...~ Knowledge of ETLELT data modelling and big data technologies ~ Familiarity with...Big data
Lorven technologies
Newark, NJ3 days ago - Data Engineer Position Looking for data engineers with 9+ years of experience. Experience developing and deploying application code using SQL, Python, spark. 3 to 5 years' experience... ...UNIX shell scripts. Developer experience in big data or warehouse (Hadoop, DB2 LUW)...Big data
$70 - $75 per hour
...opportunity to work one-on-one with application and infrastructure developers to build and enhance the AI/ML infrastructure and application... ...Groups, KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark,...Big dataFull timeContract workRemote work- ...summary: We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team... ...-based data lakes and data warehouses. 6. Develop and enforce standards for data quality,... ...ETL or ELT processes, data modeling, and big data frameworks. 16. Demonstrated ability...Big dataFor subcontractorWork at officeLocal areaShift work
$121.2k - $181.8k
...solver who seeks passion in your work, come join us. We’ll enable growth and progress together.Citibank is seeking a Senior Java Big Data Developer to design and build core components of the Regulatory Reporting Hub, a Franchise Critical Application that enables the bank...Big dataFull timeCitigroup
Jersey City, NJ2 days ago- ...of Software Development, Software Consultancy, and Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional...Big dataPermanent employmentFull timeH1b
Sonsoft
Jersey City, NJ3 days ago $32.36 - $50.56 per hour
We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team The... ...will be responsible for designing developing and maintaining scalable data pipelines and... ...AWS Knowledge of ETLELT data modeling and big data technologies Familiarity with data...Big data- ...required in a relevant field. • 8+ years of experience working in a data engineering role supporting an on-prem Data Lake; experience... ...skills and working knowledge of data structures, algorithms and big data tools (Spark, Hadoop, Python, SQL, NoSQL, Hive); Must...Big data
PALNAR
Newark, NJ3 days ago - We are seeking a skilled Data Engineer with 5-7 years of experience in designing developing and maintaining scalable data pipelines and data platforms The ideal candidate... ...data warehousing cloud technologies SQL and big data ecosystems The role involves working closely...Big data
LTM
Jersey City, NJ2 days ago - ...Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey... ...building scalable ETL/ELT pipelines in big data environments- Strong understanding of... ...databasesKey Responsibilities*Design, develop, and maintain scalable data pipelines- Process...Big dataFull time3 days per week
SRI Tech
Jersey City, NJ2 days ago - ...Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in... ...Key Responsibilities • Design, develop, and maintain scalable ETL/ELT pipelines...Big data
Diverse Lynx
Secaucus, NJ5 days ago - ...Position title: AWS data engineer Location: Chandler, AZ Onsite: 3 days a week Interview process: 2 video interviews to... ...Analytics, AWS Certified Solutions Architect) Experience with big data technologies like Hadoop, Spark or Kafka Knowledge of...Big dataContract work3 days per week
RIT Solutions, Inc.
Summit, NJ2 days ago - ...Job Title : Data Engineer Ab initio Location: Berkeley Height, NJ We are seeking a... ...reliability and troubleshooting data issues • Develop ETL pipelines for batch and real-time data... ..., integrity, and compliance across big data platforms. • Monitor and troubleshoot...Big data
Envision Technology Solutions
Berkeley Heights, NJ33 minutes ago - ...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior... ...of our data initiatives. Responsibilities: Design, develop, and implement scalable data pipelines and ETL processes using...Big data
Zortech Solutions
Passaic, NJ1 day ago - Senior Data Engineer Bigdata, Java, Spark, Kafka - Berkeley Heights NJ- ApexST / Client - ONSITE - LOCAL/Nearby Experience in Java Programming and in Big data technologies with hadoop, spark, kafka, AZURE Keylent IncBig dataLocal area
- Azure Data Engineer Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service... ...Factory, Azure Databricks, and other Azure services. Fluent with Big Data technologies like Spark, Kafka and Hive. Expert level skills...Big data
- Sr. Data Engineer Data Engineers who can build scalable, reliable data pipelines and infrastructure, requiring mastery in SQL, Python/Scala, cloud platforms (AWS), and big data technologies (Spark, Kafka, Hadoop). Key skills include data modeling, ETL/ELT pipeline construction...Big data
- Role description We are seeking a skilled Data Engineer with 5-7 years of experience in designing developing and maintaining scalable data pipelines and data platforms... ...data warehousing cloud technologies SQL and big data ecosystems The role involves working closely...Big data
- ...difference at Fiserv.Job TitleSenior Director- Data EngineeringAbout your role:You will be... ...and manage teams of data engineers and developers, providing direction and guidance to... ...years of experience in data engineering, big data, or software development, including...Big dataFull timeTemporary workH1bWork at officeMonday to Friday
Fiserv
Berkeley Heights, NJ1 day ago - Role: Sr. Data Engineer Hybrid model( Client location, Newark, NJ) Visa: GC, Citizen Required Qualifications: Bachelor's degree in... ...ingestion pipelines in AWS. Knowledge of ETL/ELT, data modeling, and big data technologies. Familiarity with data warehousing concepts and...Big data
- Data Scientist Integrated Resources, Inc., is led by a seasoned team with combined decades... ...and working with technologists to develop the process to transform raw data into business... ...programming language or similar • Knowledge of big data platforms such as Hadoop, Aster, etc....Big dataFull timeImmediate start
- Django Backend Lead Developer We are seeking an experienced Django Backend Lead Developer to join our team. The ideal candidate will have... ...background in backend development, cloud technologies, and big data processing. This role involves leading technical projects, mentoring...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
