Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Edgewater, NJ vacancy
- ...We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala...Big data
Techvilla Solutions
Weehawken, NJ4 days ago - ...Big Data Developer Or Lead Or ArchitectAbout VDart: VDart is an emerging global information technology staffing provider with expertise in Enterprise Resource Planning (Oracle/SAP), SMAC (Social, Mobile, Cloud, Analytics), Business Intelligence & Infrastructure services...Big dataFor contractors
VDart
Jersey City, NJ5 days ago $100k - $125k
...Data EngineerWe are seeking a highly skilled and motivated Data Engineer to play a pivotal... ...utilization.Diverse Data Integration: Develop robust solutions for ingesting high-volume... ...and efficient data solutions.Qualifications:Big Data Frameworks Expertise: Demonstrated high...Big dataTata Consultancy Services
Bronx, NY2 days ago$121.2k - $181.8k
...solver who seeks passion in your work, come join us. We’ll enable growth and progress together.Citibank is seeking a Senior Java Big Data Developer to design and build core components of the Regulatory Reporting Hub, a Franchise Critical Application that enables the bank...Big dataFull timeCitigroup
Jersey City, NJ4 days ago- ...of Software Development, Software Consultancy, and Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional...Big dataPermanent employmentFull timeH1b
Sonsoft
Jersey City, NJ5 days ago - ...Data Engineer With GCPWe are seeking a highly skilled data engineer with strong Google Cloud Platform (GCP) experience to design, build... ...processing systems. The ideal candidate will have hands-on expertise in big data technologies, cloud-native architecture, and ETL/ELT...Big data
AceStack LLC
Jersey City, NJ5 days ago - ...Purple DriveWe are seeking a highly skilled Palantir Data Engineer to design, develop, and maintain scalable data solutions using Palantir Foundry and... ...& Experience:Strong expertise in Palantir Foundry and big data frameworks (Spark, Hadoop).Proficiency in Python, PySpark...Big data
Purple Drive
Jersey City, NJ1 day ago - ...JPMorganChase in Jersey City, NJ, seeks a Lead Software Engineer- Financial Service Data Engineering: PySpark/Java/BigData/Datalake/AI to join the Asset and Wealth Management–Global Prime Brokerage team. You will be a core technical contributor, building trusted data...Big data
Next Frontier Capital
Jersey City, NJ9 hours ago - ...Data EngineerLocation: Jersey City, NJ (Onsite)/Houston, TX (On-site) Duration: 12 Months (Contract with possible conversion) W2 Candidates... ...in Spark, SQL, and building data pipelines (preferably in Big Data technologies).Basic knowledge of Java and Spring framework.Formal...Big dataContract work
Kaav Inc.
Jersey City, NJ5 days ago - We are seeking a skilled Data Engineer with 5-7 years of experience in designing developing and maintaining scalable data pipelines and data platforms The ideal candidate... ...data warehousing cloud technologies SQL and big data ecosystems The role involves working closely...Big data
LTM
Jersey City, NJ5 days ago - ...Senior Big Data EngineerLocation: New Jersey (hybrid)Duration: 6+ MonthsWe are seeking a highly skilled and experienced Senior Data Engineer... ...the success of our data initiatives.Responsibilities:Design, develop, and implement scalable data pipelines and ETL processes using...Big data
Zortech Solutions
Jersey City, NJ1 day ago - ...Data EngineerLocation: ADDISON, TX or Chicago, IL or Denver, CO or Charlotte, NC or Newark... ...for leading complex efforts to develop and deliver complex data solutions to accomplish... ...least 5 years of onsite exp)Experience with big data processing systems like Hadoop, Cloudera...Big dataFull time
AceStack LLC
Newark, NJ5 days ago - ...Senior AWS Data EngineerLocation: New Jersey - OnsiteDuration: FulltimeJob Description:Key Responsibilities & Skillsets:• Common Skillsets... ...Groups, KMS Keys, VPC NACLs, and SCPsFamiliar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark...Big data
Zortech Solutions
Jersey City, NJ5 days ago - ...AWS Lead Data EngineerInterview Process: at least 2 rounds Round 1 – Virtual technical... ...Candidate should have grown from a Data Engineer/Developer into a Lead role.Although this is a... ...ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to...Big dataWork at office3 days per week
Anveta
Newark, NJ5 days ago - ...understanding of the AWS platform, including its core services, architecture best practices, and security features.Extensive experience with big data technologies, including Apache Spark, for large-scale data processing and analytics.Demonstrated experience leading effective use...Big data
Chase
Jersey City, NJ5 days ago $32.36 - $50.56 per hour
...We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team... ...candidate will be responsible for designing developing and maintaining scalable data pipelines... ...Knowledge of ETLELT data modeling and big data technologies Familiarity with data...Big dataCapgemini
Newark, NJ1 day ago- ...Full TimeCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey... ...Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of... ...databasesKey Responsibilities*Design, develop, and maintain scalable data pipelines-...Big dataFull time3 days per week
SRI Tech
Jersey City, NJ4 days ago - Job-ID: 22196Category: Data ManagementLocation: Jersey City, New Jersey, United StatesWorkplace... ...will be responsible for designing, developing, and maintaining scalable data pipelines... ...Knowledge of ETL/ELT, data modeling, and big data technologies.Familiarity with data...Big data
EXL Service
Jersey City, NJ1 day ago $10k
..., for all. About The Role As a Senior Data Engineer at Hinge, you will create essential... .... You will be working on an actual big data architecture while concentrating on... ...through containerization, data modeling, developing our ETL pipelines, and more. Use your...Big dataWork experience placementHinge
Jersey City, NJ1 day ago- JPMorgan Chase in New Jersey seeks a Lead Software Engineer within Corporate Technology to drive design, development, and troubleshooting of trusted tech products across multiple business functions. You will contribute to secure, scalable production code and collaborate...Big data
Testing Site - JPMC
Jersey City, NJ4 days ago - ...Corporate Technology and drive secure, scalable technology products. You will be a core technical contributor shaping solutions across data, analytics, and automation platforms. You will lead design and development, mentor engineers, and promote best practices in CI/CD...Big data
Testing Site - JPMC
Jersey City, NJ3 days ago - ...Microsoft Fabric Data EngineerNewark, New Jersey, United StatesData Management and StorageDesign... ...and ETL (Extract, Transform, Load)Develop and implement data integration processes using... ...it into data warehouses or data lakes.Big Data and AnalyticsUtilize big data technologies...Big data
5 Star Global Recruitment Partners
Newark, NJ5 days ago $82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...to uphold the software quality standards Develop user training programs, documentation, and... ...Cloudera). • Experience in working with a Big Data implementation in production environment...Big dataFull timeTemporary workRelocationInfosys Technologies
Newark, NJ3 days ago$10k
...Machine Learning & Data Engineer, Bureau of Data Technology & StrategyThe Center for Population... ...into our integrated data architecture.Develop, and maintain scalable, secure data... ...programming (e.g., Python, R), Linux systems, and big data technologies (e.g., Hadoop, Spark)....Big dataWork at officeWork from home2 days per weekNew York City | Jobs
Corona, NY1 day ago- ...Technical/Functional Skills • 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development. • 5+ years of hands-on experience... ...skills. Roles Responsibilities • Design, develop, and maintain data pipelines using Databricks, Python,...Big data
PB consulting
Fairview, NJ4 days ago $70 - $75 per hour
...opportunity to work one-on-one with application and infrastructure developers to build and enhance the AI/ML infrastructure and application... ...Groups, KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark,...Big dataFull timeContract workRemote work- ...Software Engineer at JPMorgan Chase within the Corporate Technology Data Strategy & Architecture organization, you are an integral part of... ...or SnowflakeHands-on experience with Spark/PySpark and big data processing at scaleKnowledge of the financial services industry...Big data
Hackajob
Jersey City, NJ1 day ago - ...Senior Azure Data Engineer With Microsoft FabricLocation: Newark, NJ FTE ONLYSenior Azure Data Engineer with Microsoft Fabric Experience... ...like Azure Synapse, Azure SQL, ADLS etc.• Strong experience with big data tools(Microsoft Fabric, Databricks, Spark etc..) and...Big data
AceStack LLC
Newark, NJ5 days ago $68 - $70 per hour
...Administrator/Engineer to manage, support, and optimize enterprise-grade big data platforms. Deep hands-on expertise with Apache Spark, HDFS, and... ...enterprise IAM/LDAP integrations. Automation and Scripting: Develop and maintain automation using Python, Bash, or Perl for routine...Big dataHourly payContract workTemporary workWork experience placement- ...business and its technical teams, contractors, and vendors Develops secure and high-quality production code, and reviews and debugs... ...more programming language including Java and/or Python Strong Big-Data and database skills including Spark, Databricks, and/or Data...Big dataFor contractors
Testing Site - JPMC
Jersey City, NJ4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
