Big Data Developer
Procal Technologies Inc
Title: Big Data Engineer
Location: Basking Ridge, NJ (5-day onsite/week)
Job Responsibilities:
- Design and lead end-to-end data integration
- Perform performance tuning, diagnose, and resolve complex big data and streaming technical issues.
- Design and implement scalable solutions across the technology stack, including data processing, database, web services, network, and security layers.
- Perform integration testing and provide support to QA teams on large-scale projects.
- Contribute to requirements analysis, project estimation, system design, coding, and testing.
- Evaluate and implement appropriate third-party libraries and software to enhance product capabilities.
- Stay current with emerging techniques and trends in big data and AI/ML.
Job Requirement:
- 5+ years of hands-on experience designing and implementing data applications in production using Java, Python, or Scala on big data platforms, with deep expertise in big data technologies and data optimization techniques.
- 5+ years of hands-on experience with streaming technologies, specifically with a strong focus on Kafka, and various open-source software platforms (e.g., Apache ecosystem, Linux).
- Proven ability to optimize data flow and design efficient, scalable data pipelines, including data lakes and warehouses on containerized clusters.
- Strong understanding of distributed data architecture concepts (e.g., caching, MapReduce, stream processing).
- Solid knowledge of data security, governance, and compliance.
- Proficiency in programming languages: Java, Python, Scala, and SQL.
- Strong analytical capabilities, creativity, and critical thinking skills.
- Effective written and verbal communication, with the ability to facilitate team collaboration.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Basking Ridge, NJ vacancy
- ...collaborative team environment. Strong organizational and leadership abilities. Experience in performance tuning and optimization techniques. Knowledge of big data concepts and tools is a plus.CertificationsRelevant certifications in Apache Spark, Scala, or Python are a plus....Big data
Omni Inclusive
Whippany, NJ1 day ago - ...Immediate Need – ETL Talend Developer (Data Engineer)– Berkeley Heights NJ - Client / Apex - Hybrid/OnsiteDesign and implement cloud-native... ...one of the technical platforms (JAVA, Microsoft, Azure, AWS, Big data Stack etc.,).Understand the enterprise architecture roadmap...Big dataImmediate start
Keylent Inc
Berkeley Heights, NJ1 day ago $120k - $180k
...position sits within the newly consolidated Data and Analytics (D&A) organization... ...framework. The Lead Data Engineer serves as a big data development expert within the D&A Eligibility... ...extract, transfer, load (ETL) processes.• Develop reusable frameworks to reduce the...Big dataFull timeTemporary workWork at officeLocal areaRelocation package3 days per weekMetropolitan Life Insurance Company
Bridgewater, NJ2 days ago$81k - $155k
...What you’ll be doing...The Transformation Data Science team addresses high-impact,... ...role of AI Workflow Engineer, you will be:Developing and deploying autonomous AI agentic workflows... ...standards within financial systems.Knowledge of big data tools (SQL, Spark, and Splunk), i.e....Big dataFull timeTemporary workPart timeWork experience placementWork at officeWork from homeShift work3 days per weekVerizon
Basking Ridge, NJ2 days ago$80.5k - $157.5k
...Analyze data to identify trends, detect variances, explain root causes, and support defect... ..., and visualizations to monitor drift. Develop predictive models to detect issues early.... ...statistics. Experience with Python, SQL, Big Data, Hadoop, and data visualization tools...Big dataMphasis
Berkeley Heights, NJ21 hours ago$130k - $160k
...and consumers. POSITION OVERVIEW:We are looking for a Senior Data Scientist to develop and deploy advanced analytics and AI solutions that drive... ...learning models, and solve critical business problems using big data technologies like Databricks, Azure ML, and Apache Spark...Big dataRemote workNestlé
Bridgewater, NJ21 hours ago$109k - $174.8k
...humanity. Learn more at Job Function Data Analytics & Computational Sciences Job... ...—J&J is looking to build capability in developing supply chain solutions that support the above... ...Cloud components such as Databricks and big data frameworks like Spark, PySpark, etc....Big dataWork experience placementWork at officeImmediate startFlexible hoursmyGwork - LGBTQ+ Business Community
Raritan, NJ21 hours ago- ...SQL (is able to write complex SQL queries to extract and analyze data) Has a thorough understanding of the technology behind Gen AI and... ...AWS, Azure, or Google Cloud Platform, is a plus. Experience with big data technologies, such as Apache Spark, Hadoop, or Hive, is a plus...Big dataContract workImmediate start
Damco
Morris Plains, NJ4 days ago $176k - $282k
ResponsibilitiesWe are hiring a Senior Manager, Growth[x] Data & AI Engineering to serve as the senior technical lead for the data... ...Microsoft Certified: Azure Data Engineer Associate, dbt Certified Developer, CDMP (Certified Data Management Professional), or equivalent....Contract workWork at officeShift workPeraton Corporation
Basking Ridge, NJ14 hours ago$101k - $194k
...Want in? Join the #VTeamLife.What you’ll be doing...As a Senior Data Scientist you will own and perform specific analytics tasks as... ...manager.Driving data-derived insights across the business domain by developing advanced statistical models, machine learning algorithms and...Full timeTemporary workPart timeWork experience placementWork at officeWork from homeShift work3 days per weekVerizon
Basking Ridge, NJ1 day ago- ...into actionable insights that protect client data and critical systems. You will help us... ...efficacy while minimizing false positives.Develop clear, consumable visualizations and storytelling... ...of experience with SQL and one or more big data or cloud analytics platforms (for...Big dataFull timeTemporary workH1bWork at officeMonday to Friday
Fiserv
Berkeley Heights, NJ1 day ago $173k - $220k
Title:AVP, Data EngineeringCompany:Everest Global Services, Inc.Job Category:TechnologyJob Description:About Everest:Everest is a global... ...aligned with business objectives and enterprise strategy.Develop and execute data and analytics technology strategies and roadmaps...Full timeEverest Re Group
Warren, NJ4 days ago$86.7k - $170.9k
Position Summary Join Deloitte’s Core AI & Data practice and help organizations modernize data platforms, strengthen enterprise... ...cloud-based ingestion, transformation, and storage patterns Develop and maintain batch and streaming data workflows that support reporting...Local areaVisa sponsorshipDeloitte
Morristown, NJ1 day ago$116.2k - $229.1k
...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions... ...& Data practice offers comprehensive solutions for designing, developing, and operating advanced Data and AI platforms, products, insights...Local areaVisa sponsorshipDeloitte
Morristown, NJ1 day ago$130 per hour
...Data EngineerLocation: Warren, NJ (Hybrid from day 1)Fulltime: $130 KExperience in data engineering tools like Spark, Hadoop, Azure Data pipelines, Azure Data factory, Azure Data Lake Storage, Databricks, Delta Lake, Python, SQL Server, and experience with other cloud...Full timeE-Solutions
Warren, NJ1 day ago$71.6k
...of Fairfax Financial Holdings. For more information about C&F, please visit our website: Job DescriptionWe are seeking an Associate Data Engineer to support the S&S Data Science team's External Data function. You will build and maintain the pipelines that bring third-party...Remote workCrum & Forster
Morristown, NJ21 hours ago$55 - $60 per hour
...Data EngineerIn compliance with the salary transparency law, the expected pay range for this role is $55-$60. Actual compensation depends on experience and interview evaluation.Locations: Whippany, NJ (Hybrid Onsite) Duration: 12+ Months Contract Note: Candidate needs...Contract workWork at officeLocal area3 days per weekDamco
Whippany, NJ1 day ago$95k - $120.65k
....Position OverviewSupport and maintain the mission-critical Cost Roll process by ensuring accurate aggregation of healthcare claims data and precise matching of claims to provider demographic data. This role is responsible for preserving data pipeline integrity that supports...Full timeWork at officeLocal areaFlexible hoursZelis
Morristown, NJ1 day ago$120.1k - $214.5k
...GroupOptum Tech is a global leader in health care innovation. Our teams develop cutting-edge solutions that help people live healthier lives and... ...make the health system work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches...Minimum wageFull timeWork experience placementWork at officeLocal areaRemote work3 days per weekUnitedHealth Group
Basking Ridge, NJ4 days ago- ...implement and execute sales support programs. Develop business requirements for the various... ...key sales support activities: Master Data Maintenance, Pricing Entry, Order Tracking... ...including VLOOKUP, pivot tables, formulas, big data & reporting ~ Power BI a plus ~...Big dataWork at officeRemote workMonday to Friday
AA2IT
New Providence, NJ1 day ago - ...solutions. Responsibilities: Design and develop scalable and efficient AI and Generative... ...to best practices in AI architecture, data management, and security. Stay updated... .... Preferred Skills: Experience with big data technologies (e.g., Hadoop, Spark)....Big data
Yantran LLC
Bedminster, NJ4 days ago $82.6k - $162.8k
...with clients to transform finance. Work You’ll Do Configure and develop within OneStream to support finance processes (planning, budgeting... ...) using OneStream development tools and best practices.Support data management activities including data loads, mappings,...Local areaRemote workDeloitte
Morristown, NJ4 days ago$85k
...Job DescriptionOverview:ITFS requires a senior-level Application Developer to assist on a variety of efforts related to those applications... .... or related field and 2-6+ years of experience working as a Data Developer or EngineerExperience with SQL Server and related tools...For contractorsWork at officeRemote workCrum & Forster
Morristown, NJ2 days ago$71.3k - $140.6k
...new digital ventures, and fuel growth through innovation. Work you'll do As a PROJECT - Data Engineer II on the AI & Data team, you will be responsible for… Designing, developing, and maintaining batch and streaming data pipelines that support reporting, analytics, and...Local areaDeloitte
Morristown, NJ3 days ago- ...Principal Data EngineerLocation: Warren, NJ. (2-3 days in-office)Duration: 6+ monthsMode of interview: 2 videosKey ResponsibilitiesLead the architecture, design, and delivery of scalable enterprise data platforms using Azure Databricks, Delta Lake, and lakehouse patterns...Work at office
Echo IT Solutions
Warren, NJ4 days ago - ...Data EngineerMust have skills Azure Cloud, MS Fabric, ADF, Azure SQL, Synapse, DBT Preferred skills Data Mesh implementation, Insurance domainDesigns, builds, and maintains scalable data pipelines and architectures, leading a team to deliver robust data solutions.Drive...
Omni Inclusive
Warren, NJ1 day ago $91.1k - $179.5k
...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions... ...& Data practice offers comprehensive solutions for designing, developing, and operating advanced Data and AI platforms, products, insights...Local areaVisa sponsorshipDeloitte
Morristown, NJ3 days ago$137.5k - $193.6k
...marketing, commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and... ..., feature transformation, and predictive modeling techniques to develop and refine solutions.Building proofs of concept, interpreting...Local areaDeloitte
Morristown, NJ14 hours ago$110.84k - $145k
...Lead Data EngineerChoosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like... ...Hybrid)Key ResponsibilitiesData Engineering & Architecture Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks....Local areaFlexible hoursCapgemini
Whippany, NJ4 days ago- ...GCP Data Architect The Technical Architect influences the development and implementation of Information Services (I.S.) strategy, initiatives... ...working with both distributed architectures, ETL, EDW and Big Data technologies ~8+ years of development experience in Python...Big data
JConnect Infotech
Parsippany, NJ4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
