Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Ridgewood, NY vacancy
- ...Only On W2 Big Data DeveloperJersey City- NJLong Term ContractHadoop, Java/Scala, Spark Big Data Developer – (Count : 1)10 Plus Years Overall IT Experience, Big Data Developer with experience in building Java/Scala, Spark based applicationAt least 5 Years of strong Development...Big data
Syntricate Technologies
Jersey City, NJ3 days ago - ...Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in... ...Key Responsibilities • Design, develop, and maintain scalable ETL/ELT pipelines...Big data
Diverse Lynx
Secaucus, NJ16 hours ago - ...Data AnalystVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp... ...programming language (Python, C,C++, Java, SQL)Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark...Big data
Keylent Inc
Long Island City, NY4 days ago - DomainTools is seeking a Principal Product Manager to grow and refine data products powering threat intelligence. You will own the product... ...market-leading data products driven by customer insights and big-data analysis. You will collaborate with engineering, marketing,...Big dataRemote job
- ...analyst will be pivotal in shaping our company's underwriting, developing an understanding where we are and where we are going. They... ...comfortable with Python, R, SQL, Excel/VBA, and working with big data sets, have reserving and pricing experience. They will be proactive...Big data
Hereford Insurance Company
Long Island City, NY4 days ago - A leading telecom company is seeking a Business Analyst to develop and support Big Data solutions across various business units. In this role, you will gather and analyze business requirements and ensure that solutions are clearly specified for implementation. The ideal...Big dataRemote job
- ...is looking for a Support Engineer to own the complete incident lifecycle—from alert to root cause and permanent fix—covering our Big Data platform and data products. You will work across cloud and on‑prem environments, ensuring reliability and rapid response to issues...Big dataPermanent employment
- ...Medien basieren. Mit einem Netzwerk hoch spezialisierter Unternehmen definiert und entwickelt Reply Geschäftsmodelle, die durch KI, Big Data, Cloud Computing, digitale Medien und dem Internet der Dinge ermöglicht werden. Reply bietet Beratung, Systemintegration und...Big data
- ...Technical/Functional Skills • 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development. • 5+ years of hands-on experience... ...skills. Roles Responsibilities • Design, develop, and maintain data pipelines using Databricks, Python,...Big dataFull time
PB consulting
Jersey City, NJ8 days ago - We are looking for a Support Engineer to keep Kyivstar's Big Data platform and data products running reliably every day. You will own the full incident lifecycle - from the first alert and triage to root-cause analysis, permanent fix and prevention - across our data pipelines...Big dataPermanent employment
- (USA) Principal, Data Scientist Multiple locations. The pay range will be discussed during... ...with multiple teams within the company to develop scalable, robust technical solutions. The... ...deployment. Strong experience with big data platforms Hadoop (Hive, Map Reduce, HQL...Big dataPermanent employmentFull timeTemporary workPart timeFlexible hours
Walmart
Hoboken, NJ16 hours ago $118.69k - $189.91k
...Responsible for providing enterprise/divisional thought leadership on data visualization and analytic report development. This includes... ...achievement and individual performance. $118,691.00 - $189,906.00 Skills Big Data, Complex Data Analysis, Data Analysis, Data Engineering,...Big data- DRW is seeking a Data Center Engineer to manage the architecture and operations of their data centers in Solon, Ohio, with occasional support for other regions. The ideal candidate will have over 3 years of hands-on experience in data center engineering and must be a team...
- implementation and initial stabilization Support the September ramp-up and October implementation of inbound and outbound data processes. Ingest, transform, validate, and reconcile Gainwell, Arcadia, DHCS, and other approved data feeds within Acentra's standard claims...
- Datacenter Operations Technician - Join Our Dynamic Tech Team! Are you someone who enjoys working hands‑on with servers, cables, and network gear in a fast‑paced environment? We are looking for a Datacenter Operations Technician with solid experience to join our 24/7 infrastructure...Full timeShift workNight shift
- Blu Omega LLC is seeking a Databricks Engineer to design, build, and operate scalable data solutions for a federal program. This remote role focuses on data engineering, analytics, and cloud-based platforms to support mission-critical operations. The ideal candidate has...Remote job
- Job Overview We are looking for a Data Center Engineer to cover the Solon, Ohio area and assist with managing the architecture and operations of our data centers in that region. This person will also occasionally provide support for other regions. Responsibilities Maintaining...Local area
- ProArch is seeking a data integration specialist to support the September ramp-up and October implementation of inbound and outbound data processes. The role involves ingesting, transforming, validating, and reconciling Medicaid claims and eligibility data in ProArch's...
$80k - $100k
...Engineering The Visualization Imaging and Data Analysis Center (VIDA) at NYU's Tandon... ...research hub focused on developing innovative solutions to complex data challenges... ...following areas: Database systems and big data management Information integration...Big dataFull timeImmediate startNew York University
Brooklyn, NY2 days ago$65 per hour
...Role : Senior Data Engineer (Big Data Lead) Location: PA/NJ Job Description Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems Participate in all aspects of the software...Big data- ...across acquisition campaigns - turning complex data into clear insights that influence where... ...repeatability, and auditability Coach and develop junior team members, setting standards for... ...working with relational databases and big data platforms, including Snowflake Strong...Big data
- ...The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics.... ...data Compile and analyze data related to business issues Develop clear visualizations to convey complicated data in a straightforward...Big data
Wandata Tech
Jersey City, NJ2 days ago $74 - $84 per hour
...Job Description Job Description Data Engineer - Jersey City, NJ - Contract - $74-... ...for analysis. Key responsibilities include developing ETL pipelines, ensuring data quality, and... ...experience with cloud services and big data processing. ~ Strong understanding...Big dataContract workRemote work$160k - $194k
...solutions by assessing member Mission Critical Priorities (MCPs) and developing a customized service plan Conduct a mix of on-site and... ...technology exposure (AI, BI, ML, Digital Transformation, Block Chain, Big Data, CLOUD, etc.) Candidates should have experience from within...Big dataWorldwide$160k - $194k
...solutions by assessing member Mission Critical Priorities (MCPs) and developing a customized service plan Conduct a mix of on‑site and... ...technology exposure (AI, BI, ML, Digital Transformation, Blockchain, Big Data, Cloud, etc.) Industry background: open to Manufacturing, CPG...Big dataRemote work- We are looking for Business Analyst to develop and support Big Data solutions used across multiple business units. In this role, you will focus on structuring business needs, defining data logic and ensuring solutions are clearly specified for implementation. The position...Big dataRemote workFlexible hours
- ...technologies for digital transformation (architecture definition, Big Data, solutions development, tool implementation, etc.) and risk and... ...multidisciplinary teams. We Offer The best environment to develop talent We offer you the possibility to join a firm that provides...Big dataWork experience placementFlexible hours
- ...Senior Associate You'll join the Card Data & Analytics team, a strategic partner to the... ...complex datasets from multiple sources to develop actionable business strategies and... ...such as Python or SAS, with experience in Big Data technologies including Snowflake, Databricks...Big data
Chase
Brooklyn, NY3 days ago - Overview Job description involves designing, developing, and maintaining software, with a strong focus on data pipelines and financial systems. Key responsibilities include... ...-solving and analytical skills Experience with big data technologies (e.g., Hadoop, PySpark) is a...Big data
- ...to deliver and maintain reporting solutions within SAP Business Objects and SAC in Kentucky. You will leverage SQL and Python/R for data prep, validate reports against source systems, and support BW/S/4HANA data flows. Responsibilities include creating standardized reports...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
