Big Data Developer
Techvilla Solutions
We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning and troubleshooting in the Cloudera Big Data ecosystem.
Key Responsibilities
- Develop, maintain, and optimize big data applications and data processing pipelines.
- Work with Kafka and Apache Spark for real-time and batch data processing.
- Perform data analysis, data wrangling, and processing of large volumes of structured and unstructured data.
- Write and optimize complex SQL queries using Hive and Impala.
- Monitor, troubleshoot, and resolve performance issues in the Cloudera Big Data ecosystem.
- Use Splunk for log analysis, monitoring, and troubleshooting.
- Manage and monitor batch workflows and job scheduling using AutoSys.
- Work in Linux-based environments for development, deployment, and operational support.
- Collaborate with business users and cross-functional teams to deliver high-quality data solutions.
- Ensure data quality, reliability, scalability, and performance of big data applications.
Required Technical Skills
- Strong hands-on experience with Kafka, Spark, Scala, and SQL.
- Experience with Hive, Impala, Hadoop, and the Cloudera ecosystem.
- Proficiency in data analysis and data wrangling for large datasets.
- Experience in performance analysis, tuning, troubleshooting, and issue resolution.
- Hands-on experience with Splunk and AutoSys.
- Strong knowledge of Linux-based infrastructures.
- Experience in distributed data processing and big data technologies.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Middle Village, NY vacancy
- ...We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala...Big data
Techvilla Solutions
Ridgewood, NY2 days ago - ...Only On W2 Big Data DeveloperJersey City- NJLong Term ContractHadoop, Java/Scala, Spark Big Data Developer – (Count : 1)10 Plus Years Overall IT Experience, Big Data Developer with experience in building Java/Scala, Spark based applicationAt least 5 Years of strong Development...Big data
Syntricate Technologies
Jersey City, NJ3 days ago - ...Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in... ...Key Responsibilities • Design, develop, and maintain scalable ETL/ELT pipelines...Big data
Diverse Lynx
Secaucus, NJ12 hours ago - ...Data AnalystVisa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp... ...programming language (Python, C,C++, Java, SQL)Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark...Big data
Keylent Inc
Long Island City, NY4 days ago - ...analyst will be pivotal in shaping our company's underwriting, developing an understanding where we are and where we are going. They... ...comfortable with Python, R, SQL, Excel/VBA, and working with big data sets, have reserving and pricing experience. They will be proactive...Big data
Hereford Insurance Company
Long Island City, NY4 days ago - ...Technical/Functional Skills • 10+ years of experience in Data Engineering, Data Warehousing, or Big Data development. • 5+ years of hands-on experience... ...skills. Roles Responsibilities • Design, develop, and maintain data pipelines using Databricks, Python,...Big dataFull time
PB consulting
Jersey City, NJ8 days ago - (USA) Principal, Data Scientist Multiple locations. The pay range will be discussed during... ...with multiple teams within the company to develop scalable, robust technical solutions. The... ...deployment. Strong experience with big data platforms Hadoop (Hive, Map Reduce, HQL...Big dataPermanent employmentFull timeTemporary workPart timeFlexible hours
Walmart
Hoboken, NJ12 hours ago $65 per hour
...Role : Senior Data Engineer (Big Data Lead) Location: PA/NJ Job Description Experienced Data management specialist responsible for developing, overseeing, organizing, storing, and analyzing data and data systems Participate in all aspects of the software...Big data$74 - $84 per hour
...Job Description Job Description Data Engineer - Jersey City, NJ - Contract - $74-... ...for analysis. Key responsibilities include developing ETL pipelines, ensuring data quality, and... ...experience with cloud services and big data processing. ~ Strong understanding...Big dataContract workRemote work- ...The ideal candidate will use their passion for big data and analytics to provide insights to the business covering a range of topics.... ...data Compile and analyze data related to business issues Develop clear visualizations to convey complicated data in a straightforward...Big data
Wandata Tech
Jersey City, NJ2 days ago - Overview Job description involves designing, developing, and maintaining software, with a strong focus on data pipelines and financial systems. Key responsibilities include... ...-solving and analytical skills Experience with big data technologies (e.g., Hadoop, PySpark) is a...Big data
- ...enterprise frameworks Spring, DROOLS, Web services including REST, Messaging and streaming middleware - RabbitMQ, Kafka; • Big Data frameworks - Hadoop, Spark; Basic Kubernetes Docker, Linux, Azure skills • Microservices experience, Cloud Infra with...Big dataContract workImmediate start
Navtech
Jersey City, NJ1 day ago - ...Certification or training in Apache Kafka. Experience with data streaming, event-driven architecture, or microservices. Knowledge... ...and compliance standards related to Kafka. Familiarity with big data technologies like Hadoop or Spark. Manikanth...Big data
SARIAN Co
Jersey City, NJ12 hours ago - ...collaborates with cross-functional teams to develop strategies, monitor progress, and ensure... ...responsible for defining and implementing scalable data design solutions, collaborating with cross... ...or Software EngineeringExperience with big data and/or InfrastructureBackground in...Big data
RIT Solutions
Jersey City, NJ3 days ago - ...Job Title: Senior Data Engineer Location: Hudson Street, NJ (Hybrid) Duration: 12 Months+ Interview mode: Face to face (Mandatory... ...ETL/ELT pipelines and Snowflake data warehouse solutions. Develop Python and SQL transformations for structured and semi-structured...Full time
SRM Digital
Jersey City, NJ1 day ago - DomainTools is seeking a Principal Product Manager to grow and refine data products powering threat intelligence. You will own the product... ...market-leading data products driven by customer insights and big-data analysis. You will collaborate with engineering, marketing,...Big dataRemote job
- ...Job Title: Data Engineer Experience: 7+ Years Location: New Jersey (NJ) Work Authorization: Non-H-1B candidates only Contract... ...PySpark. The ideal candidate should have strong expertise in developing scalable data pipelines, data processing, and cloud-based data...Full timeContract workH1b
TechnoSphere, Inc.
Jersey City, NJ1 day ago - ...approaches to build solutions or breakdown technical problems Develops secure and high-quality production code, and reviews and debugs... ...practices, and security features. Extensive experience with big data technologies , including Apache Spark, for large-scale data...Big data
- ...Responsibilities Kforce has a client that is seeking a Data Science Manager in Long Island City, NY.Summary:We are seeking a Data Science Manager to lead the development of advanced machine learning and optimization solutions that drive critical business decisions...Hourly payContract work
Kforce
Long Island City, NY4 days ago - #Hiring For SQL Developer Location: Jersey City, NJ (Hybrid Role) Need local candidates Visa: USC, GC, TN, H4 EAD W2-Only... ...using tools such as neo4j, tigergraph. • In-depth knowledge of big data technology stacks such as Snowflake, Hadoop. • Significant...Big dataLocal areaImmediate start
Kaav Inc.
Jersey City, NJ12 hours ago - ...Commercial and Investment Bank–wide Marketing and Events Data Platform. In this role, you will leverage your Big Data engineering expertise to implement platforms... ...independent problem solving skills and ability to develop solutions to complex analytical/data-driven...Big data
- ...is looking for a Support Engineer to own the complete incident lifecycle—from alert to root cause and permanent fix—covering our Big Data platform and data products. You will work across cloud and on‑prem environments, ensuring reliability and rapid response to issues...Big dataPermanent employment
- A leading telecom company is seeking a Business Analyst to develop and support Big Data solutions across various business units. In this role, you will gather and analyze business requirements and ensure that solutions are clearly specified for implementation. The ideal...Big dataRemote job
- ...skilled Power BI Architect to work closely with our Enterprise Data team to maintain, develop, and modernize our Analytics platform. The role involves... ...with Cloud platforms (especially Azure) and Big Data platforms (especially Snowflake)Secondary Skills:Scripting...Big dataFull timeRemote work
E-Solutions
Jersey City, NJ3 days ago - ...Big Data/Hadoop Systems Administrator to support and administer Big Data clusters. Big Data platform serves as the foundation for a key... ...on experience in SQL (Oracle) and NoSQL Databases (HBASE). Develop and enhance platform best practices. Stay in touch with...Big data
3B Staffing LLC
Jersey City, NJ1 day ago - ...Medien basieren. Mit einem Netzwerk hoch spezialisierter Unternehmen definiert und entwickelt Reply Geschäftsmodelle, die durch KI, Big Data, Cloud Computing, digitale Medien und dem Internet der Dinge ermöglicht werden. Reply bietet Beratung, Systemintegration und...Big data
- ...company specializing in Web, Cloud & Mobility staffing solutions. Be it core Java, full-stack Java, Web/UI designers, Big Data or Cloud or Mobility developers/architects, we have them all. Job Description Primary Job Responsibilities to Include: Requirements Analysis...Big data
- ...complex business problems and issues using data from internal and external sources to... ...Essential Job Functions Ability to manage big data and creating solutions for reporting... ...process and agile practices within a team Develop internal and external partnerships to...Big data
Jobrapido
Jersey City, NJ3 days ago $90k - $120k
...AWS Data EngineerRole - AWS Data Engineer Experience Required - 8+ Years Must Have Technical/Functional SkillsSenior Data Engineer (Python with AWS) – 10+ year experienceExperience designing and building Data Pipelines using AWS Native services and PythonExperience in...Tata Consultancy Services
Jersey City, NJ23 hours ago$18 - $50 per hour
...Siemens Digital Industries Software is seeking an AI & Engineering Data Intern to support emerging Artificial Intelligence and Digital... ...engineering, software, data management, and AI technologies to develop innovative customer-facing demonstrations and internal...Remote jobHourly payFull timeInternshipLocal areaSiemens
Long Island City, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
