Big data platform engineer
$68 - $70 per hourRandstad
job summary: Seeking an experienced Spark, HDFS, and Kafka Administrator/Engineer to manage, support, and optimize enterprise-grade big data platforms. Deep hands-on expertise with Apache Spark, HDFS, and Kafka is required and will be the primary focus of this role. Experience administering these technologies within a Cloudera environment is preferred but secondary to strong expertise in the underlying technologies. location: Jersey City, New Jersey job type: Contract salary: $68 - 70 per hour work hours: 8am to 5pm education: Bachelors responsibilities:
- Spark Administration: Deploy, configure, monitor, tune, and troubleshoot Apache Spark environments and workloads. Support Spark job performance, resource management, capacity planning, and production operations.
- HDFS Administration: Manage and support HDFS storage, including capacity, performance, availability, permissions, replication, and troubleshooting. Strong understanding of HDFS architecture and integration with distributed compute platforms is required.
- Kafka Administration: Deploy, configure, manage, monitor, and troubleshoot Apache Kafka clusters, topics, producers, and consumers. Support performance, capacity, availability, security, and production operations.
- Monitoring and Performance Tuning: Monitor platform connectivity, health, capacity, and performance using tools such as Grafana, Splunk, and relevant platform management tools. Proactively identify and resolve performance bottlenecks across Spark, HDFS, and Kafka.
- Security and Compliance: Implement and manage security configurations, including Kerberos, SSL/TLS, authorization policies, HDFS ACLs, and enterprise IAM/LDAP integrations.
- Automation and Scripting: Develop and maintain automation using Python, Bash, or Perl for routine administration, configuration management, monitoring, and operational support.
- Troubleshooting and Support: Provide expert-level troubleshooting and technical support for Spark, HDFS, Kafka, and related big data technologies, including participation in an on-call rotation.
- Platform Administration: Support installations, patching, upgrades, migrations, and platform lifecycle activities while minimizing downtime. Cloudera Hadoop/CDP administration will be part of the role but is secondary to expertise in Spark, HDFS, and Kafka.
- Excellent problem-solving, analytical, and communication skills.
- Minimum 3 years of hands-on production experience administering and supporting Apache Spark, HDFS, and Kafka.
- Strong, demonstrable expertise in Spark administration, configuration, performance tuning, and troubleshooting.
- Strong, demonstrable expertise in HDFS administration, storage management, security, performance, and troubleshooting.
- Strong, demonstrable expertise in Kafka administration, topic management, producer/consumer architecture, performance, security, and troubleshooting.
- Experience with Linux operating systems and command-line tools.
- Experience with enterprise monitoring and operational tooling such as Grafana and Splunk.
- Experience with Cloudera Hadoop/CDP and Cloudera Manager is preferred but is not the primary skill requirement.
- Spark, HDFS, And Kafka Administrator/Engineer Seeking an experienced Spark, HDFS, and Kafka Administrator/Engineer to manage, support, and optimize enterprise-grade big data platforms. Deep hands-on expertise with Apache Spark, HDFS, and Kafka is required and will be the...Big data
- Big Data Platform Engineer - Jersey City, NJ Jersey City, NJ Seeking an experienced Spark, HDFS, and Kafka Administrator/Engineer to manage, support, and optimize enterprise-grade big data platforms. Deep hands-on expertise with Apache Spark, HDFS, and Kafka...Big data
- ...Job Description Job Description Title: Big Data Platform Engineer. Location: Jersey City, NJ (Onsite). Type: Contract, 12 months. Overview: ZipStaff is hiring a Big Data Platform Engineer for our client, a leading global financial services firm. This...Big dataFull timeContract workLocal area
- ...Technology Enabled Services.Job DescriptionJob Description:-Our Big Data capability team needs hands-on developers who can produce... ...a strong advantage....Operating knowledge of cloud computing platforms (AWS, especially EMR, EC2, S3, SWF services and the AWS CLI)Experience...Big dataPermanent employmentFull timeH1b
- Job Title: Data Engineer with GCP Location: New Jersey (Local Prefers) Employment Type: Contract... ...Data Engineer with strong Google Cloud Platform (GCP) experience to design, build, and... ...candidate will have hands-on expertise in Big Data technologies, cloud-native...Big dataContract workLocal area
- Role description We are seeking a skilled Data Engineer with 5-7 years of experience in... ...maintaining scalable data pipelines and data platforms The ideal candidate should have strong expertise... ...warehousing cloud technologies SQL and big data ecosystems The role involves...Big data
- ...Full TimeCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City,... ...building scalable ETL/ELT pipelines in big data environments- Strong understanding... ...experience with Spark, Hadoop, Kafka, and cloud platforms- Solid knowledge of SQL and NoSQL...Big dataFull time3 days per week
- Data Engineer Location: Jersey City, NJ (Onsite)/Houston, TX (On-site) Duration: 12 Months (Contract with possible conversion) W2 Candidates... ...expertise in Spark, SQL, and building data pipelines (preferably in Big Data technologies). Basic knowledge of Java and Spring...Big dataContract work
- Data Engineer (Insurance) Job Id: 98054 Location: Jersey City, NJ local to the location Must be a U.S. Military Veteran USC Only Key Skills... ..., Spark, AWS (Glue, EMR, S3, Aurora, RDS, AWS Architecture), Big Data Concepts Insurance Domain Knowledge (Preferred) Must Have...Big dataLocal area
$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). • Experience in working with a Big Data implementation in production environment. • Experience with...Big dataFull timeTemporary workRelocation- ...We are looking for an experienced Big Data Developer with strong expertise in big data technologies, distributed data processing, and large-scale data analysis. The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala...Big dataFull time
- ...Artificial Intelligence, Generative AI, Data Science, Data Engineering and Advanced Analytics to solve their... ...automation, and cloud-native data platforms. A global presence across North America... .... Work with Hadoop and related big data technologies where applicable....Big dataFull timeTemporary workLocal area
- Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior Data Engineer... ...such as Flask or Spring. Familiarity with cloud-based data platforms (e.g.Azure) Experience with data warehousing concepts and...Big data
- Senior AWS Data Engineer Location: New Jersey - Onsite Duration: Fulltime Job Description: Key... ...using Docker within container orchestration platforms such as AWS ECS, EKS, Google Anthos, or... ...NACLs, and SCPs Familiar with ETL and big data tool-chains such as those provided...Big dataFull time
- ...Description We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering... ...implement CI/CD strategies for enterprise data platforms. Collaborate with product, operations,... ...of ETL/ELT, data modeling, and big data technologies. Familiarity with data...Big data
- Job Description The Data/DataOps Engineer II is a junior-to-mid level position that will provide data pipeline, orchestration, and platform operations expertise to guide the development, deployment... ...like you to help us translate big data into big ideas. Join us and create...Big data
- Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ |... ...ETL/ELT frameworks for cloud-based data platforms. Drive development, code reviews, unit testing... ...-scale projects. Strong expertise in Big Data concepts , distributed systems, and...Big dataFull time
- About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office... ...Key Skills: Snowflake, SQL, Python, Spark, AWS-Glue, Big Data Concepts Responsibilities: Lead the design, development, and...Big dataWork experience placementWork at office3 days per week
- Lead Data Engineer (Forward Deployed) As a Lead Data Engineer (Forward Deployed) at JPMorganChase within the Infrastructure Data Platforms team, you will embed with infrastructure product teams to turn... ...detection, pattern analysis, or big data frameworks such as Hadoop/Spark...Big dataContract workWork at office
- Lead Data Engineer-Python/SQL/Snowflake Join us as we embark on a journey of collaboration and... ...operate secure, stable and scalable data platforms. As a hands-on technical contributor on... ...capabilities, and skills Hands-on experience with big data technologies and large-scale data...Big data
$102.5k - $210.6k
...Role Overview: As an Applied AI Platform Engineer III, you will actively engage in your engineering... ...systems, and modern AI/ML and Data infrastructure, consistently demonstrating... ...adoption-validated increments rather than big-bang builds, and keeping them supportable...Big dataVisa sponsorshipFlexible hours- ...Hybrid work environment in Newark, NJ. Data Engineer (AWS) Job Summary: We are seeking a... ...CI/CD strategies for enterprise data platforms. Collaborate with product, operations... ...of ETL/ELT, data modeling, and big data technologies. ~ Familiarity with...Big dataContract work
- ...DescriptionJob Description Mandatory skills: Eligible to workP, Big Query, Dataflow, Looker, and Python Key Responsibilities: We are seeking a skilled Data Analytics Engineer with strong experience in Google Cloud Platform (Eligible to workP) and expertise across modern data...Big data
- Lead Software Engineer Join AIML Data Platforms to help shape the future of AI/ML by building enterprise-scale data platforms that drive innovation across the firm. As a Lead Software Engineer at JPMorganChase within the AI/ML Data Platforms (AMDP) - Data Governance Engineering...
$130.9k - $268.7k
...As an Associate Director, Applied AI Platform Engineering, you will set the engineering vision and... ...frameworks, tooling, control plane, and data platform that every other engineering team... ...adoption-validated increments rather than big-bang builds. Apply a leaning-forward...Big dataWork at officeLocal areaVisa sponsorship3 days per week- ...Job Title: Lead Python Engineer – Big Data & Risk Analytics Location: Jersey City, NJ Duration: Contract - 6 months (C2H potential)... ...design and operate high-performance, auditable aggregation platforms that deliver reportable risk metrics . Responsibilities:...Big dataContract work
- Data Engineer Role: Data Engineer Required legal status: Green Card, Green Card-EAD, US Citizen Location: Charlotte, NC (Hybrid work model)... ...Scala programming language Working with Spark and PySpark for big data processing Utilizing Hadoop for data storage and processing...Big data
$120k - $150k
...Role: AWS Analytics Engineer Location: Newark, NJ (Hybrid: 3 days onsite... ...Cloud Engineer within the Data Processing team and will have... ...ETL, distributed compute, and big data frameworks such as Spark,... ...log analytics and observability platforms (Splunk, ELK, Prometheus,...Big dataWork at office$116.8k - $208.3k
...Overview Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As a Data Platform Engineering Manager, you will have the ability to share new ideas and collaborate on high-impact projects supporting mission-critical...Remote workFlexible hours- Data Engineer Position Looking for data engineers with 9+ years of experience. Experience developing and deploying application code using SQL... ...developing Linux, UNIX shell scripts. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. Experience with...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big data platform engineer. Be the first to apply!
- data platform engineer Jersey City, NJ
- data engineer analytics Jersey City, NJ
- data science developer Jersey City, NJ
- big data developer Jersey City, NJ
- big data devops engineer Jersey City, NJ
- data center engineer Jersey City, NJ
- big data cloud engineer Jersey City, NJ
- big data engineer Jersey City, NJ
- junior big data engineer Jersey City, NJ
- senior data center engineer Jersey City, NJ





