Apache Spark
TechDigital Group
- 5+ years of experience working with Apache Spark (including Structured Streaming).
- Strong proficiency in Scala, with ability to write clean, performant code.
- 3+ years of experience with Apache Kafka for real-time streaming and messaging.
- Solid understanding of data modeling, ETL, and data pipeline orchestration.
- Familiarity with Hadoop ecosystem, Hive, Parquet, or similar.
- Experience with CI/CD, Docker, and Kubernetes is a plus.
- Exposure to cloud platforms like AWS (EMR, MSK), Azure, or GCP is preferred.
- Excellent problem-solving, communication, and analytical skills.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Apache Spark in Jersey City, NJ vacancy
$59.5 per hour
...07-2676\n \****@*****.***\n \n Location: NJ USC and GC - No corps\n \n Must Haves: -Azure -Databricks -Apache Spark -CI/CD Databricks / Azure Consultant – Job Summary Seeking two experienced Databricks / Azure Consultants to support the...Suggested$65 - $70 per hour
...Job Description Spark Developer \n 18 Month W2Contract \n Jersey City \n Hybrid 3 days onsite 2 days remote \n $65-$70/hour \n \n Senior Apache Spark Developer: \n We are seeking a Senior Apache Spark Developer to help build and expand our next-generation...SuggestedRemote work- ...technical leadership and mentorship to engineering teams implementing Spark, Kafka, Databricks, and cloud-native services. \n • Drive... ...data. \n • Strong experience with: \n o Databricks \n o Apache Spark \n o Apache Kafka \n o AMPS, MQ, Hadoop, or...SuggestedContract workRemote work
- ...transformations, and utilizing cutting edge technologies both on-prem and in the cloud. \n \n Skills Required: \n Databricks \n Apache Spark \n Apache Kafka \n AMPS, MQ, Hadoop, or experience with other enterprise messaging systems \n AWS cloud services \n...Suggested
- ...have strong expertise in Snowflake, Python, SQL, AWS, Oracle, and Apache Airflow, with exposure to AI/Generative AI technologies.... ...Generative AI, RAG architectures, or vector databases. Experience with Spark, Kafka, or Databricks. SnowPro and/or AWS certifications....Suggested
- ...Experience in Architecture methodology and design principles, TOGAF is preferred Experience with Big Data technologies like Apache Hadoop, HBase, Spark, Hive Agile Development experience, SDLC Tools, Gitlab, Maven, DevOps, CI/CD - Jenkins Knowledge of mainframe platforms...
- ...MySQL). Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, dbt). Proficiency in at least one programming... ...Experience with real-time data processing frameworks (e.g., Kafka, Spark, Flink). Knowledge of CI/CD and DevOps practices in a data...Remote workFlexible hours
- ...experience with Data Storage systems like Hadoop(Product or As Service) and formats like Apache Parquet • Must have hands-on experience with Data Processing frameworks like Apache Spark, Beam, Flink, Airflow, etc • Must have hands-on experience with Data Visualization...Immediate start
- ...platforms such as Databricks or Snowflake Deep hands‑on experience with Spark/PySpark and other big data processing technologies Expertise in open‑source table formats and catalog services such as Apache Iceberg Awareness of AI risk and regulatory considerations relevant...
- ...platforms such as Databricks or Snowflake Deep hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Awareness of AI risk and regulatory considerations relevant...
- ...Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. Implement data processing and transformation workflows using Databricks, Apache Spark, and SQL to support analytics, reporting, and AI-driven use cases. Build and maintain orchestration workflows using Apache Airflow...Local area
- ...The ideal candidate should have hands-on experience with Kafka, Spark, Scala, SQL, Hadoop, Hive, and Impala, along with performance tuning... ...applications and data processing pipelines. Work with Kafka and Apache Spark for real-time and batch data processing. Perform data...
- ...-based, graph Nice to have: Familiarity with high-speed distributed computing frameworks involving MapReduce technologies, like Apache Spark, Kafka Streams, Apache Flink AWS experience - the more the better, this is what they'll be using: VPCs, S3, EC2, ACLs, KMS, AWS...Immediate startWork from home2 days per week3 days per week
$60 - $65 per hour
...technical leadership and mentorship to engineering teams implementing Spark, Kafka, Databricks, and cloud-native services. Drive performance... ...systems. Technical Skills: Strong experience with Databricks, Apache Spark, Apache Kafka, AWS cloud services, and large-scale data...- ...Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS-Glue, Big Data Concepts Responsibilities: Lead the design,... ...planning, change management, training, KT, L2/L3 support Apache Iceberg + AWS glue 10+ years of relevant experience in Data Engineering...Work experience placementWork at office3 days per week
- ...United States Role Overview Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience in database management Develop and maintain data models...
- ...enterprise-scale cloud migration initiatives involving hundreds of terabytes or petabytes of data. Strong experience with Databricks, Apache Spark, Apache Kafka, AMPS, MQ, Hadoop, or other enterprise messaging systems. Proficiency in AWS cloud services and large-scale data...Work experience placementImmediate startRemote workFlexible hours
- ...environment. This role empowers you to drive innovation using Databricks, Spark, and leading cloud technologies while influencing the future-... ...massive data volumes - Advanced expertise in Databricks, Apache Spark, Apache Kafka, AWS, and large-scale data warehouse/lakehouse...Work at office
$88.59 - $96.59 per hour
...Design and architect high-volume, low-latency, highly resilient data processing platforms Lead the development and modernization of Apache Spark-based data processing ecosystems Architect and implement solutions using Databricks for data processing, transformation, and...Hourly payPermanent employmentContract work- ...networking). Expertise in AWS cloud platform (S3, Lambda, EKS, DynamoDB, EventBridge, Kafka, Opensearch), big data technologies (Apache Spark, Glue, Redshift), and data lake/lakehouse architectures (Iceberg). Experience with containerization/orchestration and...
- ...maintain and optimize robust ETL data pipelines using Databricks (Spark, Delta Lake, Unity Catalog) and ensure efficient ingestion,... ...data services(EMR, Athena, Glue, S3) Hands-on experience utilizing Apache Spark for large-scale data processing, including developing and...Work at office
- ...Glue, Lambda, EMR, Redshift, Step Functions, CloudWatch Strong experience building distributed data processing frameworks with Apache Spark / PySpark Advanced SQL skills - complex transformations, query optimization, and dimensional modeling Expertise in DWH design patterns...Contract work
- The Senior Technical Specialist will be responsible for providing expertise in Apache spark, scala, and python. They will play a key role in developing and implementing technical solutions using these tools to meet the organization's objectives. Key Responsibilities 1...
- ...Role: Java with Spark Developer Location: NY/NJ Fulltime Responsibilities: Utilize indepth knowledge and skills across multiple... ...OOPs concepts and design patterns. Handson experience with Apache Spark with Java. Experience with caching solutions like Pinot...Full time
- ...Python Developer (Apache Airflow & Oracle)Location: Jersey City, NJ (Onsite/Hybrid as per Client Requirement) Job Type: Contract-to-Hire Duration: August 3, 2026 – August 6, 2027 Experience: 5+ YearsJob Summary: We are seeking a skilled Python Developer with strong expertise...Contract work
$156.75k - $215k
...scalable data pipelines for batch and real-time processing using Spark, Airflow, Kafka, and Flink. Drives team adoption of enterprise-... ...experience with distributed data processing frameworks such as Apache Spark and Flink Solid understanding of data modeling techniques...- ...skills. Interest in financial markets, market risk, or other complex data domains. Preferred experience includes Databricks, Apache Spark, Delta Lake, Unity Catalog, AWS, dashboard or regulatory reporting data preparation, data governance, lineage, observability,...Full time
- ...Description Want to be your own boss? With the Spark Driver™ app, you can make some extra cash by shopping and delivering for customers of Walmart and other local businesses. Available in more than 3,650 cities and all 50 states, the Spark Driver platform makes it possible...Extra incomeFor contractorsLocal area
- ...platform capabilities used by multiple product teams. Deep hands-on expertise with Databricks, including Unity Catalog, Delta Lake, Apache Spark, and SQL Warehouses, with the ability to set secure, scalable patterns. Strong expertise in large language model application...
$204.25k - $285k
...infrastructure layer (e.g., OPA/Rego, OpenFGA) and policy-as-code workflows and experience operating Databricks (Spark) and real-time stream processing with Apache Flink at production scale Strong observability and SRE tooling background (e.g., Splunk, OpenTelemetry,...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Apache Spark. Be the first to apply!


