Get new jobs by email
- ...Duration: 12+ Months Females are preferred Design, develop, and optimize large-scale data processing pipelines using Apache Spark (Spark SQL, Spark Core, and DataFrames) for high-volume batch and real-time data workloads. Write complex and high-performance...Suggested
$55 - $60 per hour
...automated build, deployment, and testing pipelines. Experience deploying and managing applications on AWS services such as Lambda, EMR, and Spark. Experience with containerized deployments and orchestration platforms. Experience troubleshooting production issues and improving...SuggestedContract work- ...assisted data enrichment Design and manage analytical workloads in Azure Synapse Analytics (Lakehouse patterns, dedicated SQL pools, Spark transformations) Maintain hybrid/multi-cloud resilience by leveraging AWS services (S3, Glue, Lambda) for contingency pipelines...Suggested
$68.25 per hour
...SQL. Scala is a plus. Deep experience with Snowflake including ELT, performance tuning, and security. Experience with Databricks and Spark, including Delta Lake and structured streaming. Experience integrating and modeling data from MongoDB for operational and analytics...SuggestedContract workImmediate start3 days per week$55 - $60 per hour
...automated build, deployment, and testing pipelines. Experience deploying and managing applications on AWS services such as Lambda, EMR, and Spark. Experience with containerized deployments and orchestration platforms. Experience troubleshooting production issues and improving...SuggestedContract work- ...integration patterns, and reference architectures. Architect scalable ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), and/or Cloud Composer orchestrations. Lead cloud-native modernization initiatives: migration from legacy platforms to Google...Suggested
- ...Intelligence & Expert Systems, GitHub, Tekton, Docker, Jira, Microservices, Data Architecture, Agile Software Development, SQL, Java, Spark, Cloud Architecture, Apache Kafka, REST APIs Skills Preferred: Telematics, Machine Learning, Data Modeling, Cloud...SuggestedLocal area
- ...ideal candidate will have deep expertise in distributed systems, cloud platforms, and modern big data technologies such as Hadoop, Spark, and Kubernetes-based orchestration. Responsibilities: Design, develop, and maintain large-scale data processing pipelines...Suggested
- ...teams Required Skills Core Skills (Must Have) Strong experience in: OpenShift (OCP) / Kubernetes-based platforms PySpark / Spark ecosystem CI/CD implementation for data platforms Airflow / Autosys orchestration tools Solid understanding of: Data lake architectures...Suggested
- ...using AWS Lake Formation, KMS encryption, and SSL. Build and operate data services on EKS (Kubernetes). Work with the Hadoop ecosystem (Spark, Hive, HDFS) using partitioning, bucketing, and columnar formats (Parquet, ORC). Troubleshoot and resolve complex big data issues...Suggested
- ..., and backup strategies Exposure to DevOps practices , CI/CD, and infrastructure automation Experience with Databricks or Spark-based processing Knowledge of data governance and compliance frameworks Familiarity with FinOps practices for cloud cost optimization...SuggestedRemote workShift work
- ...demonstrated experience designing and implementing data ingestion pipelines using tools such as: Azure Data Factory Apache Kafka Apache NiFi Spark Structured Streaming or equivalent technologies. ~5+ years of experience applying de-duplication techniques at scale, including:...SuggestedPermanent employmentLocal areaRemote work
- ...industry certifications (e.g., Microsoft Certified: Azure Database Administrator Associate), experience with Big Data technologies (Spark, Hadoop), and DevOps practices (CI/CD, Terraform). Skills/Requirements Exp. working with SQL, SSRS, SSIS, SSAS,Databricks,...SuggestedPermanent employment
- ...Kubernetes) and CI/CD practices. Experience working with large-scale machine learning frameworks such as TensorFlow, Caffe2, PyTorch, Spark ML, or related frameworks. Experience and knowledge in the most recent advancements in Gen AI, including Gemini, OpenAI, Claud...SuggestedImmediate start
- ...as AWS SageMaker, Vertex AI, Kubeflow, or MLflow. Develop and maintain feature stores and data transformation pipelines using Spark, PyTorch, or TensorFlow. Deploy and serve models via REST/gRPC endpoints or Lambda-based inference APIs with high availability...Suggested