Get new jobs by email
$121.7k - $162.2k
...that enable analytics, reporting, AI, and machine learning initiatives. Build and optimize enterprise data platforms using Databricks, Spark, Delta Lake, and Azure cloud services, ensuring performance, scalability, reliability, and cost efficiency. Develop and maintain ELT...SuggestedFull time$180k - $247.5k
.... Prior experience with coding in a core programming language (i.e., Python, Java, Scala) and willingness to learn a base level of Spark. Hands-on expertise with complex proofs-of-concept and public cloud platform(s). Know how to provide technical solutions for specialized...SuggestedFull timeWorldwide$92.25k - $120k
...deploying, versioning, and monitoring ML models in production environments. Required Skills ML / MLOps 2+ years of experience in: MLflow / Spark ML Python and ML libraries Model training and evaluation Model registration, versioning, and lifecycle management Model deployment,...SuggestedFull timeWork at officeImmediate startRemote workWork from home- ...designing and implementing modern cloud-native data architectures. Hands-on experience with Apache technologies such as Kafka, Spark, or Flink. Knowledge of event-driven architecture patterns and Azure Event Hubs. Familiarity with Azure App Configuration...SuggestedLocal areaRelocation3 days per week
- ...Qualifications: Experience with modern cloud-native data architectures. Hands-on experience with Apache tools (Kafka, Spark, Flink) and Java-based frameworks. Experience with event-driven architectures (e.g., Event Hubs). Familiarity with Azure App...Suggested
- ...Azure, Amazon Web Services, Google Cloud. Data Technologies: ~ Strong knowledge of: Kafka, OpenTelemetry, OCSF, Iceberg, Spark SQL, Python, REST APIs, Event Streaming Architectures. Preferred Qualifications: Experience with Cribl Stream and Cribl...Suggested
- ...database performance tuning. ~ Experience supporting enterprise production environments. ~ Strong understanding of Delta Lake, Spark SQL, and modern Data Engineering architectures. ~ Experience with monitoring, alerting, troubleshooting, and platform support....SuggestedContract workLocal area
- ...ServiceNow. Desired Skills & Experience: Kubernetes, OpenShift preferred. Object Storage. Execution Engines such as Spark or Trino. Table formats such as Iceberg or Hive. Metadata Lineage tools such as Datahub. Observability tools...SuggestedLong term contractContract work
- ...with project delivery and team performance. Mandatory Skills: Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes. Strong programming skills in languages such as Python, Scala, or SQL. Experience with cloud based...Suggested
- ...in building scalable ELT pipelines using dbt , implementing data transformations in Snowflake , and leveraging Databricks (PySpark & Spark SQL) for large-scale data processing. This role requires a strong understanding of data warehousing, cloud-native architectures,...SuggestedContract workLocal area
- ...skills: Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform) Production Support & Platform Reliability (using Splunk...Suggested
- ...Apache Airflow). Drive CI/CD automation, deployment strategies, and DevOps best practices. Optimize performance of pipelines, Spark jobs, and compute resources. Provide architectural guidance and technical leadership across cross-functional teams. Engage...SuggestedLocal area
- ...systems, and big data workflows. Proficiency in QMetry for test management, defect tracking, and reporting. Strong understanding of Spark architecture, data lakes, and cloud platforms. Experience with CI/CD pipelines and integration of automated tests into Databricks workflows...Suggested
- ...experience with Azure Databricks and PySpark for large-scale data processing. Experience defining standards for Databricks workloads, Spark-based pipelines, and data science model integration with production data platforms. Prior experience delivering cloud-based...SuggestedRemote work
- ...: Migrate data from on-premises or legacy systems into Azure cloud environments. Big Data Processing : Handle large datasets using Spark, Delta Lake, and Databricks notebooks. Integration : Connect Databricks with Azure Data Lake, Synapse, Power BI, and other services....Suggested
- ...breakdown of typical responsibilities: Core Technical Responsibilities Architect and optimize big data pipelines using Apache Spark, Delta Lake, and Databricks-native tools. Design scalable data ingestion and transformation workflows, including batch and...Work at office
- ...mandatory) Java or C++ (preferred) ~ Hands-on experience in: ML frameworks (TensorFlow, PyTorch, XGBoost) ~ Distributed processing (Spark, Flink) ~ Streaming systems (Kafka) ~ SQL & NoSQL databases ~ Experience building production-grade ML pipelines and...
$48.95 per hour
...data into the enterprise data pipeline for analytics and operational reporting. Engineer, enhance ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing into Apache Solr, AWS Open Search platforms. Leverage Generative AI services...Contract workRemote work- ...Qualifications: Minimum 10+ years of experience in data architecture and engineering. Expert-level knowledge of Apache Spark and its core concepts. Hands-on proficiency in Scala and/or Java (code-first approach mandatory). Advanced SQL skills and...Work experience placementWork at officeLocal areaImmediate start
- ...Vector Embeddings RAG Architectures AI Agents SnowPro Core, Advanced, or Architect Certifications. Experience with: dbt Airflow Kafka Spark Fivetran Matillion Knowledge of: AI/ML Workflows Vector Databases Semantic Search Generative AI Architectures Experience integrating...Contract work
- ...operational excellence, platform reliability, and business alignment. This role requires hands-on experience with Databricks, Apache Spark, Airflow/Astronomer, DevOps practices, and Data Engineering frameworks , along with the ability to manage multiple teams,...
- ...Job Description Job Description Description Want to be your own boss? With the Spark Driver™ app, you can make some extra cash by shopping and delivering for customers of Walmart and other local businesses. Available in more than 3,650 cities and all 50 states,...Extra incomeFor contractorsLocal area
Spark Driver
Kyle, TX4 days ago - ...within Snowflake SnowPro Core Advanced or Architect certifications Experience with modern data stack tools dbt Airflow Kafka Spark Fivetran Matillion or similar Knowledge of AIML workflows vector databases semantic search and integrating structure...
- ...information cubes, transfer rules, routines, and user exits. ~ Experience building scalable data pipelines using Databricks and Spark, including PySpark and SQL, Delta Lake, and integration with SAP and enterprise data sources. ~ Experience with SAP HANA data modeling...Contract workWork at officeRemote work
- ...within Snowflake Snow Pro Core Advanced or Architect certifications. Experience with modern data stack tools dbt Airflow Kafka Spark Five Tran Matillion or similar. Knowledge of AIML workflows vector databases semantic search and integrating structured unstructured...Long term contract
- ...experience with Databricks (architecture, administration, or platform engineering) ~ Strong understanding of distributed data processing (Spark) ~ Experience with cloud platforms (Azure preferred, or AWS/Google Cloud Platform) ~ Knowledge of data lake architecture,...Contract work
- ...AWS/Azure/Google Cloud Platform) Understanding of AI/ML concepts and model deployment Experience with big data technologies (Spark, Kafka is a plus) Preferred Skills: Experience with MLOps and model lifecycle management Knowledge of data lake and...
- ...Server Background in healthcare data ________________________________________ Technical Stack Languages & Tools: Python Spark Notebooks Apache Airflow Data Architecture: Delta tables Parquet format Medallion architecture (bronze, silver, gold layers) Lakehouses...Contract workRemote workFlexible hours
- ...Functions (orchestration) IAM, Lake Formation (security) Data Engineering & Processing Strong hands-on experience with: PySpark / Spark (EMR or Glue) SQL (advanced level) Python for data pipelines Experience with streaming (Kinesis / Kafka) is a plus Data...Contract work
- ..., and regulatory reporting. Ensure models are fit for the consumers who rely on them. Performance & Scale: Optimize SQL and Spark workloads, partitioning, storage design, and query performance to meet stringent EOD SLAs. Data Observability: Integrate quality...
