Get new jobs by email
- ...experience with Azure Databricks and PySpark for large-scale data processing. Experience defining standards for Databricks workloads, Spark-based pipelines, and data science model integration with production data platforms. Prior experience delivering cloud-based...SuggestedRemote work
- ...ServiceNow. Desired Skills & Experience: Kubernetes, OpenShift preferred. Object Storage. Execution Engines such as Spark or Trino. Table formats such as Iceberg or Hive. Metadata Lineage tools such as Datahub. Observability tools...SuggestedLong term contractContract work
- ...Azure, Amazon Web Services, Google Cloud. Data Technologies Strong knowledge of: ~ Kafka, OpenTelemetry, OCSF, Iceberg, Spark SQL, Python, REST APIs, Event Streaming Architectures. Preferred Qualifications: Experience with Cribl Stream and Cribl...Suggested
- ...mandatory) Java or C++ (preferred) ~ Hands-on experience in: ML frameworks (TensorFlow, PyTorch, XGBoost) ~ Distributed processing (Spark, Flink) ~ Streaming systems (Kafka) ~ SQL & NoSQL databases ~ Experience building production-grade ML pipelines and...Suggested
- ...Vector Embeddings RAG Architectures AI Agents SnowPro Core, Advanced, or Architect Certifications. Experience with: dbt Airflow Kafka Spark Fivetran Matillion Knowledge of: AI/ML Workflows Vector Databases Semantic Search Generative AI Architectures Experience integrating...SuggestedContract work
- ...information cubes, transfer rules, routines, and user exits. ~ Experience building scalable data pipelines using Databricks and Spark, including PySpark and SQL, Delta Lake, and integration with SAP and enterprise data sources. ~ Experience with SAP HANA data modeling...SuggestedContract workWork at officeRemote work
- ...Job Title : AWS Data Engineer with Databricks and DBT Job Location : Iselin, NJ Skill Cluster : Data-AWS Glue with EMR, Spark, Redshift,Kinesis,S3,AWS Native Data Services. Primary Skill : CICS Job Description Responsibilities Design and Development of Data...Suggested
- ...AWS/Azure/Google Cloud Platform) Understanding of AI/ML concepts and model deployment Experience with big data technologies (Spark, Kafka is a plus) Preferred Skills: Experience with MLOps and model lifecycle management Knowledge of data lake and...Suggested
- ...operational excellence, platform reliability, and business alignment. This role requires hands-on experience with Databricks, Apache Spark, Airflow/Astronomer, DevOps practices, and Data Engineering frameworks , along with the ability to manage multiple teams,...Suggested
$48.95 per hour
...data into the enterprise data pipeline for analytics and operational reporting. Engineer, enhance ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing into Apache Solr, AWS Open Search platforms. Leverage Generative AI services...SuggestedContract workRemote work- ...systems, and big data workflows. Proficiency in QMetry for test management, defect tracking, and reporting. Strong understanding of Spark architecture, data lakes, and cloud platforms. Experience with CI/CD pipelines and integration of automated tests into Databricks workflows...Suggested
- ...Basic Qualifications: Minimum 10+ years of experience in data architecture and engineering. Expert-level knowledge of Apache Spark and its core concepts. Hands-on proficiency in Scala and/or Java (code-first approach mandatory). Advanced SQL skills and deep data...Suggested
- ..., and regulatory reporting. Ensure models are fit for the consumers who rely on them. Performance & Scale: Optimize SQL and Spark workloads, partitioning, storage design, and query performance to meet stringent EOD SLAs. Data Observability: Integrate quality...Suggested
- ...with Azure stack Experience with Epic and SQL Server Background in healthcare data Technical Stack Languages & Tools: Python Spark Notebooks Apache Airflow Data Architecture: Delta tables Parquet format Medallion architecture (bronze, silver, gold layers)...SuggestedContract workRemote workFlexible hours
- ...Qualifications: Experience with modern cloud-native data architectures. Hands-on experience with Apache tools (Kafka, Spark, Flink) and Java-based frameworks. Experience with event-driven architectures (e.g., Event Hubs). Familiarity with Azure App...Suggested
- ...with project delivery and team performance. Mandatory Skills: Proven expertise in Azure Databricks, including experience with Spark, data pipelines, and data lakes. Strong programming skills in languages such as Python, Scala, or SQL. Experience with cloud based...
- ...database performance tuning. ~ Experience supporting enterprise production environments. ~ Strong understanding of Delta Lake, Spark SQL, and modern Data Engineering architectures. ~ Experience with monitoring, alerting, troubleshooting, and platform support....Contract workLocal area
- ...designing and implementing modern cloud-native data architectures. Hands-on experience with Apache technologies such as Kafka, Spark, or Flink. Knowledge of event-driven architecture patterns and Azure Event Hubs. Familiarity with Azure App Configuration...Local areaRelocation3 days per week
- ...Hybrid Mandatory skills: big data technologies, cloud platforms, AWS, Azure, Databricks platform, scalable analytics solutions, Spark, Unstructured format, Unity Catalog, Genie, Immuta, lambda, dynamodb, aws data sync, aws sftp, programming languages, Java, Python,...For contractors3 days per week
- ...data products including Customer 360, Financial Crimes, and DTR Current environment includes: Snowflake, Azure, AWS, Databricks, Spark, Airflow, Scala, Python, Terraform, Open-source data engineering stack The immediate priority is standing up Snowflake on Azure...Immediate start
- ...applications within Snowflake SnowPro Core Advanced or Architect certifications Experience with modern data stack tools dbt Airflow Kafka Spark Fivetran Matillion or similar Knowledge of AIML workflows vector databases semantic search and integrating structure dunstructured...
- ...Data Mesh concepts . Required Skills - Hands-on experience with Databricks and core data engineering tools (SQL, Python, Spark; Hadoop familiarity acceptable) Experience designing and building data pipelines and ETL/ELT processes Experience with cloud...
- ...skills: Data Engineering / Streaming Platforms (Kafka, real-time pipelines using scala/python, NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala, AWS, Databricks, cloudera manager platform) Production Support & Platform Reliability (using Splunk...
- ...: Migrate data from on-premises or legacy systems into Azure cloud environments. Big Data Processing : Handle large datasets using Spark, Delta Lake, and Databricks notebooks. Integration : Connect Databricks with Azure Data Lake, Synapse, Power BI, and other services....
- ...experience as an ETL/ELT developer/data engineer. 3+ years of Databricks data engineering experience (Databricks Data Engineer and/or Spark Developer certification preferred). Knowledge in GitHub, Jenkins, Informatica. Working knowledge of the Finance or Insurance...Contract work
- ...Bricks, Python Required Experience: 5+ years of Data Engineering experience Strong expertise in Azure Databricks (PySpark/Spark SQL) Hands-on experience with Azure Data Factory, ETL/ELT, and data ingestion frameworks Experience building and optimizing...Contract work
- ...Collaborate with business stakeholders, data architects, and product owners to translate requirements into technical designs Optimize Spark jobs, cluster configurations, and cost management across cloud environments (AWS, Azure, or Google Cloud Platform) Integrate...
- ...development. ~3+ years of hands-on experience with Databricks Data Engineering. ~ Strong expertise in AWS Databricks, Python, Spark, SQL, and UNIX Shell Scripting. ~ Experience with GitHub, Jenkins, and Informatica. ~ Knowledge of Finance or Insurance...
- ...is Charlotte NC , Irving TX, Chandler AZ, Columbus OH , Des Moines and Minneapolis MN (3 days onsite) W2 Candidates Experience with Spark, PySpark, Python, Data Lakehouse architecture, Kafka , Airflow , GCS, Big Query, Cloud Composer, Web based UI development using React...
- ...Apache Airflow). Drive CI/CD automation, deployment strategies, and DevOps best practices. Optimize performance of pipelines, Spark jobs, and compute resources. Provide architectural guidance and technical leadership across cross-functional teams. Engage...Local area