Average salary: $185,000 /yearly
More statsGet new jobs by email
- ...Migration Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility... ...Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies. Performance Optimization:...Suggested
- ...Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg to join our team in Bangalore, Karnātaka (IN-KA), India... ...Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with...SuggestedWork at officeRemote workFlexible hours
- ...Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg to join our team in Bangalore, Karnātaka (IN-KA), India... ...- *Extraction & Logic:* Python, Kafka, ANSI SQL, FTP, Apache Spark - *Data Formats:* JSON, Avro, Parquet- *Platforms:* Hadoop (...SuggestedWork at officeRemote workFlexible hours
- ...on-premises to Cloud Migration, Continuous Delivery, Big Data, Apache, Web Logic, Jenkins) in Reston, VA Apache, AWS, Big Data, Cloud... ...Docker, RDBMS, Big Data, NoSQL, HADOOP, NOSQL, Apache Kafka, Apache Spark, WebLogic, Oracle, Linux, Unix, Windows SCREENING QUESTIONS: 1...SuggestedPermanent employmentFull timeRemote work
- SIX Software Engineers ( Java, Spring, Spring boot, Apache NiFi, Maven, Hadoop, MongoDB, MS Access, Accumulo) in Baltimore, MD Accumulo, Apache Nifi, Hadoop, Java, Maven, MS Access, Spring Boot, Spring Frameworks Location: Maryland Job Function: Software Development...SuggestedFull timeRemote work
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...SuggestedFull timeLocal areaImmediate startRemote work
- ...Experience designing and implementing modern cloud-native data architectures. Hands-on experience with Apache technologies such as Kafka, Spark, or Flink. Knowledge of event-driven architecture patterns and Azure Event Hubs. Familiarity with Azure...SuggestedLocal areaRelocation3 days per week
- ...Databricks Workflows and integration with orchestration tools (e.g., Apache Airflow). Drive CI/CD automation, deployment strategies,... ...DevOps best practices. Optimize performance of pipelines, Spark jobs, and compute resources. Provide architectural guidance...SuggestedLocal area
- ...Preferred Qualifications: Experience with modern cloud-native data architectures. Hands-on experience with Apache tools (Kafka, Spark, Flink) and Java-based frameworks. Experience with event-driven architectures (e.g., Event Hubs). Familiarity with...Suggested
- ...environments. Big Data Processing : Handle large datasets using Spark, Delta Lake, and Databricks notebooks. Integration : Connect Databricks... ...experience with Databricks notebooks, clusters, and Delta Lake. Apache Spark : Expertise in PySpark/Scala for distributed data...Suggested
$48.95 per hour
...data into the enterprise data pipeline for analytics and operational reporting. Engineer, enhance ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing into Apache Solr, AWS Open Search platforms. Leverage Generative AI services...SuggestedContract workRemote work- ...Basic Qualifications: Minimum 10+ years of experience in data architecture and engineering. Expert-level knowledge of Apache Spark and its core concepts. Hands-on proficiency in Scala and/or Java (code-first approach mandatory). Advanced SQL skills...SuggestedWork experience placementWork at officeLocal areaImmediate start
- ..., operational excellence, platform reliability, and business alignment. This role requires hands-on experience with Databricks, Apache Spark, Airflow/Astronomer, DevOps practices, and Data Engineering frameworks , along with the ability to manage multiple teams, stakeholders...Suggested
- ...solutions using the Databricks platform. Core Technical Responsibilities Architect and optimize big data pipelines using Apache Spark, Delta Lake, and Databricks-native tools. Design scalable data ingestion and transformation workflows, including batch and...Suggested
- ...Location : Iselin, NJ Skill Cluster : Data-AWS Glue with EMR, Spark, Redshift,Kinesis,S3,AWS Native Data Services. Primary Skill :... ...Databricks Jobs or external tools like AWS MWAA (Managed Workflows for Apache Airflow). Implement CI/CD pipelines and version control (Git)...Suggested
- ...stack Experience with Epic and SQL Server Background in healthcare data Technical Stack Languages & Tools: Python Spark Notebooks Apache Airflow Data Architecture: Delta tables Parquet format Medallion architecture (bronze, silver, gold layers) Lakehouses and...Contract workRemote workFlexible hours
- ...Skills: Technical Proficiency: Expert-level Python (pandas, NumPy, scikit-learn, PySpark). Extensive experience with Apache Spark for large-scale data processing. Proficiency in SQL for data manipulation and querying in Lakehouse environments. AI Foundations...
- ...experience in Data Engineering, Data Architecture, or Solution Architecture. ~5+ years of hands-on experience with Databricks, Apache Spark, PySpark, and SQL. ~ Strong expertise in Databricks Lakehouse, Delta Lake, Unity Catalog, and MLflow. ~ Experience...Remote work
- ...develop, and maintain end-to-end data pipelines in Databricks using Spark and Delta Lake Build and optimize ELT/ETL processes for... ...platforms, or related roles ~ Hands-on experience with Databricks, Apache Spark (PySpark), and Delta Lake ~ Strong SQL and data...Contract workLocal areaRelocation
- ..., build, and maintain scalable data pipelines using Databricks, Spark, and cloud-native services Develop and optimize ETL/ELT workflows... ...(AWS and/or Azure) Hands ‑ on experience with Databricks, Apache Spark, and Delta Lake Strong skills in Python / PySpark and SQL...Work at officeRemote workFlexible hours
- ...requests, pytest, logging). Read and modify existing Scala/Spark jobs as needed. Use shell scripting for automation and operational... ...Time Processing Build near real time pipelines using Apache Kafka / Azure Event Hub. Implement Spark Structured...Long term contract3 days per week
- ...managing data pipelines Azure Databricks: Proficiency in building and optimizing distributed data processing solutions Apache Spark: In-depth knowledge of Spark architecture and distributed computing concepts Lakeflow Declarative Pipelines: Practical...Work experience placement
- ...of owning complex workstreams. Key Responsibilities Design, develop, and maintain data pipelines using Scala and SQL on Apache Spark Monitor and support Phase 1 pipelines post go-live Investigate and remediate pipeline failures, data quality issues, and...Local areaImmediate start
- ...Data Architect || Lead Data Engineer || Data Engineer (3 Different Roles)) with Apache Spark, Fabric & Azure Synapse - Onsite at Atlanta GA (Not Remote) 1. Data Architect Location: Midtown Atlanta, GA (4 Days Onsite) Start: Immediate Required Skills: 10+ years of Data...Immediate start
- ...Strong proficiency in Python for ML pipelines, model serving, automation, and framework development Hands‑on experience with Apache Spark / PySpark for large‑scale data processing, feature engineering, and batch inference Proven experience building and operating...Work at officeRemote workFlexible hours
- ...compliance standards are consistently maintained. Optimize Spark and SQL workloads to improve performance, scalability, and cost... ...disciplines. ~5+ years of hands-on experience with Databricks and Apache Spark. ~ Strong expertise in PySpark, Spark SQL, and large-...Contract workH1b
- ...stores into a scalable Medallion Architecture (Bronze, Silver, Gold layers): • Delta Lake Optimization: Using Databricks and Apache Spark to build ETL/ELT data pipelines with ACID transactions. Senior engineers handle schema evolution, upserts, and slowly changing...
- ...enterprise systems using orchestration tools such as Azure Logic Apps, Apache Airflow, or Databricks Workflows. • Develop... ...Lake for large-scale data processing • SQL (T-SQL / Spark SQL) for feature engineering and data validation •...Contract workWork at officeRemote workFlexible hours
- ...Ongoing (Quarterly renewal) Day to Day Job Duties: •Migrate Spark Job Definitions from Synapse to Fabric (32) Build Fabric Pipelines... ..., develop, and maintain data pipelines using Scala and SQL on Apache Spark. • Monitor and support Phase 1 pipelines post go-live....Contract workWork experience placementWork at officeImmediate startRemote workFlexible hours
- ...and execute migration from traditional Data Lake architecture to Lakehouse architecture Modernize data platforms using: Apache Spark Apache Iceberg / Open Table formats Snowflake / Cloud Data Warehouse ~ Refactor and migrate existing data pipelines to...Work at officeRemote workFlexible hours