Average salary: $185,000 /yearly
More statsGet new jobs by email
$175k - $195k
...: Who You Are Quantifind is seeking a Senior Platform Engineer to work on Quantifind's Apache Spark pipeline that generates risk signal results from diverse data sources such as Sanctions, PEP records, Negative News, Court & Arrest records, and much more. You will...SuggestedFull timeWork at officeImmediate startWork from homeFlexible hours- ...organization, apply now. We are currently seeking a Pentaho / Apache Hop to join our team in Bengaluru, Karnātaka (IN-KA), India (IN)... .... Integrate Apache Hop with external systems such as Kafka, Spark, Hadoop, or cloud storage (AWS S3, GCS, Azure Blob). Implement...SuggestedWork at officeRemote workFlexible hours
- ...on-premises to Cloud Migration, Continuous Delivery, Big Data, Apache, Web Logic, Jenkins) in Reston, VA Apache, AWS, Big Data, Cloud... ...Docker, RDBMS, Big Data, NoSQL, HADOOP, NOSQL, Apache Kafka, Apache Spark, WebLogic, Oracle, Linux, Unix, Windows SCREENING QUESTIONS: 1...SuggestedPermanent employmentFull timeRemote work
- ...Migration Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility... ...Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies. Performance Optimization:...Suggested
- SIX Software Engineers ( Java, Spring, Spring boot, Apache NiFi, Maven, Hadoop, MongoDB, MS Access, Accumulo) in Baltimore, MD Accumulo, Apache Nifi, Hadoop, Java, Maven, MS Access, Spring Boot, Spring Frameworks Location: Maryland Job Function: Software Development...SuggestedFull timeRemote work
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...SuggestedFull timeLocal areaImmediate startRemote work
- ...GA Job Summary We are seeking a highly skilled Data Engineer with strong expertise in Azure Synapse Analytics, Apache Spark, and modern cloud-based data platforms. The ideal candidate will have hands-on experience designing and implementing scalable...Suggested
- ...Job Responsibilities: Lead architecture and delivery of high-throughput, low-latency data pipelines using Databricks and Apache Spark (Core, SQL, Structured Streaming). Establish lakehouse patterns with Delta Lake (ACID transactions, schema evolution, time...SuggestedWork at office
- ...Unity Catalog, Lakeflow / Delta Live Tables, Databricks SQL, Photon, Serverless, Auto Loader, Databricks Apps, Vector Search Apache Spark (expert): PySpark and Scala; internals DAG execution, shuffle optimisation, memory tuning, adaptive query execution, Structured...SuggestedWorldwide
- ...Snowflake Data Engineer Location: Plano, TX Local F2F Required SnowSQL Apache Spark Design, develop, and maintain data pipelines using Snowflake and modern data engineering tools. Build and optimize data models (dimensional, star/snowflake schemas...SuggestedLocal area
$148k - $216k
...and platforms such as MLflow, Kubeflow, SparkML, Synapse ML, SQL, Spark/PySpark, dbt, and Airflow. Cloud Foundations: Practical... ...: Familiarity with distributed data computation engines such as Apache Spark, Ray, or Dask. Industry Certifications: Relevant cloud or...SuggestedRemote workFlexible hours- ..., including: SQL and data modeling Microsoft Fabric Data Engineering Lakehouse architecture OneLake Apache Spark and PySpark Fabric Notebooks Fabric Data Factory Data Pipelines and ETL/ELT Data Warehousing Real-Time...Suggested
- ...Delivery: Build and optimize batch and streaming data pipelines using Spark and Delta Lake Develop data products and domain-oriented... ...in large enterprise environments ~ Deep expertise in Apache Spark (Scala/Python), Delta Lake and Lakehouse architectures...SuggestedTemporary workRelocationFlexible hours
$135.81k - $231.25k
...or other ETL tools such as Azure Databricks, Azure Data Factory, Apache Nifi etc. Proficiency in SQL, Python, Scala, or Java for... ...Databricks Knowledgeable in big data technologies (e.g., Hadoop, Spark) and their integration with cloud platforms for handling large...SuggestedFull timeContract workTemporary workPart timeCasual workWork at officeLocal areaMonday to FridayShift work- ...catalog search. Build metadata extraction pipelines from SQL, Spark jobs, stored procedures, Airflow, dbt, and BI tools.... ...Python programming skills. ~ Hands-on expertise with PySpark and Apache Spark. ~ Experience with Snowflake Data Cloud. ~ Experience...Suggested3 days per week
$750 per month
...semantic models, business entity mappings, data dictionaries, and governed analytical datasets required. Strong experience with Apache Spark, PySpark, SQL, Python, DataOps automation, CI/CD pipelines, and cloud-native data engineering practices required. Experience supporting...Work experience placementWork at officeRemote workFlexible hours- ...engineering, ETL development, or data platform development. ~ Strong hands-on development experience with: Python, PySpark / Apache Spark, Advanced SQL. ~ Experience with Machine Learning model development, training, and tuning. ~ Experience working with...Contract workRemote workVisa sponsorship
- ...Integration Development Vault REST API Direct Data API Spark Messaging Vault Java SDK REST API Design Web API... ...Enterprise Integration Patterns Data Engineering Apache Iceberg Databricks Lakehouse AWS Integration AWS...
- ...Analytics, Azure API Management (APIM), Azure DevOps. Databases: SQL Server, Oracle, PostgreSQL, Delta Lake Big Data: Apache Spark Version Control: GitHub, Git, Azure DevOps Visualization: Power BI & Integration with REST APIs for custom dashboards....Relocation
- ...management. Preferred Skills Data Operations: Experience managing Lakehouse architectures and data platform components (e.g., Apache Spark, Trino, Apache Ranger, Apache Iceberg, Apache Superset, data catalogs). Security & Governance: Familiarity with AWS Secrets...
- ...systems to Azure-native services. Oversee Azure IaaS and PaaS services including Key Vault, Synapse, Data Factory, Databricks, Apache Spark, SQL MI, APIM, App Gateway, and App Services. Implement and enforce cloud security, cost management, and compliance...Permanent employmentLocal area3 days per week
- .... Modernize legacy ETL applications and migrate workloads to Spark and Spring Batch frameworks. Design and implement high-performance... ..., and retention management. Messaging & Event Streaming Apache Kafka administration and development. Kafka Producer and...Full timeWork at officeRemote workFlexible hours
- ...data platform engineering, cloud infrastructure, distributed data processing, and platform operations. Technical Skills: AWS, Apache Spark, Apache Flink, Apache Airflow, Kubernetes, Python, Iceberg, HDFS. Business / Domain Skills: Data Engineering, Cloud...Full time
- ...~ Excellent analytical, communication, and problem-solving skills. Preferred Skills Experience with PySpark or Apache Spark. Knowledge of AWS Glue, Redshift, Lambda, EMR, or Athena. Familiarity with Git and Linux. AWS Cloud certifications...Full time
- ...forecasting, and privacy-preserving analytics. You will develop Scala and Spark solutions on cloud platforms, implement governance and privacy... ...: 5+ years of data engineering with strong Scala and Apache Spark on AWS and/or Google Cloud Platform. Strong Python for pipelines...Hourly payWork at officeLocal area2 days per week
- .... The position requires hands-on work across Java, Python, Spark, TypeScript, Angular, AWS services, and event-driven architectures... ...-oriented and functional programming. Expertise in PySpark and Apache Spark for high-performance distributed data processing. Depth in...Hourly payWork at officeLocal area2 days per week
- ...Stack: Storage & Warehouse: BigQuery (including BigLake and Omni), Google Cloud Storage. Processing: Dataflow (Apache Beam), Dataproc (Spark/Hadoop), Cloud Composer (Airflow). Messaging: Pub/Sub and Confluent/Kafka integration. Analytics & AI:...Full timeRemote work
- ...The role requires leadership of a major workstream, strong Scala, Spark, SQL, and Python skills, and cloud data platform expertise. The... ...~8+ years in Data Engineering with strong Scala and extensive Apache Spark on AWS and/or Google Cloud Platform. ~ Strong Python for...Work at office2 days per week
$122k - $197k
...~ Expertise in SQL programming and database management systems ~ Hands-on experience with ETL tools and technologies (e.g. Apache Spark, Apache Airflow). ~ Familiarity with cloud platforms such as Google Cloud Platform (GCP), and experience with relevant services...Full timeCasual workWork at office3 days per week- ...Databricks Lead cloud modernization initiatives across Azure, AWS, or GCP Build and optimize Lakehouse architectures using Apache Spark and Delta Lake Develop secure, high-performance data solutions for analytics and AI/ML workloads Implement Infrastructure...Contract workRemote work