Average salary: $185,000 /yearly
More statsGet new jobs by email
$103k - $140k
...storage at scale. Depending on the assignment, you may: Build Spark-based extract, transform, and load (ETL) pipelines with Glue,... ...layer, including Parquet, partitioning, and lifecycle, feeding Apache Iceberg tables. Connect PostgreSQL on Amazon Aurora and DynamoDB...SuggestedFull timeTemporary workWork at officeImmediate start- ...federal standards. Collaborate with product managers, engineers, security specialists, and business analysts to deliver API-ready data platforms using Databricks, Spark, and Terraform, ensuring availability and compliance across dev, test, #J-18808-Ljbffr Jobleads-USSuggestedRemote job
- ...-as-code tools such as Terraform. ETL Pipeline Development: Build and maintain data pipelines using Databricks notebooks and Apache Spark for large-scale data processing. Manage data flow from source systems through cloud object storage staging into target database...SuggestedContract workTemporary workWork experience placementLocal areaRemote workFlexible hours
$89.89k - $175.44k
...programming language used for data engineering. Experience with modern data-integration and workflow frameworks such as Apache Airflow, AWS Glue, Spark, or comparable tools. Experience with Jupyter Notebook or other equivalent tools for analyzing data. Experience with...SuggestedContract workLocal areaImmediate startFlexible hours- ...environments, or cloud-based data solutions Proficiency in Python, SQL, and data engineering concepts Experience with Databricks, Apache Spark, PySpark, or similar big data technologies Experience with AWS cloud services such as S3, IAM, CloudWatch, Glue, Athena, or...Suggested
$99k - $130k
...Kubernetes, Amazon ECS) Experience with Big Data Tools/Frameworks: Spark, Hadoop, Presto, Amazon EMR. Advanced SQL experience Hands on... ...) Experience with Streaming Data Ingestion (Amazon Kinesis, Apache Kafka) Experience with Semantic Modeling or Visual Analytics (Tableau...SuggestedTemporary workLocal area$150k - $200k
...environments. Responsibilities Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark (PySpark), SQL (PostgreSQL), and AWS Glue Develop and optimize AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA...SuggestedTemporary workRemote work- ...solutions. This role requires strong expertise in Lucidworks Fusion, Apache Solr, and relevance tuning to build scalable and high-performing... ...in search/recommendation systems. Knowledge of Kafka, Spark, or streaming technologies. Experience in eCommerce or large-...SuggestedContract workTemporary workLocal area
HarmonyTech
Washington DC7 days ago - ...runs it on schedule at full volume, and the path that writes what it found back to the lake as evidence. Our stack is Amazon EKS, Spark, Apache Iceberg and Delta Lake, Argo Workflows, Argo CD, Crossplane, and Python and Scala. We do not expect you to have used all of it....SuggestedFull timeRemote workFlexible hours
- ...engineering practices. Technical Skills Expert‑level experience with Databricks Lakehouse Platform. Strong proficiency with Apache Spark, PySpark, SQL, and Python. Experience designing and maintaining operational data pipelines at enterprise scale. Hands‑on experience...SuggestedFor contractorsLocal area
$150k - $200k
...clients. You Will Get To Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models using Python, Apache Spark (PySpark), SQL (PostgreSQL), and AWS Glue. Develop and optimize AWS-native data platforms leveraging AWS Glue, Amazon EMR, Amazon...SuggestedFull timeTemporary workRemote work$65 - $68 per hour
...Experience implementing a Cloud BPM implementation for the Federal Government. Experience developing and integrating Appian CMS, Apache Spark, Java, Python, AWS (EMR, AWS Lambda, AWS RDS services). Experience in RDBMS’s Oracle, Snowflake, SQL Server, and hands-on...SuggestedRemote jobHourly payLive inLocal areaFlexible hours- ...documentation, and code review. Databricks & Lakehouse Engineering Design and implement Databricks lakehouse solutions using Apache Spark, Delta Lake, Unity Catalog, notebooks, workflows, and SQL warehouses. Develop scalable data models and medallion architectures...Suggested
- ...of experience with data integration and ingestion tools, such as Apache NiFi. Methodology: Experience working with Scrum and Kanban... ...platforms including Hadoop, MapReduce, Hive, HBase, Kafka, and Spark. DevOps & Tools: Understanding of git and DevOps-enabled technologies...SuggestedContract workRemote work
$75 - $80 per hour
...Strong hands-on expertise in Amazon MSK (Managed Streaming for Apache Kafka), Kafka Streams, and Kafka Connect. Experience in managing... .../Sub messaging platforms and frameworks. Experience with Flink, Spark Streaming, or similar frameworks for real-time processing. Deep...SuggestedContract work$296.3k
...performant and enable quick iteration by distributed teams. Strong data processing skills using tools like Numpy, Pandas, and Apache Spark. Experience developing or working with safety-critical code and systems Experience deploying foundation models into production...Full timeLocal areaRemote workWork from homeRelocationRelocation packageFlexible hours$160k - $205k
...Data orchestration API-based integrations Enterprise Platforms Linux Git Maven Elasticsearch PostgreSQL Apache Spark Solr Software Engineering Software development lifecycle (SDLC) Object-oriented design Design patterns CI/CD best...For contractorsFlexible hours- ...graph libraries and frameworks, and machine learning libraries (e.g., PyTorch Geometric, DGL, GDS) Proficient in at least one Apache Spark-based cloud service (e.g., Azure Databricks) Commitment to and engagement in building strong and trustful relationships with teammates...Full timeTemporary workWork at officeImmediate start3 days per week
Amida Technology Solutions
Washington DC1 day ago - ...High and multi-tenant security and compliance standards. The ideal candidate has strong hands-on experience with Databricks, Apache Spark, and the broader AWS data ecosystem. This individual should be comfortable working across the full data lifecycle—from ingestion...Full timeFlexible hours
- ...Workshop, Contour, Actions, or Functions. Palantir Foundry certification or formal Foundry training. Experience using PySpark, Apache Spark, or Databricks notebooks. Experience developing ontology-driven applications and operational workflows. Advanced...For contractors
- ...maintaining ETL/ELT pipelines at scale. ~ Extensive experience with AWS, Google Cloud Platform (GCP), or Azure. ~ Proficiency in Apache Spark, Kafka, NoSQL databases, and orchestration tools like Apache Airflow. ~ Strong skills in Python, Java, or Scala. ~ Deep...Full time
$65.05 per hour
...implementing, and maintaining distributed systems. ~ Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger. ~ Knowledge of Apache Iceberg and object storage such as S3 or Ozone. ~ Strong Python development for automation and services...Contract work- ...develop, and maintain scalable data solutions. Strong experience with Microsoft Azure data services Hands-on expertise in Databricks, Apache Spark, and data engineering workflows Proficiency in Alteryx for data preparation and analytics Strong knowledge of SQL, ETL/ELT...Full timeWorldwide
- ...architecture using GKE with Cloud SQL and Pub/Sub. Big Data Experience working with large-scale data processing frameworks such as Apache Spark, Dataflow, or BigQuery. Example: Building ETL pipelines that process terabytes of daily event data and transform it for...
$90 - $105 per hour
...governed raw, clean, and curated data layers using Python, PySpark, Spark SQL, Foundry Code Repositories, Pipeline Builder, Databricks,... ...Databricks Lakehouse and Medallion architectures using Apache Spark and Delta Lake, including incremental and historical processing...Hourly payWork at office- ...areas. Strong enterprise experience with Databricks . Expert knowledge of: Databricks Lakehouse Delta Lake Apache Spark PySpark Spark SQL SQL Medallion Architecture Unity Catalog Strong experience designing ETL/ELT...
$75k - $110k
...freshness, and statistical validity. Build automated quality checks and integration/end-to-end tests using Python, PySpark/Spark, SQL, and Apache Airflow. Validate data transformations and pipelines across Apache Spark, Python, AWS, Amazon S3, and related AWS data...Full timeTemporary workRemote work- ...deployment and adoption. Design and develop Databricks Apps and production-grade data/AI solutions using Python or Scala, SQL, Apache Spark, Delta Lake, and Databricks platform services. Build reference architectures and scalable solutions across batch/streaming...
- ...maintaining Infrastructure-as-Code solutions using Terraform and CI/CD pipelines. ~ Strong knowledge of Delta Lake, Unity Catalog, Apache Spark, and lakehouse architecture concepts. ~ Experience developing automation solutions and reusable engineering components....
- ...Job Title: Data Engineer Databricks / Scala / Spark / Kafka Work Location: Richardson, TX | Indianapolis, IN | Tampa, FL | Hartford,... ...experienced Data Engineer with strong expertise in Databricks, Scala, Apache Spark, and Kafka to design, develop, and maintain scalable data...Long term contract
