Average salary: $185,000 /yearly
More statsGet new jobs by email
$150k - $200k
...divh2Apache Spark Guru/Solutions Architect/h2pZachary Piper Solutions is seeking an Apache Spark Guru/Solutions Architect to support a reputable software company working with federal customers on short to medium term customer engagements on their big data challenges using...SuggestedTemporary work$175k - $195k
Senior Software Engineer (Apache Spark) Location Hybrid work in Washington, DC : Who You Are Quantifind is seeking a Senior Platform Engineer to work on Quantifind's Apache Spark pipeline that generates risk signal results from diverse data sources such as Sanctions,...SuggestedFull timeWork at officeImmediate startWork from homeFlexible hours$96.8k - $251.6k
...Strong programming skills (e.g., Python, Kafka, Java, Scala) with experience in distributed data processing technologies (e.g. Spark, Databricks, Apache Beam) • Deep knowledge of cloud data ecosystems on AWS, Oracle Cloud Infrastructure (OCI), and/or Azure; familiarity with...SuggestedTemporary workFlexible hours$145.7k - $171.4k
...developing unit tests. ~3+ years of experience in design and support of enterprise-level applications. ~3+ years of experience with Apache Spark. ~3+ years of experience with Git. ~3+ years of experience with CI/CD pipelines in Azure DevOps or similar. ~1+ years of...SuggestedFull timeRemote workFlexible hoursBlueprint Technologies
Washington DC11 hours ago- ...integrating visualization tools, such as Tableau, Qlik, Socrata, with data lakes and data warehouses). • Use of Big Data tools including Apache Spark, Databricks, Sagemaker and MLFlow. • Experience with Azure data tools including Synapse and Data Factory. • Net CoreWeb...Suggested
$79.2k - $178.1k
...orchestration technologies (Kubernetes, Docker) • Familiar with Java open-source and API standards • Previous experience of working with Apache Spark, Kafka and related technologies • Strong problem-solving, troubleshooting and analytical skills • Ability to quickly learn new...SuggestedTemporary workRemote workFlexible hours$54.12 - $85.2 per hour
...experience in providing mentorship and guidance to junior architects. Preferred Qualifications • Experience with Databricks, Apache Spark, and Delta Lake for real-time and batch data processing. • Proficiency in data streaming technologies such as Kafka, AWS Kinesis...SuggestedHourly payMonday to FridayFlexible hours- ...Cloud (multi-cloud experience preferred) - AI/ML Tools: TensorFlow, PyTorch, Scikit-learn, MLflow, Kubeflow - Data Integration: Apache Spark, Kafka, Airflow, Informatica, Talend - Programming: Python, SQL, Scala, Java - DevOps/MLOps: Docker, Kubernetes, CI/CD pipelines...SuggestedTemporary workWorldwideFlexible hours
$130k - $160k
...APIs, and operational procedures. Design and implement batch and/or real-time data pipelines processing terabytes of data using Apache Spark and/or Kafka. Design and manage data storage solutions using relational and non-relational databases. Work with Amazon S3,...SuggestedFull timeWork at officeWork from homeInrix
Washington DC11 hours ago$184k - $230k
...large-scale distributed systems and backend services. ~ Hands-on experience with data processing frameworks such as Apache Beam, Dataflow, or Spark, and orchestration tools like Airflow. ~ Strong understanding of cloud infrastructure (GCP, AWS, or Azure) and data storage...SuggestedFull timeMoloco
Washington DC11 hours ago$203k - $256k
...with performance tuning, and with with data processing frameworks (e.g. Spark, MapReduce, AWS EMR) ~ Experience in operating a workload/workflow management system (e.g. Ray.io , Slurm, Apache Airflow/Beam/Flink) and developing distributed systems using asynchronous...SuggestedFull timeTemporary workRelocation packageZoox
Washington DC11 hours ago$103.95k - $240.35k
..., Tableau, Power BI, D3.js) in an operational environment. • Experience with Big Data technologies and platforms such as Apache Hadoop, Apache Spark, and NoSQL Databases for the storing, processing and managing of large structured, semi-structured, and unstructured data...SuggestedPermanent employmentFull timeContract workPart timeWork experience placementWork at officeLocal areaRemote workWorldwideShift work- ...AI/ML solutions with existing client infrastructure, leveraging cloud platforms (Azure, AWS) and modern frameworks (Databricks, Apache Spark). Validate and optimize deployed models and solutions, ensuring alignment with business objectives and technical standards....SuggestedWork at officeLocal areaImmediate start
- ...Services (AWS), Microsoft Azure or equivalent cloud services ~ Apache Kafka, Google Cloud Pub/Sub or equivalent ~ Apache AirFlow... ..., RabbitMQ, Amazon Kinesis, Apache Flume, Apache Storm, Apache Spark Streaming, Google Cloud Pub/Sub ~ Experience with best-practice...SuggestedFull timeContract workWork at officeRemote work
- ..., containerization (Docker, Kubernetes), and cloud platforms Experience with data pipeline tools (Apache Airflow, Kubeflow, MLflow) and big data technologies (Spark, Hadoop) Knowledge of government compliance requirements, security frameworks, and responsible AI...SuggestedFull timeFor contractorsLocal area
- ...processing and pipeline concepts, such as ETL, ELT, and tools like Apache Airflow. Understanding of GitOps and CI/CD best practices... ...technologies, most specifically Hadoop, Snowflake, NoSQL, HDFs, Spark, Kafka, Trino, etc. ~ Familiarity with data transformations,...Work experience placementFlexible hours
$160k - $220k
...operating systems and tools like Terraform, Ansible, Puppet for managing them ~ Experience working with in-stream data processing using Apache Kafka, RabbitMQ, ActiveMQ, or similar technologies ~ Production experience with Docker and Kubernetes ~ Front-end experience in...Permanent employmentFull timeTemporary workWork at officeWorldwideMonday to FridayWeekend workSpacex
Washington DC11 hours ago- ...microservice-based architectures using Docker and other container technologies. Implement messaging solutions with AWS SQS/SNS, Apache Kafka, or RabbitMQ. Collaborate within cross-functional teams to deliver mission-driven software solutions. Design and support...Full time
Tla-Llc
Washington DC11 hours ago $110.7k - $171.8k
...Advanced Degree (e.g. Masters, MBA, JD, MD) ~ Proficient in Hadoop, Spark, PySpark, Scala, and Python for large‑scale data processing. ~... ..., processing, and orchestration. ~ Advanced experience with Apache Spark for batch and near–real-time analytics. ~ Experience...Full timeWork experience placementWork at officeLocal areaRelocation package- ...advanced analytics capabilities. Technical Implementation : Streaming Data Architecture: Build real-time data pipelines using Apache Kafka, Apache Flink, and AWS Kinesis for processing high-volume transaction streams. Machine Learning Integration: Implement ML...Full time
Sofi
Washington DC11 hours ago $152.4k - $213.38k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...Remote jobWorldwide- ...engineering, and infrastructure support. Professional certification in at least one of the following areas: Amazon Web Services (AWS), Apache Spark, Big Data, Databricks, or Oracle. Strong proficiency with Linux/Unix and Windows server environments, virtualization...Full timeFor contractorsLocal area
$140k - $160k
...-critical analytics programs. Knowledge of data governance and metadata management practices. Knowledge in Databricks and Apache Spark. Familiarity with containerization or orchestration tools (Docker, Kubernetes). Eligibility: Must be legally authorized...Full timeWork at office1 day per week$140k - $160k
...for deploying and managing ML models at scale. Knowledge of Anaconda and Jupyter notebooks. Familiarity with Databricks and Apache Spark. Background in data governance and enterprise metadata management. Eligibility: Must be legally authorized to work in...Full time1 day per week$93.5k - $110.7k
...requirements into technical specifications, diagrams, and implement in conformance with architectural and business requirements. Apache Camel, Java, AWS (ideally lambda) and Angular knowledge ~ Bachelor's in Computer Science, Engineering or Technical Science...Full timeLive inWork at officeLocal areaAccenture Federal Services
Washington DC11 hours ago$122.5k - $145k
...management tools (pip, npm) Experience with UNIX-like operating systems Experience working with in-stream data processing using Apache Kafka, RabbitMQ, ActiveMQ, or similar technologies Experience with Docker and Kubernetes Front-end experience in Angular,...Permanent employmentFull timeTemporary workWork at officeRemote workMonday to FridayWeekend workSpacex
Washington DC11 hours ago$151.1k - $211.55k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...For contractorsWork at officeWorldwide$219.9k - $307.88k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...Remote jobWorldwide$161.28k - $225.79k
...more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one ~ Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals ~ Familiarity with CI/CD for production deployments ~ Working knowledge of MLOps...Remote jobTemporary workWork experience placementWorldwide$150.8k - $203.9k
...PyTorch, Tensorflow/Keras, NumPy, Pandas, XGBoost), SQL, A/B testing, statistical modeling, data visualization. Preferred Skills: Spark, Apache Airflow, AWS (S3, DynamoDB, Lambda, Kinesis, SageMaker). You communicate cross-functionally and can take a data science...Minimum wageFull timeWork experience placementLocal areaRemote work
