Average salary: $185,000 /yearly
More statsGet new jobs by email
- ...• Optimize data storage and processing solutions in AWS Cloud, utilizing services such as AWS Glue, Redshift, S3, and Apache Spark. • Develop and maintain documentation for data workflows, data models, and architectural designs to ensure transparency...SuggestedFull timeImmediate start
$155k - $225k
...diagnosing complex failures in distributed processing jobs (e.g., Spark executor errors, memory leaks, data skew) using logs,... ...Lake. Proficiency with common big data file formats, including Apache Parquet and Apache Avro. Infrastructure as Code (IaC): Experience...SuggestedFull timeWork at officeHome officeFlexible hours$110k - $130k
...of orchestration tools (e.g., Airflow, Dagster, Prefect). ~ Experience developing sophisticated data pipelines using AWS EMR, Apache Spark, etc. ~ Creative-minded individual, enjoys open-ended problems and challenging the status quo ~ Excellent written and spoken...SuggestedFull timeTemporary workFlexible hours- ...Engineer will play a crucial role in developing and optimizing Spark applications in AWS Databricks, leveraging your expertise in Python... ...in designing and building efficient ETL pipelines using Apache Spark in the Databricks environment. Responsibilities include...SuggestedFull timeContract work
- ...structured and unstructured data ingestion, processing, and transformation. Automate and optimize data workflows using tools like Apache Spark, Kafka, Airflow, and dbt. Monitor, troubleshoot, and optimize data pipeline performance. Data Governance, Security &...SuggestedFull timeVisa sponsorship
- ...Design and develop high-performance data pipelines using Scala/Spark on AWS EMR. Build new features and data products while maintaining... ...Technical Requirements: ~5+ years of hands-on experience with Apache Spark using Scala exclusively (no PySpark). ~ Proven track...SuggestedFull timeLocal areaRemote workWork from homeFlexible hours
$152.4k - $213.38k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...SuggestedRemote jobWorldwide$174k - $293k
...including cloud and data architecture in a large-scale, hybrid cloud and on-prem environment 5+ years of experience working with Apache Spark or Databricks 5+ years of experience in leading and partnering with cross-functional teams, involving key stakeholder...Suggested- ...framework. Preferred Qualifications Experience solving complex compliance or business problems Experiences with big-data technologies such as Spark and Presto Experience with workflow automation tools and orchestration platforms, such as Apache Airflow...SuggestedInternship
$151.1k - $211.55k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...SuggestedFor contractorsWork at officeWorldwide$330k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...SuggestedRemote jobWorldwide$161.28k - $225.79k
...life-long learning, and driving business value through AI ~[Preferred] Experience using the Databricks Intelligence Platform and Apache Spark™ to process large-scale distributed datasets Pay Range Transparency Databricks is committed to fair and equitable...SuggestedContract workRemote workWorldwide$245.3k - $343.48k
...solution-based approach to selling and creating value for customers. Promote Databricks' Data Intelligence Platform powered by Apache Spark™ and Delta Lake Prioritize opportunities and leverage appropriate resources. Build a plan for success internally at...SuggestedRemote jobLocal areaWorldwide$138k
...language models (LLMs), embedding-based retrieval, and multi-modal learning Build and optimize ML pipelines using tools such as Apache Spark, Airflow, Kubeflow, and MLflow, ensuring reproducibility, scalability, and operational excellence Define and track key...SuggestedFull timeTemporary workFlexible hours$140k - $160k
...-critical analytics programs. Knowledge of data governance and metadata management practices. Knowledge in Databricks and Apache Spark. Familiarity with containerization or orchestration tools (Docker, Kubernetes). Eligibility: Must be legally authorized...SuggestedFull timeWork at office1 day per week$140k - $160k
...for deploying and managing ML models at scale. Knowledge of Anaconda and Jupyter notebooks. Familiarity with Databricks and Apache Spark. Background in data governance and enterprise metadata management. Eligibility: Must be legally authorized to work in...Full time1 day per week- ...data platforms . Architect solutions leveraging Databricks, Spark, Delta Lake, and related big data technologies . Define and... ...years with cloud-based solutions. ~ Expertise in Databricks, Apache Spark, Delta Lake , and distributed data processing frameworks....Full timeFor contractorsLocal area
$203k - $256k
...with performance tuning, and with with data processing frameworks (e.g. Spark, MapReduce, AWS EMR) ~ Experience in operating a workload/workflow management system (e.g. Ray.io , Slurm, Apache Airflow/Beam/Flink) and developing distributed systems using asynchronous...Full timeTemporary workRelocation package$196.2k - $274.65k
...machine learning. As a member of our team, you will exercise and develop expertise in those areas, using open-source projects such as Apache Spark, MLflow, and Delta Lake. This is a customer-facing role, where you will work with customers, your teammates, the product team,...Remote jobLocal areaWorldwide- ...Relevant certifications such as Cloudera Certified Administrator for Apache Hadoop are desirable. Strong proficiency in Linux/Unix... ...resolve performance bottlenecks, tune configurations (HDFS, YARN, Spark, Hive, etc.), and conduct capacity planning. Security and...Local area3 days per week
$191.4k - $252.72k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...Local areaWorldwide$171.8k - $240.5k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...Local areaWorldwide- ..., containerization (Docker, Kubernetes), and cloud platforms Experience with data pipeline tools (Apache Airflow, Kubeflow, MLflow) and big data technologies (Spark, Hadoop) Knowledge of government compliance requirements, security frameworks, and responsible AI...Full timeFor contractorsLocal area
- ...Collibra. Data Ingestion & Governance Automation Lead the implementation of event-driven data ingestion using Edge Servers, Apache Kafka, or AWS Glue. Ensure automated metadata extraction, data lineage tracking, and governance workflows in Collibra....
InDev
Washington DC5 days ago $161.3k - $225.8k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter LinkedIn and Facebook . Benefits At Databricks,...Remote jobWork experience placementWorldwide- ...publishing systems with support for tracking data lineage/provenance and facilitating user discovery of relevant data sources(e.g., CKAN, Apache Atlas, Amundsen). b. Tasks Writing transformation expressions or functions, tests to ensure edge cases are handled correctly...Full timeContract workFor contractorsLocal areaImmediate start
Sylger Corporation
Washington DC18 days ago - ...Kubernetes, containerization · Google Cloud Platform (GCP), Amazon Web Services (AWS), Microsoft Azure or equivalent cloud services · Apache Kafka, Google Cloud Pub/Sub or equivalent · Apache AirFlow or equivalent · Experience with data processing applications and...Contract work
Magnus Management Group LLC
Washington DC9 days ago - ...and infrastructure support. ~ Professional certification in at least one of the following areas: Amazon Web Services (AWS), Apache Spark, Big Data, Databricks, or Oracle. ~ Strong proficiency with Linux/Unix and Windows server environments, virtualization platforms...Full timeFor contractorsLocal area
$125.5k - $147.6k
...time data processing solutions using streaming technologies like Apache Beam and Pub/Sub. Collaborate with data architects and... ...processing and streaming technologies such as Pub/Sub, Kafka, or Spark Streaming. ~ Solid understanding of SQL for data modeling, querying...Local areaImmediate startFlexible hours$129.6k - $236.3k
...ML technologies Advocacy for a positive customer experience Preferred Qualifications Knowledge of Big Data systems, Apache Spark is a plus Experience with testing AI and/or ML algorithms is a plus Adept at leveraging technology to solve problems, including...Relocation
