Average salary: $185,000 /yearly
More statsGet new jobs by email
$175k - $195k
Join to apply for the Senior Software Engineer (Apache Spark) role at Quantifind 2 days ago Be among the first 25 applicants Join to apply for the Senior Software Engineer (Apache Spark) role at Quantifind Who You Are Quantifind is seeking a Senior Platform Engineer to...SuggestedFull timeWork at officeImmediate startWork from homeFlexible hours$225.4k - $257.2k
Senior Lead Data Engineer (Snowflake, Databricks, Apache Iceberg, Spark + SQL workload optimizations) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative...SuggestedFull timePart timeInternshipLocal area- ...Description: We are seeking a highly skilled and experienced AWS/Spark Data & AI Engineer with a strong background in Python and... ...develop, and maintain large-scale, distributed data pipelines using Apache Spark, PySpark, and AWS services like AWS Glue, EMR, S3, and Redshift...SuggestedRemote jobContract work
$193.4k - $220.7k
Lead Data Engineer (Java, Scala, Spark) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of...SuggestedFull timePart timeInternshipH1bLocal area$158.6k - $181k
Senior Data Engineer (Python, Spark, Databricks, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you...SuggestedFull timePart timeInternshipH1bLocal area- ...support our Engineering team. Job Dutie s : Design and develop robust data ingestion and processing pipelines using Apache Spark, Scala, Python, and AWS cloud services. Oversee the production, quality assurance, and maintenance of data systems, ensuring...SuggestedFull timeLocal areaRemote workWork from homeFlexible hours
Resonate
Washington DC14 hours ago $138k
...language models (LLMs), embedding-based retrieval, and multi-modal learning Build and optimize ML pipelines using tools such as Apache Spark, Airflow, Kubeflow, and MLflow, ensuring reproducibility, scalability, and operational excellence Define and track key...SuggestedFull timeTemporary workFlexible hoursCoupand
Washington DC14 hours ago- ...• Optimize data storage and processing solutions in AWS Cloud, utilizing services such as AWS Glue, Redshift, S3, and Apache Spark. • Develop and maintain documentation for data workflows, data models, and architectural designs to ensure transparency...SuggestedFull timeImmediate start
- ...AI/ML solutions with existing client infrastructure, leveraging cloud platforms (Azure, AWS) and modern frameworks (Databricks, Apache Spark). Validate and optimize deployed models and solutions, ensuring alignment with business objectives and technical standards....SuggestedWork at officeLocal areaImmediate start
$110k - $130k
...of orchestration tools (e.g., Airflow, Dagster, Prefect). ~ Experience developing sophisticated data pipelines using AWS EMR, Apache Spark, etc. ~ Creative-minded individual, enjoys open-ended problems and challenging the status quo ~ Excellent written and spoken...SuggestedFull timeTemporary workFlexible hours- ...structured and unstructured data ingestion, processing, and transformation. Automate and optimize data workflows using tools like Apache Spark, Kafka, Airflow, and dbt. Monitor, troubleshoot, and optimize data pipeline performance. Data Governance, Security &...SuggestedFull timeVisa sponsorship
$129k - $200k
...interfaces to query, consume, and update datasets Manage large datasets using distributed storage and compute frameworks (e.g., Apache Spark, Hadoop, or Dask) Ensure data security, compliance, and consistency across the full data lifecycle Drive improvements in...SuggestedRemote jobFull time- ...Engineer will play a crucial role in developing and optimizing Spark applications in AWS Databricks, leveraging your expertise in Python... ...in designing and building efficient ETL pipelines using Apache Spark in the Databricks environment. Responsibilities include...SuggestedFull timeContract work
- ...Design and develop high-performance data pipelines using Scala/Spark on AWS EMR. Build new features and data products while maintaining... ...Technical Requirements: ~5+ years of hands-on experience with Apache Spark using Scala exclusively (no PySpark). ~ Proven track...SuggestedFull timeLocal areaRemote workWork from homeFlexible hours
$193.4k - $220.7k
...scripting (Python, SQL, Java, JavaScript, Golang, Bash, Perl or Ruby) ~4+ years of experience with technologies Apache Mesos, Marathon, or Apache Spark ~4+ years of experience using build and deployment tools (Jenkins, Docker) ~2+ years of experience with distributed...SuggestedFull timePart timeInternshipH1bLocal area- ...scalable data processing and analytics. Ideal candidates will have strong data engineering skills with experience in Databricks, Apache Spark, Delta Lake, and cloud platforms (AWS, Azure, or GCP). Note: U.S. citizenship is required for this role. Basic Qualifications:...
- ...Qualifications Technical Expertise: Strong Python programming and Spark experience for data analytics. Proficient in GCP services:... ...Scheduler Datastream Pub/Sub BigQuery Dataproc. Skilled in Apache Beam for batch and stream processing. Experience with REST...Full time
- ...Position: Big Data Engineer (Spark / Scala / Power BI) Location: Redmond, WA (Remote) Must work in PST time zone) Duration: Long Term... ...seeking an experienced Big Data Engineer with strong expertise in Apache Spark, Scala, SQL, and Power BI. The ideal candidate will be...Remote work
$84.9k - $160.2k
...and performance metrics. Troubleshoot and resolve platform-related issues. Qualifications Experience with Databricks platform and Apache Spark. Strong understanding of cloud platforms such as AWS. Excellent problem-solving and troubleshooting skills. Strong communication...Live inWork at officeLocal area- ...and MSFT engineering culture . Key Responsibilities Design, develop, and maintain scalable big data solutions using Apache Spark and Scala. Implement complex SQL queries for data transformation and analytics. Develop and optimize Power BI...
- ...Palantir certification (required). Proficient in Python, SQL, and Spark. Strong understanding of cloud‑based data platforms (AWS, Azure... .... Preferred Qualifications Experience with Delta Lake, Apache Airflow, or Kafka. Familiarity with data privacy and compliance...Full timeRemote work
- ...framework. Preferred Qualifications Experience solving complex compliance or business problems Experiences with big-data technologies such as Spark and Presto Experience with workflow automation tools and orchestration platforms, such as Apache Airflow...Internship
$45.5 - $53 per hour
...technical issues. In this role, you will: + Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines. + Continuously improve and optimize the automation...Hourly payFull timeContract workLocal areaRemote work$83.43k - $222.48k
...managing and operating an Azure Databricks environment. Proven ability to work with core features like Delta Lake, Unity Catalog, and Apache Spark. Relevant certifications such as Microsoft Certified: Azure Solutions Architect Expert, Databricks Certified Data Engineer...Hourly payFull timeTemporary workLocal areaFlexible hours$112.6k - $187.6k
...Expertise in Git, collaborative development, and shell scripting **Data Frameworks** + Hands-on experience with big data processing (Apache Spark, Hadoop) and workflow orchestration (Airflow, Step Functions) + Experience with streaming technologies (Kafka, Kinesis) and data...Contract workWork experience placementH1bRemote work$90k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive...Work at officeLocal areaWorldwide- ...The Company At Scribd (pronounced “scribbed”), our mission is to spark human curiosity. Join our team as we create a world of stories... ...pipelines and working with distributed data processing frameworks like Apache Spark, Databricks, or similar. Intermediate level in at least...Temporary workLocal areaHome officeFlexible hours
$113k - $188k
...weaknesses for intelligence requirements. Experience in at least two of the following: Machine Learning, Natural Language Processing, Apache Spark, Hadoop, R, C++, SQL Database/Coding, or visualization tools such as Tableau. Pay Transparency The pay for this position within...Permanent employment$175.8k - $200.7k
...experience in Java + 2+ years of experience with AWS (EMR, Lambdas, SQS, Step Functions, Dynamo DB) + 2+ years of experience with Apache Spark + 4+ years of experience in open source frameworks + 2+ years of experience in Agile practices + 2+ years of experience in...Full timePart timeInternshipH1bLocal area$125.4k - $175.5k
...Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook. Benefits At Databricks, we strive...Worldwide
