Lead AWS Data Bricks Spark/Scala Engineer
Highbrow LLC
Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long Term # of Layers:0 Work Eligibility:US Permanent Eligibility to Work Required Key Technology : DataBricks, AWS, Spark Job Responsibilities : Data Bricks Architect profile with AWS combination. Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala Data Management, Migration experience from other platforms to AWS Drive mentality of building well architected applications for AWS Cloud Drive the mentality of quality being owned by the entire team Identify code defects and work with developers to address quality issues in product code. Finding bottlenecks and thresholds in existing code through the use of automation tools. Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily. Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary Skills and Experience Required : Required : 10+ years of experience in architecture, design, implementation, and analytics solutions Hands on development Design and Develop applications using Databricks Experience with Solutioning on AWS Data Migration experience from other platforms to AWS In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. Desired : Any programming language experience with SQL, Store procedures, Spark/Scala. Strong understanding of Data Modeling and defining conceptual logical and physical data models. Ability to design and demonstrate system Architecture with different environments Ability to deal with both On-Premises and Cloud systems #J-18808-Ljbffr Highbrow LLC
- A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes data management and engineering proficiency using Databricks and Spark, with responsibilities including migration...Amazon Web ServiceDataRemote job
- Enterprise Data Architect We are seeking an experienced... ...semantic/context layer engineering, and enterprise data... ...& Canonical Design Lead design of conceptual, logical... ...data platforms (Azure/AWS/GCP) including... ...data stack tools (dbt, Spark, Kafka, Airflow, etc.)...Amazon Web ServiceData
- ...Apache Spark Developer Absolute Business Solutions... ...of innovators, engineers, analysts and business... ...Technology, Defense, AI/ML, and Data Science fields. As we... ...Apache Spark (PySpark, Scala) Delta Lake, Parquet... ...S3 / object storage AWS / GCP / Azure (environment...Amazon Web ServiceDataFlexible hours
- ...provider in St. Louis is looking for a System Engineer to enhance intelligence analysis... ...multidisciplinary teams. With a focus on AWS services and container technologies, candidates... ...professionals eager to advance their careers. #J-18808-Ljbffr (EDO) Entertainment Data Oracle, Inc.Amazon Web ServiceDataFlexible hours
$132.5k - $338.3k
...We Are: Accenture is a leading global professional services company that helps the world... ...world's major cloud providers, including AWS, Azure, and Google and Private Cloud leaders... ...stack of integrated cloud capabilities across data, edge, integrated infrastructure and...Amazon Web ServiceDataWork experience placementLive inWork at officeLocal area$120k - $240k
...to support the NGA's Data Modernization Services... ...including experience with AWS, Python, Kubernetes,... .../ Processing: Apache Spark (PySpark, Scala), Delta Lake, Parquet,... ...environments. Work closely with engineers, developers, DevOps... ...Experience with Data Bricks, Syntasa or similar...Amazon Web ServiceDataFlexible hoursShift work- ...Technology Group (CSTG) is a leading multi-cloud technology... ...certifications across AWS and Azure; helping our... ...The primary focus of a Data Engineer is to help our clients... ...Experience with Java, Scala and/or Python (... ...or analytic pipelines (Spark, AWS Glue or Azure DataFactory...Amazon Web ServiceData
- ...Computer Science, Information Technology, Data Science, Artificial Intelligence or a... .... • Proven experience as an AI Engineer, Machine Learning Engineer, or... ...with big data technologies (Hadoop, Spark) and cloud platforms (AWS, Azure, Google Cloud) • Strong analytical...Amazon Web ServiceData
- ...Role : Data Engineer Location : St. Louis, MO ( Onsite - Hybrid, 3 Days in a week ) Must haves: Scala, Pyspark, Databricks and AWS Role Overview: Team Focus: Supports critical... ...NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala,...Amazon Web ServiceData3 days per week
- ...We are looking for a Data Architect with strong experience... ...In this role, you will lead scalable cloud data... ...into platform engineering, establish governance standards... ...in Databricks, Spark/PySpark, SQL, Python, PyTorch... ...major cloud platforms (AWS or GCP). Knowledge of...Amazon Web ServiceData
- ...Role: Agentic AI Engineer Location: St Louis, MO- Hybrid/onsite Contract... ...Computer Science, Information Technology, Data Science, Artificial Intelligence or a... ...with big data technologies (Hadoop, Spark) and cloud platforms (AWS, Azure, Google Cloud) Strong...Amazon Web ServiceDataContract work
- ...security of mission‑critical data systems while supporting application... ...system administrators, cloud engineers, cybersecurity personnel, and... ...tuning), Big data tools (Spark, Hadoop), Data manipulation (Pandas... ...Knowledge of Cloud Platforms (AWS, Azure) Experience with modern...Amazon Web ServiceDataContract workFlexible hoursNight shift
- ...AI Engineer Design, develop, and deploy AI and machine learning models for... ...Integrate AI solutions with big data platforms and cloud environments (AWS, Azure, Google Cloud). Analyze large... ...data technologies such as Hadoop and Spark. Experience with cloud platforms...Amazon Web ServiceData
- ...AI/Machine Learning Engineer CleanSlate Technology Group is a leading multi-cloud technology... ...products, IoT, and Data and Analytics that... ...related education AWS or Azure ML experience... ...with Databricks, Spark, or similar using PySpark or Scala (SparkML experience...Amazon Web ServiceData
- ...If you enjoy building modern data solutions, integrating complex... ...structures, data topics, and data engineering processes while implementing... ...data pipelines using Apache Spark, Kafka, or similar technologies... ...with cloud platforms such as AWS, Microsoft Azure, or Google Cloud...Amazon Web ServiceDataWork at officeFlexible hours
- ...with proven expertise in data platform architecture,... ...scale data workloads from AWS to Snowflake. This role... ...Key Responsibilities Lead the end‑to‑end migration... ...Collaborate with data engineers, analysts, and business... ...Experience with Python, Spark, or DBT for data transformations...Amazon Web ServiceData
- ...is seeking a Senior Geospatial Data Engineer to join our Xtrack Product Team. In this role, you will lead the design and implementation... ...based data solutions (e.g., GCP, AWS, Azure). Ensure data quality,... ...technologies such as Hadoop, Spark, MapReduce, or Kafka....Amazon Web ServiceData
- ...Data Scientist Location: St. Louis, MO Clearance: TS/SCI... ...Questions. Collaborate with engineering and product development teams.... ...Platform AI-ML toolsets (e.g. AWS Sagemaker, GCP Vertex). Experience... ...building data pipelines with spark, kafka, or nifi. Join...Amazon Web ServiceData
- Mandatory required skills - AWS, Python, Airflow, Kedro, or Luigi... .../Desired skills - Hadoop, Spark, or similar frameworks. Experience... ...for MLOps implementations. Data Pipeline Design : Develop data... ...Collaborate with data scientists, engineers, and DevOps teams to implement...Amazon Web ServiceData
- ...Location: St. Louis, MO Title: Data Engineer Experience: 10+ Years (... ...such as Kafka and Spark Structured Streaming . Establish... ...and anomaly detection . Lead deployments, migrations, and... ...cloud database ecosystems (AWS, Azure, or GCP). Expertise...Amazon Web ServiceData
- ...Job Title: Data Scientist Work Location & Reporting... ...Have Skills: Python & Spark, advanced ML/... ...scalable ETL/Big Data engineering, and solid AWS + SQL experience. Good... ...Responsibilities • Lead the full ML development... ...Python (primary) o Scala or Java (preferred for...Amazon Web ServiceDataContract workWork experience placementImmediate startRelocation
$140k - $180k
...skilled Machine Learning Engineer with approximately... ...collaborate closely with data scientists, software engineers... ...cloud platforms (AWS, Azure, GCP) to build scalable... ...(e.g., Pandas, Spark, Dask). ~ Hands-on experience... ...Focus is a leading financial services firm...Amazon Web ServiceDataWork at officeLocal area- ...Group is seeking a Cloud Engineer to support our client’s... ...automated testing frameworks. Lead containerized solution... ...hybrid and cloud (AWS) environments. Implement... ...and optimize geospatial data processing and API integrations... ...Services GitLab Apache Spark, Glue, and other ETL...Amazon Web ServiceDataRemote workFlexible hoursNight shift
$75k - $150k
...Data Scientist Absolute Business Solutions Corp... ...community of innovators, engineers, analysts and business... ...Fluent in Python/Scala/R as well as SQL/NOSQL... ...Experience with Apache Spark or other Big Data tools... ...providers such as GCP, AWS and Azure Prior experience...Amazon Web ServiceDataRemote work- ...Developer Join the Software Engineering team. This individual will... ...have components built for data analytics, business... ...static languages such as Java, Scala, etc. and dynamic... ...cloud services particularly AWS. Experience with Apache Spark and/or Hadoop. Experience...Amazon Web ServiceDataCasual work
$49 - $70 per hour
...talented Senior Software Engineer (Cloud Data Engineering). Do you... ...data pipelines using Spark and Azure, and... ...You Will Be Doing: A leading provider of mobility solutions... ...pipelines usingPython, Scala, or Java. Strong... ...Background in Azure, AWS, or other public cloud...Amazon Web ServiceData- ...C2C We are seeking a Senior Data Engineer to support a Fortune 50 health... ...operations. Responsibilities Lead the development and training of... ...platforms, including AWS, Databricks, Azure, and GCP .... ...computing frameworks such as Apache Spark . Familiarity with advanced AI...Amazon Web ServiceData
- A nonprofit organization seeks a Program Manager for the Spark Academy in St. Louis. This full-time role involves managing program schedules, recruiting volunteers, and fostering youth development through engaging educational activities. Candidates should hold a relevant...Full time
$170k - $205k
...automate, and optimize enterprise data platforms across AWS and Snowflake environments... ...bit about us: We are a leading modern data consultancy... ..., AI, DevOps, and data engineering challenges. Our teams partner... ...including AWS, Snowflake, Spark, Kafka, Airflow, and Databricks...Amazon Web ServiceDataLocal areaRemote work- ...Group is seeking a Software Engineer to support our client’s... ...pipelines for CI/CD. Lead containerized solution... ...across hybrid and cloud (AWS) environments. Implement... ...and optimize geospatial data processing and API... ...Services GitLab Apache Spark, Glue, and other ETL processes...Amazon Web ServiceDataWork at officeFlexible hoursNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead AWS Data Bricks Spark/Scala Engineer. Be the first to apply!
- aws cloud infrastructure engineer Saint Louis, MO
- aws Saint Louis, MO
- junior aws Saint Louis, MO
- aws cloud architect Saint Louis, MO
- software development engineer aws Saint Louis, MO
- devops aws developer (remote) Saint Louis, MO
- senior aws cloud engineer Saint Louis, MO
- aws developer Saint Louis, MO
- aws solution architect Saint Louis, MO
- amazon web services engineer Saint Louis, MO


