Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AWS Data Bricks Spark/Scala Engineer

Highbrow LLC

Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long Term # of Layers:0 Work Eligibility:US Permanent Eligibility to Work Required Key Technology : DataBricks, AWS, Spark Job Responsibilities : Data Bricks Architect profile with AWS combination. Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala Data Management, Migration experience from other platforms to AWS Drive mentality of building well architected applications for AWS Cloud Drive the mentality of quality being owned by the entire team Identify code defects and work with developers to address quality issues in product code. Finding bottlenecks and thresholds in existing code through the use of automation tools. Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily. Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary Skills and Experience Required : Required : 10+ years of experience in architecture, design, implementation, and analytics solutions Hands on development Design and Develop applications using Databricks Experience with Solutioning on AWS Data Migration experience from other platforms to AWS In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. Desired : Any programming language experience with SQL, Store procedures, Spark/Scala. Strong understanding of Data Modeling and defining conceptual logical and physical data models. Ability to design and demonstrate system Architecture with different environments Ability to deal with both On-Premises and Cloud systems #J-18808-Ljbffr Highbrow LLC

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead AWS Data Bricks Spark/Scala Engineer in Saint Louis, MO vacancy
  • A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes data management and engineering proficiency using Databricks and Spark, with responsibilities including migration... 
    Amazon Web Service
    Data
    Remote job

    Highbrow LLC

    Saint Louis, MO
    3 days ago
  • Enterprise Data Architect We are seeking an experienced...  ...semantic/context layer engineering, and enterprise data...  ...& Canonical Design Lead design of conceptual, logical...  ...data platforms (Azure/AWS/GCP) including...  ...data stack tools (dbt, Spark, Kafka, Airflow, etc.)... 
    Amazon Web Service
    Data

    Resideo Technologies Inc.

    Saint Louis, MO
    2 days ago
  •  ...Apache Spark Developer Absolute Business Solutions...  ...of innovators, engineers, analysts and business...  ...Technology, Defense, AI/ML, and Data Science fields. As we...  ...Apache Spark (PySpark, Scala) Delta Lake, Parquet...  ...S3 / object storage AWS / GCP / Azure (environment... 
    Amazon Web Service
    Data
    Flexible hours

    Absolute Business Solutions Corp

    Saint Louis, MO
    4 days ago
  •  ...provider in St. Louis is looking for a System Engineer to enhance intelligence analysis...  ...multidisciplinary teams. With a focus on AWS services and container technologies, candidates...  ...professionals eager to advance their careers. #J-18808-Ljbffr (EDO) Entertainment Data Oracle, Inc.
    Amazon Web Service
    Data
    Flexible hours

    (EDO) Entertainment Data Oracle, Inc.

    Saint Louis, MO
    2 days ago
  • $132.5k - $338.3k

     ...We Are: Accenture is a leading global professional services company that helps the world...  ...world's major cloud providers, including AWS, Azure, and Google and Private Cloud leaders...  ...stack of integrated cloud capabilities across data, edge, integrated infrastructure and... 
    Amazon Web Service
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Saint Louis, MO
    1 day ago
  • $120k - $240k

     ...to support the NGA's Data Modernization Services...  ...including experience with AWS, Python, Kubernetes,...  .../ Processing: Apache Spark (PySpark, Scala), Delta Lake, Parquet,...  ...environments. Work closely with engineers, developers, DevOps...  ...Experience with Data Bricks, Syntasa or similar... 
    Amazon Web Service
    Data
    Flexible hours
    Shift work

    Absolute Business Solutions Corp. (ABSc)

    Saint Louis, MO
    4 days ago
  •  ...Technology Group (CSTG) is a leading multi-cloud technology...  ...certifications across AWS and Azure; helping our...  ...The primary focus of a Data Engineer is to help our clients...  ...Experience with Java, Scala and/or Python (...  ...or analytic pipelines (Spark, AWS Glue or Azure DataFactory... 
    Amazon Web Service
    Data

    CleanSlate Technology Group

    Saint Louis, MO
    1 day ago
  •  ...Computer Science, Information Technology, Data Science, Artificial Intelligence or a...  .... • Proven experience as an AI Engineer, Machine Learning Engineer, or...  ...with big data technologies (Hadoop, Spark) and cloud platforms (AWS, Azure, Google Cloud) • Strong analytical... 
    Amazon Web Service
    Data

    Yochana

    Saint Louis, MO
    1 day ago
  •  ...Role : Data Engineer Location : St. Louis, MO ( Onsite - Hybrid, 3 Days in a week ) Must haves: Scala, Pyspark, Databricks and AWS Role Overview: Team Focus: Supports critical...  ...NIFI) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala,... 
    Amazon Web Service
    Data
    3 days per week

    Futran Tech Solutions Pvt. Ltd.

    Saint Louis, MO
    1 day ago
  •  ...We are looking for a Data Architect with strong experience...  ...In this role, you will lead scalable cloud data...  ...into platform engineering, establish governance standards...  ...in Databricks, Spark/PySpark, SQL, Python, PyTorch...  ...major cloud platforms (AWS or GCP). Knowledge of... 
    Amazon Web Service
    Data

    Hcltech

    Saint Louis, MO
    8 hours ago
  •  ...Role: Agentic AI Engineer Location: St Louis, MO- Hybrid/onsite Contract...  ...Computer Science, Information Technology, Data Science, Artificial Intelligence or a...  ...with big data technologies (Hadoop, Spark) and cloud platforms (AWS, Azure, Google Cloud) Strong... 
    Amazon Web Service
    Data
    Contract work

    VDart

    Saint Louis, MO
    2 days ago
  •  ...security of mission‑critical data systems while supporting application...  ...system administrators, cloud engineers, cybersecurity personnel, and...  ...tuning), Big data tools (Spark, Hadoop), Data manipulation (Pandas...  ...Knowledge of Cloud Platforms (AWS, Azure) Experience with modern... 
    Amazon Web Service
    Data
    Contract work
    Flexible hours
    Night shift

    (EDO) Entertainment Data Oracle, Inc.

    Saint Louis, MO
    20 hours ago
  •  ...AI Engineer Design, develop, and deploy AI and machine learning models for...  ...Integrate AI solutions with big data platforms and cloud environments (AWS, Azure, Google Cloud). Analyze large...  ...data technologies such as Hadoop and Spark. Experience with cloud platforms... 
    Amazon Web Service
    Data

    Cynet Systems

    Saint Louis, MO
    4 days ago
  •  ...AI/Machine Learning Engineer CleanSlate Technology Group is a leading multi-cloud technology...  ...products, IoT, and Data and Analytics that...  ...related education AWS or Azure ML experience...  ...with Databricks, Spark, or similar using PySpark or Scala (SparkML experience... 
    Amazon Web Service
    Data

    CleanSlate Technology Group

    Saint Louis, MO
    4 days ago
  •  ...If you enjoy building modern data solutions, integrating complex...  ...structures, data topics, and data engineering processes while implementing...  ...data pipelines using Apache Spark, Kafka, or similar technologies...  ...with cloud platforms such as AWS, Microsoft Azure, or Google Cloud... 
    Amazon Web Service
    Data
    Work at office
    Flexible hours

    D&G Solutions

    Saint Louis, MO
    1 day ago
  •  ...with proven expertise in data platform architecture,...  ...scale data workloads from AWS to Snowflake. This role...  ...Key Responsibilities Lead the end‑to‑end migration...  ...Collaborate with data engineers, analysts, and business...  ...Experience with Python, Spark, or DBT for data transformations... 
    Amazon Web Service
    Data

    Stellar IT Solutions LLC

    Saint Louis, MO
    1 day ago
  •  ...is seeking a Senior Geospatial Data Engineer to join our Xtrack Product Team. In this role, you will lead the design and implementation...  ...based data solutions (e.g., GCP, AWS, Azure). Ensure data quality,...  ...technologies such as Hadoop, Spark, MapReduce, or Kafka.... 
    Amazon Web Service
    Data

    Object Computing

    Saint Louis, MO
    2 days ago
  •  ...Data Scientist Location: St. Louis, MO Clearance: TS/SCI...  ...Questions. Collaborate with engineering and product development teams....  ...Platform AI-ML toolsets (e.g. AWS Sagemaker, GCP Vertex). Experience...  ...building data pipelines with spark, kafka, or nifi. Join... 
    Amazon Web Service
    Data

    Intellectix

    Saint Louis, MO
    4 days ago
  • Mandatory required skills - AWS, Python, Airflow, Kedro, or Luigi...  .../Desired skills - Hadoop, Spark, or similar frameworks. Experience...  ...for MLOps implementations. Data Pipeline Design : Develop data...  ...Collaborate with data scientists, engineers, and DevOps teams to implement... 
    Amazon Web Service
    Data

    TechDigital Group

    Saint Louis, MO
    4 days ago
  •  ...Location: St. Louis, MO Title: Data Engineer Experience: 10+ Years (...  ...such as Kafka and Spark Structured Streaming . Establish...  ...and anomaly detection . Lead deployments, migrations, and...  ...cloud database ecosystems (AWS, Azure, or GCP). Expertise... 
    Amazon Web Service
    Data

    Purple Drive

    Saint Louis, MO
    4 days ago
  •  ...Job Title: Data Scientist Work Location & Reporting...  ...Have Skills: Python & Spark, advanced ML/...  ...scalable ETL/Big Data engineering, and solid AWS + SQL experience. Good...  ...Responsibilities • Lead the full ML development...  ...Python (primary) o Scala or Java (preferred for... 
    Amazon Web Service
    Data
    Contract work
    Work experience placement
    Immediate start
    Relocation

    Diverse Lynx

    Saint Louis, MO
    4 days ago
  • $140k - $180k

     ...skilled Machine Learning Engineer with approximately...  ...collaborate closely with data scientists, software engineers...  ...cloud platforms (AWS, Azure, GCP) to build scalable...  ...(e.g., Pandas, Spark, Dask). ~ Hands-on experience...  ...Focus is a leading financial services firm... 
    Amazon Web Service
    Data
    Work at office
    Local area

    Focus Financial Partners Inc.

    Saint Louis, MO
    20 hours ago
  •  ...Group is seeking a Cloud Engineer to support our client’s...  ...automated testing frameworks. Lead containerized solution...  ...hybrid and cloud (AWS) environments. Implement...  ...and optimize geospatial data processing and API integrations...  ...Services GitLab Apache Spark, Glue, and other ETL... 
    Amazon Web Service
    Data
    Remote work
    Flexible hours
    Night shift

    (EDO) Entertainment Data Oracle, Inc.

    Saint Louis, MO
    1 day ago
  • $75k - $150k

     ...Data Scientist Absolute Business Solutions Corp...  ...community of innovators, engineers, analysts and business...  ...Fluent in Python/Scala/R as well as SQL/NOSQL...  ...Experience with Apache Spark or other Big Data tools...  ...providers such as GCP, AWS and Azure Prior experience... 
    Amazon Web Service
    Data
    Remote work

    Absolute Business Solutions Corp

    Saint Louis, MO
    3 days ago
  •  ...Developer Join the Software Engineering team. This individual will...  ...have components built for data analytics, business...  ...static languages such as Java, Scala, etc. and dynamic...  ...cloud services particularly AWS. Experience with Apache Spark and/or Hadoop. Experience... 
    Amazon Web Service
    Data
    Casual work

    The Timberline Group Company

    Saint Louis, MO
    4 days ago
  • $49 - $70 per hour

     ...talented Senior Software Engineer (Cloud Data Engineering). Do you...  ...data pipelines using Spark and Azure, and...  ...You Will Be Doing: A leading provider of mobility solutions...  ...pipelines usingPython, Scala, or Java. Strong...  ...Background in Azure, AWS, or other public cloud... 
    Amazon Web Service
    Data

    TECHNOLOGY PARTNERS INC

    Saint Louis, MO
    4 days ago
  •  ...C2C We are seeking a Senior Data Engineer to support a Fortune 50 health...  ...operations. Responsibilities Lead the development and training of...  ...platforms, including AWS, Databricks, Azure, and GCP ....  ...computing frameworks such as Apache Spark . Familiarity with advanced AI... 
    Amazon Web Service
    Data

    Brooksource

    Saint Louis, MO
    4 days ago
  • A nonprofit organization seeks a Program Manager for the Spark Academy in St. Louis. This full-time role involves managing program schedules, recruiting volunteers, and fostering youth development through engaging educational activities. Candidates should hold a relevant... 
    Full time

    The Salvation Army USA Central Territory

    Saint Louis, MO
    20 hours ago
  • $170k - $205k

     ...automate, and optimize enterprise data platforms across AWS and Snowflake environments...  ...bit about us: We are a leading modern data consultancy...  ..., AI, DevOps, and data engineering challenges. Our teams partner...  ...including AWS, Snowflake, Spark, Kafka, Airflow, and Databricks... 
    Amazon Web Service
    Data
    Local area
    Remote work

    Jobot

    Saint Louis, MO
    20 hours ago
  •  ...Group is seeking a Software Engineer to support our client’s...  ...pipelines for CI/CD. Lead containerized solution...  ...across hybrid and cloud (AWS) environments. Implement...  ...and optimize geospatial data processing and API...  ...Services GitLab Apache Spark, Glue, and other ETL processes... 
    Amazon Web Service
    Data
    Work at office
    Flexible hours
    Night shift

    (EDO) Entertainment Data Oracle, Inc.

    Saint Louis, MO
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AWS Data Bricks Spark/Scala Engineer. Be the first to apply!