Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AWS Data Bricks Spark/Scala Engineer

Highbrow LLC

Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long Term # of Layers:0 Work Eligibility:US Permanent Eligibility to Work Required Key Technology : DataBricks, AWS, Spark Job Responsibilities : Data Bricks Architect profile with AWS combination. Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala Data Management, Migration experience from other platforms to AWS Drive mentality of building well architected applications for AWS Cloud Drive the mentality of quality being owned by the entire team Identify code defects and work with developers to address quality issues in product code. Finding bottlenecks and thresholds in existing code through the use of automation tools. Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily. Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary Skills and Experience Required : Required : 10+ years of experience in architecture, design, implementation, and analytics solutions Hands on development Design and Develop applications using Databricks Experience with Solutioning on AWS Data Migration experience from other platforms to AWS In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. Desired : Any programming language experience with SQL, Store procedures, Spark/Scala. Strong understanding of Data Modeling and defining conceptual logical and physical data models. Ability to design and demonstrate system Architecture with different environments Ability to deal with both On-Premises and Cloud systems #J-18808-Ljbffr Highbrow LLC

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead AWS Data Bricks Spark/Scala Engineer in Saint Louis, MO vacancy
  • A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes data management and engineering proficiency using Databricks and Spark, with responsibilities including migration... 
    Amazon Web Service
    Data
    Remote job

    Highbrow LLC

    Saint Louis, MO
    1 day ago
  •  ...Bigdata Developer/Lead - Saint Louis, MO (Day1 Onsite) - Full Time Centraprise...  ...developing and optimizing big data solutions ensuring high performance...  ...: 10 Years Technical Skills: Scala, Apache Spark, Apache Hadoop, Hive, AWS and SQL Qualifications: Possess... 
    Amazon Web Service
    Data
    Full time

    Centraprise

    Saint Louis, MO
    3 days ago
  •  ...Skilled with: Oracle, Postgres, AWS, SQL, Scripting ~60% Completing / Managing customer data requests for new software being...  ...of tables ~ Role: Worked as Lead, Lead design/dev of relational databases, directing other db engineers. ~ Role: Not looking for a DBA... 
    Amazon Web Service
    Data

    Saxon Global

    Saint Louis, MO
    1 day ago
  •  ...provider in St. Louis is looking for a System Engineer to enhance intelligence analysis...  ...multidisciplinary teams. With a focus on AWS services and container technologies, candidates...  ...professionals eager to advance their careers. #J-18808-Ljbffr (EDO) Entertainment Data Oracle, Inc.
    Amazon Web Service
    Data
    Flexible hours

    (EDO) Entertainment Data Oracle, Inc.

    Saint Louis, MO
    5 days ago
  •  ...We Are: Accenture is a leading global professional services company that helps the world...  ...world's major cloud providers, including AWS, Azure, and Google and Private Cloud leaders...  ...stack of integrated cloud capabilities across data, edge, integrated infrastructure and... 
    Amazon Web Service
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Saint Louis, MO
    5 days ago
  • $107.5k - $188.4k

     ...your entire firm with industry-leading integration and innovations to...  ...can deep dive into code with engineers and influence senior leadership...  ..., integration contracts, data models, resiliency, and observability...  ...on with cloud services (Azure/AWS), container platforms, CI/CD,... 
    Amazon Web Service
    Data
    Work experience placement
    Work at office
    Local area

    Wolters Kluwer

    Saint Louis, MO
    1 day ago
  • $73.01k - $170.64k

     ...for an AI Workflow & Automation hands-on Lead Engineer to join our hybrid team located in Charlotte...  ...scale. Tech Stack : .NET, Angular, AWS Expertise in automation frameworks,...  ...productivity, streamline workflows, and support data-informed task execution. Familiarity... 
    Amazon Web Service
    Data
    Work at office
    Local area
    Flexible hours
    Shift work

    Perficient

    Saint Louis, MO
    5 days ago
  • $98.4k - $199k

    Application Developer Lead Job Locations US-IL-Chicago | US-IL-Chicago |...  ...integration services, primarily in Python on AWS. The role combines hands-on engineering leadership with integration...  ...Embed security, compliance, and data protection controls into design and... 
    Amazon Web Service
    Data
    Full time

    Old National Bank

    Saint Louis, MO
    6 days ago
  •  ...Data Analytics Cloud Architect Location: Seattle, WA / St. Louis...  ...multi-cloud platforms (either AWS/Azure, having experience on...  ...years of experience with data engineering and data pipelines for on-prem...  ...coding experience with Python, Spark, R, SQL or other equivalent programming... 
    Amazon Web Service
    Data
    Full time

    JConnect Infotech

    Saint Louis, MO
    17 days ago
  • $72 per hour

     ...Minio or Ceph, Apache ozone, Object storage technologies - S3, Spark, Scala, Hive, Base, Kudu. Resource will be working closely with...  ...experience in Hadoop administration activities. Exposure in AWS Big data. Deploy/maintain Hadoop clusters, add/remove nodes using cluster... 
    Amazon Web Service
    Data

    Keylent Inc

    Saint Louis, MO
    10 hours ago
  •  ...AWS Data Engineer Prefer locals or the one who are ready to travel for meetings on their own expenses 2-4 times a month. Bill Rate: 50-5...  ...Skills and Experience 5+ years as a Data Engineer working on Spark, and streaming data ingestion and processing At least 3+... 
    Amazon Web Service
    Data
    Contract work
    Local area

    ShiftCode Analytics

    Saint Louis, MO
    2 days ago
  •  ...Must haves - Scala, Pyspark, Databricks and AWS Team schedule: Onsite Monday...  ...Focus: Supports critical data ingestion, streaming and model...  ...High level overview : Engineer with experience in Scala,...  ...) Big Data Platforms (Spark, Hadoop/Ozone, Hive or impala... 
    Amazon Web Service
    Data

    Futran Tech Solutions Pvt. Ltd.

    Saint Louis, MO
    3 days ago
  •  ...Principal Java Developer/Team Lead Principal Java Developer/Team...  ...create the next generation back end data analytics platform designed to...  ...tools such as Java, Spring, Spark, Kafka, Drools/jBPM, and ELK (...  ...models to deploy the application to AWS cloud using automated tools... 
    Amazon Web Service
    Data

    The Timberline Group Company

    Saint Louis, MO
    2 days ago
  •  ...Responsibilities Design, develop, and maintain scalable data pipelines and architectures to support...  ...in Python and SQL Experience with Spark, Kafka, and other big data technologies...  ...with cloud platforms, preferably AWS Strong understanding of ETL pipeline development... 
    Amazon Web Service
    Data

    TheCorporate

    Saint Louis, MO
    3 days ago
  •  ...AI Engineer Design, develop, and deploy AI and machine learning models for...  ...Integrate AI solutions with big data platforms and cloud environments (AWS, Azure, Google Cloud). Analyze large...  ...data technologies such as Hadoop and Spark. Experience with cloud platforms... 
    Amazon Web Service
    Data

    Cynet Systems

    Saint Louis, MO
    1 day ago
  •  ...Role: AI Engineer (Agentic AI Experience) Location: St Louis, MO Remote- OK...  ...Computer Science, Information Technology, Data Science, Artificial Intelligence or a...  ...with big data technologies (Hadoop, Spark) and cloud platforms (AWS, Azure, Google Cloud) Strong... 
    Amazon Web Service
    Data
    Local area
    Remote work

    Diverse Lynx

    Saint Louis, MO
    4 days ago
  • $25 - $42 per hour

     ...ISO 13485 environment. The Packaging Team Lead will be expected to complete appropriate...  ...operations utilizing SAP and computerized data collection systems. ~ Support site...  ...become a part of a team that is dedicated to Sparking Discovery and Elevating Humanity!... 
    Data
    Work at office
    Shift work
    Night shift

    EMD Millipore

    Saint Louis, MO
    2 days ago
  •  ...Technology Group (CSTG) is a leading multi-cloud technology...  ...certifications across AWS and Azure; helping our...  ...The primary focus of a Data Engineer is to help our clients...  ...Experience with Java, Scala and/or Python (...  ...or analytic pipelines (Spark, AWS Glue or Azure DataFactory... 
    Amazon Web Service
    Data

    CleanSlate Technology Group

    Saint Louis, MO
    3 days ago
  •  ...Location: St. Louis, MO Title: Data Engineer Experience: 10+ Years (...  ...such as Kafka and Spark Structured Streaming . Establish...  ...and anomaly detection . Lead deployments, migrations, and...  ...cloud database ecosystems (AWS, Azure, or GCP). Expertise... 
    Amazon Web Service
    Data

    Purple Drive

    Saint Louis, MO
    2 days ago
  •  ...a full-time Senior AI Engineer located in St. Louis, MO...  ...Analytics team will play a leading role in shaping and...  ...that combines advanced data engineering skills, strong...  ...frameworks (e.g., Spark) Cloud data platforms...  ...AI/ML platforms (Azure, AWS, GCP, Palantir, Dataiku... 
    Amazon Web Service
    Data
    Full time

    McCarthy Holdings, Inc.

    Saint Louis, MO
    1 day ago
  •  ...Data Scientist Location: St. Louis, MO Clearance: TS/SCI...  ...Questions. Collaborate with engineering and product development teams....  ...Platform AI-ML toolsets (e.g. AWS Sagemaker, GCP Vertex). Experience...  ...building data pipelines with spark, kafka, or nifi. Join... 
    Amazon Web Service
    Data

    Intellectix

    Saint Louis, MO
    2 days ago
  •  ...Senior Geospatial Data Engineer Object Computing, Inc. is seeking a Senior...  ...Team. In this role, you will lead the design and implementation...  ...data solutions (e.g., GCP, AWS, Azure). Ensure data quality...  ...technologies such as Hadoop, Spark, MapReduce, or Kafka. Experience... 
    Amazon Web Service
    Data

    Object Computing

    Saint Louis, MO
    2 days ago
  •  ...Job Title: Data Scientist Work Location & Reporting...  ...Have Skills: Python & Spark, advanced ML/...  ...scalable ETL/Big Data engineering, and solid AWS + SQL experience. Good...  ...Responsibilities • Lead the full ML development...  ...Python (primary) o Scala or Java (preferred for... 
    Amazon Web Service
    Data
    Contract work
    Work experience placement
    Immediate start
    Relocation

    Diverse Lynx

    Saint Louis, MO
    2 days ago
  •  ...Developer Join the Software Engineering team. This individual will...  ...have components built for data analytics, business...  ...static languages such as Java, Scala, etc. and dynamic...  ...cloud services particularly AWS. · Experience with Apache Spark and/or Hadoop. · Experience... 
    Amazon Web Service
    Data
    Casual work

    The Timberline Group Company

    Saint Louis, MO
    1 day ago
  • $140k - $180k

     ...skilled Machine Learning Engineer with approximately...  ...collaborate closely with data scientists, software engineers...  ...cloud platforms (AWS, Azure, GCP) to build scalable...  ...(e.g., Pandas, Spark, Dask). ~ Hands-on experience...  ...Focus is a leading financial services firm... 
    Amazon Web Service
    Data
    Work at office
    Local area

    Focus Financial Partners Inc.

    Saint Louis, MO
    3 days ago
  • $65 - $75 per hour

     ...permanent over time. We are seeking a Data Engineering Manager to lead execution delivery for a large-scale...  ...capabilities within a modern AWS-based ecosystem. The ideal candidate...  ...technologies such as: Python SQL Spark / PySpark Cloud data platforms (... 
    Amazon Web Service
    Data
    Hourly pay
    Permanent employment
    Contract work
    For contractors
    Flexible hours

    Blend360

    Saint Louis, MO
    1 day ago
  •  ...Senior Data Engineer Awetomaton is seeking a Senior Data Engineer to...  ...data from Kubernetes platforms, AWS, and other internal sources...  ...Proficiency in Python, SQL, Spark, or similar data-centric technologies...  ...We provide industry leading benefits that balance your health... 
    Amazon Web Service
    Data
    Work at office
    Flexible hours

    Awetomaton Ltd

    Saint Louis, MO
    2 days ago
  • $75k - $150k

     ...Data Scientist Absolute Business Solutions Corp...  ...community of innovators, engineers, analysts and business...  ...Fluent in Python/Scala/R as well as SQL/NOSQL...  ...Experience with Apache Spark or other Big Data tools...  ...providers such as GCP, AWS and Azure Prior experience... 
    Amazon Web Service
    Data
    Remote work

    Absolute Business Solutions Corp

    Saint Louis, MO
    16 hours ago
  •  ...native applications; designing APIs, data models, sequence diagrams, and class diagrams...  ...; cloud architecture, including AWS, OpenShift, and Azure; Microservices design...  ...OAuth2, JWT, SAML, and HIPAA; data engineering with Kafka, Spark, and ETL pipelines; DevOps, including... 
    Amazon Web Service
    Data
    Local area
    Work from home

    CarepathRx

    Saint Louis, MO
    2 days ago
  • $49 - $70 per hour

     ...talented Senior Software Engineer (Cloud Data Engineering). Do you...  ...data pipelines using Spark and Azure, and...  ...You Will Be Doing: A leading provider of mobility solutions...  ...pipelines usingPython, Scala, or Java. Strong...  ...Background in Azure, AWS, or other public cloud... 
    Amazon Web Service
    Data

    TECHNOLOGY PARTNERS INC

    Saint Louis, MO
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AWS Data Bricks Spark/Scala Engineer. Be the first to apply!