Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead AWS Data Bricks Spark/Scala Engineer

Highbrow

Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long Term # of Layers:0 Work Eligibility:US Permanent Eligibility to Work Required Key Technology : DataBricks, AWS, Spark Job Responsibilities : Data Bricks Architect profile with AWS combination. Data Management, Solutioning, Data Engineering and ETL proficiency using Data Bricks tool / framework which includes programming with Spark/Scala Data Management, Migration experience from other platforms to AWS Drive mentality of building well architected applications for AWS Cloud Drive the mentality of quality being owned by the entire team Identify code defects and work with developers to address quality issues in product code. Finding bottlenecks and thresholds in existing code through the use of automation tools. Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily. Ownership over your work task, and are comfortable interacting with all levels of the team and raise challenges when necessary Skills and Experience Required : Required : 10+ years of experience in architecture, design, implementation, and analytics solutions Hands on development Design and Develop applications using Databricks Experience with Solutioning on AWS Data Migration experience from other platforms to AWS In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib. Desired : Any programming language experience with SQL, Store procedures, Spark/Scala. Strong understanding of Data Modeling and defining conceptual logical and physical data models. Ability to design and demonstrate system Architecture with different environments Ability to deal with both On-Premises and Cloud systems #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead AWS Data Bricks Spark/Scala Engineer in Morris Plains, NJ vacancy
  •  ...A technology solutions firm is seeking a Lead AWS Data Bricks Spark/Scala Engineer to architect and implement solutions primarily on AWS. This role emphasizes data management and engineering proficiency using Databricks and Spark, with responsibilities including migration... 
    Amazon Web Service
    Data
    Remote work

    Highbrow

    Morris Plains, NJ
    1 day ago
  •  ...A leading tech firm is seeking a Data Engineer to work with business and technical teams in Morris Plains, NJ. The...  ...have robust development experience in Spark, Py-Spark, Shell scripting, and...  ...participating in Agile processes. Knowledge of AWS and health care domains is a plus.... 
    Amazon Web Service
    Data
    Remote work

    Highbrow

    Morris Plains, NJ
    1 day ago
  •  ...A leading Aerospace and Defense company in Parsippany, NJ, is seeking a Full-Stack Developer to join its Enterprise Data and Process Automation Team. You will utilize your AWS expertise to design and maintain applications within the company’s data architecture. This role... 
    Amazon Web Service
    Data

    Marotta Controls

    Parsippany, NJ
    4 days ago
  •  ...Role: Power BI Lead Location: NJ Long Term Contract Responsibilities...  ...dashboards built # Experience in analyzing data sets, ETL and data warehousing solutions...  ...Experience in cloud data infrastructure (AWS or Azure) # Experience in building... 
    Amazon Web Service
    Data
    Long term contract

    Maintec Technologies

    Parsippany, NJ
    4 days ago
  • $132.5k - $338.3k

     ...and NAS environments and proficiency across major cloud platforms (AWS, Azure) · You have experience with hypervisor and container...  ...Accenture's Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.... 
    Amazon Web Service
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Morristown, NJ
    4 days ago
  • $161.25k - $232.92k

     ...Job title: PSS Launch Solution Lead ~ Location: Cambridge, MA...  ...enterprise goals. Join the digital engine driving Sanofi's transformation...  ..., Service Cloud, Sales Cloud, Data Cloud) Maintain solid...  ...integration technologies including IICS, AWS, Snowflake, and Python Stay... 
    Amazon Web Service
    Data
    Shift work

    Sanofi Group

    Morristown, NJ
    3 days ago
  •  ...We Are: Accenture is a leading global professional services company that helps the world...  ...world's major cloud providers, including AWS, Azure, and Google and Private Cloud leaders...  ...stack of integrated cloud capabilities across data, edge, integrated infrastructure and... 
    Amazon Web Service
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Morristown, NJ
    2 days ago
  • $132.5k - $338.3k

     ...'s latest technologies in AI, data analytics, and automation. Our...  ...You Are: The Integration Lead Architect playing a pivotal role...  ...architecture, software engineering, and large-scale system integration...  ...and integration patterns across AWS or Azure, including... 
    Amazon Web Service
    Data
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Morristown, NJ
    2 days ago
  • $172.83k - $222.2k

     ...IT: ADP, Inc. seeks Lead STAT Analyst at our Roseland, NJ loc to execute ADP's global Compliance...  ...w/ ablty to anlyze reslts acrss large data sets usng db & scrptng tools;...  ...also incl: Cld Tech/infrstructure (such as AWS); & Kubernetes. Annual base salary range for... 
    Amazon Web Service
    Data

    New York Times

    Roseland, NJ
    1 day ago
  •  ...Consulting or client service delivery experience on Amazon AWS (AWS) Minimum of 10 years of experience in big data, database and data warehouse architecture and...  ...DynamoDB, Cloudtrail, CloudWatch, Docker, Lambda, Spark, Glue, Sage Maker, AI/Client, API GW, etc.... 
    Amazon Web Service
    Data
    Work experience placement

    Omni Inclusive

    Whippany, NJ
    2 days ago
  •  ...Lead Information Security Analyst - Identity Unlock your career potential: Global Security...  ...most valuable assets -- their employee data. We are honored by this trust and are...  ...implementations across the major cloud providers (AWS, Azure, OCI, GCP) ~ Strong scripting or... 
    Amazon Web Service
    Data

    Automatic Data Processing

    Roseland, NJ
    4 days ago
  •  ...Innovation 2024 6. Sparrow , the leading card experience for non-prime...  ...core banking. We are an engineering-first organization that values...  ...critical applications and data platforms. The role involves leading...  ...-scale database running on AWS Proactively identify areas... 
    Amazon Web Service
    Data

    Zeta Corporation

    Basking Ridge, NJ
    6 days ago
  •  ...The Onshore Solution Architect / Functional Lead will serve as the strategic and hands-on...  ...the current enhancement backlog, optimizing data flow across systems, and ensuring Sales,...  ...workflows utilizing Conga, DocuSign, and AWS. Day-in-the-Life / Daily Activities:... 
    Amazon Web Service
    Data
    Immediate start
    Shift work
    Night shift
    Day shift

    VDart

    Florham Park, NJ
    4 days ago
  • $172.83k - $222.2k

    ADP, Inc. is hiring a Lead STAT Analyst in our Roseland, New Jersey location. What you’ll do: Build...  ...architecture environment, including traditional on‑prem data centers as well as public cloud infrastructure and services (AWS, GCP, Azure) to understand, evaluate, and... 
    Amazon Web Service
    Data
    Temporary work
    Work experience placement

    ADP, Inc.

    Roseland, NJ
    1 day ago
  •  ...Senior/Lead Software Developer We are seeking an experienced...  ...This role requires a versatile engineer with minimum 5 to 6 years of experience...  ...building and managing data pipelines and workflow orchestration...  ...frameworks Cloud & AI AWS: Hands on experience with core... 
    Amazon Web Service
    Data
    Long term contract

    VTal Technology Solutions

    Roseland, NJ
    3 days ago
  • $170k

     ...transformative journey as a Cloud Infrastructure Engineer - Data Platforms. Join our team and use...  ...to build the next-generation AWS data platform for a leading financial institution. In your role...  ...tools - for example, Apache Spark on AWS (EMR) or AWS Glue for big data... 
    Amazon Web Service
    Data
    Hourly pay
    Temporary work

    慨正橡扯

    Morristown, NJ
    4 days ago
  •  ...Development Experience is mandatory ~6-8 years of Data Engineering experience working with both distributed...  ...mining, cloud computing and data management tools including but not limited to Microsoft Azure, AWS Cloud, Google Cloud, hadoop, HDFS, mapr and spark.... 
    Amazon Web Service
    Data

    SARIAN Co

    Parsippany, NJ
    3 days ago
  •  ...Position: Senior Data Engineer Location: 99 Jefferson Rd, Parsippany, NJ 07054 (Onsite) Duration...  .... Build data pipelines, jobs using Spark and Databricks to ingest into Data Lake/Delta Lake on AWS Support teams using the Data and AI/ML platform... 
    Amazon Web Service
    Data

    Equiliem

    Parsippany, NJ
    3 days ago
  •  ...Job Title: Data Engineer Job ID: 2023-11994 Job Location: Morris Plains, NJ (remote to start) Job...  ...are Permitted Key Technology: Spark, Py-Spark, Shell scripting, Teradata, Hive...  ...to the designated platform/servers like AWS or Hadoop Edge Nodes Implement Hadoop job... 
    Amazon Web Service
    Data
    Work experience placement
    Remote work

    Highbrow

    Morris Plains, NJ
    1 day ago
  •  ...Data Modeler The Data Modeler will design and implement data models to support the development of curated, reusable, and governed data...  ...in data modeling and database design. ~ Familiarity with AWS data services (Redshift, Glue, S3) is a plus. Candidate must... 
    Amazon Web Service
    Data

    Argyle Infotech

    Parsippany, NJ
    4 days ago
  • Role: Java Technical Lead Location: Morris Plains, NJ or Austin, TX...  ...Large scale Applications and AWS. Sound knowledge of Object-Oriented...  ...: Batch Job Development, Data Reliability Applications, Monitoring...  ...DB. Experience with Apache Spark and Kafka is a big plus. #J-18... 
    Amazon Web Service
    Data

    Highbrow LLC

    Morris Plains, NJ
    20 hours ago
  •  ...AI Research Engineer / Data Scientist (LLM) - Mid-Senior Job location: Morristown...  ...and stakeholders. What You'll Do • Lead POC → pilot → production for LLM/agent solutions...  .../metrics). • Cloud experience (Azure/AWS/GCP) and vector/search tech (e.g., Azure... 
    Amazon Web Service
    Data

    Damco Solutions

    Morristown, NJ
    5 days ago
  • $115k

     ...decision making. Your experience with modern data platforms, including cloud-based...  ...Highly Valued Skills Experience with AWS, Python, Spark, Scala or Quantexa would be an added advantage...  ...other functions/ business divisions. Lead a team performing complex tasks, using... 
    Amazon Web Service
    Data

    hackajob

    Whippany, NJ
    4 days ago
  •  ...Develop and maintain applications using Python, with a focus on Streamlit. Perform data analysis using Python to support business objectives. Create and manage AWS Glue Jobs. Collaborate with team members using Jira and Confluence. Communicate effectively... 
    Amazon Web Service
    Data

    Georgia IT Inc

    Whippany, NJ
    4 days ago
  • $189.59k

     ...Data Engineer AVP To build and maintain the systems that collect, store...  ...functions/ business divisions. Lead a team performing complex...  ...Develop data pipelines using Apache Spark, Python, and Databricks, as...  ...-cloud platforms including AWS Glue, Azure Data Factory, and... 
    Amazon Web Service
    Data
    Hourly pay

    Barclays

    Whippany, NJ
    4 days ago
  •  ...Sr. Etl Engineer W/ Redpoint Exp Only interested in candidates with hands-on Redpoint Data Integration experience. 12+ month contract, 2-3 days a week onsite in either: Dallas...  .... Also required are ETL, Data Warehousing, AWS. Postgres experience is a strong plus. Keywords... 
    Amazon Web Service
    Data
    Contract work
    2 days per week
    3 days per week

    ShiftCode Analytics

    Morristown, NJ
    4 days ago
  • $115k - $145.35k

    Position Overview PRODUCT MANAGER, Data Platform - A role within Zelis’s enterprise...  ...internal data platform, working closely with engineering leads to define business requirements,...  ...familiarity with tools such as SQL, Python, R, Spark, AWS, Azure, Airflow, Snowflake, and PowerBI... 
    Amazon Web Service
    Data
    Full time
    Remote work
    Visa sponsorship

    LE018 Zelis Healthcare, LLC

    Convent Station, NJ
    20 hours ago
  • $87k - $217.6k

     ...of healthcare through data innovation? At IQVIA, we...  ..., data scientists, and engineering teams to ensure data integrity...  ...frameworks (e.g., Spark, Hadoop). ~ Expertise in cloud platforms (AWS, Azure, or GCP) and...  ...outcomes. IQVIA is the leading global provider of data... 
    Amazon Web Service
    Data
    Full time
    Part time
    Immediate start
    Remote work
    Worldwide

    IQVIA

    Parsippany, NJ
    3 days ago
  •  ...scalable, and highly available cloud-based solutions and estimation on AWS and Azure Cloud. Experience in Azure Databricks and ADF, Azure...  ...proposal writing. Experience with integration of different data sources with Data Warehouse and Data Lake is required.... 
    Amazon Web Service
    Data

    The Dignify Solutions, LLC

    Morristown, NJ
    4 days ago
  •  ...the world. Join the digital engine driving Sanofi's transformation...  ...seeking an AI Product Line Owner to lead a centralized Sanofi workflow...  ...with enterprise research data systems and serves as the foundation...  ...with cloud platforms (e.g., AWS) and distributed systems. ~ Experience... 
    Amazon Web Service
    Data

    Sanofi

    Morristown, NJ
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead AWS Data Bricks Spark/Scala Engineer. Be the first to apply!