Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer With Scala Exp.

Guru Schools

Overview:

**Mandatory skills / Required Experience**- Azure (Bigdata Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**Job Description: -**- 11+ years of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data pipelines, architectures & data sets- Knowledge of Python/C# is a MUST- Assure that data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements- Develop and maintain innovative Azure solutions- The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)- Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications- Build data pipelines to collectively bring together data- Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer With Scala Exp. in New York, NY vacancy
  •  ...solve the industry's greatest challenges with technology, creativity, and agility....  ...ingenuity. What is in it for you? As an Data Engineer you will be a part of an Agile team to build...  ...scalable data pipelines using Spark and Scala. Implement ETL processes to transform... 
    Suggested
    Full time
    Remote work
    Worldwide

    CitiusTech

    New York, NY
    2 days ago
  • $150k - $170k

     ...Senior Data Engineer At Magnite, we cultivate an environment of continuous growth and collaboration...  ...to help us tackle that responsibility with creativity and focus. Magnite is the...  ...are seeking someone with proficiency in Scala and Spark to build and optimize large-... 
    Suggested
    Hourly pay
    Work experience placement
    Summer work
    Seasonal work
    Local area
    Shift work

    Magnite

    New York, NY
    4 days ago
  • $229.9k - $262.4k

    Senior Lead Data Engineer (Enterprise Platform Technology) (Java, Python, Scala, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving...  ...Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior... 
    Suggested
    Full time
    Part time
    Internship
    Local area

    Capital One

    New York, NY
    5 days ago
  •  ...leading tech company in New York is seeking a hands-on Scala Developer to enhance their Big Data platform for financial crime control solutions. The role...  ...development, automated testing, and collaboration with global teams. Ideal candidates should have extensive Java... 
    Suggested

    Govserviceshub

    New York, NY
    4 days ago
  •  ...Title: Sr. Data Engineer Location: New York, NY Job Description...  ...Python, alternatively Scala or Java) Proficiency in atleast...  ...or similar) Proficiency with data structures, data serialization...  ...lines for each skill on your exp.) Python 5 10 I have designed... 
    Suggested

    Damco Solutions

    New York, NY
    1 day ago
  •  ...within the newly consolidated Data and Analytics (D&A) organization...  ...MetLife Global by earnings) with everything related to data, analytics...  ..., data governance, data engineering, data modeling, data analysis...  ...experience with SQL, Spark &/or Scala/Python and performance tuning.... 

    MetLife

    New York, NY
    10 hours ago
  • $220k - $300k

     ...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership...  ...hands-on data engineering execution with practical team leadership, helping the organization...  ...data engineering, such as Python, Java, Scala, Go, or similar ~ Comfort with... 
    Local area
    Remote work
    Flexible hours

    Bayview Asset Management

    New York, NY
    2 days ago
  •  ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite...  ...firm. You will work in close collaboration with software engineers, data scientists and...  ...in Java SpringBoot. Python and Scala is a plus Experience building APIs... 

    Enterprise Engineering

    New York, NY
    10 hours ago
  •  ...About the Role SafeRide Health is seeking a Data Engineer to design, build, and optimize scalable...  ...reporting and insights Partner with cross-functional teams (Operations, Compliance...  ...programming language (e.g., Python, Java, Scala) Strong problem-solving, troubleshooting... 
    Remote work
    Flexible hours

    Safe Ride Services

    New York, NY
    2 days ago
  • $45 - $55 per hour

     ...FocusKPI is looking for a Data Engineer to join our client's growing team and spearhead analyses...  ...handling. Partner cross-functionally with technical and business stakeholders to...  ...required ~ Team's Tech Stack: Spark, Scala, Python, DBT, Airflow, Kafka, AWS EMR, Hive... 
    Work at office
    Remote work

    FocusKPI Inc.

    New York, NY
    10 hours ago
  •  ...develop, and optimize Snowflake data warehouses for performance and...  ...analytics and reporting. Work with SQL, stored procedures, UDFs,...  .... Collaborate with cloud engineers to integrate Snowflake within...  ...Sub). Hands-on with Python or Scala for data transformations. Knowledge... 
    Full time
    Contract work
    Remote work

    Tek Ninjas

    New York, NY
    2 days ago
  •  ...Job Title: Data Engineer Job Summary: We are seeking a skilled and motivated Data Engineer...  ...initiatives. You will work closely with data scientists, analysts, and software...  ...programming language (e.g., Python, Java, Scala). ~ Familiarity with cloud platforms (... 
    Remote work
    Flexible hours

    Adidev Technologies Inc

    Jersey City, NJ
    1 day ago
  •  ..., Inc. (OCI) OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure...  ...software and strategic partnerships with Amazon and Google to build...  ...Spark). Proficiency in Go, Java, Python, or Scala. Proficiency in CI/CD pipelines and Infrastructure... 

    Object Computing

    New York, NY
    2 days ago
  •  ...Responsibilities: Build and maintain data pipelines using Python and SQL....  ...issues to meet service goals. Work with analytics, engineering, and business teams to deliver clean,...  ...tools. Skilled in Python, SQL, R, or Scala. Good project management skills;... 
    Work at office

    Texas State Library and Archives Commision

    New York, NY
    3 days ago
  •  ...Overview: Role: Data Engineer Location: New York (100% onsite) (Need local to NY) Interview...  ...need to have colab set up ready with Gmail account so they can code on the L1...  ...Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL Cloud Platforms:... 
    Local area

    Guru Schools

    New York, NY
    1 day ago
  •  ...proprietary AI Studio and AI Engines, the company helps drive the clients...  ...in their Digital AI journeys. With offices in North America, Asia...  ...infrastructure required for data integration, storage,...  ...languages such as Python (must have), Scala, and proficiency in writing... 
    Full time
    Work experience placement
    H1b
    Local area
    Remote work

    Fusemachines

    New York, NY
    10 hours ago
  • $140k - $240k

     ...Overview The Data Engineer on the Nebula team plays a critical role in building and evolving...  ..., this individual partners closely with Product, Engineering, AI, Analytics, and...  ...data engineering, such as Python, Java, Scala, or Go ~ Comfort working with CI... 
    Local area
    Remote work
    Flexible hours

    Bayview Asset Management

    New York, NY
    2 days ago
  •  ...Data Engineer Jersey City, New Jersey, United States Title: Data Engineer Join a forward...  ...platforms like Snowflake, BigQuery, and S3 Work with distributed systems such as Spark and...  ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and... 

    Glint Tech Solutions LLC

    Jersey City, NJ
    10 hours ago
  •  ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern data architectures...  ...enabling analytics and ML use cases, with strong fundamentals in data modeling and...  .... ~ Experience in Python, Scala, or Java. ~ Hands-on experience with... 

    Apolis

    New York, NY
    4 days ago
  •  ...Overview Are you passionate about big data and eager to work with cutting-edge technologies? We have an exciting opportunity for a Data Engineer - Spark Developer to join our dynamic and...  ...; Advanced knowledge of Python or Scala; Spark query tuning and performance optimization... 
    Full time
    Remote work
    Flexible hours

    European Dynamics

    Brooklyn, NY
    4 hours ago
  •  ...ethically democratize the benefits of data and AI . Since 2019, we have...  ...culture from the ground up. Engineers here own major surface areas ,...  .... Highlights: Well-funded with 5+ years of runway. At the...  ...current data stack is Delta Lake, Scala Spark, Python Spark, and... 
    Remote work
    Flexible hours

    Yobi

    New York, NY
    2 days ago
  •  ...City Salary: Market We are a group of engineers collaborating with Product Managers, Clients and Quants on...  ...basis to build the next generation of Data AnalyticsRapidly expanding to tackle...  ...Streaming Data Initiative using C++, Java, Scala, Python Strong communication,... 

    WONESE

    New York, NY
    3 days ago
  •  ...a mission to make public web data accessible for AI through contributions...  ...project is for those who lead with initiative and seek to...  ...The Role. We are seeking a Data Engineer with expertise in building and...  ...languages such as Python, Scala, or Java for pipeline orchestration... 

    Solana Foundation

    New York, NY
    1 day ago
  •  ...consolidated Employer & Broker pillar of Data and Analytics (D&A)...  ...of MetLife Global by earnings) with everything related to...  ...validate the data loaded by data engineering team. Work with IT, business,...  ...Experience with SQL, Spark &/or Scala/Python and performance tuning.... 
    Work experience placement

    MetLife

    New York, NY
    4 days ago
  •  ...Overview: **Required:****10+ yrs exp Data Analyst/Engineer with Financial client experience. Strong SQL, Big data****Required** **NY/NJ locals who can go in person interviews.****Day 1 Onsite in NewYork**Responsibilities:• Perform data enquiry, data analysis and data... 
    Local area

    Guru Schools

    New York, NY
    4 days ago
  •  ...million households. They are currently expanding their Data Engineering team based in New York City, NY. This role is...  ...as a Data Engineer including hands-on experience with a combination of the following: Python, Scala, SQL, AWS, EMR, EKS, Data, Athena, Hadoop, ClickHouse... 
    Immediate start

    The Cypress Group

    New York, NY
    5 days ago
  • $148.7k - $199.4k

     ...Senior Software Engineer Disney Entertainment and ESPN Product &...  ...developers, designers, technologists, data scientists, and more – all...  ...The team marries technology with creativity to build world-class...  ...and stream processing using Scala and Python with frameworks like... 
    Work experience placement

    Disney France

    New York, NY
    1 day ago
  •  ...scalable, secure, cloud-native data platforms on Google Cloud...  ...FinOps best practices Mentor engineers, conduct design/code reviews,...  ...engineering standards • Collaborate with product, analytics, and data...  ...: Advanced SQL, Python (Java/Scala a plus) • Data Engineering:... 

    Mphasis

    New York, NY
    10 hours ago
  •  ...a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal...  ...sets, PDTs, and derived tables. Partner with stakeholders to translate business questions...  ...programming language (e.g., Python, Scala, Java). Deep expertise with major cloud... 
    Remote work

    Comfrt

    New York, NY
    2 days ago
  • $190k - $220k

     ...Senior Data Engineer Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA...  ...focus on their craft and their customers. With teams in Denver, San Francisco, and New...  ...one programming language (e.g., Python, Scala, or Java) ~ Proven experience building... 
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer With Scala Exp.. Be the first to apply!