Data Engineer With Scala Exp.
Guru Schools
Overview: **Mandatory skills / Required Experience**- Azure (Bigdata Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**Job Description: -**- 11+ years of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data pipelines, architectures & data sets- Knowledge of Python/C# is a MUST- Assure that data is cleansed, mapped, transformed, and otherwise optimized for storage and use according to business and technical requirements- Develop and maintain innovative Azure solutions- The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)- Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications- Build data pipelines to collectively bring together data- Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer With Scala Exp. in New York, NY vacancy
$150k - $170k
...Senior Data Engineer At Magnite, we cultivate an environment of continuous growth and collaboration... ...to help us tackle that responsibility with creativity and focus. Magnite is the... ...are seeking someone with proficiency in Scala and Spark to build and optimize large-...SuggestedHourly payWork experience placementSummer workSeasonal workLocal areaShift workMagnite
New York, NY4 days ago$229.9k - $262.4k
Senior Lead Data Engineer (Enterprise Platform Technology) (Java, Python, Scala, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving... ...Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior...SuggestedFull timePart timeInternshipLocal area- ...Title: Sr. Data Engineer Location: New York, NY Job Description... ...Python, alternatively Scala or Java) Proficiency in atleast... ...or similar) Proficiency with data structures, data serialization... ...lines for each skill on your exp.) Python 5 10 I have designed...Suggested
Damco Solutions
New York, NY1 day ago $220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership... ...hands-on data engineering execution with practical team leadership, helping the organization... ...data engineering, such as Python, Java, Scala, Go, or similar ~ Comfort with...SuggestedLocal areaRemote workFlexible hoursBayview Asset Management
New York, NY2 days ago- ...within the newly consolidated Data and Analytics (D&A) organization... ...MetLife Global by earnings) with everything related to data, analytics... ..., data governance, data engineering, data modeling, data analysis... ...experience with SQL, Spark &/or Scala/Python and performance tuning....Suggested
MetLife
New York, NY5 days ago - ...Responsibilities: Build and maintain data pipelines using Python and SQL.... ...issues to meet service goals. Work with analytics, engineering, and business teams to deliver clean,... ...tools. Skilled in Python, SQL, R, or Scala. Good project management skills;...Work at office
Texas State Library and Archives Commision
New York, NY3 days ago - ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite... ...firm. You will work in close collaboration with software engineers, data scientists and... ...in Java SpringBoot. Python and Scala is a plus Experience building APIs...
Enterprise Engineering
New York, NY5 days ago - ...Overview: Role: Data Engineer Location: New York (100% onsite) (Need local to NY) Interview... ...need to have colab set up ready with Gmail account so they can code on the L1... ...Languages & Scripting: Spark, Python, Java, Scala, Hive, Kafka, SQL Cloud Platforms:...Local area
Guru Schools
New York, NY1 day ago - ...Job Title: Data Engineer Job Summary: We are seeking a skilled and motivated Data Engineer... ...initiatives. You will work closely with data scientists, analysts, and software... ...programming language (e.g., Python, Java, Scala). ~ Familiarity with cloud platforms (...Remote workFlexible hours
Adidev Technologies Inc
Jersey City, NJ1 day ago - ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern data architectures... ...enabling analytics and ML use cases, with strong fundamentals in data modeling and... .... ~ Experience in Python, Scala, or Java. ~ Hands-on experience with...
Apolis
New York, NY4 days ago - ...Data Engineer Jersey City, New Jersey, United States Title: Data Engineer Join a forward... ...platforms like Snowflake, BigQuery, and S3 Work with distributed systems such as Spark and... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and...
Glint Tech Solutions LLC
Jersey City, NJ5 days ago $45 - $55 per hour
...FocusKPI is looking for a Data Engineer to join our client's growing team and spearhead analyses... ...handling. Partner cross-functionally with technical and business stakeholders to... ...required ~ Team's Tech Stack: Spark, Scala, Python, DBT, Airflow, Kafka, AWS EMR, Hive...Work at officeRemote workFocusKPI Inc.
New York, NY5 days ago- ...proprietary AI Studio and AI Engines, the company helps drive the clients... ...in their Digital AI journeys. With offices in North America, Asia... ...infrastructure required for data integration, storage,... ...languages such as Python (must have), Scala, and proficiency in writing...Full timeWork experience placementH1bLocal areaRemote work
Fusemachines
New York, NY5 days ago $140k - $240k
...Overview The Data Engineer on the Nebula team plays a critical role in building and evolving... ..., this individual partners closely with Product, Engineering, AI, Analytics, and... ...data engineering, such as Python, Java, Scala, or Go ~ Comfort working with CI...Local areaRemote workFlexible hoursBayview Asset Management
New York, NY2 days ago- ...ethically democratize the benefits of data and AI . Since 2019, we have... ...culture from the ground up. Engineers here own major surface areas ,... .... Highlights: Well-funded with 5+ years of runway. At the... ...current data stack is Delta Lake, Scala Spark, Python Spark, and...Remote workFlexible hours
- ...Overview: **Required:****10+ yrs exp Data Analyst/Engineer with Financial client experience. Strong SQL, Big data****Required** **NY/NJ locals who can go in person interviews.****Day 1 Onsite in NewYork**Responsibilities:• Perform data enquiry, data analysis and data...Local area
Guru Schools
New York, NY4 days ago - ...consolidated Employer & Broker pillar of Data and Analytics (D&A)... ...of MetLife Global by earnings) with everything related to... ...validate the data loaded by data engineering team. Work with IT, business,... ...Experience with SQL, Spark &/or Scala/Python and performance tuning....Work experience placement
$160k - $200k
...As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex, client-facing... .... You'll bring deep, hands-on expertise with Databricks and the broader modern data stack... ...production-quality code in Python, with Scala experience a strong plus for deeper...Work experience placementRearc
New York, NY4 days ago- ...Sr. Data Engineer Location: New York, NY Duration: C2H Visa: US Citizen, GC, H1 Pay... ...and management skills coupled with deep experience engineering and managing... ...in one or more languages (Python, Java, Scala, C/C++) ~2+ years experience with NoSQL...
Cardinal Integrated
New York, NY1 day ago $148.7k - $199.4k
...Senior Software Engineer Disney Entertainment and ESPN Product &... ...developers, designers, technologists, data scientists, and more – all... ...The team marries technology with creativity to build world-class... ...and stream processing using Scala and Python with frameworks like...Work experience placementDisney France
New York, NY1 day ago- ...scalable, secure, cloud-native data platforms on Google Cloud... ...FinOps best practices Mentor engineers, conduct design/code reviews,... ...engineering standards • Collaborate with product, analytics, and data... ...: Advanced SQL, Python (Java/Scala a plus) • Data Engineering:...
Mphasis
New York, NY5 days ago $190k - $220k
...Senior Data Engineer Denver, CO;San Francisco, CA;New York, NY;Los Angeles, CA;Seattle, WA... ...focus on their craft and their customers. With teams in Denver, San Francisco, and New... ...one programming language (e.g., Python, Scala, or Java) ~ Proven experience building...Full timeWork at officeLocal areaRemote work2 days per week3 days per weekGusto
New York, NY1 day ago- ...Senior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses...
Apex Informatics
Jersey City, NJ5 days ago - ...BigQuery, Python, GCP Skill Cluster : Data-GCP Data Plex, with Data Governance, Data Catalog, Data... ...We are seeking a highly skilled Data Engineer with strong hands-on experience in BigQuery... ...Proficiency in Python / Java / Scala Nice to Have Experience with: Dataflow...
Diversity Nexus
New York, NY3 days ago $138k - $181.65k
...THE POSITION Our roster has an opening with your name on it We are looking for a Senior Data Engineer to design and build scalable, reliable, and high-quality... ...at least one programming language (e.g., Python, Scala, or Java). ~ Hands-on experience with modern data...Temporary workLocal areaWorldwideFanDuel
New York, NY2 days ago- ...Sr. Data Engineer New York, New York, United States About the Job Sr. Data Engineer Job Summary:... ...ability to work independently, and collaboration with client teams. Compensation: Data Engineer: 10+ years exp - $140-$160k (4 positions) Senior Data...
Inizio Partners
New York, NY1 day ago - ...million households. They are currently expanding their Data Engineering team based in New York City, NY. This role is... ...as a Data Engineer including hands-on experience with a combination of the following: Python, Scala, SQL, AWS, EMR, EKS, Data, Athena, Hadoop, ClickHouse...Immediate start
The Cypress Group
New York, NY5 days ago $164.64k - $246.96k
...Overview We are hiring a Senior Lead Data Engineer to build and scale the data foundations... ...vertical, partnering closely with Applied ML, ML Platform, and Causal Science... ...Expertise: Deep experience with Spark (PySpark/Scala), Databricks, Airflow, and Kafka. ~ ML...Paramount
New York, NY1 day ago- Transformeer data naar waardevolle inzichten met Azure en moderne BI-tools. Werk aan uitdagende... ...leiding te nemen in de wereld van data-engineering? Jouw avontuur begint hier bij Centric!... ...en querytalen zoals SQL, Python, Scala, etc. Vaardigheid om oplossingen te ontwerpen...
- ..., Inc. (OCI) OCI is seeking experienced Data Engineers to design, develop, and manage data infrastructure... ...software and strategic partnerships with Amazon and Google to build... ...Spark). Proficiency in Go, Java, Python, or Scala. Proficiency in CI/CD pipelines and Infrastructure...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer With Scala Exp.. Be the first to apply!
Related searches
- staff data engineer New York, NY
- data engineering intern summer New York, NY
- senior data integration developer New York, NY
- data engineer graduate New York, NY
- data engineer contract New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- software data engineer New York, NY
- hadoop big data developer New York, NY
- data developer New York, NY