Data Engineer with Scala and Spark
IMR Soft LLC
Position Data Engineer with Scala & Spark Location
NYC, NY
Duration 12 Months Role Overview We need Data engineering, Scala, Snowflake and Data modeling for this role. Need only resources who can do scala coding. Job Description 12 to 20 years' experience in data analysis, data objects development and modeling in Snowflake data store. Snowflake REST API experience is required: Account API, Alert API, Artifact Repository API, Catalog Integration API, Cortex Inference API, Database API, Dynamic Table API, Event Table API, Iceberg Table API, Notebook API. Experience Experience with building data pipelines from legacy to Snowflake for unstructured and semi-structured datasets Informatica ETL and/or Talend ETL experience Efficient SQL and PLSQL queries development and Python scripts development experience Proven ability to work in distributed systems Proficiency with relational databases (such as DB2) querying and focus on data transformations Strong data modeling concepts and schema design on relational data store and on cloud data store Familiarity with data visualization tools such as Tableau and PowerBI is a plus Collaborating with data scientists/experts to integrate machine learning models into Snowflake Data Warehousing background is required #J-18808-Ljbffr IMR Soft LLCVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with Scala and Spark in New York, NY vacancy
- IMR Soft LLC is seeking a Data Engineer with strong Scala & Spark skills to design and implement data pipelines in Snowflake. The role emphasizes data modeling, REST API work, and collaboration with data science teams to integrate ML models. Ideal candidates have extensive...Suggested
- The Cypress Group is seeking a Data Engineer to join our expanding Data Engineering team in New York City. This... .... You will write efficient code in Python, Scala, or Spark / PySpark, develop and optimize ETL processes with AWS and SQL, and leverage Parquet and Snowflake...Suggested
- ...in New York is seeking an Intermediate Data Engineer to design and manage scalable ETL pipelines... ...analytics. The role involves working with AWS services and optimizing data processes... ..., and proficiency in PySpark and Apache Spark. This position will require onsite work...Suggested
- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks Lakehouse architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools...Suggested
- Veriipro in New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines, migrate data from Hadoop to Snowflake using PySpark, and develop enterprise...Suggested
- Tech Mirrors is seeking a Big Data Engineer in New York, NY for a long-term project. Responsibilities include designing and enhancing ETL... ...years of experience and strong knowledge of UNIX Shell, Python, Spark, and SQL. A positive team player is essential. This is an...
- A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates... ...have strong experience with AWS services and data warehousing...Full time
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano -... ...party systems. Collaborate with data scientists, analysts, and... ...technologies such as AWS Glue, Spark, and Databricks. Optimize... ...skills in Python, Scala, Java, and experience with Spark...Long term contractWork at office
InterSources
New York, NY3 days ago - ...the newly consolidated Data and Analytics (D&A) organization... ...Global by earnings) with everything related to... ...data governance, data engineering, data modeling, data... ...Optimize reusable frameworks, Spark jobs for performance... ...with SQL, Spark &/or Scala/Python and performance...Temporary workWork at officeLocal area3 days per week
MetLife
New York, NY2 days ago - ...Job Title: Data Engineer Location: NJ/NYC or Chicago - 3-4 days... ...a Specialist in Data Science with a focus on Big Data, you will... ...technologies such as Hadoop, Spark, and NoSQL databases to process... ...skills in Python, Scala, R, or Java, with experience...3 days per week
3B Staffing LLC
New York, NY3 days ago - ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting... ...work in close collaboration with software engineers, data scientists... ...Java SpringBoot. Python and Scala is a plus ~ Experience... ...Integration and UI development. Experience with Spark and Databricks....
3B Staffing LLC
New York, NY23 hours ago - ...hackajob is collaborating with J.P. Morgan to connect them with exceptional... ...Elevate and drive innovation, data engineering solutions, and serve as a decision... ...Skills : Databricks, DBX, PySpark, Spark, Terraform, Kafka, Python/Scala, Glue/EMR Experience with AI Developer...Work at office
J.P. Morgan
New York, NY14 days ago - ...Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description:... ...enterprise software solutions ~ Proficient in Spark, Scala, Python, AWS Cloud technologies ~3+... ...implementations ~ Experience with Agile Development methodologies ~ Experience...Remote work
Zortech Solutions
New York, NY4 days ago $160k - $200k
...As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex... ...deep, hands-on expertise with Databricks and the broader... ...platforms ~ Expert-level in Apache Spark, including runtime internals,... ...quality code in Python, with Scala experience a strong plus for...Work experience placementRearc
New York, NY1 day ago- ...Sr. Data Engineer Location: New York, NY Duration: C2H Visa: US... ...and management skills coupled with deep experience engineering... ...more languages (Python, Java, Scala, C/C++) ~2+ years experience... ...AWS Kinesis, Kafka, Storm, Spark, SonarQube highly desired...
Cardinal Integrated
New York, NY3 days ago $138k - $181.65k
...POSITION Our roster has an opening with your name on it We are looking for a Senior Data Engineer to design and build scalable,... ...and assets using tools like Spark, dbt or similar frameworks... ...programming language (e.g., Python, Scala, or Java). ~ Hands-on...Temporary workLocal areaWorldwideFanDuel
New York, NY4 days ago- .... Below is the requirement with my client. Please share the updated... ...and below details. Title: Data Engineer Location: New York,... ...languages e.g., Python, Scala. Experience in Starburst... ...using Databricks and Apache Spark (PySpark and Scala). Build...Full timeImmediate startRelocation
3B Staffing LLC
New York, NY3 days ago - ...democratize the benefits of data and AI . Since 2019, we have... ...culture from the ground up. Engineers here own major surface areas... ...effectively. Highlights Well‑funded with 5+ years of runway. At the... ...data stack is Delta Lake, Scala Spark, Python Spark, and Airflow -...Remote workFlexible hours
- We are partnered with an established Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines... ...Databricks, Azure Data Factory, and Spark (Python/Scala) Proven experience architecting data...
- ...Overview We are seeking a Lead Data Engineer to join a rapidly growing... ...efficiency and scalability. Partner with architecture, engineering, BI... ...solutions. Optimize Spark workloads, ETL processes, and... ...with SQL, Spark, Python, and/or Scala. Hands-on experience with...
- ...company in New York is seeking a Lead Data Engineer to oversee data workflows and ensure the... ...orchestration techniques while collaborating with cross-functional teams. Ideal... ...design and familiarity with Delta Lake, Scala Spark, and Python Spark. The company offers competitive...Remote job
- Carlsbad Tech is looking for a Lead Data Engineer to develop and optimize data pipelines in New York, NY. This role requires expertise in building data solutions using technologies like Kafka and Snowflake, ensuring scalable and reliable data processing. Join a team that...
$209k - $238.5k
...real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a... ...programming languages like Java, Scala, Python and Open Source RDBMS and... ...MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ years...InternshipLocal area- We are hiring a Data Engineer on behalf of one of our prestigious Fortune... ...technologies. Collaborate with data analysts, business stakeholders... ...with Python, PySpark, or Scala. Experience working with ETL... ...big data technologies like Spark, Hadoop, or Databricks is preferred...Visa sponsorship
$105k - $151k
## Data EngineerApplylocations: Parsippanytime type... ...management, and assist the data engineering team in applying... ...provide the candidate with an exceptionally broad... ...programming language (Python, Scala, Java).* Experience in... ...and analytics (Hadoop, Spark)* Familiarity with...Full timeWork at office- ...households. They are currently expanding their Data Engineering team based in New York City, NY. This... ..., maintainable code in Python, Scala, or Spark / PySpark. Develop and optimize ETL... ...experience as a Data Engineer. Proficiency with Python, Scala, or Spark / PySpark....
$150k - $350k
...based on your skills and experience — talk with your recruiter to learn more. Base pay... ...a leading investment firm, where engineers, data scientists, and domain experts collaborate... ...Proficiency in Python Experience with Spark, Scala, or related frameworks Familiarity...Full time- ...Client is looking for a skilled Data Engineer to join their team. The ideal... .... You will work closely with data scientists, analysts, and... ...technologies such as Hadoop, Spark, and Kafka. Experience with... ...languages such as Python, Java, or Scala. Knowledge of cloud-based...Local areaRelocation
$100k - $140k
...We are hiring a senior‑level Data Engineer to build trustworthy data products... ...Collaborate directly with business leaders to translate... ...processing frameworks (e.g., Spark). Knowledge of data warehousing... ...programming experience (e.g., Scala). Understanding of data...Work at officeRemote workWeekend work3 days per week$80.42k - $106.05k
Data Engineer (Pyspark) Job Location: Jersey City Location: New York, NY, US Role Overview... ...ELT workflows using Databricks, Apache Spark, and Scala. Architect and manage data lake house solutions... ...services and APIs, and collaborate with cross‑functional teams to define data...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with Scala and Spark. Be the first to apply!
Related searches
- data engineer analytics New York, NY
- associate data engineer New York, NY
- junior data developer New York, NY
- data engineer manager New York, NY
- remote data engineer New York, NY
- junior data engineer remote New York, NY
- senior cloud data engineer New York, NY
- data platform engineer New York, NY
- data infrastructure engineer New York, NY
- aws data engineer New York, NY