Spark Data Engineer | PySpark, AWS ECS, Snowflake
Quadrant IQ Solutions LLC
A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing tools such as Snowflake or Teradata. This is a full-time position that promises great opportunities for growth in a dynamic environment. #J-18808-Ljbffr Quadrant IQ Solutions LLC
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer | PySpark, AWS ECS, Snowflake in New York, NY vacancy
$112.7k - $148k
# Data Engineer - SnowflakeNew YorkApply for this job* Permanent... ...are looking for a Snowflake Data Engineer with... ...Snowflake and Databricks (PySpark/SQL). - Develop and... ...with \*\*Databricks / Spark / PySpark\*\* - Advanced... ...- Experience with AWS / Azure / GCP - Knowledge...Amazon Web ServicePermanent employmentFull timeLocal areaCapgemini
New York, NY1 day ago- ...New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines... ...data from Hadoop to Snowflake using PySpark, and develop enterprise ETL solutions....Suggested
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery...Amazon Web ServiceFull timePart timeInternshipH1bLocal area- ...Have Skills Python & PySpark – Expert-level... ...very strong Apache Spark experience (large-scale data processing, optimization... ...tuning). AWS Cloud ECS (Elastic Container... ...preferred Data Warehousing Snowflake or Teradata (hands-... ...platform, and cloud engineering teams. Seniority level...Amazon Web ServiceFull timeH1b
Quadrant IQ Solutions LLC
New York, NY1 day ago - ...currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.... ...within AI service providers (e.g., AWS, GCP, Azure) to provide a first-in... ...with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while partnering with clients and...Amazon Web ServiceH1bLocal area
- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks... ...architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow...Amazon Web Service
$110k - $130k
...The New York Times, data powers decisions... ...looking for a Data Engineer to help us build them... ...cloud architecture (AWS and GCP) and... ...data modeling and PySpark for complex data processing... ...and tune Spark computeresources (e... ...Warehouse (BigQuery, Snowflake, DataBricks)Familiarity...Amazon Web ServiceFull timeLocal areaFlexible hours- ...They are currently expanding their Data Engineering team based in New York City, NY. This... ...combination of the following: Python, Scala, Spark or PySpark, AWS, ETL, SQL. The Data Engineer will... ...with columnar data stores (Parquet, Snowflake, etc.) is a plus. BSCS or equivalent...Amazon Web ServiceImmediate start
The Cypress Group
New York, NYa month ago - ...and passionate Senior Data Engineer to design and execute... ...and platforms including AWS and Azure cloud, APIs,... ...using Python, PySpark, and or Data Integration... ...debug code in PySpark/Spark/Python. Strong SQL and... ...Experience with Redshift, Snowflake, Databricks SQL, Oracle...Amazon Web ServiceLocal area3 days per week
- ...Build and scale cloud data products on Snowflake supporting institutional trading, risk, and regulatory... ...squads with BAs, QA, and platform engineering; participate in design reviews and code... ...: Airflow, Control-M, or Autosys. AWS: S3, IAM, Glue, Lambda, Secrets Manager...Amazon Web Service
Gandiv Insights LLC
New York, NY5 days ago - ...Job Description Role – AWS/Senior DE Location –... ...- Key Skills: Snowflake, SQL, Python, Spark, AWS- Glue, Big Data Concepts Responsibilities... ...mentorship to junior data engineers. ~ Ensure compliance... ...experience with SQL, python and PySpark ~ Good understanding...Amazon Web ServiceWork experience placementWork at office
Inizio Partners
New York, NYa month ago - ...THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes... ...from third-party APIs, and work with Snowflake, Spark, and AWS to deliver high-performance data... ...analytics libraries like Pandas , Polars , PySpark or DuckDB ; 2+ years of experience...Amazon Web ServiceWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
New York, NY3 days ago $160k - $220k
...it. Who you are As a Senior Data Engineer at Metropolis, you will play... ...with extensive experience in Snowflake and dbt Hands‑on experience... ...computing services, preferably AWS, including hands‑on... ...are a plus: Experience with Spark and PySpark Master’s degree in Computer...Amazon Web ServiceTemporary workWork at officeLocal areaAfternoon shiftMetropolis Inc
New York, NY4 days ago- ...Snowflake Lead – Data Engineering San Antonio, TX / New York, NY (Onsite) Local to San Antonio, TX / New York, NY only! P&C / Specialty Insurance... ...Snowflake Cortex AI / AI-enabled analytics * Strong AWS Cloud data platform experience * Expertise in Data Engineering...Amazon Web ServiceTemporary workLocal area
Delan Associates, Inc
New York, NY15 days ago $140k - $150k
David Yurman is seeking a Data Engineer to design and implement data solutions in a hybrid setting... ...in New York. The role involves creating AWS-based data pipelines, ensuring data... ...strong experience in AWS technologies and Snowflake, with excellent communication skills. A...Amazon Web Service- ...our team as a Senior Data Engineer building and operating... ...Databricks lakehouse on AWS that hydrates data... ...native orchestration. Tune Spark and SQL workloads for... ...in dbt, PySpark, and SQL that serve BI... ...downstream systems through Snowflake and Databricks secure...Amazon Web ServiceFlexible hoursShift work
Alter Domus
New York, NY5 days ago - David Yurman is seeking a Data Engineer based in Tribeca, New York, to design and build data integration solutions. This role, which is hybrid, focuses on analytics modernization through AWS and Snowflake technologies. The successful candidate will develop data pipelines...Amazon Web Service
- Karsun Solutions, LLC is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines and analytics... ...owners and data analysts. You will work with Databricks, PySpark, Airflow, and AWS, employing CI/CD practices to deliver repeatable data delivery...Amazon Web Service
- BasePoint is seeking a Data Engineer to own and evolve our batch data ingestion layer, supporting a team of Analytics Engineers... ...credit facilities. You will work primarily with Snowflake, dbt, Dagster, and AWS, embedded in a 16-person data team serving Credit, Operations...Amazon Web Service
- Responsibilities Develop and maintain data models in dbt following modular & scalable design... ...maintain scalable data pipelines using Snowflake and DBT Build and optimize pipelines on... .... Familiarity with cloud platforms (like AWS). Strong problem-solving skills and...Amazon Web Service
- ...connecting real-time data with world-class... ...Director, Data Engineering who will be responsible... ...data pipelines in Snowflake and Databricks... ...ETL packages using PySpark, SQL, and Python for... ...as Python and AWS GlueDesign, Build,... ...Databricks and Apache Spark (PySpark)....Amazon Web ServiceTemporary workFreelanceFlexible hours
- Build and scale cloud data products on Snowflake supporting institutional trading, risk, and regulatory... .... Qualifications 7+ years in data engineering; 4+ years hands-on Snowflake in a production... ...: Airflow, Control-M, or Autosys. AWS: S3, IAM, Glue, Lambda, Secrets...Amazon Web Service
$110k - $130k
...with this role. Position Details: Role: Snowflake Lead Data Engineering Locations: New York, NY... ...Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend ETL Roles & Responsibilities The Snowflake...Amazon Web ServiceFull timeContract workImmediate startSiri InfoSolutions Inc
New York, NY1 day ago- ...focus on transforming enterprise technology. This senior data engineer role targets Snowflake in production, dbt modeling, and orchestration across data... ...architectures, and reliable cloud deployments using AWS, Git-based CI/CD, and Terraform, collaborating with analytics...Amazon Web Service
- ...partnering with a leading New York City hospital to hire 1-Senior Snowflake Data Engineer for a full-time, permanent position. This is a Hybrid... ...ETL best practices, and cloud data platforms i.e. (Azure or AWS or GCP). Ability to analyze large datasets to identify data...Amazon Web ServicePermanent employmentFull timeRemote work
- ...more optimized, digitally enabled, and data-driven organizations through our comprehensive... ...Group is seeking an experienced Senior Snowflake Data Engineer to support enterprise data... ...orchestration using Airflow, Azure Data Factory, AWS Glue, or similar technologies....Amazon Web ServiceTemporary work
- CTG is seeking a skilled Snowflake Data Engineer to join our client's growing data engineering team. This role is ideal for a data professional... ...Snowpark, or similar data transformation frameworks. Knowledge of AWS, Azure, or Google Cloud Platform. Experience building ELT/...Amazon Web ServiceOngoing contractLocal area
- ...We are seeking a talented Data Engineer with 2-4 years of experience... ...scalable data pipelines on the AWS Cloud using Snowflake. The ideal candidate should... ...) Python (Mandatory) PySpark (Preferred) Version Control... ...Tool). Exposure to Apache Spark or PySpark. Knowledge of...Amazon Web Service
$135k
...together the rigor of data-driven analysis... ...seeking a Senior Data Engineer with deep expertise... ...libraries (e.g., PySpark, Apache Airflow) and... ...Data tools such as Spark or Scala Hands-on... ...cloud platform (e.g., AWS, GCP); familiarity... ...warehouses (e.g., Snowflake, BigQuery, Redshift...Amazon Web ServicePermanent employmentH1bLocal areaWorldwideHome office- ...services provider is seeking a candidate for a remote position focused on leading cloud-native data platform implementations. The ideal candidate has a strong background in AWS, Snowflake, and Python, with experience in managing enterprise data infrastructures and leading...Amazon Web ServiceCasual workRemote work
Jobot
New York, NY2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer | PySpark, AWS ECS, Snowflake. Be the first to apply!
Related searches
- data platform engineer New York, NY
- aws data engineer New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- big data developer New York, NY
- software data engineer New York, NY
- data center engineer New York, NY
- big data cloud engineer New York, NY
- director data engineering New York, NY
- hadoop big data developer New York, NY