Spark Data Engineer | PySpark, AWS ECS, Snowflake
Quadrant IQ Solutions LLC
A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing tools such as Snowflake or Teradata. This is a full-time position that promises great opportunities for growth in a dynamic environment. #J-18808-Ljbffr Quadrant IQ Solutions LLC
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer | PySpark, AWS ECS, Snowflake in New York, NY vacancy
- ...is seeking an Intermediate Data Engineer to design and manage scalable... ...role involves working with AWS services and optimizing... ...centralized data lake and Snowflake environment. Candidates should... ...pipelines, and proficiency in PySpark and Apache Spark. This position will require...Amazon Web Service
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, SQL, Snowflake, Databricks, & GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive...Amazon Web ServiceFull timePart timeInternshipH1bLocal area$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery...Amazon Web ServiceFull timePart timeInternshipH1bLocal area- ...currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.... ...within AI service providers (e.g., AWS, GCP, Azure) to provide a first-in... ...with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while partnering with clients and...Amazon Web ServiceH1bLocal area
- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks... ...architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow...Amazon Web Service
- ...Have Skills Python & PySpark - Expert-level... ...very strong Apache Spark experience (large-scale data processing, optimization... ...tuning). AWS Cloud ECS (Elastic Container... ...Data Warehousing Snowflake or Teradata (hands-... ...platform, and cloud engineering teams. Seniority level...Amazon Web ServiceFull timeH1b
$110k - $130k
...The New York Times, data powers decisions... ...looking for a Data Engineer to help us build them... ...cloud architecture (AWS and GCP) and... ...data modeling and PySpark for complex data processing... ...and tune Spark computeresources (e... ...Warehouse (BigQuery, Snowflake, DataBricks)Familiarity...Amazon Web ServiceFull timeLocal areaFlexible hours- ...Data Engineer – IntermediateAmpcus Inc. is a certified global provider... ...centralized data lake and Snowflake data warehouse. The role... ...transformation logic using PySpark and Apache Spark (Java).Work with large, structured... ...-structured datasets on AWS infrastructure.Ensure data...Amazon Web Service
Ampcus
New York, NY1 day ago - ...Experience & Design, Engineering and Managed Services.... ...possibilities.As a Senior Data Engineer, AI & Agents,... ...across Databricks and Snowflake, converting source... ...Advanced SQL together with Spark / PySpark, and experience with... ...cases.Experience with AWS and S3, in...Amazon Web ServiceContract work
- ...Data EngineerDesign, build, and optimize scalable... ...data from Kyriba into Snowflake and Databricks. Develop... ...pipelines and feature engineering built on top of... ...in Databricks, Apache Spark (PySpark/SQL).Proven experience... ...optimizationHands-on experience with AWS services — including S...Amazon Web Service
TPI Global
New York, NY3 days ago - ...Snowflake Data EngineerLocation: NYC, NY /onsite Domain- BFSI exp a must Only full time Role... ...Agile squads with BAs, QA, and platform engineering; participate in design reviews and code... ...Orchestration: Airflow, Control-M, or Autosys.AWS: S3, IAM, Glue, Lambda, Secrets Manager...Amazon Web ServiceFull time
Futran Tech Solutions Pvt. Ltd.
New York, NY4 days ago - ...Sr Data EngineerTechnology is at the heart... ...global organization of engineers, product developers... ...will work across AWS, Databricks, Unity Catalog, Snowflake and Airflow to... ...using Databricks, PySpark, SQL, and Unity Catalog... ...with PySpark and/or Spark SQL in production.Strong...Amazon Web Service
Walt Disney Company
New York, NY3 days ago $140k - $150k
David Yurman is seeking a Data Engineer to design and implement data solutions in a hybrid setting... ...in New York. The role involves creating AWS-based data pipelines, ensuring data... ...strong experience in AWS technologies and Snowflake, with excellent communication skills. A...Amazon Web Service- ...Job Description:- Our client is seeking an experienced Snowflake Data Engineer to optimize and stabilize their cloud data platform. You will... ...reduce costs, and establish best practices across Snowflake and AWS infrastructure. Responsibilities & Qualifications...Amazon Web Service
Connvertex Technologies Inc.
New York, NY2 days ago $110k - $130k
...Have Technical/Functional Skills Snowflake, Cortex AI, Python and Insurance Domain on AWS Cloud, Talend ETL Roles &... ...lead for CLEARBROOK ’s enterprise data platform, responsible for end to... ...expertise in Snowflake, strong data engineering fundamentals, and the ability to...Amazon Web ServiceTata Consultancy Services
New York, NY3 days ago- David Yurman is seeking a Data Engineer based in Tribeca, New York, to design and build data integration solutions. This role, which is hybrid, focuses on analytics modernization through AWS and Snowflake technologies. The successful candidate will develop data pipelines...Amazon Web Service
- ...Data Engineering-Big Data EngineeringAs a technical lead, you will guide... ...native data platforms leveraging Snowflake, AWS, Apache Airflow and modern... ...in SQL, Python, and PySpark.Extensive experience working... ...Data technologies including Spark, Hadoop, Hive, HBase, Kafka,...Amazon Web Service
EXL
New York, NY4 days ago - ...building and operating the data integrations that... .... This is a hands-on engineering role with real... ...applications, primarily as AWS Glue jobs written in PySpark.Investigate... ...ETL/ELT pipelines with Spark (PySpark), ideally as... ...With)Cloud: AWS (EC2, ECS, RDS, CloudWatch), including...Amazon Web ServiceFull timeWork at officeRemote work
Twenty Inc.
New York, NY4 days ago - The Phoenix Group is seeking a Senior Data Engineer to join our growing data and technology team in the financial services... ...the business. You will work with Python, SQL, Snowflake, dbt, Airflow, Databricks, and AWS to enable reliable data-driven decisions, data quality...Amazon Web Service
- ...connecting real-time data with world-class... ...Director, Data Engineering who will be responsible... ...data pipelines in Snowflake and Databricks... ...ETL packages using PySpark, SQL, and Python for... ...as Python and AWS GlueDesign, Build,... ...Databricks and Apache Spark (PySpark)....Amazon Web ServiceTemporary workFreelanceFlexible hours
$168k - $252k
...in large-scale IT and engineering, we combine market-leading... ...spanning technology, data sciences, consulting... ...SQL, DBT, Python, Spark, PySpark, Java, JavaScript, Scala... ...Google Cloud Platform, Snowflake, and Databricks. Experience... ..., Azure AI services, AWS AI services, Pi,...Amazon Web ServiceFlexible hours- We are looking for a Senior Data Engineer to join a growing data and technology... ...data transformations within Snowflake Work with Databricks for... ...-based data solutions in AWS Integrate data from internal... ...business teams Nice to Have Spark/PySpark Terraform CI/CD Data quality...Amazon Web Service
- ...Snowflake Lead – Data Engineering San Antonio, TX / New York, NY (Onsite) Local to San Antonio, TX / New York, NY only! P&C / Specialty Insurance... ...Snowflake Cortex AI / AI-enabled analytics * Strong AWS Cloud data platform experience * Expertise in Data Engineering...Amazon Web ServiceTemporary workLocal area
Delan Associates, Inc
New York, NYa month ago - ...THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes... ...from third-party APIs, and work with Snowflake, Spark, and AWS to deliver high-performance data... ...analytics libraries like Pandas , Polars , PySpark or DuckDB ; 2+ years of experience...Amazon Web ServiceWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- FlairTech Solutions is seeking a Data Engineer to design and operate data platform pipelines from our New York area operations... ...building scalable data transformations with dbt, leveraging Snowflake, and integrating AWS services to deliver reliable data products. You will...Amazon Web Service
$35 per hour
...Sales Executives, Software Engineers, Data Analysts, Ad Operations, Marketing... ...(e.g. Google BigQuery, Snowflake, Databricks) to support data... ...technologies such as Google BigQuery, AWS Redshift or Databricks... ...preferred Familiarity with PySpark, Spark or other distributed data...Amazon Web ServiceWork experience placementInternshipLocal area$112.29k - $161.28k
...meets media scale, where data becomes direction,... ...built on the Azure and AWS technology stacks. These... ...platforms (e.g., Snowflake, Databricks)Define enterprise... ...mentorship to data engineers and analystsAct as a... ...DatabricksLanguages: SQL, Python, Spark (PySpark), JavaETL /...Amazon Web ServiceTemporary workFreelanceFlexible hours- ...Role Name: AWS Data & Solution Engineer Location: NYC, NY Employment... ...primary skills on Python & PySpark development who will be able... ...unit test applications on Spark framework on Python. Build... ...Preferred expertise on Snowflake, AWS Redshift & DynamoDB...Amazon Web ServiceFull timeWork at office
Acunor Inc
New York, NY2 days ago - Elios AI is seeking a senior Lead Data Engineer for a fully onsite contract engagement in New... ...of production-grade data platforms using Snowflake, covering ingestion, transformation, and... ...data governance, along with experience in AWS and Python. This senior-level position...Amazon Web ServiceContract work
- ...services provider is seeking a candidate for a remote position focused on leading cloud-native data platform implementations. The ideal candidate has a strong background in AWS, Snowflake, and Python, with experience in managing enterprise data infrastructures and leading...Amazon Web ServiceRemote jobCasual work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer | PySpark, AWS ECS, Snowflake. Be the first to apply!
Related searches
- bi data engineer New York, NY
- data engineer analytics New York, NY
- principal data engineer New York, NY
- senior cloud data engineer New York, NY
- data center engineer New York, NY
- staff data engineer New York, NY
- director data engineering New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- azure data engineer New York, NY