Spark Data Engineer | PySpark, AWS ECS, Snowflake
Quadrant IQ Solutions LLC
A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing tools such as Snowflake or Teradata. This is a full-time position that promises great opportunities for growth in a dynamic environment. #J-18808-Ljbffr Quadrant IQ Solutions LLC
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer | PySpark, AWS ECS, Snowflake in New York, NY vacancy
$215.2k - $245.6k
Data Engineer 4 (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks, GenAI) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At...Amazon Web ServiceFull timePart timeInternshipH1bLocal area- ...New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines... ...data from Hadoop to Snowflake using PySpark, and develop enterprise ETL solutions....Suggested
- Data Engineer - Intersystems to Cloud Migration (Snowflake/Databricks) Location: Remote NYC Contract: Ongoing Contract-Part-time BigRio... ...processing jobs using Databricks (Spark, PySpark, Delta Lake). Integrate data workflows with AWS RDS, Snowflake, and Databricks. Work...Amazon Web ServiceOngoing contractContract workPart timeRemote work
- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks... ...architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow...Amazon Web Service
- Data Engineer Location: remote (prefer EST but not picky) Interview process: 2 video... ...experience (required). Extensive AWS experience, including: Lambda, ECS, Glue Strong data engineering background with: PySpark Apache Spark Snowflake AWS Glue Batch processing...Amazon Web ServiceContract workRemote work
- ...Have Skills Python & PySpark - Expert-level... ...very strong Apache Spark experience (large-scale data processing, optimization... ...tuning). AWS Cloud ECS (Elastic Container... ...Data Warehousing Snowflake or Teradata (hands-... ...platform, and cloud engineering teams. Seniority level...Amazon Web ServiceFull timeH1b
$35 per hour
...Sales Executives, Software Engineers, Data Analysts, Ad Operations, Marketing... ...(e.g. Google BigQuery, Snowflake, Databricks) to support data... ...technologies such as Google BigQuery, AWS Redshift or Databricks... ...Familiarity with PySpark, Spark or other distributed data processing...Amazon Web ServiceInternshipLocal area- ...am reaching out to you on an exciting job opportunity with one of our clients. Position: Snowflake Data Engineer Contract: W Requirements: Candidates must have experience with AWS implementation Data pipelines, snowpipes already set up (might need to modify, so Python...Amazon Web ServiceRemote jobContract work
- Big Data Engineer Location: Remote Role Summary Excellent Scala, PySpark, Java coding experience for REST API and SOAP... ...webservices Excellent AWS experience (Batch and... ...microservices) using EMR/EC2/ECS/S3/Airflow/Step... ...Application performance tuning (Spark/Hadoop/EMR, Java,...Amazon Web ServiceRemote work
- Required Skills & Experience • 4-8+ years as a Data Engineer \n• Deep experience with Snowflake, Snowpipes, and cloud-based ingestion patterns \n• Strong SQL and stored procedure experience \n• Experience with AWS Lambda \n• Familiarity with DBT (nice-to-have but common...Amazon Web ServiceContract workRemote work
- Data Engineer Remote Until Covid 12 Months Job Description Experience in crafting re-useable data model for various Business Intelligence... ...the calculated columns and measures using SQL queries on Snowflake (AWS) and python. Experience in working with AWS, MS Azure or other...Amazon Web ServiceLocal areaRemote workFlexible hours
- Role- Snowflake Data Engineer Location- NYC, NY(only locals)-Onsite Role Overview Build and scale cloud data products on Snowflake supporting... ..., exposures. Orchestration: Airflow, Control-M, or Autosys. AWS: S3, IAM, Glue, Lambda, Secrets Manager. CI/CD and IaC: Git,...Amazon Web ServiceLocal area
- Data Engineer Simulmedia is looking for an experienced and dynamic Data... ...platform (Databricks / Spark / Delta) and our data warehouse... ...strongly preferred; EMR, Snowflake or BigQuery also relevant)... ...bases Working knowledge of AWS (S3, IAM, ECS or similar compute) and Docker...Amazon Web ServiceWork experience placementRemote work
$130k - $150k
The Senior Data Engineer is responsible for designing, building... ...using Apache Spark, Kafka, and Flink • Build... ...optimize complex SQL and PySpark transformations for... ...cloud data services: AWS Glue, Azure Data Factory... ...with Databricks, Snowflake, or Apache Hudi • Knowledge...Amazon Web ServiceFull time- ...Lead - Senior - Intermediate AWS/Cloud - EMR[Hive, Pyspark],S3, Athena or any other... ...and small amount of hands-on Spark - Spark Batch Processing... ...small amount of hands-on Big Data/Hadoop - Working experience... ...development, Nifi, and Kafka DWH - Snowflake,SQL, Data Modelling, Data...Amazon Web ServiceWork experience placementWork at officeRemote work
- ...Snowflake AI Data EngineerChoosing Capgemini means choosing a company where you will be empowered... ....Role Overview The Snowflake AI Data Engineer / Lead serves as the onsite technical lead... ..., and advanced data engineering on AWS Cloud. This role requires deep expertise...Amazon Web Service
Capgemini
New York, NY5 days ago - ...competitive advantage through Data Management. We... .... Role Name: AWS Data & Solution Engineer Location: NYC, NY Employment... ...skills on Python & PySpark development who will... ...test applications on Spark framework on Python.... ...Preferred expertise on Snowflake, AWS Redshift & DynamoDB...Amazon Web ServiceFull timeWork at office
- Azure - Data Factory, Databricks, Synapse, ADLS Senior Data Engineer - 8+ Years Experience Job Type: Full... ...technologies such as Apache Spark/PySpark. Develop data models... ...platforms such as AWS, Azure, or GCP. Implement... ...Databricks and/or Snowflake is highly desirable. Knowledge...Amazon Web ServiceFull timeWork at officeRemote work
- Senior/Lead Data Engineer Remote - CST Hours, Within US only... ...strong expertise in Snowflake, Informatica IDMC, ETL... ...warehousing, Python, CI/CD, and AWS or Databricks, with... ...and/or Databricks/Spark, including data... ...Exposure to Snowpark, PySpark, AWS Glue/S3/Lambda, streaming...Amazon Web ServiceRemote work
$146.6k - $150k
...place. Your Impact As a Data Engineer II, you will design,... ...strong skills in SQL and PySpark Hands‑on experience... ...cloud platforms such as (AWS, GCP, Azure, Oracle)... ...solutions such as Snowflake, BigQuery, Redshift, and... ...distributed systems such as (Spark, Dask, Flink) and...Amazon Web ServiceHourly payApprenticeshipWork at officeEasy work$135k - $160k
...make an impact? The Senior Data Engineer in Data and Analytics is responsible... ...and architectures on AWS (including services such as... .../ELT pipelines using Apache Spark (PySpark/Scala) on Databricks, applying... ...dimension tables, star and snowflake schemas, and aggregations —...Amazon Web ServiceRemote work$176k - $179.5k
...a senior software engineer, building AI that transforms... ...manage scalable data pipelines and... ...skills in SQL and PySpark Proven experience building... ...(Pandas, Spark, dbt, LangChain, LangGraph... ...cloud platforms (AWS, Azure, GCP) A strong... ...Asset Bundles, Snowflake, BigQuery, PSQL, etc...Amazon Web ServiceHourly payApprenticeshipWork at officeEasy workShift work$195k
...are looking for a Senior Data Engineer to join our lean, high-... ...is built in Python on AWS, so deep Python... ...using AWS Glue, Apache Spark, Airflow, or equivalent... ...modeling techniques: star/snowflake schemas, slowly changing... ...containerized deployments (Docker, ECS/EKS). Prior experience...Amazon Web ServiceWork from homeFlexible hours$145k - $155k
...can drive meaningful change, spark innovation, and achieve... ...Kentro is seeking a remote Data Engineer to support the implementation... ...data ingestion pipelines using PySpark, SQL, and Delta Lake. Support... ...solutions (i.e. Databricks, Snowflake, AWS, etc.) Minimum of 5 years of...Amazon Web ServiceRemote jobH1bLocal areaFlexible hours- Job Title: Lead Data Engineer Location: Dallas, TX Client... ...o SQLAlchemy o PySpark o FastAPI / Flask o... ...Talend • DataStage • AWS Glue • Apache Airflow... ...PostgreSQL • MySQL • Snowflake • Amazon Redshift Knowledge... ...experience with: • Apache Spark • PySpark • Hadoop...Amazon Web ServiceContract work
- ...services provider is seeking a candidate for a remote position focused on leading cloud-native data platform implementations. The ideal candidate has a strong background in AWS, Snowflake, and Python, with experience in managing enterprise data infrastructures and leading...Amazon Web ServiceRemote jobCasual work
- ...consulting firm, is seeking a Data Integration Engineer with strong enterprise payment... ...work with SQL, Python (Pandas, PySpark), and cloud data platforms (AWS, Snowflake, Redshift), and collaborate across... .../batch processing with Kafka, Spark, #J-18808-Ljbffr SynechronAmazon Web Service
- ...sustainable, more inclusive world.Job Description:Role OverviewThe Snowflake AI Data Engineer / Lead serves as the onsite technical lead, driving Snowflake-native AI, GenAI, and advanced data engineering on AWS Cloud.This role requires deep expertise in Snowflake, Cortex AI...Amazon Web ServiceFull timeLocal area
$150k - $175k
...Staritas is seeking a Senior Manager, Data Engineering to lead its enterprise data... ...databases. Experience with AWS, Azure, Google Cloud, or hybrid... ...Familiarity with tools such as Spark, PySpark, Airflow, dbt, Databricks, Snowflake, BigQuery, Redshift, Azure Data...Amazon Web ServiceFor contractorsWork at officeLocal areaRemote workFlexible hours$90.5k - $140k
...skilled Databricks Engineer with minimum of 5+... ...optimize scalable data platforms and analytics... ...Databricks, Apache Spark, and cloud-native... ...Apache Spark / PySpark Delta Lake SQL... ...DevOps Azure / AWS / GCP Terraform... ...Experience with Snowflake, Power BI, or Microsoft...Amazon Web ServiceFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer | PySpark, AWS ECS, Snowflake. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- senior cloud data engineer New York, NY
- senior data integration developer New York, NY
- data developer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- data platform engineer New York, NY
- data engineering intern summer New York, NY
- data engineer analytics New York, NY
- data engineer manager New York, NY