Spark Data Engineer | PySpark, AWS ECS, Snowflake
Quadrant IQ Solutions LLC
A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing tools such as Snowflake or Teradata. This is a full-time position that promises great opportunities for growth in a dynamic environment. #J-18808-Ljbffr Quadrant IQ Solutions LLC
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Spark Data Engineer | PySpark, AWS ECS, Snowflake in New York, NY vacancy
- ...is seeking an Intermediate Data Engineer to design and manage scalable... ...role involves working with AWS services and optimizing... ...centralized data lake and Snowflake environment. Candidates should... ...pipelines, and proficiency in PySpark and Apache Spark. This position will require...Amazon Web Service
- ...of different types of data systems across the organization... ...SQL Data Warehouse and Snowflake environments Interpret... ...tools like Databricks, spark Understand, comply and... ...and other software engineers on design Collaborate/... ...Platforms - Azure, AWS (Anyone) Data Tools and...Amazon Web ServiceWork experience placement
$112.7k - $148k
...Data Engineer - Snowflake Choosing Capgemini means choosing a company where you... ...using Snowflake and Databricks (PySpark/SQL). Develop and... ...experience with Databricks / Spark / PySpark Advanced SQL (query... ...Experience with AWS / Azure / GCP Knowledge of...Amazon Web ServicePermanent employmentFull timeContract workLocal area- ...applications using the Snowflake platform Work with a... ...various sources like AWS S3, Azure DataLake Gen... ...Cloning, Time Travel, Data Sharing, Data Replication... ...SnowPro Advanced Data Engineer. Development... ...ingestion / transformation. PySpark / Spark experience. Additional...Amazon Web ServiceWork experience placementVisa sponsorship
- ...Role description Snowflake SQL Pyspark New York,NY Onsite Essential SQL ability to write complex queries in snowflake Analytical thinking ability to distill user feedback into broad issue categories test and compare the product with different settings...Suggested
- ...Strong hands-on expertise with: PySpark (RDD, Data Frames, Spark SQL, performance tuning) DPL (Data... ...Proficiency in Python for data engineering workflows. Experience with distributed... .../ELT pipelines on cloud platforms (AWS / Azure / GCP). Familiarity...Amazon Web Service
- ...Title: Senior Snowflake Data Engineer Location: New York City, NY (Onsite) Duration: 6+ months... ...hands-on experience with Python, PySpark, and Snowflake ~ Proven expertise in... ...processing frameworks ~ Experience with AWS cloud platforms ~ Strong...Amazon Web Service
$100 - $170 per hour
...About the job Data Engineer Snowflake and Databricks -New York, NY -Hybrid Data Engineer Snowflake... ...and streams ~ Hands on Databricks PySpark and Delta Lake and Unity Catalog and... ...Airflow or dbt or Azure Data Factory or AWS Glue ~ CI and CD with Git and pull requests...Amazon Web ServiceHourly payContract workLocal areaRemote work- A data solutions company in Georgia is seeking a qualified candidate with strong expertise in Databricks... ...architecture and advanced experience with PySpark and Spark SQL. Ideal applicants will possess a deep knowledge of AWS services and data orchestration tools like Airflow...Amazon Web Service
- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading... ...Experience with cloud platforms (AWS, Azure, or GCP) and related data services (e.g., S3, Snowflake, Databricks). Should be familiar...Amazon Web ServiceRemote work
- A leading financial services firm is seeking a Data Engineer to join its regulatory reporting data engineering team. The position... ...and processing large datasets using Scala and Spark on Databricks and Snowflake. The ideal candidate will have a bachelor's degree in Computer...Full time
$79.32k - $110.68k
Pyspark Data Engineer - Officer Apply (opens in new window) Job Req Id: 26953427 Location(s): Mississauga, Ontario, Canada Job Type: Hybrid Posted... ...-scale data processing systems using frameworks like Apache Spark, Hadoop, and Kafka. Proficiency in Python programming....Full time- A technology consulting firm in New York is seeking a Data Engineer to join their regulatory reporting team. The role involves developing data pipelines using Scala and Spark on Databricks and Snowflake. Candidates should have a Bachelor’s degree in Computer Science and...
- ...Title: Lead Snowflake Data Engineer Location: NYC | Fully Onsite | Prioritizing local candidates... ...backend data services using Python and PySpark Leverage Snowflake Cortex AI to enable... ...→ consumption) in cloud environments (AWS preferred) Required: Ownership of...Amazon Web ServiceContract workLocal area
- ...Have Skills Python & PySpark - Expert-level... ...very strong Apache Spark experience (large-scale data processing, optimization... ...tuning). AWS Cloud ECS (Elastic Container... ...Data Warehousing Snowflake or Teradata (hands-... ...platform, and cloud engineering teams. Seniority level...Amazon Web ServiceFull timeH1b
- ...hands-on experience in Python programming for data engineering and data processing. Extensive experience with Apache Spark (PySpark) for large-scale data processing and... ...platforms. Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services....Amazon Web Service
- ...Overview: Senior Data Engineer - Python & PySpark Job Summary We are seeking an experienced... ...pipelines using: Python Apache Spark / PySpark ~ Build reusable and... ...solutions on cloud platforms such as: AWS Azure GCP Work with...Amazon Web Service
- ...Title Required Skills: Java/Spring + Spark/SQL/AWS, should be very good in building data pipelines – Primary Skillset, MUST HAVE... ...MUST BE very strong on the Spark/Data Engineering side of things Data lake/Snowflake/Kubernetes – These are a HUGE plus – They...Amazon Web Service
$113k
Job Description: Staff Data Engineer (B2B Identity Platform) Build what’... ...identity solution on a strong Snowflake foundation—and you’ll play a... ...with cloud environments (AWS, Azure, or GCP) Experience with... ...in-person collaboration to spark ideas and strengthen our teams...Amazon Web ServicePermanent employmentFull timeContract workTemporary workWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week- ...A leading technology firm is seeking a seasoned Data Migration Engineer to migrate enterprise data platforms from Snowflake to AWS. The successful candidate will design migration strategies, optimize data pipelines, and ensure adherence to Federal compliance standards...Amazon Web ServiceRemote work
- ...Mutual of Omaha is looking for a highly skilled Data Engineer to develop and maintain data-centric solutions for group insurance products... ...building data pipelines, especially with technologies like AWS and Snowflake. The role is remote, accessible to applicants in the United...Amazon Web ServiceRemote work
- ...NGV Software is searching for a Senior Data Engineer to join their data engineering team in the United States. The ideal candidate will have over 7 years of experience, particularly with Snowflake and AWS, and will be responsible for designing and optimizing data pipelines...Amazon Web Service
- ...A staffing agency is seeking a Senior Data Engineer for a pivotal role in cloud data modernization. This fully remote position involves leading Snowflake and AWS initiatives, optimizing data platforms, and enhancing data processing capabilities. Ideal candidates will have...Amazon Web ServiceRemote work
- ...Responsibilities Develop and maintain data models in dbt following modular & scalable... ...and maintain scalable data pipelines using Snowflake and DBT Build and optimize pipelines on Snowflake... .... Familiarity with cloud platforms (like AWS). Strong problem-solving skills and...Amazon Web Service
- ...Nps-Prism is seeking a highly skilled Data Engineer to work in a cloud-based team, primarily focusing on Python, SQL, and PySpark. This role involves designing and optimizing data... ...Databricks on platforms like Azure and AWS. The ideal candidate will possess 3-6 years...Amazon Web ServiceRemote work
- ...NPS Prism is looking for a Data Engineer with 3-6 years of experience to work remotely. The ideal... ...have strong skills in Python, SQL, and PySpark, along with proven experience in Databricks and cloud platforms like Azure and AWS. Responsibilities include designing ETL workflows...Amazon Web ServiceRemote work
- ...Framework Ventures is seeking a Senior Data Engineer to lead the evolution of decentralized data infrastructure that powers our Blockchain... ...hands-on experience, with a strong proficiency in Python, Snowflake, and AWS, among other technologies. You will design robust data...Amazon Web ServiceRemote workFlexible hours
- ...Must Haves: Python, Pyspark, AWS,Apache Spark, Kafka, Snowflake, Palantir Job Description: • 3-10 years of hands-on experience in data engineering with a focus on ETL workflows, data pipelines, and cloud computing. • Strong experience with AWS services...Amazon Web Service
- ...A leading IT consulting firm is seeking a Senior Data Engineer to lead complex data migration efforts from SAS platforms to Snowflake on AWS. This remote position focuses on designing and optimizing data pipelines, developing ETL workflows, and ensuring federal compliance...Amazon Web ServiceFull timeRemote work
- ...Data Engineer (Insurance) Job Id: 98054 Location: Jersey City, NJ local... ...USC Only Key Skills: Snowflake, SQL, Python, Spark, AWS (Glue, EMR, S3, Aurora, RDS, AWS... ...Strong proficiency in SQL, Python, and PySpark. Good understanding of data...Amazon Web ServiceLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark Data Engineer | PySpark, AWS ECS, Snowflake. Be the first to apply!
Related searches
- bi data engineer New York, NY
- staff data engineer New York, NY
- data visualization developer New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- sr information security engineer New York, NY
- IT data engineer New York, NY
- junior big data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer contract New York, NY

