Senior Data Engineer - Spark & AWS (SQL + Python)
bfiverecruiting
bfiverecruiting is looking for a Senior Data Engineer to build ETL infrastructure and design data pipeline architectures using AWS services such as Glue and Spark. The ideal candidate will have over 8 years of experience in AWS and Python programming and be skilled in SQL for optimizing large datasets. This role requires strong expertise in data integration, and experience with data warehousing solutions like Amazon Redshift is essential. Join us to work with cutting-edge technologies in a collaborative environment. #J-18808-Ljbffr bfiverecruiting
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Spark & AWS (SQL + Python) in New York, NY vacancy
$500 per month
...group of experienced engineers, traders, and... ...Portage Ventures, Spark Capital, Tribe Capital... ...the vision for our data transformation layer... ...models using dbt and SQL to support diverse... ...~ Proficiency in Python for transformations... ...environments (GCP or AWS). Nice to Haves...Amazon Web ServiceSeniorSQLPythonRemote workHome officeAlpaca
New York, NY22 days ago$200k - $220k
...Senior Data Engineer New York, New York, United States The Role As... ...diverse backgrounds and voices spark better ideas and more... ...production data platforms with Python and SQL ~ Deep expertise in big-data... ...(Kafka/Kinesis) ~ Proven AWS skills plus Terraform / CloudFormation...Amazon Web ServiceSeniorSQLPythonSchonfeld
New York, NY20 days ago- ...deserves better software. As a Senior Data Engineer, you'll be hands-on with the backbone... ...expertise: Deep knowledge of AWS and open-source data tools (e.g. Spark, Iceberg, Kafka, dbt, etc.)... ...to have: Proficiency in Python, SQL, and infrastructure-as-code (Terraform...Amazon Web ServiceSeniorSQLPythonWork at officeRemote workFlexible hours
Camber
New York, NY3 days ago - ...1 In-person interview Senior Data Engineer Job Responsibilities... ...Expert-level proficiency in Python and PySpark/Apache Spark for large-scale financial... ...~ Solid understanding of SQL including joins, window functions... ...environment ~ AWS Certified Cloud Practitioner...Amazon Web ServiceSeniorSQLPythonContract work
Compu-Vision Consulting
New York, NY4 days ago - Overview Job Title: Senior Data Engineer (Banking) Location: New York City,... ...engineer, Snowflake, Databricks, Python, PySpark, SQL, Banking Key... ...and Databricks (Delta Lake, Spark optimization). Proficiency... ...Experience with cloud platforms (AWS/Azure) and CI/CD tools (Jenkins...Amazon Web ServiceSeniorSQLPythonContract work
- ...We are looking for a Senior Data Engineer to help design, build... ...Strong proficiency in Python for building data... ...infrastructure. Advanced SQL skills and deep... ...frameworks such as Airflow, AWS Glue, dbt, or similar... ...frameworks such as Spark (or equivalent)....Amazon Web ServiceSeniorSQLPythonWork at officeRelocation package
Nelo Mobile
New York, NY3 days ago - ...Senior Forward Deployed Data Scientist/Engineer At Scale AI, we are accelerating the... ...coding abilities in Python for data science (e.... ...mastery of complex SQL across large datasets... ...distributed systems (e.g., Spark, Ray).... ...warehousing (e.g., AWS, GCP, Snowflake, BigQuery...Amazon Web ServiceSeniorSQLPython
SCALE INC
New York, NY4 days ago - ...Job Description Job Title: Senior Consultant, Data Engineer Work Style/ Location: Hybrid... ...Stack Languages & Frameworks: Python , SQL , Spark Data Platforms: BigQuery,... ...tools Cloud: GCP; Azure, GCP, AWS What We're Looking For We'...Amazon Web ServiceSeniorSQLPythonFull timeWork at office
Biz First
New York, NY4 days ago $180k - $220k
...Senior Data Engineer New York City, New York Garner's mission is to transform the healthcare... ...of data pipelines using Python and SQL in AWS. Where you will work: This role... ...Snowflake) ~ Expertise with SQL tuning, Spark development, medallion and event-driven...Amazon Web ServiceSeniorSQLPythonWork at officeFlexible hours3 days per weekGarner Health
New York, NYa month ago- BDIPlus is seeking a Senior Data Engineer to support a Fortune 100 financial services client... ...storage using Apache Iceberg on AWS S3 Define and implement machine-... ...data quality frameworks Strong SQL and programming skills (Python, Spark; dbt preferred) Experience with...Amazon Web ServiceSeniorSQLPython
- ...proprietary AI Studio and AI Engines, the company helps... ...potential with AI. Senior Data Engineer Are you an... ...technologies such as AWS, GCP, Azure,... ...Strong proficiency in Python, SQL (complex queries, performance... ...), and PySpark/Apache Spark. Data Modeling: Expert...Amazon Web ServiceSeniorSQLPythonH1bLocal area
Fusemachines
New York, NY2 days ago - Tranzeal is seeking a highly skilled Data Engineer / Data Ingestion Engineer with over 6 years of experience in building scalable... .... The ideal candidate should have expertise in AWS Glue, Apache Spark, Python, SQL, and Snowflake. This role is fully remote, allowing for...Amazon Web ServiceSQLPythonRemote jobImmediate startFlexible hours
$160k - $220k
...Who you are As a Senior Data Engineer at Metropolis, you will... ...of experience with Python, and experience building... ...ecosystems ~ Proficiency in SQL, ETL/ELT, and data... ...services, preferably AWS, including hands-on... ...Experience with Spark and PySpark Master'...Amazon Web ServiceSeniorSQLPythonTemporary workWork at officeLocal areaAfternoon shiftMetropolis Corp
New York, NY3 days ago$140k - $160k
...Times is looking for a Senior Data Engineer to join the Customer-... ...native architectures (AWS preferred), including... ...Programming fluency with Python ~ Experience using... ...Kafka, Apache Flink, or Spark Streaming... ...Flask) Experience with SQL Understanding of modern...Amazon Web ServiceSeniorSQLPythonFull timeLocal areaFlexible hoursNew York Times
New York, NY5 days ago$110k - $150k
...Senior Data Engineer Neuberger's Private Markets Technology group... ...~ Advanced SQL skills and experience... ...). ~ Proficiency in Python and experience with data... ...frameworks such as Apache Spark, Pandas, or Polars.... ...Snowflake and cloud services (AWS or Azure). ~...Amazon Web ServiceSeniorSQLPythonWork at officeShift work2 days per weekNeuberger Berman
New York, NY4 days ago- ...The engineering team at Chainalysis is inspired by solving... ...We're looking for a Senior Data Platform Engineer to... .../Databricks/Apache Spark/Apache Flink, as well... ...practices ~ Expertise with AWS services, cloud... ...and proficient with Python/Java and SQL ~ Experience...Amazon Web ServiceSeniorSQLPythonFlexible hours
Chainalysis Inc.
New York, NY5 days ago - ...experiences. We are seeking a Senior Data and Analytics Engineer to help build the... ...proficiency with SQL and experience with... ...such as dbt, Apache Spark, or similar tools Strong... ...and services such as AWS Redshift, Snowflake,... ...Proficiency in Python or TypeScript for data...Amazon Web ServiceSeniorSQLPython
$124k - $177k
...energetic and passionate Senior Data Engineer to design and execute... ...platforms including AWS and Azure cloud, APIs,... ...ETL/ELT processes using Python, PySpark, and or Data... ...of data sources using SQL and AWS big data... ...debug code in PySpark/Spark/Python. Strong SQL and...Amazon Web ServiceSeniorSQLPythonLocal area3 days per weekNew York Life
New York, NY1 day ago$140k - $170k
...Job Title Senior Data Engineer, 1 Job Description About The Position... ...Data Engineer with strong Python and SQL skills to join the Data... ...cloud service platform (GCP and AWS preferred). You've worked... ...data at scale using Apache Spark, Beam or a similar framework...Amazon Web ServiceSeniorSQLPythonTemporary workWork at officeLocal areaRemote workFlexible hoursDotdash Meredith
New York, NY5 days ago- ...within the architecture, engineering and construction... ...Description As a Senior Data Engineer, you will design... ...pipelines in Databricks using Spark and Delta Lake.... ...systems ~ Strong SQL and Python skills Preferred... ...modern cloud data stacks (AWS, Azure, or GCP)...Amazon Web ServiceSeniorSQLPythonFull time
SOCOTEC
New York, NY4 days ago - ...value. We are hiring a Senior Forward Deployed Data Scientist / Engineer to work directly with customers... ..., or judgment. Python and SQL matter in this role, but... ...distributed systems such as Spark, Ray, or Airflow... ...data platforms such as AWS, GCP, Snowflake, or BigQuery...Amazon Web ServiceSeniorSQLPython
$176k - $238k
...Senior Data Engineer, Knowledge & Information United States We Breathe... ...production data pipelines using Python, SQL, Airflow, cloud... ...data pipelines at scale in AWS, with sharp instincts for data... ...similar orchestration tools and Spark or comparable distributed processing...Amazon Web ServiceSeniorSQLPythonFor contractorsWork experience placementWork at officeLocal areaRemote workFlexible hoursKomodo Health
New York, NY1 day ago$120k - $140k
...Group (OPG) is currently seeking a senior data engineer to join our technology team. In... ...applications. ~8+ years of Linux, Bash, Python, and SQL experience. ~4+ years using Spark and other Hadoop ecosystem software. ~4+ years using AWS cloud services, esp. EMR, Glue,...Amazon Web ServiceSeniorSQLPythonWork at officeLocal areaImmediate startFlywheel Digital
New York, NY4 days ago$160k - $180k
...for the Sr. Analytics Engineer role at Cyera Join to... ...the company reinventing data security, empowering... ...at least 2+ years in a senior role. Expert in SQL, Python, or R for data... ...dbt, Airflow, Apache Spark) and cloud data platforms (AWS, GCP, or Azure). Strong...Amazon Web ServiceSeniorSQLPythonTemporary workWork at officeRemote work$175.5k - $180k
Tech & AI Senior Data Engineer I - QuantumBlack, AI by McKinsey Job ID: 1092... ...Expert-level proficiency in Python and SQL and the ability to work in polyglot... ...using modern frameworks (Spark, LangChain, Databricks, Dask... ...) across cloud providers (AWS, Azure, GCP) ~ Exceptional...Amazon Web ServiceSeniorSQLPythonApprenticeshipWork at officeLocal areaEasy workMcKinsey & Company
New York, NY2 days ago$250.8k - $286.2k
...Senior Lead Data Engineer Do you love building and pioneering in the... ...like Java, Scala, Python and Open Source RDBMS... ...with cloud computing (AWS, Microsoft Azure, Google... ...development including Python, SQL, Scala, or Java 4+... ..., Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4...Amazon Web ServiceSeniorSQLPythonFull timePart timeInternshipLocal areaCapital One Financial Corp
New York, NY5 days ago$138k - $181.65k
...We are looking for a Senior Data Engineer to design and build scalable... ...using tools like Spark, dbt or similar... ...platforms. ~ Strong SQL skills and fluency in... ...programming language (e.g., Python, Scala, or Java). ~... ...data platforms (e.g., AWS, GCP, Azure). ~ Strong...Amazon Web ServiceSeniorSQLPythonTemporary workLocal areaWorldwideFanDuel
New York, NY3 days ago$156.8k - $235.2k
...Overview We are hiring a Senior Lead Data Engineer to build and scale the data... ...batch/streaming pipelines (Spark, Flink, Databricks, Airflow... ...: Experience with AWS/Azure/GCP and high-performance... ...Proficient programming skills in Python and SQL with a focus on performance...Amazon Web ServiceSeniorSQLPythonParamount
New York, NY5 days ago- We’re looking for a Senior Data Engineer to design, build, and optimize our data platforms so teams... ...You’ll work heavily with Databricks, Spark, SQL, and Python , building scalable data solutions... ...pipelines in a cloud environment (AWS, Azure, or GCP). Strong understanding...Amazon Web ServiceSeniorSQLPythonFull timeLocal areaRemote workWork visa
$176.72k - $265.08k
...to harness the power of data to drive innovation, create... ...? We are looking for a Senior Data Engineering Lead to be a player‑coach... ...serving layers (e.g., using Python, Scala, SQL, and Spark). Lead & Mentor: Lead a... ...a major cloud platform (AWS, GCP, or Azure) and its data...Amazon Web ServiceSeniorSQLPythonFull timeInformation Technology Senior Management Forum
Jersey City, NJ4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Spark & AWS (SQL + Python). Be the first to apply!
Related searches
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- junior data developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY