Lead Data Engineer: Python + AWS for Scalable Pipelines
EPAM Systems, Inc.
EPAM Systems, Inc. is seeking a Lead Data Software Engineer (Python+AWS) to drive the design and development of scalable data solutions. In this role, you will lead technical initiatives, mentor team members, and deliver robust data engineering systems leveraging cloud and big data technologies. The ideal candidate will have over 5 years of experience in data software engineering, proficiency in Python and SQL, and expertise in AWS and Databricks. You will work in a dynamic environment while collaborating with multi-national teams. #J-18808-Ljbffr EPAM Systems, Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer: Python + AWS for Scalable Pipelines in New York, NY vacancy
- Lead Data Engineer with SQL, Python and Capital banking job at Cortex consultants LLC. New York, NY. Our... ...of batch and real-time data pipelines, ensuring scalability, reliability, and performance. Architect... ...of cloud platforms (AWS, Azure, GCP) is a plus Domain Knowledge...Amazon Web ServicePipeline
- ...Summary: As an ML Lead at S&P Global,... ...maintain our evolving data infrastructure,... ...on creating scalable and optimized data pipelines. Your work will... ...Learning, NoSQL, Python, SQL, Workflow... ...ETL tools, Data Engineering. Required languages... ..., preferably AWS. Experience working...Amazon Web ServicePipelineFlexible hours
$170k - $210k
...all. We build powerful, scalable, and elegant software... ...We are looking for a Lead Data Engineer to join our team. This... ...scalable, secure data pipelines using dbt, Apache Airflow... ...with Terraform and AWS-managed services Built... ...in SQL and Python Hands-on experience...Amazon Web ServicePipelineRemote workWork visaShift workMark43
New York, NY13 days ago- ...Hi, Position: Lead Data Engineer Experience Required... ...teams, and deliver scalable, cloud-based data... ...reliability across data pipelines and systems. Stakeholder... ...and a wide range of AWS services (Glue, EMR,... ...-on experience with Python, PySpark , and...Amazon Web ServicePipelineFull time
Centraprise
Jersey City, NJ1 day ago - ...Lead / Principal Data Engineer - Marketing Technology (Contract) - Job#5799... ...source systems, ingestion pipelines, and the processes that... ...- Build and maintain scalable data pipelines across Martech... ...Airflow, dbt, Fivetran, AWS s3, lambda, Python, SQL - Previous...Amazon Web ServicePipelineContract workTemporary workImmediate start
Delphi-US
New York, NY4 days ago - ...companies includes leading global... ...Distribution, and Data & Analytics. Made... ...developers, data engineers, designers, and... ...tooling. Pipeline Development: Design... ..., and maintain scalable ETL/ELT... ...queries. Strong Python: Proficiency in... ...warehouses such as AWS Redshift and...Amazon Web ServicePipeline
TMX Group
New York, NY5 days ago $180k - $250k
...,000.00/yr A world-leading trading firm is seeking a Lead Data Engineer to architect, scale... ...design advanced data pipelines that unlock new... ...fast, reliable, and scalable systems in a data-driven... ...Deep expertise in Python, SQL, and cloud platforms (e.g., AWS, GCP, or Azure)...Amazon Web ServicePipelineFull time$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant... ...business processes into scalable data platforms, pipelines, and trusted datasets.... ...cloud platforms such as AWS, GCP, or Azure ~... ...engineering, such as Python, Java, Scala, Go, or similar...Amazon Web ServicePipelineLocal areaRemote workFlexible hoursBayview Asset Management
New York, NY2 days ago$220k - $230k
...digital assets and data center... ...growing demand for scalable energy and compute... ...hands-on data engineer with 8+ years... ...you're ready to lead. You set the technical... ...'re fluent in Python or Java and... ...data stack - AWS, Databricks/Spark... ...streaming data pipelines, owning them...Amazon Web ServicePipelineLocal areaFlexible hoursGalaxy USA
New York, NY4 days ago- As a Lead Data Engineer at Rearc, you'll play a pivotal role in establishing... ...workflows for efficiency, scalability, and reliability. You’ll work... ...efficient, high‑quality data pipelines and analytical foundations.... ...including platforms such as AWS Redshift, Azure Synapse Analytics...Amazon Web ServicePipelineFlexible hours
- ...based in New York is seeking a Data Engineer to design, build, and maintain scalable data infrastructure and analytics... ...collaborating with teams to architect data pipelines that support enterprise-wide AI... ...of experience, strong skills in AWS, Python, and ETL processes. Benefits...Amazon Web ServicePipeline
$220k
...Recruiter | Databricks Data Engineer Recruitment |... ...Top Talent with Leading US Opportunities... ...using Databricks and AWS . This is a... ...and deploy data pipelines and platforms using... ...for performance, scalability, and security Ensure... ...Proficient in Python and SQL...Amazon Web ServicePipelineFull timeRemote workFlexible hours- Lead Data Engineer in NY job at Vertex Elite LLC. New York, NY. Location... ...Modelling, Expert level SQL, Python, AWS Technologies (Glue),... ...engineering roadmap, ensuring scalability, performance, and innovation... ...and implement data models, pipelines, and data integration frameworks...Amazon Web ServicePipelineLong term contract
$73.01k - $170.64k
...Databricks Lead Data Engineer As a Databricks Lead Data Engineer,... ...and programming skills in Python, SQL, Pyspark, Databricks... ...testing and deployment of scalable batch/streaming data pipelines using Databricks. Data... ...Event Hub, Azure DevOps) or AWS (S3, Lamda, Glue)....Amazon Web ServicePipelineWork at officeLocal areaFlexible hoursPerficient
New York, NY1 day ago- ...diagnostics and drug development is seeking a Data Engineer to design and implement scalable data processing pipelines. Ideal candidates should have 4+ years of... ...in data engineering, proficiency in Python, and familiarity with AWS and Databricks. The position offers flexible...Amazon Web ServicePipelineRemote jobFlexible hours
- ...Solutions is actively recruiting Lead data engineer for full-time roles with... ..., builds, and maintains scalable data pipelines and ETL/ELT workflows for batch... ...programming languages(s); Python, Java and SQL Hands-on... ...with cloud data services (AWS S3, Glue, Redshift, Athena,...Amazon Web ServicePipelineFull timeRelocation
- Data Engineering | Contract with potential for extension... ...to bring on a Lead Snowflake Data Engineer... ...at the center of pipeline design, modeling,... .... Architect scalable data models optimized... ...data services in Python and PySpark. Leverage... ...environments. AWS preferred. Required...Amazon Web ServicePipelineContract workShift work
- CLEAR is seeking a Data Engineer II in New York City to enhance their secure identity... .... The role involves building scalable data systems, developing data pipelines, and collaborating with... ...tools like Snowflake, Spark, and AWS. CLEAR offers competitive salary...Amazon Web ServicePipeline
- ...driven storage solutions provider is seeking a Data Engineer to enhance data operations. This role involves designing scalable data pipelines, ensuring data quality across the... ...data management, strong technical skills in AWS and data tools, and a capacity for leadership...Amazon Web ServicePipelineFull time
$225k - $300k
...seeking a Senior Software Engineer, Data, to design and build the next... ...role involves developing scalable data systems and pipelines, implementing... ...engineering, with strong Python and SQL skills and familiarity... ...with cloud platforms like AWS and tools such as Snowflake...Amazon Web ServicePipelineClear Corporate Services LLC
New York, NY3 days ago$98k - $140k
A leading data solutions company is seeking a Senior Data Engineer to design and optimize scalable ETL/ELT pipelines within a cloud-based environment. The ideal candidate will have at least... ...optimization skills, and proficiency in AWS services and the Matillion platform....Amazon Web ServicePipelineRemote job- ...seeking a professional to design and lead scalable data architectures and pipelines across cloud and hybrid setups. This role requires proficiency in Python, PySpark, SQL, and ETL tools like... ...experience with cloud environments including AWS, GCP, and Azure. The ideal candidate...Amazon Web ServicePipeline
- ...Design, build, and maintain scalable and reliable data pipelines for dataset creation,... ...optimize Airflow pipelines on AWS for data processing,... ...production-grade SQL and Python code for large-scale data... ...analysis Partner closely with ML engineers to enable model training,...Amazon Web ServicePipeline
$220k - $230k
...Pro Network is seeking a Senior Data Engineer in New York City. The ideal... ...engineering, with advanced skills in Python or Java, and a deep understanding of AWS and Databricks/Spark. You will... ...for architecting and building scalable data pipelines, ensuring high data quality,...Amazon Web ServicePipeline$70 - $85 per hour
Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70... ...Design, develop, and maintain scalable data pipelines using Apache Spark on... ...Databricks notebooks, SQL, and Python. Collaborate with AI/ML... ...efficiency in cloud platforms (AWS, Azure, or GCP). Ensure...Amazon Web ServicePipelineContract workLocal areaRemote workFlexible hours- A leading technology research organization is seeking an AI Data Engineer to build scalable data pipelines and collaborate with data scientists on impactful AI initiatives. This is a fully... ...familiarity with cloud platforms like AWS and tools such as Databricks. The...Amazon Web ServicePipelineRemote job
$156.8k - $235.2k
...We are hiring a Senior Lead Data Engineer to build and scale the... ...design and operate pipelines processing billions of... ...Content Pipelines: Build scalable workflows for metadata... ...: Experience with AWS/Azure/GCP and high-performance... ...programming skills in Python and SQL with a focus...Amazon Web ServicePipelineParamount
New York, NY4 days ago$120k - $195k
Lead Data Engineering & Governance (Pharma) New York, NY | Full-Time Location:... ...interconnected workstreams - from pipeline modernization and data... ...Lead the design and delivery of scalable data pipelines and data platform solutions built on AWS and Snowflake, ensuring reliability...Amazon Web ServicePipelineHourly payFull timeWork at officeLocal areaDay shift$180k
...skilled and motivated Senior Data Engineer to join our dynamic team... ..., and maintaining scalable data infrastructure and pipelines. You will work closely with... ...programming languages such as Python, Java, or Scala.... ...cloud platforms such as AWS, Google Cloud, or Azure....Amazon Web ServicePipelineFull time- ...About the job Tech Lead, Data & Inference Engineer Our Client... ...spend and accelerate pipeline growth. With a strong... ...Build and maintain scalable batch and streaming... ...large datasets) and Python skills. ~ Hands-on... ...cloud infrastructure (AWS, GCP, or Azure). ~...Amazon Web ServicePipelineFull time
Catalyst Labs, LLC
New York, NY5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer: Python + AWS for Scalable Pipelines. Be the first to apply!
Related searches
- python programmer New York, NY
- freelance python developer New York, NY
- python developer part time New York, NY
- python developer data analytics New York, NY
- python engineer New York, NY
- python developer New York, NY
- python automation engineer New York, NY
- python developer with big data New York, NY
- python developer internship New York, NY
- c++-python developer New York, NY