AWS Data Engineer: Scalable Pipelines & APIs
Compunnel, Inc.
Compunnel, Inc. is seeking a data engineering lead to design and implement scalable ETL pipelines and data products for critical trading applications. You will work with autonomy on end-to-end data solutions, from ingestion to API delivery, and archive data to data lakes for analytics. The role demands expertise in Python, SQL, cloud services, and resilient API architectures, plus experience with monitoring stacks and modern data tooling. U.S. #J-18808-Ljbffr Compunnel, Inc.
- ...company in New York is seeking a Senior Data Engineer to shape data products crucial to their... ...role, you will build and optimize data pipelines, manage data architecture, and collaborate... ...and familiarity with cloud services like AWS. You'll work in an office-first...Amazon Web ServicePipelineWork at office
- ...hands-on Senior / Lead Data Engineer to provide technical... ...leadership for the platforms, pipelines, and data products... .... You will architect scalable, cloud-first data... ..., SQL, Snowflake, and AWS.• Architect reliable solutions... ...Platform, including APIs, services, plugins,...Amazon Web ServicePipeline
- ...Design develop and maintain data pipelines for efficient data ingestion,... ...Develop Node.js Express backend APIs with comprehensive unit... ...functionality and reliability. Utilize AWS Lambda serverless functions... ...using AWS EKS for scalability and manageability. Provision...Amazon Web ServicePipeline
- ...About Tavily - Search API Tavily is a cutting... ...to help build the data infrastructure that... ...experienced Data Engineer to join our growing... ...maintaining highly scalable data management systems... ...optimize the data pipelines that are crucial to... .... Experience with AWS and their data...Amazon Web ServicePipeline
- ...Data EngineerAs a Data Engineer at Client, you will develop a deep understanding... ....Data Processing Pipelines: Design, build, and maintain reliable and scalable daily data pipelines.... ...knowledge of RESTful APIs and message queue... ...DjangoExperience with AWS and related cloud technologiesFluent...Amazon Web ServicePipeline
- ...Data Infrastructure EngineerDesign, build, and operate scalable data pipelines across Salesforce, Snowflake, and external systems (ticketing... ...). Leverage Fivetran and API-based ingestion frameworks to... ...reliability and observability. Manage AWS infrastructure supporting data...Amazon Web ServicePipeline
- ...development of cloud-based data platforms, pipelines, and data products... ...Python, SQL, Snowflake, and AWS. Build scalable solutions for a variety of... ...'s data platform through APIs, automation, metadata management... ...reviews, mentorship, and engineering best practices. Drive...Amazon Web ServicePipeline
- ...fund is seeking a Senior Data Engineer to build and evolve... ...new datasets and build scalable solutions that... ...support scalable Python ETL pipelines to ingest, process, and... ...infrastructure, leveraging AWS and Databricks to... ...modern data architecture, APIs, databases and cloud...Amazon Web ServicePipeline
- AgileEngine is seeking a Senior Data Engineer to design and implement scalable data lakes, warehouses, and... ...on Python-based ETL/ELT pipelines, Airflow orchestration, and... ...workflows from diverse third-party APIs, leveraging Snowflake, Spark, and AWS to deliver high-performance...Amazon Web ServicePipelineRemote job
- ...We are seeking a Senior Data Engineer to join our team, focusing... ...CRM integration within an AWS, Snowflake, and DBT... ...This role involves building scalable customer and marketing data pipelines, enabling segmentation and... ...JSON transformations and API integrations to synchronize...Amazon Web ServicePipelineContract workRemote work
- ...RoleAs an AI-Native Data Platform Engineer at Farther, you will... ...architect custodial data pipelines, canonical financial... ....Your ImpactDesign scalable ingestion pipelines across... ...)Comfortable with AWS data services (S3,... ...OpenAI or Anthropic APIs into production systemsExperience...Amazon Web ServicePipeline
- ...are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud‑native data platforms and pipelines. You will lead the... ...cloud‑native solutions using AWS services and Spark. Lead... ...Experience building REST APIs using Java. Knowledge of...Amazon Web ServicePipeline
$215.2k - $244.7k
...clients developing Big Data strategy and... ...flow and processing pipelines for analysis using... ...and implement scalable AI/ML and Generative... ...Azure OpenAI, OpenAI APIs, LangChain,... ...Models (LLMs), prompt engineering, embeddings, vector... ...platforms such as AWS, Azure, GCP etc.Experience...Amazon Web ServicePipelineLocal areaImmediate startFlexible hours- ...Strategies is looking to hire a Data Engineer to be a part of our... ...as our core backend API team. The individual... ...on top of Snowflake on AWS infrastructure. Experience... ...and implementing scalable ETL and data processing... ...that utilize the data pipeline to provide actionable insights...Amazon Web ServicePipelineFlexible hours
- Responsibilities Data Pipeline Expertise: Capable of implementing... ...accessible via APIs for critical tier 1... ...skills in Python, SQL, AWS Cloud Services (Cloud... ...principles). Resilience Engineering Techniques:... ...practices. Ability to design scalable, efficient, and resilient...Amazon Web ServicePipeline
- ...review responsibilities (Data Engineering Specifics). Work... ...Construct and manage data pipelines and integration... ...platforms like Azure or AWS to deploy, manage, and... ...handling, whether as APIs or standalone applications... ...Guarantee the security, scalability, and efficiency of the...Amazon Web ServicePipeline
$153k - $204k
...the role:As a Senior Data Engineer you will own and evolve... ...Apache Superset) and ETL pipelines, while delivering ad-... ...maintain robust and scalable data pipelines to collect... ...sources, including APIs, databases, and third-... ...cloud platforms (e.g., AWS, GCP, Azure) and...Amazon Web ServicePipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$90k - $135k
...Job Summary As a Data Engineer at Wellbe you will play a... ...analysts, to develop data pipelines, transform data and... ...transformations for publication of scalable warehouse integrations... ..., DataFlow, ADF or AWS Glue required.... .... Experience building API data ingestion...Amazon Web ServicePipelineContract workLocal areaRemote work- ...ID: 1563 Job Summary The Data Engineer will design, develop, and maintain scalable data solutions that... ...robust and efficient data pipelines. Essential Functions Design... ...platforms (Azure or AWS) and hybrid architecture... ...connectors and external API integration Integration...Amazon Web ServicePipelineFull time
- ...NJ 3days/week Description: Data Engineering We are seeking a hands-on... ...design, build, and maintain scalable virtualized data products and... ..., virtualization, API enablement, and cloud-based... ...Build and support ETL/ELT pipelines using AWS services. Integrate data from...Amazon Web ServicePipelineHourly pay
- ...Industry Experience: Sr. Data Engineer (5 – 10 years)... ...team to build modern, scalable data platforms for our... ...robust data architectures, pipelines, and workflows that enable... ...from third‑party APIs, model data using dbt,... ...experience working with Azure. AWS experience is...Amazon Web ServicePipelineFull timeWork at officeVisa sponsorshipWork visa
$96k - $128k
...largest clinical trial data sets in the industry.... ...ingestion services (SaaS APIs, DBs, Streams),... ...governance. As a Senior Data Engineer, you will expand this... ...and maintain robust, scalable data pipelines and processes. You... ...platforms. Familiarity with AWS cloud services....Amazon Web ServicePipelineWork at officeLocal areaFlexible hours- ...expertise to join our engineering team. This role is ideal... ...contribute to building scalable, highperformance applications... ...and optimize RESTful APIs and backend services... ...and integrations using AWS services Write... ...Familiarity with CI/CD pipelines Knowledge of Agile/Scrum...Amazon Web ServicePipeline
$64.89k - $173.04k
...hiring a fully remote Data Engineer with strong SQL and Python... ...maintenance of data pipelines and platform... ...contributing to reliability, scalability, and observability. Write... ...platforms (RabbitMQ, AWS SNS/SQS). Familiarity... ...Familiarity with REST API integration patterns....Amazon Web ServicePipelineHourly payFull timeTemporary workWork experience placementLocal areaRemote work$126k - $180k
...impact. The Department: Data At Gemini, our Data Team is the engine that powers insight, innovation... .... From building scalable pipelines and platforms, to enabling... ...-chain indexing, chain APIs, etc. Experience with infrastructure... ...Databricks on AWS It Pays to Work Here The...Amazon Web ServicePipelineContract workWork at officeRemote workFlexible hours- ...are seeking a skilled Data Engineer to join our dynamic team... ...and optimizing data pipelines, implementing big data... ...data solutions using AWS, Azure, or GCP. Ensure... ...integrity, efficiency, and scalability in all solutions. Core... .... Knowledge of API development and integration...Amazon Web ServicePipelineRemote jobContract workFlexible hours
- Role- Data Engineer Location- New York Job Description We are seeking... ...our team and build robust, scalable data pipelines. In this role, you will: Design... ...; experience with DataFrame API, Spark SQL, and UDFs; strong... ...: Strong proficiency with AWS services (S3, EC2, IAM, Glue...Amazon Web ServicePipelineLocal area
$89k - $95k
...AI Data Engineer Job # | 042947 Department Code | 20701-9... ...workflows) to accelerate pipeline development,... ...quality, compliance, and scalability. Joining an established... ...analytics. Familiarity with API development,... ...infrastructure (Azure, AWS, GCP), containerization...Amazon Web ServicePipelineFull timeWork experience placementSummer workLocal areaRemote work$141.8k - $173.3k
...match IMPACT YOU'LL MAKE Senior Data Engineer is responsible for writing... ...enterprise-class data pipelines and scalable cloud-based data solutions that... ...batch, near real-time, and API-based integrations. Drive Technical... ...(platforms like Azure, AWS, GCP). Demonstrated experience...Amazon Web ServicePipelineWork experience placementRemote work$112.29k - $179.71k
...communication, media, data and technology to... ....OverviewAs a Data Engineer, you will develop... ...owners to build a scalable solution.Integrate with 3rd party API’s for data consumption... ...scalable ETL pipelines.• Experience and thorough... ...is required.• AWS and Databricks Certifications...Amazon Web ServicePipelineTemporary workFreelanceFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AWS Data Engineer: Scalable Pipelines & APIs. Be the first to apply!
- bi data engineer New York, NY
- data engineer analytics New York, NY
- principal data engineer New York, NY
- senior cloud data engineer New York, NY
- data center engineer New York, NY
- staff data engineer New York, NY
- director data engineering New York, NY
- data engineer graduate New York, NY
- big data devops engineer New York, NY
- azure data engineer New York, NY

