AWS Data Engineer: Scalable Pipelines & APIs
Compunnel, Inc.
Compunnel, Inc. is seeking a data engineering lead to design and implement scalable ETL pipelines and data products for critical trading applications. You will work with autonomy on end-to-end data solutions, from ingestion to API delivery, and archive data to data lakes for analytics. The role demands expertise in Python, SQL, cloud services, and resilient API architectures, plus experience with monitoring stacks and modern data tooling. U.S. #J-18808-Ljbffr Compunnel, Inc.
- ...Data Engineer As a Data Engineer at Client, you will develop... .... Data Processing Pipelines: Design, build, and maintain reliable and scalable daily data pipelines.... ...Requires knowledge of RESTful APIs and message queue... ...Django Experience with AWS and related cloud...Amazon Web ServicePipeline
- ...Chartmetric Data Engineer PositionChartmetric, Inc. is a... ...DoBuild and optimize ETL pipelines processing data for 10... ...metricsDesign scalable data ingestion systems... ...data ecosystem spanning AWS RDS, Elasticsearch, Clickhouse... ...data, streaming APIs, or social media analytics...Amazon Web ServicePipelineWork at office
$110k
...Who you are: The Data and AI Engineer will own the data infrastructure... ...and maintaining our AWS Redshift data... ...stack end-to-end: source APIs in, clean and modeled... ...Build and maintain ETL pipelines to ingest, transform,... ...keeping the environment scalable as we add sources and...Amazon Web ServicePipelineFull timeFlexible hours- ...Design develop and maintain data pipelines for efficient data ingestion,... ...Develop Node.js Express backend APIs with comprehensive unit... ...functionality and reliability. Utilize AWS Lambda serverless functions... ...using AWS EKS for scalability and manageability. Provision...Amazon Web ServicePipeline
- ...are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud‑native data platforms and pipelines. You will lead the... ...cloud‑native solutions using AWS services and Spark. Lead... ...Experience building REST APIs using Java. Knowledge of...Amazon Web ServicePipeline
$126k - $180k
...impact. The Department: Data At Gemini, our Data Team is the engine that powers insight,... .... From building scalable pipelines and platforms, to enabling... ...on-chain indexing, chain APIs, etc. Experience with... ...optimizing Databricks on AWS It Pays to Work Here...Amazon Web ServicePipelineContract workWork at officeRemote workFlexible hours- Responsibilities Data Pipeline Expertise: Capable of implementing... ...accessible via APIs for critical tier 1... ...skills in Python, SQL, AWS Cloud Services (Cloud... ...principles). Resilience Engineering Techniques:... ...practices. Ability to design scalable, efficient, and resilient...Amazon Web ServicePipeline
$140k - $180k
...Data Engineer, Data Platform About the Role We... ...optimizing various ETL pipelines to fuel both internal... ...experience of working with APIs and building data... ...governance frameworks with a scalable and repeatable process... ...public clouds (e.g., AWS, GCP) Additional...Amazon Web ServicePipelineFull timeWork at officeFlexible hours- ...review responsibilities (Data Engineering Specifics). Work... ...Construct and manage data pipelines and integration... ...platforms like Azure or AWS to deploy, manage, and... ...handling, whether as APIs or standalone applications... ...Guarantee the security, scalability, and efficiency of the...Amazon Web ServicePipeline
- ...RoleAs an AI-Native Data Platform Engineer at Farther, you will... ...architect custodial data pipelines, canonical financial... ....Your ImpactDesign scalable ingestion pipelines across... ...)Comfortable with AWS data services (S3,... ...OpenAI or Anthropic APIs into production systemsExperience...Amazon Web ServicePipeline
$215.2k - $244.7k
...clients developing Big Data strategy and... ...flow and processing pipelines for analysis using... ...and implement scalable AI/ML and Generative... ...Azure OpenAI, OpenAI APIs, LangChain,... ...Models (LLMs), prompt engineering, embeddings, vector... ...platforms such as AWS, Azure, GCP etc.Experience...Amazon Web ServicePipelineLocal areaImmediate startFlexible hours- About Tavily - Search API Tavily is a cutting... ...to help build the data infrastructure that... ...experienced Data Engineer to join our growing... ...maintaining highly scalable data management systems... ...optimize the data pipelines that are crucial to... .... Experience with AWS and their data...Amazon Web ServicePipeline
$160k - $200k
...transform raw, complex data and facts into... ...: Software engineering is your passion, and... ..., design, and API development. You are... ...developing digital product pipelines (CI/CD pipelines).... ...and scalability to your approach as... ...Docker, Kubernetes, AWS, or GCP. You're also...Amazon Web ServicePipelineFull timeWork at officeRemote workFlexible hours$153k - $204k
...the role:As a Senior Data Engineer you will own and evolve... ...Apache Superset) and ETL pipelines, while delivering ad-... ...maintain robust and scalable data pipelines to collect... ...sources, including APIs, databases, and third-... ...cloud platforms (e.g., AWS, GCP, Azure) and...Amazon Web ServicePipelinePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$88.54k - $127.16k
...Data Manager of Data Engineering PHM is the leading health media agency in the US, built... ...clients Design and manage scalable pipelines, including ingestion from APIs (REST, GraphQL, vendor feeds)... ...Required: Cloud platforms: AWS, Azure, Databricks Data warehouses...Amazon Web ServicePipeline- ...Duties and Responsibilities Data Infrastructure & Pipeline Engineering● Design, build, and operate scalable data pipelines across Salesforce... ...)● Leverage Fivetran and API-based ingestion frameworks to... ...reliability and observability● Manage AWS infrastructure supporting data...Amazon Web ServicePipeline
$185k
...Senior Data EngineerNew York, NY (This role... ...data lake. The Pipeline Team plays a crucial... ...and maintaining scalable, performant data pipelines... ...product teams and engineering teams to solve... ...using native AWS cloud infrastructure... ...generative AI tooling, LLM APIs (e.g., Amazon...Amazon Web ServicePipelineTemporary workWork at officeWork from homeMonday to Friday- ...expertise to join our engineering team. This role is ideal... ...contribute to building scalable, highperformance applications... ...and optimize RESTful APIs and backend services... ...and integrations using AWS services Write... ...Familiarity with CI/CD pipelines Knowledge of Agile/Scrum...Amazon Web ServicePipeline
$125k - $140k
...Senior Data EngineerEkimetrics is a global... ...ResponsibilitiesAs a Senior Data Engineer, you will lead and... ..., build robust, scalable data architectures... ...scalable data pipelines and ETL workflows... ...and formats (i.e. APIs, CSV files, JSON, databases... ...with GCP or AWS a plus.Experience...Amazon Web ServicePipelineWork at officeFlexible hours$100k - $140k
...Accounting Operations Data Engineer to build and maintain... ...integrations and ingestion pipelines to warehouse modeling,... ...using modern, scalable technologies. In this... ...for backend services, APIs, automation, and data... ...Infrastructure & Delivery AWS for cloud...Amazon Web ServicePipelineFull timeWork at office- ...NextBrain as a Senior Data Engineer in Remote, FL Are you... ...information. If you have modern AWS data engineering... ...information, and scalable data architectures, we... ...storage, and serving pipelines on AWS. Develop pipelines... ...data stores. Develop APIs and services for consistent...Amazon Web ServicePipelineRemote work
- ...Description Job Description Data Engineer Location: New York... ..., and scale the pipelines, storage layers, and... ...standardization, and scalability across the platform... ...natural language retrieval APIs and structured data... ...S3, Dagster, dbt, and AWS What We're Looking...Amazon Web ServicePipelineFull time
- ...connecting real-time data with world-class... ...Director, Data Engineering who will be responsible... ...teams to design scalable data... ...transformations and data pipelines in Snowflake and Databricks... ...as Python and AWS GlueDesign, Build,... ...integrating REST APIs and third-party data...Amazon Web ServicePipelineTemporary workFreelanceFlexible hours
- ...environment. The Alteryx Engineer is responsible for... ...automation and data integration... ...builds and supports scalable data workflows, applications... ...Develop ETL/ELT pipelines supporting analytics... ...enterprise systems API, Platform & System... ...with cloud services (AWS S3, EC2, RDS/Aurora...Amazon Web ServicePipelineRemote job
$170k - $250k
...platform for infinitely scalable clinical capacity. We... ...for a highly driven Data Engineer to help design, build,... ...maintain scalable, data pipelines and architectures... ...cloud data platforms (AWS and/or GCP), data warehouses... ...(e.g., FHIR/HL7, EHR APIs), including working...Amazon Web ServicePipelineWork at office3 days per week- Data EngineerOur client, a top tier Management... ...experienced Data Engineer to support our data... ...infrastructure and pipelines, ensuring seamless... ...(e.g., databases, APIs, external data sets... ...analytics teams, enabling scalable and efficient data... ...platforms (e.g., AWS, Azure, or Google...Amazon Web ServicePipelineContract work
- ...Senior - Intermediate AWS/Cloud - EMR[Hive, Pyspark... ...amount of hands-on Big Data/Hadoop - Working... ...huge volume of data in a scalable fashion. - 1-2 experience... ...ingestion, File Ingestion, API etc., - 5+ years of... ...designing and building ETL pipelines; expert with data...Amazon Web ServicePipelineWork experience placementWork at officeRemote work
- IT INFRASTRUCTURE ENGINEER - 95714 The IT & Telecom division... ..., detail-oriented Data Engineer to support... ...implement, and maintain scalable data pipelines using Apache NiFi for... ...environments (Azure, AWS, or GCP), including automation... ..., databases, and APIs. -Familiarity with...Amazon Web ServicePipelineFull time
$160k - $200k
...maintained by a detection engineering team rather than... ...Position Overview The Data Platform team is responsible... ..., build, and maintain scalable data pipelines that ingest and... ...telemetry (TBs / day) Own API and event stream... ...Experience with either AWS or GCP Strong systems...Amazon Web ServicePipelineRemote workShift work$35 - $90 per hour
JOB SUMMARY Data Engineer JOB DESCRIPTION Location: Remote (U... ...build, test, and deploy scalable full-stack solutions (services, APIs, and UI components) aligned... ...experience in GCP, AWS, or Azure. • Hands-on experience... .../Kubernetes, CI/CD pipelines, and Agile delivery...Amazon Web ServicePipelineContract workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AWS Data Engineer: Scalable Pipelines & APIs. Be the first to apply!
- data engineer contract New York, NY
- big data cloud engineer New York, NY
- staff data engineer New York, NY
- big data developer New York, NY
- finance data engineer New York, NY
- software data engineer New York, NY
- data engineer intern New York, NY
- data systems engineer New York, NY
- hadoop big data developer New York, NY
- data engineer machine learning New York, NY



