Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AWS Data Engineer: Scalable Pipelines & APIs

Compunnel, Inc.

Compunnel, Inc. is seeking a data engineering lead to design and implement scalable ETL pipelines and data products for critical trading applications. You will work with autonomy on end-to-end data solutions, from ingestion to API delivery, and archive data to data lakes for analytics. The role demands expertise in Python, SQL, cloud services, and resilient API architectures, plus experience with monitoring stacks and modern data tooling. U.S. #J-18808-Ljbffr Compunnel, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AWS Data Engineer: Scalable Pipelines & APIs in New York, NY vacancy
  •  ...Data Engineer As a Data Engineer at Client, you will develop...  .... Data Processing Pipelines: Design, build, and maintain reliable and scalable daily data pipelines....  ...Requires knowledge of RESTful APIs and message queue...  ...Django Experience with AWS and related cloud... 
    Amazon Web Service
    Pipeline

    InterSources

    New York, NY
    3 days ago
  •  ...Chartmetric Data Engineer PositionChartmetric, Inc. is a...  ...DoBuild and optimize ETL pipelines processing data for 10...  ...metricsDesign scalable data ingestion systems...  ...data ecosystem spanning AWS RDS, Elasticsearch, Clickhouse...  ...data, streaming APIs, or social media analytics... 
    Amazon Web Service
    Pipeline
    Work at office

    Chartmetric

    New York, NY
    2 days ago
  • $110k

     ...Who you are: The Data and AI Engineer will own the data infrastructure...  ...and maintaining our AWS Redshift data...  ...stack end-to-end: source APIs in, clean and modeled...  ...Build and maintain ETL pipelines to ingest, transform,...  ...keeping the environment scalable as we add sources and... 
    Amazon Web Service
    Pipeline
    Full time
    Flexible hours

    Ushg Careers

    New York, NY
    28 days ago
  •  ...Design develop and maintain data pipelines for efficient data ingestion,...  ...Develop Node.js Express backend APIs with comprehensive unit...  ...functionality and reliability. Utilize AWS Lambda serverless functions...  ...using AWS EKS for scalability and manageability. Provision... 
    Amazon Web Service
    Pipeline

    Compunnel, Inc.

    New York, NY
    3 days ago
  •  ...are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud‑native data platforms and pipelines. You will lead the...  ...cloud‑native solutions using AWS services and Spark. Lead...  ...Experience building REST APIs using Java. Knowledge of... 
    Amazon Web Service
    Pipeline

    The Judge Group

    New York, NY
    5 days ago
  • $126k - $180k

     ...impact. The Department: Data At Gemini, our Data Team is the engine that powers insight,...  .... From building scalable pipelines and platforms, to enabling...  ...on-chain indexing, chain APIs, etc. Experience with...  ...optimizing Databricks on AWS It Pays to Work Here... 
    Amazon Web Service
    Pipeline
    Contract work
    Work at office
    Remote work
    Flexible hours

    Gemini

    New York, NY
    1 day ago
  • Responsibilities Data Pipeline Expertise: Capable of implementing...  ...accessible via APIs for critical tier 1...  ...skills in Python, SQL, AWS Cloud Services (Cloud...  ...principles). Resilience Engineering Techniques:...  ...practices. Ability to design scalable, efficient, and resilient... 
    Amazon Web Service
    Pipeline

    Compunnel, Inc.

    New York, NY
    2 days ago
  • $140k - $180k

     ...Data Engineer, Data Platform About the Role We...  ...optimizing various ETL pipelines to fuel both internal...  ...experience of working with APIs and building data...  ...governance frameworks with a scalable and repeatable process...  ...public clouds (e.g., AWS, GCP) Additional... 
    Amazon Web Service
    Pipeline
    Full time
    Work at office
    Flexible hours

    Sigma Computing

    New York, NY
    4 days ago
  •  ...review responsibilities (Data Engineering Specifics). Work...  ...Construct and manage data pipelines and integration...  ...platforms like Azure or AWS to deploy, manage, and...  ...handling, whether as APIs or standalone applications...  ...Guarantee the security, scalability, and efficiency of the... 
    Amazon Web Service
    Pipeline

    Vortalsoft Inc

    New York, NY
    5 days ago
  •  ...RoleAs an AI-Native Data Platform Engineer at Farther, you will...  ...architect custodial data pipelines, canonical financial...  ....Your ImpactDesign scalable ingestion pipelines across...  ...)Comfortable with AWS data services (S3,...  ...OpenAI or Anthropic APIs into production systemsExperience... 
    Amazon Web Service
    Pipeline

    Farther Advisors

    New York, NY
    3 days ago
  • $215.2k - $244.7k

     ...clients developing Big Data strategy and...  ...flow and processing pipelines for analysis using...  ...and implement scalable AI/ML and Generative...  ...Azure OpenAI, OpenAI APIs, LangChain,...  ...Models (LLMs), prompt engineering, embeddings, vector...  ...platforms such as AWS, Azure, GCP etc.Experience... 
    Amazon Web Service
    Pipeline
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    New York, NY
    4 days ago
  • About Tavily - Search API Tavily is a cutting...  ...to help build the data infrastructure that...  ...experienced Data Engineer to join our growing...  ...maintaining highly scalable data management systems...  ...optimize the data pipelines that are crucial to...  .... Experience with AWS and their data... 
    Amazon Web Service
    Pipeline

    Tavily

    New York, NY
    4 days ago
  • $160k - $200k

     ...transform raw, complex data and facts into...  ...: Software engineering is your passion, and...  ..., design, and API development. You are...  ...developing digital product pipelines (CI/CD pipelines)....  ...and scalability to your approach as...  ...Docker, Kubernetes, AWS, or GCP. You're also... 
    Amazon Web Service
    Pipeline
    Full time
    Work at office
    Remote work
    Flexible hours

    Blockworks

    New York, NY
    4 days ago
  • $153k - $204k

     ...the role:As a Senior Data Engineer you will own and evolve...  ...Apache Superset) and ETL pipelines, while delivering ad-...  ...maintain robust and scalable data pipelines to collect...  ...sources, including APIs, databases, and third-...  ...cloud platforms (e.g., AWS, GCP, Azure) and... 
    Amazon Web Service
    Pipeline
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    3 days ago
  • $88.54k - $127.16k

     ...Data Manager of Data Engineering PHM is the leading health media agency in the US, built...  ...clients Design and manage scalable pipelines, including ingestion from APIs (REST, GraphQL, vendor feeds)...  ...Required: Cloud platforms: AWS, Azure, Databricks Data warehouses... 
    Amazon Web Service
    Pipeline

    Digitas

    New York, NY
    2 days ago
  •  ...Duties and Responsibilities Data Infrastructure & Pipeline Engineering● Design, build, and operate scalable data pipelines across Salesforce...  ...)● Leverage Fivetran and API-based ingestion frameworks to...  ...reliability and observability● Manage AWS infrastructure supporting data... 
    Amazon Web Service
    Pipeline

    Nederlander Productions

    New York, NY
    a month ago
  • $185k

     ...Senior Data EngineerNew York, NY (This role...  ...data lake. The Pipeline Team plays a crucial...  ...and maintaining scalable, performant data pipelines...  ...product teams and engineering teams to solve...  ...using native AWS cloud infrastructure...  ...generative AI tooling, LLM APIs (e.g., Amazon... 
    Amazon Web Service
    Pipeline
    Temporary work
    Work at office
    Work from home
    Monday to Friday

    Trepp, LLC

    New York, NY
    3 days ago
  •  ...expertise to join our engineering team. This role is ideal...  ...contribute to building scalable, highperformance applications...  ...and optimize RESTful APIs and backend services...  ...and integrations using AWS services Write...  ...Familiarity with CI/CD pipelines Knowledge of Agile/Scrum... 
    Amazon Web Service
    Pipeline

    Tapestry, Inc.

    New York, NY
    2 days ago
  • $125k - $140k

     ...Senior Data EngineerEkimetrics is a global...  ...ResponsibilitiesAs a Senior Data Engineer, you will lead and...  ..., build robust, scalable data architectures...  ...scalable data pipelines and ETL workflows...  ...and formats (i.e. APIs, CSV files, JSON, databases...  ...with GCP or AWS a plus.Experience... 
    Amazon Web Service
    Pipeline
    Work at office
    Flexible hours

    Ekimetrics

    New York, NY
    1 day ago
  • $100k - $140k

     ...Accounting Operations Data Engineer to build and maintain...  ...integrations and ingestion pipelines to warehouse modeling,...  ...using modern, scalable technologies. In this...  ...for backend services, APIs, automation, and data...  ...Infrastructure & Delivery AWS for cloud... 
    Amazon Web Service
    Pipeline
    Full time
    Work at office

    MONTICELLOAM

    New York, NY
    5 days ago
  •  ...NextBrain as a Senior Data Engineer in Remote, FL Are you...  ...information. If you have modern AWS data engineering...  ...information, and scalable data architectures, we...  ...storage, and serving pipelines on AWS. Develop pipelines...  ...data stores. Develop APIs and services for consistent... 
    Amazon Web Service
    Pipeline
    Remote work

    Abacus

    New York, NY
    5 days ago
  •  ...Description Job Description Data Engineer Location: New York...  ..., and scale the pipelines, storage layers, and...  ...standardization, and scalability across the platform...  ...natural language retrieval APIs and structured data...  ...S3, Dagster, dbt, and AWS What We're Looking... 
    Amazon Web Service
    Pipeline
    Full time

    NxT Level

    New York, NY
    22 days ago
  •  ...connecting real-time data with world-class...  ...Director, Data Engineering who will be responsible...  ...teams to design scalable data...  ...transformations and data pipelines in Snowflake and Databricks...  ...as Python and AWS GlueDesign, Build,...  ...integrating REST APIs and third-party data... 
    Amazon Web Service
    Pipeline
    Temporary work
    Freelance
    Flexible hours

    Publicis Media

    New York, NY
    4 days ago
  •  ...environment. The Alteryx Engineer is responsible for...  ...automation and data integration...  ...builds and supports scalable data workflows, applications...  ...Develop ETL/ELT pipelines supporting analytics...  ...enterprise systems API, Platform & System...  ...with cloud services (AWS S3, EC2, RDS/Aurora... 
    Amazon Web Service
    Pipeline
    Remote job

    Varite

    New York, NY
    5 days ago
  • $170k - $250k

     ...platform for infinitely scalable clinical capacity. We...  ...for a highly driven Data Engineer to help design, build,...  ...maintain scalable, data pipelines and architectures...  ...cloud data platforms (AWS and/or GCP), data warehouses...  ...(e.g., FHIR/HL7, EHR APIs), including working... 
    Amazon Web Service
    Pipeline
    Work at office
    3 days per week

    Thesis Care

    New York, NY
    5 days ago
  • Data EngineerOur client, a top tier Management...  ...experienced Data Engineer to support our data...  ...infrastructure and pipelines, ensuring seamless...  ...(e.g., databases, APIs, external data sets...  ...analytics teams, enabling scalable and efficient data...  ...platforms (e.g., AWS, Azure, or Google... 
    Amazon Web Service
    Pipeline
    Contract work

    RIT Solutions

    New York, NY
    5 days ago
  •  ...Senior - Intermediate AWS/Cloud - EMR[Hive, Pyspark...  ...amount of hands-on Big Data/Hadoop - Working...  ...huge volume of data in a scalable fashion. - 1-2 experience...  ...ingestion, File Ingestion, API etc., - 5+ years of...  ...designing and building ETL pipelines; expert with data... 
    Amazon Web Service
    Pipeline
    Work experience placement
    Work at office
    Remote work

    Georgia IT Inc

    New York, NY
    5 days ago
  • IT INFRASTRUCTURE ENGINEER - 95714 The IT & Telecom division...  ..., detail-oriented Data Engineer to support...  ...implement, and maintain scalable data pipelines using Apache NiFi for...  ...environments (Azure, AWS, or GCP), including automation...  ..., databases, and APIs. -Familiarity with... 
    Amazon Web Service
    Pipeline
    Full time

    New York City Department of Transportation

    New York, NY
    5 days ago
  • $160k - $200k

     ...maintained by a detection engineering team rather than...  ...Position Overview The Data Platform team is responsible...  ..., build, and maintain scalable data pipelines that ingest and...  ...telemetry (TBs / day) Own API and event stream...  ...Experience with either AWS or GCP Strong systems... 
    Amazon Web Service
    Pipeline
    Remote work
    Shift work

    Nebulock

    New York, NY
    4 days ago
  • $35 - $90 per hour

    JOB SUMMARY Data Engineer JOB DESCRIPTION Location: Remote (U...  ...build, test, and deploy scalable full-stack solutions (services, APIs, and UI components) aligned...  ...experience in GCP, AWS, or Azure. • Hands-on experience...  .../Kubernetes, CI/CD pipelines, and Agile delivery... 
    Amazon Web Service
    Pipeline
    Contract work
    Immediate start
    Remote work

    Core Centre Of Resource Excellence Inc

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Data Engineer: Scalable Pipelines & APIs. Be the first to apply!