Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer - AWS/Databricks

$90k

Acuity

Overview Acuity Inc. is seeking a highly skilled Data Engineer to join our Engineering Team, helping drive the design and delivery of AWS cloud-scale data platforms for federal clients. This role requires knowledge and/or experience with Spark, Delta Lake, and distributed data pipelines on Databricks. The ideal candidate brings both engineering and strategic insight into enterprise data modernization. Why Acuity? Are you ready to use your expertise in the areas of IT Modernization, Data Enablement, and Hyperautomation to make a real difference? Join Acuity, Inc., a technology consulting firm that supports federal agencies. We combine industry partnerships and long-term federal experience with innovative technical leadership to support our customers' critical missions. Responsibilities Build and maintain scalable PySpark-based data pipelines in Databricks notebooks to support ingestion, transformation, and enrichment of structured and semi-structured data. Design and implement Delta Lake tables optimized for ACID compliance, partition pruning, schema enforcement, and query performance across large datasets. Develop ETL and ELT workflows that integrate multiple source systems into a centralized, query-optimized data warehouse architecture. Leverage Spark SQL and DataFrame APIs to implement business rules, dimensional joins, and aggregation logic aligned to warehouse modeling best practices. Collaborate with data architects and engineers to implement cloud-native data solutions on AWS using S3, Glue, RDS, and IAM for secure, scalable storage and access control. Optimize pipeline performance through intelligent partitioning, caching, broadcast joins, and adaptive query tuning. Deploy and version data engineering assets using Git-integrated development workflows and automate deployment with CI/CD tools such as GitLab or Jenkins. Monitor pipeline health, job execution, and cluster utilization using native Databricks tools and AWS CloudWatch, identifying bottlenecks and optimizing cost-performance tradeoffs. Conduct technical discovery and mapping of legacy source systems, identifying required transformations and designing end-to-end data flows. Implement governance practices including metadata tagging, data quality validation, audit logging, and lineage tracking using platform-native features and custom logic. Support ad hoc data access requests, develop reusable data assets, and maintain shared notebooks that meet operational reporting and analytics needs across teams. Qualifications 2+ years of experience in data engineering and Agile analytics 2+ years of experience creating software for retrieving, parsing and processing structured and unstructured data 1 to 2 years of experience building scalable ETL and ELT workflows for reporting and analytics 1 or more years experience building enterprise data engineering solutions in the cloud, with preferred experience with cloud native technologies from AWS and Databricks Experience with data quality, validation frameworks, and storage optimization strategies BA or BS degree Clearance Requirement: Must be US Citizen with an ability to obtain and maintain US Suitability Min USD $90,000.00/Yr. Max USD $100,000.00/Yr. Salary Range The salary range for this position represents Acuity's good faith estimate of the compensation for this job title at the time of posting. Final compensation will be determined based on factors including, but not limited to, the candidate's qualifications, experience, education, certifications, skills, geographic location, contract requirements, applicable labor categories, and, where applicable, contract award and funding. Acuity

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer - AWS/Databricks in New York, NY vacancy
  •  ...institution is seeking a hands-on Lead Data Engineer to design and deliver scalable enterprise...  ...The engineer will work with Snowflake and Databricks, build production data pipelines,...  ...technologies. ~ Experience with Azure, AWS, or GCP. ~ Production performance optimization... 
    Amazon Web Service
    Databricks
    Full time

    Madison-Davis, LLC

    New York, NY
    12 hours ago
  •  ...Data Protection Engineer In this pivotal role, you will design, develop, and execute a comprehensive...  ...observability platforms (e.g., Atlan, Databricks, Anomalo, or equivalent)....  ...cloud architecture, specifically the AWS stack. Experience leveraging AI-driven... 
    Amazon Web Service
    Databricks

    Apollo Solutions

    New York, NY
    7 days ago
  •  ...Title: Data Engineer (Early Career) Duration : FTE/Permanent Salary : 90-95k Location...  ...models and tuning performance on Snowflake, Databricks, or a similar platform. Automating...  ...Running and supporting workloads on AWS (Azure or GCP is fine too), including containerized... 
    Amazon Web Service
    Databricks
    Permanent employment
    Work experience placement

    Gotham Technology Group

    New York, NY
    12 days ago
  • $112k - $200k

     ...Lead Data Engineer New York, NY (Midtown) | Hybrid, 50% in office | $112,000 - $200,000 base...  ...orchestration tool ~ Azure experience (AWS or GCP also considered) ~ Solid grounding...  ...large enterprise Nice to have Databricks and Spark Azure Data Factory and... 
    Amazon Web Service
    Databricks
    Full time
    Work at office

    Lawrence Harvey

    New York, NY
    12 hours ago
  •  ...building scalable and robust data pipelines to enable data-driven...  ...have experience working on Databricks ,Airflow , Redshift , Snaplogic...  ...data warehouse and data engineering projects.Experience developing...  ...data processing solutions like AWS Kinesis, Kafka, Spark Stream... 
    Amazon Web Service
    Databricks

    Virtusa

    New York, NY
    7 hours ago
  • $65 - $80 per hour

     ...Data Engineer - Domain Lead New York, NY (Hybrid) Contract-to-Hire $65 - $80 per hour ABOUT THE ROLE Join a globally recognized...  ...to work hands-on with large-scale datasets, leveraging Databricks (on AWS) to build and manage data pipelines from source through... 
    Amazon Web Service
    Databricks
    Hourly pay
    Contract work
    Local area

    Brooksource

    New York, NY
    16 hours ago
  •  ...Experience You Will Need: PySpark: Hands-on experience with Data Frames, RDDs, joins, transformations, and actions. Databricks: Job optimization, cluster configuration, repartitioning, and Shuffle mechanics AWS: S3 buckets, IAM, CloudWatch, and integration with... 
    Amazon Web Service
    Databricks

    Saxon Global

    New York, NY
    1 day ago
  • $10k

     ...all. About the Role:   As a Senior Data Engineer at Hinge, you will create essential data...  ...Terraform, Kafka, Airflow, dbt, Looker, AWS technologies (S3, Redshift), GCP...  ...and CI/CD technologies (CircleCI), Spark, Databricks Factors such as scope and responsibilities... 
    Amazon Web Service
    Databricks
    Work experience placement

    Hinge

    New York, NY
    a month ago
  •  ...Agentic Commerce Orchestration Engine helping enterprise retailers,...  ...Logicbroker is hiring a Lead Data Engineer to drive delivery across...  ...ll lead the build of a modern Databricks platform and shape the Gold-...  ...Data sources across Azure, AWS, GCP, and others. Why Logicbroker... 
    Amazon Web Service
    Databricks
    Full time
    Contract work
    Work at office
    Remote work

    Logicbroker

    New York, NY
    12 hours ago
  •  ...Technologies: Proficiency in cloud platforms like Azure, AWS, or Google Cloud. Data Engineering: Strong understanding of data warehousing, data lakes,...  ...: Strong experience with Cloud Data Platform like Databricks (preferred), Snowflake, Redshift, etc. Databricks Expertise... 
    Amazon Web Service
    Databricks

    Saxon Global

    New York, NY
    2 days ago
  • Senior Data Engineer This position is all about extracting RAW data. Must have solid ELT (extract...  ...in Cloud Architecture, ideally AWS. Experience in cloud administration, cost...  ...underlying our data pipeline: Spark, AWS, Databricks, and Airflow. Know the internals of these... 
    Amazon Web Service
    Databricks

    Zortech Solutions

    New York, NY
    1 day ago
  • Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description: Required...  ...least one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop), atleast one relational data... 
    Amazon Web Service
    Databricks

    Concord IT Systems

    New York, NY
    1 day ago
  • $100 - $130 per hour

    A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders OnlyNo...  ...in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architecturesExpertise... 
    Amazon Web Service
    Databricks
    Remote work

    Open Systems Technologies

    New York, NY
    3 days ago
  •  ...Job-ID: 21585Category: Data ManagementLocation: New York, United...  ...Experience (In Years): 0-3Data Engineer – Modern Data PlatformRole OverviewWe...  ....Good to HaveApache Airflow / AWS MWAA for orchestration.AWS...  ...Container Services (SPCS).Databricks.Terraform / Infrastructure as... 
    Amazon Web Service
    Databricks

    EXL Service

    New York, NY
    8 hours ago
  •  ...StatesWorkplace: HybridPosted: 2026-11-05Job Role: Data engineer-EngineeringExperience (In Years): 6-9Job Title: Databricks Data EngineerExperience: 8-10 YearsLocation:...  ...EngineeringDesign cloud-native data solutions on Azure, AWS, or GCP.Implement secure, scalable, and... 
    Amazon Web Service
    Databricks

    EXL Service

    New York, NY
    3 days ago
  •  ...Job Description Hiring: Lead Data Engineer – Databricks | Manhattan, NY | Hybrid | Remote Also Available We're looking for an experienced...  ...and production deployment practices ~ Experience with AWS services, particularly S3, is a plus ~ Knowledge of Auto... 
    Amazon Web Service
    Databricks
    Work at office
    Remote work
    3 days per week

    Wise Skulls

    New York, NY
    17 days ago
  •  ...DescriptionJob Description Analytics Engineer Job Title Analytics Engineer...  ...to bridge the gap between Data Engineering and Business...  ...with cloud platforms such as AWS, Azure, or Google Cloud. Knowledge...  ...Experience with Apache Spark or Databricks. Knowledge of data lake and lakehouse... 
    Amazon Web Service
    Databricks
    Flexible hours

    Ova Technologies

    New York, NY
    1 day ago
  •  ...Data Integration Engineer We are seeking a highly skilled Integration/Data Engineer with 5+ years...  ...with cloud-based platforms (e.g., Azure, AWS, Salesforce). Familiarity with...  ...Knowledge of modern data platforms (e.g., Databricks, Snowflake, Azure Data Factory).... 
    Amazon Web Service
    Databricks

    3B Staffing LLC

    New York, NY
    1 day ago
  • $180k - $210k

     ...growing Fintech in NYC is scaling its data team and hiring a Senior Analytics Engineer. Join a growing data team to build...  ...BigQuery, Snowflake, Redshift, or Databricks). BigQuery is the actual stack,...  ..., and cloud experience (GCP or AWS).Comfortable with a BI tool like Looker... 
    Amazon Web Service
    Databricks
    Contract work

    ConsultNet

    New York, NY
    3 days ago
  • $200k - $275k

     ...You will be Doctronic's first dedicated data engineer, and you will own the plumbing end to end...  ..., Glue workflows, or similar) ~ Solid AWS fundamentals: IAM, Lambda, Kinesis, Glue...  ...datasets, notebook environments (SageMaker, Databricks, Jupyter) Experience with BI tooling (... 
    Amazon Web Service
    Databricks
    Full time

    doctronic

    New York, NY
    7 days ago
  •  ...We’re looking for a Senior Manager, Data Engineering to lead and grow the team responsible...  ...ll set the technical direction for our AWS-based data platform, develop the engineers...  ...tools such as EMR, Glue, Delta, Iceberg, Databricks and orchestration tools. ~ Hands-on... 
    Amazon Web Service
    Databricks
    Full time
    Work at office
    3 days per week

    Stash

    New York, NY
    2 days ago
  •  ...Job Description We are seeking a hands-on Senior AI / Data Engineer to build and deploy production-grade Agentic AI and multi-...  ...integration, and enterprise AI applications. Experience with Databricks, Azure, AWS, or GCP. Strong Python and data engineering skills.... 
    Amazon Web Service
    Databricks

    Highbridge Consulting LLC

    New York, NY
    22 days ago
  • $116k - $145k

     ...your name on it We are looking for a Data Engineer to join our growing data engineering...  ...experience with modern data tools such as Databricks, Airflow, dbt, Spark, or Kafka. ~ Understanding...  ...with cloud-based data platforms (AWS, Google Cloud Platform, or Azure).... 
    Amazon Web Service
    Databricks
    Temporary work
    Local area
    Worldwide

    FanDuel

    New York, NY
    3 days ago
  • Senior Data Engineer Apex Systems is seeking a strong Senior Data Engineer with 7+ years of experience...  ...and support of the enterprise AWS Cloud environment, with emphasis in EMR...  ...SQL Server) Preferred qualifications: AWS DataBricks GitHub (actively working within) Mentorship... 
    Amazon Web Service
    Databricks
    Full time
    Work at office
    Remote work

    Software Technology Inc

    New York, NY
    1 day ago
  • $110k - $120k

    Data Engineer with Capital Market Experience Understanding of post-trade data flows including allocations...  ..., SQL Server, Snowflake, Redshift, Databricks, or similar database and data warehouse technologies on cloud, preferably AWS. Experience with stream and batch data... 
    Amazon Web Service
    Databricks

    Tata Consultancy Services

    New York, NY
    1 day ago
  • Data Engineer The Data Engineer will be building and improving our data pipelines while implementing...  ...platforms (e.g., Google Cloud Platform, AWS, or Azure). Understanding of data...  ...Qualifications: Hands-on experience with Databricks platform. Experience in Ad Tech, or Media... 
    Amazon Web Service
    Databricks

    Software Technology Inc

    New York, NY
    1 day ago
  • $175.5k - $180k

     ...the implementation of scalable data architectures for cutting-...  ...the design of complex feature engineering workstreams, ensuring our data...  ...(Spark, LangChain, Databricks, Dask, Airflow, Dagster, Kedro...  ...Terraform) across cloud providers (AWS, Azure, GCP)Exceptional time... 
    Amazon Web Service
    Databricks
    Apprenticeship
    Easy work

    McKinsey & Company

    New York, NY
    3 days ago
  • $100k - $140k

     ...bonusesResponsibilitiesWe are hiring a hands-on senior level Data Engineer to build trustworthy, well governed data products and...  ...with modern lakehouse platforms (e.g., Microsoft Fabric, Databricks, Snowflake, AWS)Experience building data solutions in cloud environments... 
    Amazon Web Service
    Databricks
    Work at office
    Remote work
    3 days per week

    GUARD Insurance Group

    New York, NY
    3 days ago
  •  ...Role : Engagement Manager, Data Engineering Work Location : New York City Hire Type: Full-Time Work...  ...large data programs on cloud platforms (AWS, Azure or GCP) and modern data stacks such as Snowflake, Databricks, BigQuery or Redshift. ~ Strong working knowledge... 
    Amazon Web Service
    Databricks
    Full time

    EXL

    New York, NY
    12 hours ago
  • $86.7k - $170.9k

    Position Summary As a Data Engineer II on the AI & Data team, you will be responsible for...  ...and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query...  ...cloud platform: Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform... 
    Amazon Web Service
    Databricks
    Local area

    Deloitte

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - AWS/Databricks. Be the first to apply!