Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

6AM City

Job Description The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T‑SQL development, ETL processes, and Python scripting to ensure efficient data transfer, transformation, and integration. The primary focus will be on automating data workflows, supporting diverse file formats, and utilizing APIs for seamless data import and export. The Data Engineer will collaborate closely with cross‑functional teams to enhance data‑driven decision‑making and contribute to the overall success of our data infrastructure. Job Responsibilities Utilize advanced T‑SQL skills to design, optimize, and maintain database structures. Develop complex SQL queries for reporting and data transformation. Design, implement, and optimize ETL processes for efficient data extraction, transformation, and loading. Develop and maintain ETL scripts using Python for seamless integration with existing data workflows. Automate SFTP file transfer processes, ensuring secure and reliable data exchange. Import and export data and files in various formats, including flat file, XML, JSON, X12, Excel, and Parquet using Python. Utilize Python to integrate with APIs for importing and exporting data. Collaborate with team members and stakeholders to review and optimize code for efficiency and maintainability. Collaborate with analysts and business stakeholders to understand data visualization requirements. Work closely with cross‑functional teams to understand data requirements and ensure data integrity. Document data engineering processes, standards, and best practices. Use Git and GitHub for version control of scripts and queries, ensuring a collaborative and organized development environment. Integrate Tableau for effective data representation and reporting. Qualifications Education Bachelor's Degree in Computer Science, Information Technology, or a related field. Experience Minimum of 5 years of hands‑on experience in T‑SQL development and ETL processes. Proven experience in Python scripting for data manipulation and automation. Technical Skills Strong expertise in database design, optimization, and maintenance using T‑SQL. Proficient in developing and optimizing ETL processes. Experience with automating SFTP file transfers and handling diverse file formats. Knowledge of data formats such as XML, JSON, X12, Excel, and Parquet. Familiarity with API integration for data import and export using Python. Proficient in version controlling scripts and queries using Git and GitHub. Preferred Skills Experience in data visualization using Tableau. Strong problem‑solving skills and ability to troubleshoot data‑related issues effectively. Identify and implement solutions to complex technical projects. Ability to work independently and in a team environment. Excellent communication and collaboration skills. Knowledge of health care delivery and operations a plus. If you are a data engineering professional with a solid background in T‑SQL, ETL, Python scripting, and a passion for enhancing data infrastructure, we encourage you to apply and contribute to our dynamic and innovative team. Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities and activities may change at any time with or without notice. #J-18808-Ljbffr

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
  •  ...The Senior Technical Specialist will be responsible for providing expertise in Apache spark...  ...Responsibilities Develop and implement data processing frameworks using Apache spark....  ...implementing scalable solutions. Knowledge of data engineering concepts and methodologies. Ability to... 
    Senior

    TechDigital Group

    Jersey City, NJ
    4 days ago
  •  ...A leading technology services company in New York is seeking a Senior Data Engineer specializing in Credit Risk. The role involves application development using Python and SQL Server, as well as maintaining data models. The ideal candidate will have around 15 years of... 
    Senior

    GovServicesHub

    New York, NY
    12 hours ago
  •  ...Job Title Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources. Develop versatile software components to extract useful information from various unstructured or semi-structured text data. Implement advanced... 
    Senior
    Work experience placement

    1872 Consulting

    New York, NY
    1 day ago
  •  ...Senior Data Engineer Jersey City, New Jersey, United States Role Overview Hands-on experience with Azure Services: Databricks, Data Factory and DevOps Proficient in Python, Apache Spark, and PySpark Write advance and complex SQL queries with solid experience... 
    Senior

    Inizio Partners

    Jersey City, NJ
    1 day ago
  •  ...onsite in Jersey City 3 days/week Primary Responsibilities: Use data to create features and analytics for internal Data Services...  ...King Jr. Dr. Tampa, FL 33607 “We work in Life Sciences, Clinical, Engineering, IT, and more. Above all, we specialize in people.” #J-18808-Ljbffr... 
    Senior
    3 days per week

    The Fountain Group

    Jersey City, NJ
    1 day ago
  •  ...Senior Snowflake Data Engineer Three days onsite in NYC, NY, locals only. Face-to-face interviews will be there. Six months senior Python and Snowflake developer to design, build, and optimize scalable data pipelines, develop robust backend services, implement Snowflake... 
    Senior
    Local area

    RIT Solutions

    New York, NY
    1 day ago
  •  ...Required Skills and Experience: Proven experience as a Data Engineer or in a similar role with a focus on Snowflake, Python, Pyspark, and SQL. Strong understanding of data warehousing concepts and cloud data platforms, especially Snowflake. Hands-on... 
    Senior

    Saxon Global

    New York, NY
    11 hours ago
  •  ...Senior Data Engineer Location: Dublin, Leinster, Ireland Job Type: Hybrid Job Overview Are you looking for a career move that will put you at the heart of a global financial institution? Then bring your skills in data engineering, building scalable data pipelines, problem... 
    Senior
    Casual work
    Work from home

    Citi

    New York, NY
    4 days ago
  •  ...Senior Data Engineer (Informatica & PySpark) Experience: 8–10 years in Data Engineering and Data Analysis. Informatica Expertise: Strong hands‑on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization. PySpark Development: Advanced skills... 
    Senior

    Qode

    Brooklyn, NY
    4 days ago
  •  ...Senior Data Engineer Polymarket is looking for a Senior Data Engineer to help scale our data platform to support the next phase of the company's growth. Every trade, position, and resolution flows through a data layer that powers our entire user-facing product – leaderboards... 
    Senior

    Polymarket

    New York, NY
    4 days ago
  •  ...Job Description: Bachelor's degree in computer science, Engineering, or related field. Proven experience working with Amazon Aurora and/or PostgreSQL in a production environment. Strong SQL skills and experience with SQL tuning techniques. Proficiency... 
    Senior

    Texas State Library and Archives Commision

    New York, NY
    3 days ago
  •  ...Senior Big Data Engineer Location: Weehawken, New Jersey, US; New York City, New York, US; Stamford, US, Connecticut, US Project description ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver: • Scalable cost-efficient infrastructure... 
    Senior

    Futran Tech Solutions Pvt. Ltd.

    Weehawken, NJ
    1 day ago
  •  ...companies we partner with. We are looking for an experienced Data Engineer to join our team and help design, build, and optimize data solutions...  ...of data visualization tools like Power BI. Job Details Seniority level: Mid-Senior level Employment type: Contract Job... 
    Senior
    Contract work
    For contractors

    hackajob

    New York, NY
    3 days ago
  •  ...Requirements You have 3+ years of experience in data engineering, backend engineering, or a similar role You have strong programming skills...  ...you check every box, apply anyway! What the job involves As a Senior Data Engineer, you will own and build critical data and... 
    Senior

    DoubleVerify

    New York, NY
    4 days ago
  •  ...Senior Data Engineer Location: Jersey City, NJ (Onsite role) Duration: 12+ months contract Requirements: Working as part of an agile SCRUM team Building scalable and robust ETL data flows and databases using a range of technologies Exploring new technology... 
    Senior
    Contract work

    Kasmo Global

    Jersey City, NJ
    1 day ago
  • $130k - $170k

     ...Senior Data Engineer Location: New York, NY Position Type: Full Time Pay Range: $130,000-$170,000 Per Year Description Our client is looking for a Senior Data Engineer to design and scale data infrastructure supporting investment strategies. The role involves... 
    Senior
    Full time

    Mitchell Martin

    New York, NY
    1 day ago
  • $160k - $200k

     ...As a Senior Data Engineer at Rearc, you'll be the technical anchor on complex, client-facing data engineering engagements, someone who can sit across the table from a client's data leadership team, understand their most difficult data challenges, and then go head-down... 
    Senior
    Work experience placement

    Rearc

    New York, NY
    4 days ago
  •  ...At January, we're fixing what's broken in credit. Our data-driven platform rebuilds trust, delivers results, and helps millions...  ...people's lives. About the Role As January's founding Senior Data Engineer, you'll transform how we leverage data to expand access to credit... 
    Senior
    Part time
    Immediate start

    January Technologies, Inc.

    New York, NY
    3 days ago
  • $160k - $210k

     ...generation of small business intelligence products built on years of learnings in the space. We are seeking an experienced Senior Data Engineer to join our team and help shape the trajectory of these products. Your work will directly impact the accuracy, scalability,... 
    Senior

    Enigma Corporation

    New York, NY
    3 days ago
  •  ...Job Summary This Senior Data Engineer will be part of the team responsible for developing and deploying Engineering and Integration solutions. Primary responsibility will be to work closely with the Data Architects and Machine Learning Team to implement data solutions... 
    Senior
    Remote work

    MultiPlan

    New York, NY
    3 days ago
  •  ...with every single person we interact with in a way that's consistent with these values. About The Role We are hiring a Senior Data Engineer to build and scale the data infrastructure that powers Wagmo's growth. You'll design and maintain robust pipelines,... 
    Senior
    Work at office

    Wagmo, Inc.

    New York, NY
    10 hours ago
  •  ...Requirements 5–8+ years of data engineering experience, ideally at a B2B SaaS, marketplace, or data products company , Deep hands-on expertise...  ...into data workflows What the job involves We're hiring a Senior Data Engineer to build and own the data infrastructure that powers... 
    Senior

    Spoiler Alert

    New York, NY
    2 days ago
  • $180k - $220k

     ...Senior / Staff Data Engineer — Direct Hire Location: New York City, NY (Hybrid — 3–4 days/week onsite) Compensation: $180K–$220K base salary + equity Employment Type: Full-time About the Company Our client is building software that improves the accessibility... 
    Senior
    Full time
    3 days per week

    G2i Inc.

    New York, NY
    3 days ago
  • $175k - $225k

     ...Senior Data Engineer New York, New York, United States Courier Health is on a mission to solve one of the biggest and most meaningful opportunities in healthcare: reinvent how people living with chronic and rare diseases are supported. We are building the future... 
    Senior

    Courier Health

    New York, NY
    1 day ago
  •  ...innovation comes from deep empathy and a relentless focus on solving the real-world challenges of healthcare. Job Title: Senior Data Engineer We're hiring a Data Engineer to join our team and help build the foundation of Verse's data infrastructure. This is a... 
    Senior
    Work at office

    Verse Medical

    New York, NY
    3 days ago
  •  ...Data Engineer You will be part of a growing Data Engineering team that handles CLIENT data for Internal and External Users. The IT department services over 10 internal groups and the Data Engineer will be a seasoned Technology leader comfortable with a variety of data... 
    Senior
    Immediate start

    Cardinal Integrated

    Secaucus, NJ
    1 day ago
  •  ...Senior Data Engineer We are seeking a highly skilled Senior Data Engineer with 8+ years of hands-on experience in enterprise data engineering, including deep expertise in Apache Airflow DAG development, dbt Core modeling and implementation, and cloud-native container... 
    Senior

    Marchon Partners

    Jersey City, NJ
    1 day ago
  •  ...analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics...  ...team in the world. We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for... 
    Senior
    Local area

    Tiger Analytics

    Jersey City, NJ
    3 days ago
  • $60 - $70 per hour

     ...Job Title NTT DATA is seeking a professional with strong data engineering experience. Job Description At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors... 
    Senior
    Hourly pay
    Temporary work
    Remote work
    Flexible hours

    NTT DATA

    New York, NY
    1 day ago
  •  ...Senior Data Engineer 3 days Hybrid in Orlando, FL Locals only 5+ months contract Role summary Software Engineer with strong ETL experience to design, build, and support file-to-table data transformations using IBM InfoSphere DataStage. You'll turn inbound... 
    Senior
    Contract work
    Temporary work
    Local area

    RIT Solutions, Inc.

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!