Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

MSR Technology Group

Job Description

Job Description

Infomatics is hiring a Senior Data Engineer on a direct hire/FTE basis to lead design, development and implementation efforts on our client’s Enterprise Analytics platform which includes an MPP Enterprise Data Warehouse, cloud-based Data Lake and other Big Data technologies.

Essential Duties and Responsibilities :

  • Guides the the strategic capabilities and architecture design related to Data Warehousing, Big Data and Data analytics in close collaboration with Technical Leadership.
  • Architects and develops code for large-scale ETL pipelines with data processing frameworks supporting distributed data warehouse and distributed analytic systems running in the cloud.
  • Leads side-by-side design sessions with our business experts and engineers to understand our product and business to design, socialize, and implement proper conceptual, logical and physical data models.
  • Spearheads efforts with multiple, disparate, data providers, as well as downstream consumers, to engineer efficient, tracable, and fault tolerant, batch and streaming, data pipelines to that support complex analytical analysis and enterprise-wide Business Intelligence applications
  • In collaoration with our Data Science team, lead efforts to develop and implement production grade code/pipelines, in laguages including Python, leveraging advanced statistical routines, Machine Learning and other AI technologies.
  • Responsible for oversight and improvements on approaches to monitor and support data quality automation efforts. Working along side QA Engineering, implement quality check routines as part of data processing frameworks and validates flow of information.
  • Drives engineering efforts for Data Warehouse and Big Data infrastructure needs, including but not limited to, automation of system builds, security requirements, performance requirements and logging/monitoring in collaboration with DevOps engineers
  • Resolves escalated issues related to complex data anomolies and performance. In addition, implements adjustments, conducts after action reviews to determine root cause/corrective measures, and ensures knowledge transfer to operations support team.
  • Provides mentorship and guidance to help guide and grow the technical depth of junior Data Engineers and across the BI & Analytics team.
  • Ensures documentation is complete and up to date with regard to standards, best practices and technical specifications.
  • Leads design and code review sessions and provides feedback and mentorship to peers.
  • Educates the BI & Analytics team on the latest industry technologies, trends and strategies; Provides thought leadership around approaches, patterns and best practices in the Data Engineering domain.
  • Assists employees, vendors or other customers by answering questions related to Data Warehousing and Big Data processes, procedures and services
  • Collaborate with data team, product owners, Scrum-master to refine and estimate stories/epics to deliver on commitments on time and with high quality while providing exceptional customer service
  • Provides Tier 3 support and create run books to mentor Tier 1 and Tier 2 support staff
  • Other duties as assigned

Background & Experience Required:

  • This position requires a minimum of 10 years of progressive database development and integration experience.
  • Demonstrated experience in designing and implementing large-scale logical and physical data model with expert knowledge of Kimball methodologies.
  • Demonstrated advanced/expert level experience in multiple relational (RDMS) and non-relational (NoSQL) data platforms is required.
  • Demonstrated advanced experience in SQL tuning, indexing, distribution, partitioning, data access patterns and scaling strategies is required.
  • Demonstrated advanced scripting knowledge with Jupyter/Python or R is required.
  • Demonstrated expert experience with data integrations and data processing for business intelligence and analytics workloads is required.
  • Experience in software versioning tools including git, SVN or related.
  • Advanced experience with AWS S3 or other distributed object stores, MPP Data Warehousing, (e.g. AWS Redshift), Elastic MapReduce is needed.
  • Experience implementing statistical models, ML and other AI technologies into production data is required.
  • Experience developing container
  • Demonstrated experience implamenting Big Data pipelines including Spark, Hive, Sqoop or related technologies.
  • Experience implementing streaming data pipelines to support realtime and near realtime decision making.
  • Understanding of Software Development Life Cycle (SDLC) methodologies such as Agile and Waterfall is needed.
  • Proven track record of designing data platforms leveraging large complex data sets.

Educational Requirements:

This position requires a Bachelors Degree in Computer Science, Computer Information Systems or related or equivalent experience.

Data or cloud related certifications are a plus.

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Scottsdale, AZ vacancy
  • $1,000 per month

     ...right content and ads. Our technology and data-driven solutions help companies reach new...  ...an experienced, detail-oriented data engineer with experience in big data and an understanding...  ...ETLed and managed. We’re looking for a Senior data engineer that can help evolve,... 
    Senior
    Work at office
    Remote work
    Work from home
    Flexible hours
    Shift work

    Wurl

    Phoenix, AZ
    15 days ago
  • $115k - $130k

     ...one of the "Best Banks to Work For" in the U.S. by American Banker. Position Purpose As part of the Technology team, the Senior Data Engineer will act as a subject matter expert (SME) responsible for managing, designing, and optimizing enterprise data pipelines and... 
    Senior
    Currently hiring
    Remote work

    Capital Bank

    Phoenix, AZ
    a month ago
  •  ...Virtuous Software, Inc. is looking for a Data Migration Engineer in Phoenix, AZ. The role involves extracting, mapping, and importing client data to Virtuous for sophisticated nonprofit customers. Requires strong SQL skills and experience with data migration. Ideal candidates... 
    Senior

    Virtuous

    Phoenix, AZ
    1 day ago
  •  ...Senior Data Engineer – GCP, Scala, Spark & Python Location: Phoenix, AZ (Hybrid) Mandatory Skills: ANSI-SQL, GCP Big Query, Scala Job Description Role Focus: Hands-on data engineering with Spark, Scala, Python, and cloud platforms such as GCP; AWS knowledge... 
    Senior

    United IT

    Phoenix, AZ
    2 days ago
  • Job Post Working knowledge on Big Query Hands on experience on Dataproc Javapython programming language Good Experience on Bigtable Good to have ComposerAirflow experience Good team player communicator can operate independently with minimal guidance
    Senior

    Futran Tech Solutions Pvt. Ltd.

    Phoenix, AZ
    3 days ago
  •  ...JOB DESCRIPTION Roles/Responsibilities LOCATION: Phoenix, AZ Design Data Engineering capabilities that cater to the enterprise and span multiple functions such as data ingestion data transformation and define data pipeline standards and documentation... 
    Senior

    Cuboid IT Solutions

    Phoenix, AZ
    4 days ago
  •  ...Our client, a leading organization in the financial services industry, is seeking a Senior Data Engineer to join their team. As a Senior Data Engineer, you will be part of the Data Analytics Department supporting cross-functional teams. The ideal candidate will demonstrate... 
    Senior
    Weekly pay
    Contract work
    Temporary work
    Flexible hours

    Experis/Manpower Group

    Phoenix, AZ
    2 days ago
  •  ...is seeking an Analytics Developer in Phoenix, Arizona, to enhance analytics for digital and marketing initiatives. You will analyze data requirements, develop solutions, and ensure data integrity across analytics products. This position involves extensive collaboration... 
    Senior

    Baylor Scott & White Health

    Phoenix, AZ
    4 days ago
  •  ...dental insurance, tuition assistance, 401(k) United States, Arizona, Phoenix Senior Data Engineer Block 23 What you’ll do: As a Senior Data Engineer, you will serve as a Subject Matter Expert in the Enterprise Data & Analytics domain, as well as in adjacent areas, ensuring... 
    Senior

    Western Alliance Bank

    Phoenix, AZ
    2 days ago
  • $8,500 per month

     ...SENIOR DATA ENGINEER ​     Job Code: SRDATENG ​   Reports To: ​Director, Data Operations & Engineering ​   Base Location: AZ or CO ​   Work Status: ​ Virtual Office ​   Minimum Starting Monthly Range: $8,500​   Hiring Range (Monthly Pay): $8... 
    Senior
    Full time
    Part time
    Work at office
    Local area
    Work from home

    Contexture

    Phoenix, AZ
    2 days ago
  • $113k

     ...Job Summary Consumer Cellular is seeking skilled Senior Data Engineers who thrive in a highly collaborative, agile team environment. Engineers at Consumer Cellular design elegant technical solutions for complex product requirements, deliver high quality code as part... 
    Senior
    Hourly pay
    16 hours
    Full time
    Flexible hours
    Shift work

    Consumer Cellular

    Scottsdale, AZ
    3 days ago
  • $106.9k - $176.5k

     ...career wherever you want it to go.  Join EY and help to build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Phoenix, AZ
    1 day ago
  •  ...Overview Axon is seeking a Data Analytics Engineer to configure system databases, design and maintain scalable analytics solutions, and develop custom reports and dashboards for our software applications. Your Impact We expect you to work with data engineers, business... 
    Senior
    Work at office

    Out in Science, Technology, Engineering, and Mathematics

    Scottsdale, AZ
    15 days ago
  • Cognite AS seeks a Senior Data Engineer in Phoenix, Arizona, to lead the development of innovative data solutions for improved business operations. You will design a scalable Enterprise Data Warehouse and collaborate with various teams to optimize data-driven decision-... 
    Senior

    Cognite AS

    Phoenix, AZ
    3 days ago
  • Senior Data Engineer with hands‑on Palantir Foundry experience to design, build, and operate production pipelines and ontologies. You’ll own pipelines end‑to‑end — from raw ingestion to curated ontology objects — and partner with analysts, data scientists, and business... 
    Senior

    Objectways

    Phoenix, AZ
    2 days ago
  • $77k - $202k

     ...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time...  ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies...  ...thorough data architecture strategies. As a Senior Associate you analyze complex problems,... 
    Senior
    Full time
    H1b

    PwC

    Phoenix, AZ
    3 days ago
  • $140k - $150k

    Senior Data Modeler / Analytics Engineer - Phoenix, AZ We’re hiring a Senior Data Modeler / Analytics Engineer to help lead a greenfield data transformation within a large, modern data organization. This is a high-impact, highly visible role focused on building enterprise... 
    Senior
    Full time

    Harnham

    Phoenix, AZ
    3 days ago
  • A leading IT consulting firm in Phoenix, Arizona is seeking a skilled professional experienced in Hadoop cluster management. Key responsibilities include managing large scale Hadoop clusters, tuning performance, and excellent Linux administration skills. The ideal candidate...
    Senior

    E*Pro Inc

    Phoenix, AZ
    1 day ago
  • $128k - $252.5k

     ...programs that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and...  ...business impact and new initiatives Collaborate with data engineers, data scientists, project managers, and business teams to make... 
    Senior
    Visa sponsorship

    PowerToFly

    Phoenix, AZ
    4 days ago
  •  ...change. Constantly grow as you work hard for a mission that matters at a company where you matter. Your Impact We are seeking a Senior Data Engineer II to play a pivotal role in building and advancing Axon’s Corporate Data Platform - a best‑in‑class, cloud‑native data... 
    Senior
    Work at office
    Remote work

    Accreditation Council for Graduate Medical Education

    Scottsdale, AZ
    6 days ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time...  ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies...  ...current and future business needs. As a Senior Manager you lead large projects, innovate... 
    Senior
    Full time
    H1b

    PwC

    Phoenix, AZ
    4 days ago
  • A leading engineering firm in Phoenix seeks a Principal Engineer Mechanical to oversee data center infrastructure. This position demands expertise in mechanical and electrical systems, with responsibilities including design reviews, incident analysis, and mentoring. The... 
    Senior

    Exyte

    Phoenix, AZ
    2 days ago
  • $140k - $155k

     ...and location. The position is accountable for ownership of key data technologies including Snowflake, Power BI, Informatica, and related...  ...& Team Management Lead, mentor, and develop a team of data engineers and BI developers Establish delivery standards, performance... 
    Senior
    Full time
    Temporary work
    Local area
    Remote work
    Worldwide

    Owens & Minor

    Phoenix, AZ
    4 days ago
  • $155k - $235k

     ...application, and expertise. About the Team The Data Platform team sits within Scribd's...  ...setting standards, and ensuring data works for engineers, analysts, and business users alike. About the Role We're looking for a Senior AI Data Engineer to lead the AI engineering... 
    Senior
    Home office
    Flexible hours

    Scribd

    Phoenix, AZ
    11 hours ago
  •  ...excellent benefit program. Generous Paid Time Off. Flexible schedules for work/life balance. Position Profile The Senior Data & AI Engineer will need to have deep hands'on experience in Snowflake, Microsoft Fabric (incl. OneLake), and healthcare data ecosystems.... 
    Senior
    Flexible hours

    Hospice of the Valley

    Phoenix, AZ
    4 days ago
  • $102.3k - $209.5k

     ...Description Tracks and monitors ongoing Data Center critical infrastructure...  ...suitability for data center builds. Acts as the engineering representative on a wide range of moderately...  ..., and Governance: -Collaborates with senior team members and supports a project or other... 
    Senior
    Contract work
    Temporary work
    For contractors
    Flexible hours
    Shift work

    Oracle

    Phoenix, AZ
    11 hours ago
  •  ...sustainable infrastructure and our expertise in engineering, procurement, consulting and construction...  ..., cross-functional group of experts in data, technology, GIS, and asset management...  ..., presenting recommendations to senior stakeholders, and guiding decision-making... 
    Senior
    Full time
    Part time
    Work experience placement
    Work at office
    Relocation
    Visa sponsorship
    Flexible hours

    Black & Veatch

    Phoenix, AZ
    2 days ago
  • Axon Enterprise is seeking a Data Analytics Engineer to develop and support analytics for software applications. The role requires expertise in SQL Server Management Studio and Power BI, and offers a hybrid work model with travel to client locations. You will maintain data... 
    Senior

    Axon Enterprise

    Scottsdale, AZ
    1 day ago
  • $152k - $160k

    TriWest Healthcare Alliance in Phoenix, Arizona seeks an experienced professional to manage and lead the development, maintenance, and support of business applications. The role requires a Bachelor's degree, US citizenship, and at least 5 years of IT management experience...
    Senior
    Remote job

    TriWest Healthcare Alliance

    Phoenix, AZ
    4 days ago
  •  ...Senior Data Platform Engineer Onsite Phoenix, AZ Job Description We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ. This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform.... 
    Senior

    EITACIES

    Phoenix, AZ
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!