ETL Data Engineer
Apptad Inc
Primary Responsibilities:
Design and develop ETL/ELT solutions on Azure Databricks, LakeBase and Spark
Develop, implement, and deploy large scale data pipelines empowering machine learning algorithms, insights generation, business intelligence dashboards, reporting and new data products
Design, build, optimize, and manage modern large-scale data pipelines ETL/ELT processing to support data integration for analytics, machine learning features and predictive modelling
Consume data from a variety of sources (RDBMS, APIs, FTPs and other cloud storage) & formats (Excel, CSV, XML, JSON, Parquet, Unstructured)
Write advanced / complex SQL with performance tuning and optimization
Identify ways to improve data reliability, data integrity, system efficiency and quality
Participate in architectural evolution of data engineering patterns, frameworks, systems, and platforms including defining best practices and standards for managing data collections and integration
Mentor other data engineers and provide technical direction by teaching other data engineers how to leverage cloud data platforms
Required Qualifications:
7 + years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions
5 + years of experience in Python
2 + years of experience in Apache Spark (PySpark/Spark SQL)
2+ years building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus
2+ years of experience in SQL with designing complex data schemas and query performance optimization
Experience with DevOps automation with Terraform.
Experience with CI/CD process and tools GitHub Actions, GIT, Artifactory, Sonar
Preferred Qualifications:
Bachelor's degree in Computer Science, Engineering, Mathematics or related discipline
Extensive knowledge of data architecture principles (e.g., Data Lake, Databricks Delta Lake, Data Warehousing, etc.)
Extensive knowledge of data modelling techniques including slowly changing dimensions, aggregation, partitioning and indexing strategies
Experience working with LLMs
Ability to independently troubleshoot and performance tune large scale enterprise systems
Excellent collaborator with experience working effectively with cross-functional teams such as leadership, product management and engineering, with a willingness to inspire other data engineers, data scientists and analysts
Solid communication skills with the ability to communicate technical concepts to both technical and non-technical audiences
- ...National Top Companies Certified as a Great Place to Work® Fortune Best Workplaces in Financial Services & Insurance Sr. Data Engineer ESSENTIAL FUNCTIONS AND RESPONSIBILITIES Designs, builds, and maintains scalable data pipelines supporting batch, real-time...SuggestedFull timeWork experience placement
$164.56k - $205.7k
...pharmacy experience through intelligent, scalable technology. Data is foundational to how we serve patients, empower operators, and... ...decision-making across the business. As the Senior Manager, Data Engineering, you will lead the strategy, architecture, and execution of...SuggestedFull timeTemporary workWork experience placementRemote workFlexible hours$106.52k - $157.27k
...First (Days) Overview: Sentara is hiring a Senior Healthcare Data Analyst! This position is fully remote. Overview The... ...of experience in data analysis, business analysis, data mapping, ETL, data warehouse, or related data environments. ~ Must have advanced...SuggestedFull timeTemporary workRemote workShift work- ...adjacent verticals (e.g. home, motorcycle, RV, etc) to become the one-stop-shop for all your physical assets. Why We’re Hiring Our Data Science & Analytics team has been a force multiplier and accelerant to our business that has helped us reach these pivotal...SuggestedHourly payFull timeContract workPart timeFreelanceLocal areaRemote workFlexible hours
- ...parts approvals, and expedited replacements within established monetary limits. •Analyze service data and recommend corrective actions or product enhancements to Engineering and R&D. •Author and maintain technical documentation, bulletins, and training materials used...SuggestedFull timeFor contractorsRemote work
$75k - $80k
...traditionally manual channel. Our modern logistics and fulfillment engine helps businesses to build and scale high-quality, personalized... ...AI to work faster, catch its mistakes, and never put customer data or API keys into tools that aren't approved. Composure: you...Full timeLocal areaRemote work$106.3k - $206.2k
...drive positive, lasting change that moves missions and the government forward! Accenture Federal Services is seeking a Cloud Engineer to deliver secure cloud platform implementations supporting government customers. This role focuses on designing, implementing, and...Full timeLive inWork at officeLocal area$58.1k
...successful candidate will play a crucial role in supporting the clinical environment, ensuring seamless image viewing, interpretation, and data exchange. ESSENTIAL RESPONSIBILITIES 1. Image Management & System Optimization Ensures an optimal environment for the viewing...Full timeFor contractorsWork at officeLocal areaRemote work$120k - $150k
Why Great Gray? At Great Gray Group, we strive to set the bar for the retirement services industry. Our goal is to deliver advanced retirement solutions that combine our core fiduciary services with robust investment options, innovative technology, and dedicated client ...Full timeWork experience placementLocal areaRemote workVisa sponsorship$33.05 - $49.6 per hour
...programs, projects and services, and monitors revenue budgets and benchmarking activities. Acts as support for all system intermediary data requests, audits and exit conferences. Assists in preparation and provides necessary information required for the completion of...Daily paidFull timeTemporary workPart timeInterim roleWork at officeRemote workRelocationFlexible hoursShift work$60k - $65k
The Revenue Cycle Analyst is responsible for supporting reporting, analytics, and data integrity efforts across the revenue cycle function. This role serves as a key partner to Revenue Cycle leadership and the Business Intelligence team, ensuring accurate, consistent...Full timeWork experience placementRemote work$97.16k - $142.58k
...business requirements for system enhancements and issue resolution. Investigate and troubleshoot Salesforce-related business process and data issues. Coordinate and perform User Acceptance Testing (UAT) for system changes and enhancements. Create, maintain, and analyze...Full timeTemporary workRemote workShift work$137k - $170k
...this role: As a Product Analyst at Liftoff, you'll turn complex data into rigorous analysis that informs product decisions across... ...closely with Product Managers, Data Scientists, and Machine Learning Engineers to define success metrics, evaluate experiments, and understand...Full timeRemote work- Tahoe Forest Hospital District Level 1 Technical Support SpecialistThe Tahoe Forest Hospital District Level 1 Technical Support Specialist is a customer-focused professional who provides essential technical assistance to end-users within our organization. In addition to...
Tahoe Forest Health
Truckee, CA1 day ago - ...into the future. Job Description As a Senior Software Engineer for FuzeRx, you will join a team that is working to improve... ...intake automation rate by leveraging LLMs to parse unstructured data from prescriptions. Accelerate pharmacist workflows by integrating...Full timeTemporary workWork experience placementRemote workLong distanceFlexible hours
$112.5k - $202.9k
...of education and experience deemed equivalent (Required) 3+ years of experience in telecommunications, solutions consulting, or engineering roles with a professional track record of successful solution sales and managing internal and external relationships in a matrix...Full timeTemporary workPart timeWork experience placementLocal areaRemote workFlexible hours$100k - $200k
Join us as a Senior Software Engineer on our development team! We are looking for a Senior Software Engineer to develop features... ...Unity. Strong understanding of software architecture patterns, data structures, and system design. Experience shipping consumer-...Full timeCasual workRemote workWorldwide$140k - $150k
...automotive vertical. We believe human intellect paired with data-driven AI is the winning combination. It always has been. And we... ...be a part of, there’s good news. We’re hiring for a Sr. Software Engineer. The Position As a Software Engineer at Foureyes, you'll build...Full timeSummer workRemote work$140k - $157.5k
...the status quo and help government leaders shape the future. We engineer scalable, human-centered solutions that help agencies deliver their... ...mission faster and better. Our teams blend product, design, AI, data, and modern software practices to modernize legacy systems,...Full timeContract workTemporary workLocal areaRemote work$120k - $140k
...Software Engineer in Test US REMOTE (AZ, CA, CO, FL, GA, MA, MD, NC, NJ, NH, NV, OH, OR, PA, TN, TX) About VivoSense VivoSense... ...effort on functionality that presents the greatest product, data integrity, security, or clinical risk. Review product requirements...Full timeRemote workFlexible hours$70k
...ME, MI, MN, MO, NC, NH, NJ, NV, NY, OH, OK, OR, PA, RI, SC, TN, TX, UT, VA, VT, WA, WI Role Description: The Solutions Engineer will join ShipBob’s growing Revenue team responsible for understanding the unique strategic needs of each of our mid-market clients...Full timeLocal areaRemote workFlexible hours- ...best practices and assess the potential impact of these changes. Qualifications What You Will Need: Bachelor of Science – Engineering (Computer Science, Electrical, Mechanical, etc.) or two to three years of relevant gaming experience. Communicates effectively...Full time
- ...hardware to appropriate locations.Maintain, upgrade and repair workstations and POS systems.Set up and configure Office applications.Data entry and POS product input and maintenance.Stay informed about industry trends and complete relevant Information Technology...Hourly payFull timeSeasonal workWork at officeLocal area
$165k - $205k
...automated code testing and linting. Liftoff moves around hundreds of TB of data each day, and this team owns most of the infrastructure which powers our real-time data pipelines. As a Software Engineer at Liftoff, you will: Have end-to-end ownership of projects, and...Full timeRemote work- ...has deployed the largest second-life battery project in the world, delivering power to AI data centers in months rather than years using proprietary energy architecture engineered entirely in-house. The company is profitable, the market it operates in is projected to grow...Full timeImmediate startNight shiftWeekend work
$128.16k - $160.2k
...Description Fuze Health is seeking a Senior DevSecOps Engineer to join our Engineering organization. As a full-service pharmacy... ...hiring process by providing recruiters and hiring managers with data-backed insights based on information provided in your resume, including...Full timeTemporary workWork experience placementRemote workFlexible hours- Tahoe Donner is seeking a Help Desk Technician in Truckee, CA to provide first-level IT support for employees, troubleshoot hardware and software issues, and help maintain day-to-day IT operations. The role involves configuring desktops, laptops, and POS systems, assisting...
- ...customers. Kraus Hamdani Aerospace is seeking a versatile Software Engineer to design, build, deploy, and support software for autonomous... ...the world's most endangered species, and provide geospatial data to assist in slowing climate change. Compensation & Benefits...Full timeWorldwide
- ...urine drug screens. The role requires adherence to safety practices and completion of competency assessments. Responsibilities include data entry, order processing, specimen transport, and coordination with the laboratory team to ensure timely and accurate test results....
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to ETL Data Engineer. Be the first to apply!
