Senior Data Engineer

Senior Data Engineer

As a Senior Data Engineer at Radwell, you will be a key member of the data engineering team, responsible for designing, building, and maintaining our data environment. You will collaborate closely with fellow data engineers, ML teams, reporting analysts, and software engineers to ensure our data pipelines are efficient, scalable, and reliable. The Radwell Data Engineer is a forward-thinking innovator who understands how to implement data solutions for next-generation challenges by working directly with the business to understand their data needs. Your work will help optimize activities across multiple functions such as pricing, warehousing, and procurement, driving data-driven decisions and operational efficiency throughout the organization.

· Architect and scale data platforms — design and maintain distributed data systems (batch + streaming), ensuring reliability, performance, and cost efficiency

· Lead end-to-end data pipeline development — build, optimize, and monitor ETL/ELT pipelines that support analytics, ML training, and real-time inference workloads

· Enable machine learning workflows — collaborate with data scientists to deliver feature pipelines, model training environments, and production inference systems

· Own data quality and governance — define standards for data validation, lineage, cataloging, and compliance across the organization

· Partner with cross-functional teams — work with product, analytics, and ML teams to translate business needs into scalable data solutions

· Operational excellence — manage CI/CD for data and ML pipelines, implement observability, and ensure SLAs for mission-critical data services

· Evaluate and integrate new technologies — assess tools for data processing, orchestration, storage, and MLOps; lead POCs and production rollouts

· Build and maintain advanced data systems that bring together data from disparate sources in order to enable decision makers

· Design, develop, and maintain scalable data pipelines and ETL processes using Databrick, azure data factory, SQL and Python

· Build pipelines and prepare data for use by data scientists, data analysts, and other data systems

· Take a solution-oriented problem-solving approach to develop creative solutions for business needs by partnering with business leaders and subject matter experts

· Leverage cloud infrastructure and metadata driven frameworks to deliver value and scalability

· May be modified from time to time. Other duties, tasks and work may be assigned

· Consistently meet monthly deadlines and objectives as agreed and typically described in monthly reviews or through other project planning efforts

· Handle ongoing projects and day-to-day demands that are not identified in formal monthly objectives in a timely and accurate manner

· Adherence to any related budget expenses

· Adherence to/achievement of business objectives described in project benefit analyses

· Incorporate AI-powered developer tools (e.g., GitHub Copilot, Cursor, Claude Code) to accelerate code scaffolding, boilerplates, and refactoring

· Govern the deployment pipeline by maintaining ultimate accountability for the security, extensibility, and clarity of AI-generated code

· Automate test suites using Generative AI to programmatically generate edge-case validation checks, regression testing, and data quality rules.

· Manage continuous integration and zero-touch deployment (CI/CD) via GitHub Actions, Terraform, or Jenkins, using AI to debug execution failures and draft deployment manifests

· Implement rollback strategies and reversible migration practices for schema modifications developed through automated workflows

· Build automated anomaly detection and schema drift monitoring alerts into critical business pipelines

· Enforce data governance standards, maintaining clear lineage tracking and access controls across cloud layers

· Bachelor's degree in computer science, Engineering, or related field discipline preferred

· Minimum 10 years' experience delivering data engineering solutions on a cloud platform

· Minimum 10 years' experience implementing modern designs using at least one cloud-based solution

· Minimum 10 years' experience with SQL or NoSQL databases

· Minimum 10 years' experience with at least one programming language, with a strong preference towards Python

· Advanced level proficiency with at least one ETL / data orchestration technology such as Azure Data Factory, SSIS, Informatica

· Experience in cloud-based data warehousing and data lake solutions such as Databricks, Snowflake, or Redshift

· Expertise with SQL, database design and data structures (star/snowflake schemas, de/normalized design)

· Familiarity with DevOps tools such as git, TFS, CI/CD, Jira

· Fundamental understanding of big data, open source, and data streaming concepts

· Fundamental understanding of implementation of MLOps best practices

· Familiarity with packaged software data extraction from systems such as NetSuite, Profit21 ERP as well as Salesforce CRM.

· Experience sub-setting data into cube structures for business use in data reporting and analytics.

· Ability to think strategically and provide recommendations utilizing traditional and modern architectural components based on business needs

· Excellent written and verbal communication skills along with strong desire to work in cross functional teams. Ability to present extremely complex technical information in a business-friendly manner

· A passion for staying up to date with the latest trends and advancements in the field

· Team player who can coach and be coached as needed. Openness to adapting your approach for the betterment of the team

· Strong technical ability and eagerness to learn new technologies and skills

· Attitude to thrive in an entrepreneurial, fast-paced environment

· High School Diploma or equivalent required

· BS in computer science, statistics, or operations research or related technical discipline required

· Minimum 10 years' experience in an analytics or data engineering role.

· Continuous sitting and typing for extended periods

· Occasional reaching/working overhead, climbing or balancing, stooping and occasional lifting of up to 25 pounds may be required.

This is an exempt position, which requires a work schedule that will achieve the results and objectives identified by the company. Generally, the schedule for this position will be 8:00am-5:00pm, Monday through Friday, with one hour for lunch. Nights and weekends may be worked at the Development Team Manager's discretion based on current project and implementation needs, deadlines, and workload. Employee is expected to come to work on time and adhere to accepted time-off policies.

Dress attire is casual but professional in an office setting. All employees are encouraged to wear "Radwear" (shirt with company logo) once the initial supply (at company expense) has been received. Radwell ID Badge and Access card must be always worn. Radwell Safety Policies must be adhered to at all times.

This job description does not list all the duties of the job. You may be asked by supervisors or managers to perform other duties. You will be evaluated in part based upon your performance of the tasks listed in this job description. The employer has the right to revise this job description at any time. The job description is not a contract for employment and either you or the employer may terminate employment at any time, for any reason.

Benefits: Radwell offers a comprehensive benefits package including health, dental, and vision coverage. The Company provides company sponsored short-term and long-term disability benefits, as well as $50,000 in Life insurance. These benefits, along with additional voluntary benefits, are available to all regular full-time employees beginning on first day of employment . All employees are automatically enrolled at 3% into the Company's 401(k) Plan on the first of the month following 90 days of continuous employment. Employees are eligible for common paid Company Holidays and 15 days of PTO annually, which begin accruing on first date of employment and may be used immediately upon joining the team.

Salary Information: The recruiting base salary range for this FULL TIME position is $140,000 - $170,000/year. Within the range, individual pay is determined by factors, including job-related skills, experience, and relevant education or training. Additionally, this role is bonus-eligible, with a target bonus percentage that provides an opportunity to earn even more based on company performance.