Senior Data Engineer

Senior Data Engineer Design, build, and manage AMH's data platform and tools for efficient processing and analysis of large data sets. Develop and maintain scalable data pipelines, ensure data quality, and deploy machine learning models to production. Collaborate with business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization. Build real-time and batch pipelines to handle large volumes of data efficiently. Translate business requirements into scalable data solutions and provide technical leadership and mentorship to team members. Responsibilities Design, develop, and maintain real-time or batch data pipelines to process and analyze large volumes of data. Design and develop programs and tools to support ingestion, curation, and provisioning of complex first-party and third-party data to achieve analytics, reporting, and data science. Design and develop advanced data products and intelligent APIs. Monitor system performance by performing regular tests, troubleshooting, and integrating new features. Lead analysis of data and design the data architecture to support BI, AI/ML, and data products. Implement data platform architecture to meet organization analytical requirements, addressing operational needs such as scalability, maintainability, extensibility, flexibility, and integrity. Lead peer development and code reviews with focus on test-driven development and CI/CD. May occasionally work evenings and/or weekends. Qualifications Bachelor’s degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, or a related field. Master’s degree in the same fields is preferred. Minimum of eight (8) years of experience as a data engineer with full-stack capabilities. Minimum of ten (10) years of experience in programming. Minimum of five (5) years in cloud technologies such as Azure, AWS, or Google Cloud. Strong SQL knowledge. Experience in ML and ML pipelines. Experience in real-time integration, developing intelligent apps and data products. Proficiency in Python and experience with CI/CD practices. Background in IAAS platforms and infrastructure. Hands-on experience with Databricks, Spark, Fabric, or similar technologies. Experience with Agile methodologies. Hands-on experience in designing and developing data pipelines and data products. Experience designing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions. Experience with Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks, Azure Data Catalog, Cosmos DB, ML Studio, AI/ML, etc. Extensive experience in Big Data technologies such as Apache Spark and streaming technologies such as Kafka, Event Hub, etc. Experience designing data applications in a cloud environment. Intermediate experience with RESTful APIs, messaging systems, and AWS or Microsoft Azure. Expertise in data architecture, data modeling, data analysis, and data-quality frameworks. Knowledge of BI tools such as Power BI and Tableau. Compensation and Benefits Annual pay range: $121,116.00 to $151,395.00, depending on location, education, training, skills, and experience. Discretionary annual bonus eligibility. Medical, dental, and vision insurance. Flexible spending accounts and/or health savings accounts. Dependent savings accounts. 401(k) with company matching contributions. Employee stock purchase plan. Tuition reimbursement program. 9 paid holidays per year. Accredited PTO at rate of 0.0577 hours per hour worked, up to 120 hours per year. Employment Policies Background check required. AMH will consider qualified applicants with arrest or conviction records in accordance with all applicable federal, state, and local laws, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. AMH provides reasonable accommodations to qualified individuals with disabilities. To request an accommodation, email View email address on click.appcast.io. Learn more about your rights. American Homes 4 Rent, LP (“AMH”) provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, gender identity, sexual orientation, marital status, pregnancy, status as a parent, national origin, age, disability (physical or mental), family medical history or genetic information, political affiliation, military service, or other non-merit based factors. AMH complies with applicable state and local laws governing nondiscrimination in employment in every location where the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. AMH participates in the E-Verify program. Illinois Privacy Notice: IL E-Verify Notice. Information regarding our collection and use of your personal information can be found here. CA Privacy Notice: To learn more about what information we collect when you apply for a job, and how we use that information, please see our CA Job Applicant Privacy Notice found here. #J-18808-Ljbffr