Senior Data Engineer

Senior Data Engineer

Develop and maintain data pipelines using Python and PySpark. Design and optimize ETL processes for large-scale data workflows. Work extensively with MongoDB for schema design, querying, indexing, and data modeling. Write complex SQL queries, stored procedures, and performance-tuned datasets. Collaborate with data engineers, analysts, and business teams to understand requirements. Ensure data quality, consistency, and governance throughout the development lifecycle. Troubleshoot and resolve performance issues across Python, Spark, and database layers. Participate in Agile ceremonies and contribute to solution architecture discussions.

Experience: 7 years of software or data engineering experience. Strong programming experience with Python (Pandas, NumPy preferred). Hands-on experience with PySpark for distributed data processing. Deep expertise with MongoDB (NoSQL operations, pipelines, indexing strategies). Strong proficiency in SQL with the ability to write complex queries and optimize performance. Experience working with large datasets and scalable big data pipelines. Familiarity with cloud platforms (AWS, Azure, GCP) is an advantage. Strong analytical and problem solving skills. Excellent communication and teamwork capabilities.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence, and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.