Lead Data Engineer

OpenKyber is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, OpenKyber has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

We are seeking a Big Data Engineer to join our team. The ideal candidate will have strong experience in Java/J2EE development, Agile delivery, and CI/CD practices and a proven ability to design, build, test, deploy, and maintain secure, resilient applications .

• Design, develop and maintain scalable and large-scale data processing pipelines and infrastructure on the cloud following engineering standards, governance standards and technology best practices
• Develop and optimize data models for large-scale datasets, ensuring efficient storage, retrieval, and analytics while maintaining data integrity and quality.
• Collaborate with cross-functional teams to translate business requirements into scalable and effective data engineering solutions.
• Demonstrate a passion for innovation and continuous improvement in data engineering, proactively identifying opportunities to enhance data infrastructure, data processing and analytics capabilities.

• Strong analytical problem solving and critical thinking skills
• Proficiency in at least one programming language ( Python, if not Java or Scala)
• Proficiency in at least one distributed data processing framework ( Spark or similar)
• Proficiency in at least one cloud data Lakehouse platforms (AWS Data lake services or Databricks, alternatively Hadoop),
• Proficiency in at least one scheduling/orchestration tools ( Airflow, if not AWS Step Functions or similar)
• Proficiency with relational and NoSQL databases.
• Proficiency in data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), and big-data storage formats (Parquet, Iceberg, or similar),
• Experience working in teams following Agile methodology
• Experience with test-driven development (TDD) or behavior-driven development (BDD) practices, as well as working with continuous integration and continuous deployment (CI/CD) tools.

• Experience with cloud platforms and related services.
• Exposure to test automation and performance engineering.

• Competitive compensation and benefits
• Opportunities for growth with global clients
• A supportive, inclusive culture that values innovation and people
• Exposure to cutting-edge technologies and projects

OpenKyber is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

For applications and inquiries, contact:View email address on us.fitly.work