Data Engineering

Data Engineering

New York, NY

Contract Role

Rate: $60 - $62/hr

Onsite from Day 1

Data & AI Engineer - Lounge Services

Required Skill:

• Bachelor's degree in computer science, data engineering, other technical discipline, or equivalent work experience.
• (Advanced degree preferred) 4-6 years of Data Engineering experience with proven hands-on experience in Big Data technologies and Business Intelligence tools.
• Understanding of Agile or other rapid application development methods.
• Exposure to design and coding across one or more platforms and languages as appropriate.
• Exposure to application design, software development, and automated testing methodologies.
• Experience with CI/CD practices using Git, Jenkins, and code integration/review processes.
• Backend platform: Experience building data connectors with relational & nonrelational backend databases including MongoDB, PostgreSQL, and custom API Connectors.
• Google Cloud Platform Expertise: Hands-on experience with GCP services like BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud Composer (Airflow DAGs), and Cloud Functions. •
• Programming Languages: Strong proficiency in Python and SQL for data ingestion, processing, and manipulation.
• ETL/ELT: Experience with ETL/ELT processes and data warehousing concepts.
• Data Modeling: Understanding of data modeling principles and techniques. •
• Cloud Technologies: Knowledge of cloud computing concepts and standard processes
• Design, build, and maintain scalable data pipelines (batch and streaming) supporting real-time / near-real-time data integration for Lounge Services Analytics use cases.
• Develop and optimize ETL/ELT processes for structured and unstructured data from various backend DBs and sources including MongoDB, PostgreSQL, APIs, and third-party systems. •
• Architect and manage cloud-native data infrastructure/warehouses within Google Cloud Platform (BigQuery) environments.
• Orchestrate Data Transformations with Cloud Composer / Airflow DAGs.
• Enable trusted, analytics-ready datasets to support Tableau dashboards and analytics.
• Experience with observability and monitoring tools such as Datadog, CloudWatch, Prometheus, or similar platforms.
• Implement data monitoring, logging, and observability frameworks to ensure data quality, integrity, governance and security standards are met.
• Build AI / ML models and integrations to support predictive & personalized use cases including lounge recommendations, capacity forecasting, and lounge optimization
• Collaborate with cross-functional teams including Analytics, Product & Business to define data requirements and deliver solutions.
• Optimize data storage and processing for performance and cost-efficiency (partitioning and indexing solutions).
• Implement and enforce data governance standards, including data classification, access controls, and retention policies.
• Develop and maintain metadata management practices, including data lineage, catalog documentation, and business glossary alignment.

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.