Senior Data Engineer

Build the future of software development with a team that values innovation, collaboration, and personal growth. Why Choose ShaktaTechnology ? We believe in creating an environment where everyone can thrive and do their best work. Comprehensive health, dental, and vision insurance for you and your family. Flexible hours, remote work options, and generous vacation policy. Team Culture Collaborative environment with regular team events and celebrations. Open Positions Explore exciting opportunities to grow your career with us. Tech Office Full-time Build ETL/ELT pipelines using Python & SQL Implement dimensional data models Write optimized SQL queries Work with Parquet + partitioning Develop Spark batch jobs Implement dbt models & tests (if used) Fix data issues identified by monitoring Requirements: 1 Tech Office Full-time Build and manage workflows in Airflow / ADF / Dagster Handle scheduling, retries, backfills Implement data quality checks Maintain pipeline logs & alerts Monitor SLAs and resolve failures Support streaming pipelines (Kafka / Pub/Sub / Event Hubs – basic) Requirements: 1 Tech Office Full-time Manage cloud storage (S3 / ADLS / GCS) Implement IAM/RBAC with guidance from Senior Manage secrets (KMS / Key Vault / Secret Manager) Support Databricks / EMR / Dataflow / Dataproc jobs Write basic Terraform modules Create & maintain Docker images Assist in CI/CD pipelines Requirements: 1 Tech Office Full-time Design overall data architecture (lakehouse / medallion) Decide data modeling standards (facts, dimensions, naming) Own warehouse/lakehouse strategy (BigQuery / Snowflake / Redshift / Databricks) Lead Spark strategy and performance optimization Review PRs, enforce code quality & best practices Define data quality rules, SLAs, backfill strategy Own security design (IAM/RBAC, PII handling) Guide CI/CD, branching strategy, release process Cost optimization & capacity planning Mentor mid-level engineers Requirements: 1 Our Hiring Process We've designed a straightforward, transparent process to help us get to know each other better. 1 2 Screening Initial phone/video call to discuss your experience and interests. 3 Technical Technical assessment or portfolio review relevant to the role. 4 Final Interview Meet the team and discuss how you'll contribute to our mission. #J-18808-Ljbffr