Senior Data Engineer

Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations. We leverage cutting-edge technologies to create scalable, secure, and user-friendly applications.

As we continue to grow, we’re looking for a skilled Senior Data Engineer to join our dynamic team and contribute to our mission of transforming business processes through technology.

This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

 

Senior Data Engineer

Job Title: Senior Data Engineer
Location: 100% Remote (Continental United States)
Position Type: In-house Bright Vision Technologies SOW engagement (no third-party client or vendor)
Experience: 6+ years
Salary: 100k - 150k
Sponsorship: No new H1B sponsorship available. H1B transfers welcomed for qualified candidates.
Employment Type: Full-time, direct W2 with Bright Vision Technologies (no C2C, no 1099, no third-party)
Engagement: Long-term, multi-year, aligned to the Bright Vision SOW delivery roadmap
Compensation: Competitive base salary commensurate with experience, plus benefits.

Employment Terms & Visa Policy

This is a 100% remote, full-time, direct W2 position with Bright Vision Technologies.
This role is part of Bright Vision Technologies’ in-house Statement of Work (SOW) engagement. The client, end customer, and employer for this position is Bright Vision Technologies — there is no third-party client, vendor, or implementation partner involved.
We do not engage in C2C, 1099, or third-party arrangements for this role.

BUT STRICTLY NO C2C/1099/3RD PARTY COMPANIES. ALL OUR ROLES ARE W2 AND NO 3RD PARTY BROKERING PLEASE.
Candidates must be willing to work directly as a full-time W2 employee of Bright Vision Technologies and contribute to our in-house SOW deliverables.
No new H1B sponsorship is available for this role.

However, candidates who are currently on a valid H1B visa and require a transfer are welcome to apply. We will support H1B transfers for qualified candidates.
For every role, a technical coding assessment is mandatory. Please apply only if you are confident in your technical abilities and hands-on experience.

Job Summary
We are seeking an accomplished Senior Data Engineer to architect, design, develop, and maintain enterprise-grade data platforms, scalable data pipelines, and distributed data processing systems that support analytics, business intelligence, and machine learning initiatives across multiple business domains. In this role, you will be responsible for the end-to-end data engineering lifecycle, from translating business and analytical requirements into robust data architectures, to developing reliable ETL/ELT pipelines, to deploying cloud-native data solutions and supporting them throughout their operational lifespan. The successful candidate will bring deep expertise in data engineering, distributed computing, cloud data platforms, and database technologies, combined with strong hands-on experience building scalable, secure, and high-performance data solutions. You will work closely with data scientists, business analysts, software engineers, solution architects, DevOps engineers, and stakeholders in an Agile environment to deliver high-quality, reliable, and governed data platforms that directly support strategic business outcomes.

Key Responsibilities

• Design, build, and continuously refine scalable batch and real-time data pipelines using Python, SQL, Spark, Scala, or equivalent technologies, ensuring reliable, efficient, and high-performance data movement across enterprise systems while supporting evolving business and analytical requirements.
• Author secure, reusable, and production-quality ETL/ELT workflows that adhere to enterprise coding standards, data governance policies, data quality principles, and security best practices, incorporating validation, encryption, auditing, and error handling throughout the data lifecycle.
• Develop scalable data integration solutions using modern cloud data platforms such as AWS, Azure, or Google Cloud, leveraging services including Databricks, Snowflake, BigQuery, Redshift, Synapse Analytics, Data Factory, Glue, or equivalent technologies to enable enterprise data processing.
• Design and implement robust data architectures, dimensional data models, data lakes, data warehouses, and streaming data solutions that integrate multiple structured, semi-structured, and unstructured data sources while ensuring consistency, scalability, and high availability.
• Actively participate in enterprise data architecture discussions, cloud migration initiatives, technical design reviews, and solution planning sessions by evaluating trade-offs involving scalability, performance, maintainability, governance, security, and operational costs.
• Continuously monitor, profile, and optimize ETL processes, Spark jobs, SQL queries, database performance, storage utilization, partitioning strategies, and pipeline throughput by identifying bottlenecks and implementing measurable performance improvements.
• Implement and maintain robust metadata management, data cataloging, lineage tracking, schema evolution, data quality validation, monitoring, and governance frameworks that ensure trusted, discoverable, and compliant enterprise data assets.
• Develop comprehensive automated testing frameworks for data pipelines, ETL workflows, data validation, reconciliation, integration testing, and performance testing using modern testing methodologies and data quality tools to ensure reliable production deployments.
• Contribute meaningfully to CI/CD pipeline design, infrastructure automation, and deployment processes using Jenkins, GitHub Actions, Azure DevOps, Terraform, Docker, Kubernetes, or equivalent technologies, enabling consistent and automated delivery of enterprise data solutions.
• Proactively identify data pipeline bottlenecks, operational risks, technical debt, scalability challenges, and architectural weaknesses while driving continuous improvement initiatives through optimization, refactoring, technical documentation, and engineering best practices.
• Collaborate effectively within Agile/Scrum delivery teams by participating in sprint planning, backlog refinement, daily standups, architecture discussions, sprint reviews, and retrospectives to ensure consistent delivery of scalable, high-quality data engineering solutions.
• Maintain clear, current, and comprehensive technical documentation—including data architecture diagrams, pipeline specifications, ETL workflows, metadata documentation, deployment guides, operational runbooks, and disaster recovery procedures—to ensure maintainability, governance, and knowledge sharing across teams.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, Software Engineering, Mathematics, or a closely related technical discipline.
• Five or more years of professional experience designing, developing, and supporting production-grade enterprise data engineering solutions, ETL pipelines, and cloud-based data platforms.
• Strong, demonstrable understanding of data structures, database design, distributed computing, data modeling, ETL/ELT methodologies, data warehousing concepts, and large-scale data architecture principles.
• Advanced working knowledge of Python, SQL, Spark, Scala, Java, and enterprise data engineering frameworks used to build scalable, high-performance data processing solutions.
• Hands-on, production-level experience designing and operating batch processing, streaming data pipelines, data lakes, and cloud-native data platforms using technologies such as Databricks, Snowflake, Apache Spark, Kafka, Airflow, or equivalent solutions.
• Proven experience working with relational and NoSQL databases including PostgreSQL, SQL Server, Oracle, MySQL, MongoDB, Cassandra, or equivalent database technologies, including schema design, query optimization, indexing strategies, and performance tuning.
• Strong SQL skills and meaningful experience designing dimensional models, star schemas, snowflake schemas, data marts, partitioning strategies, indexing, and enterprise-scale data warehouse solutions.
• Solid experience with Git-based version control, CI/CD pipelines, DevOps practices, release management, infrastructure automation, and Agile software development methodologies supporting enterprise data engineering initiatives.
• Hands-on experience deploying enterprise data platforms and analytics solutions on AWS, Azure, or Google Cloud Platform, including managed storage, compute, networking, security, identity management, and data integration services.
• Strong troubleshooting, analytical thinking, debugging, root-cause analysis, communication, and documentation skills, with the ability to investigate complex data processing issues methodically and implement scalable, maintainable engineering solutions.

Preferred Qualifications

• Experience designing and implementing event-driven architectures, real-time data streaming platforms, Apache Kafka, Apache Flink, Apache NiFi, RabbitMQ, or equivalent enterprise messaging and streaming technologies.
• Familiarity with containerization, orchestration, Infrastructure as Code, and cloud-native deployment practices using Docker, Kubernetes, Terraform, Helm, or equivalent enterprise automation technologies.
• Exposure to distributed systems concepts including eventual consistency, fault tolerance, distributed transactions, data replication, partitioning strategies, CAP theorem, high availability, and large-scale data processing architectures.
• Experience implementing data governance frameworks, master data management (MDM), data lineage, metadata management, data quality automation, security compliance, and DataOps best practices within enterprise cloud and Agile development environments.

How to Apply
Would you like to know more about this opportunity?
For immediate consideration, please send your resume to View email address on brightvisiontechnologies.applytojob.com or contact us at Show phone number. Learn more about Bright Vision Technologies at
We recognize that our people are our strength, and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company.
We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs.
Bright Vision Technologies is an Equal Opportunity Employer, including Disability/Veterans.
Position offered by “No Fee Agency.”

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.