Lead Data Engineer

Lead Data Engineer

Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX)

About BigRio:

BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting-edge Big Data, Machine Learning, and Custom Software strategy, analysis, architecture, and implementation solutions. We are an elite group with MIT roots, shining when tasked with complex missions. Whether it's assembling mounds of data from a variety of sources, surfacing intelligence with Deep Learning, or building high-volume, highly-available systems, we consistently deliver.

Job Overview

We are looking for a Senior Back End / Data Engineer to join our Data Engineering team. The ideal candidate will have an advanced knowledge of building Data Pipelines, batch processing frameworks, and Data Modeling techniques to facilitate seamless Data Ingestion and Exports. In this role you will collaborate with various technology and business stakeholders to deliver data solutions that meet user needs. The candidate should possess intellectual acumen, with an engineering mindset and an interest in developing enterprise scale solutions using industry recognized cloud platforms, databases, data integration/orchestration tools, and big data technologies.

Responsibilities:

• Design and implement robust, scalable, and high-performance data pipelines to support the organization's data needs.
• Implement Data Ingestion, transformation, and Data Quality features to support Application Engineering, Analytics, and various Business Verticals across the organization.
• Collaborate with Data Architect, and Business Analysts in building data models to improve reliability and interpretability of data for analytical and business needs.
• Design, develop, and maintain robust data export solutions to facilitate the efficient transfer of data to external systems and platforms.
• Actively contribute to the creation of design documents, assess technologies, and conduct Proof of Concepts (PoCs).
• Experience supporting production jobs and mitigate issues in a timely manner.
• Write unit, integration, and functional tests for new features.
• Contribute to the Technology Roadmap, PR Reviews and formulate standards/best practices.
• Bring in a positive attitude and foster a culture that embraces continuous learning and Innovation.

Experience:

5+ years of experience as a Data Engineer, with a focus on building enterprise data solutions. 3+ years of Cloud Experience: Azure (preferred)/AWS/GCP. Expert in Microsoft SQL Server (preferred) or other relational databases. Strong experience in Microsoft ETL stack, SSIS, Azure Data factory. Strong programming skills in Python, C# or any other programming language. Expertise with SQL, stored procedures, triggers, and performance tuning. Experience working with Big Data technologies: Spark, Databricks or other frameworks. Prior experience in building data pipelines that are scalable, reliable and fault tolerant while delivering data integrity and code quality. Experience in building data lakes to support high speed querying by the end users. Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. Prior Experience working with Healthcare Information exchange standards like HL7, X12 EDI, FHIR will be helpful. Experience or knowledge with creating RESTful API's is a plus. Experience building Dashboards and visualizations using Power BI or other tools is a plus.