Databricks Subject Matter Expert

Job Description

Job Description

Description:

Subject Matter Expert – Data Engineering

Job Summary

B&A is seeking a highly experienced and mission-oriented Databricks Subject Matter Expert . We are seeking an independent, subject matter expert to lead and provide support for data collection, data validation, data visualization, and analytics. Our culture includes a highly entrepreneurial atmosphere within a well-established business. We value highly motivated, self-starters who thrive in a fast-paced environment.

Responsibilities

• Lead and provide expert support for data collection, data validation, data visualization, and analytics initiatives
• Apply disciplined methodologies for the planning, analysis, design, and development of information systems on an enterprise-wide basis or across a business sector
• Develop analytical techniques and methodologies to solve complex business and technical problems
• Perform strategic systems planning, business information planning, and business analysis
• Organize and analyze large volumes of structured and unstructured data sets using data analytical tools
• Locate, access, merge, clean, and standardize data from multiple sources, and develop derived metrics
• Create and implement data collection and analysis tools using programming languages such as Python, Databricks, SQL, Scala, R, and Java
• Design, script, debug, and analyze data engineering solutions
• Implement and create machine learning-based tools and processes
• Apply distributed and parallel processing technologies (e.g., Spark) to handle big data analytics tasks involving large data volumes
• Perform SQL Server data imports from CSV and TXT files
• Leverage Excel and Google Suite for data analysis, reporting, and collaboration
• Utilize supporting tools and platforms such as Pentaho (data import/transformation), Azure Data Studio, GitHub, and Smartsheet as needed
• Document task requirements, work completed, processes, and technical details thoroughly
• Communicate effectively with stakeholders across technical and business teams
• Operate independently as a subject matter expert in a fast-paced, entrepreneurial environment

Education and Experience

• Bachelor’s or master’s degree in computer science Computer Science, Data Science, Engineering, or a related field.
• This position requires a minimum of seven (7) years experience, of which at least three (3) years must be specialized.

Required Skills

• Knowledge in organizing and analyzing large amounts of structured and unstructured data sets using data analytical tools, to include experience locating, accessing, merging, cleaning, and standardizing data, and developing derived metrics.
• Strong proficiency in creating and implementing data collection and analysis tools while utilizing programming languages and environments, including Python, Databricks, SQL, Scala, R, and Java. Knowledge of design, scripting, debugging, and analysis.
• Experience in the implementation and creation of machine learning-based tools or processes.
• Knowledge in distributed & parallel processing (e.g., Spark) and the computational power required to handle most big data analytics tasks that can process large volumes of data.

Desired Skills

• Good facility with SQL Server data import from CSV files and TXT files
• Strong skills with Excel and Google Suite
• Familiarity with the following software packages and platforms are helpful: Pentaho for data import and transformation, Azure Data Studio, GitHub, and Smartsheet.
• Strong documentation and communication skills
• Documenting details of task requirements, work completed, etc.

Security Clearance

• Eligible to obtain a Public Trust Clearance.

More About B&A:

Notable Clients
B&A has grown to be a company that is trusted by our clients for exceptional service, innovative solutions, and inspired employees. Our service extends through federal, state, and local Government, the private sector, and higher education. Some of our notable clients include Department of Homeland Security, U.S. Customs and Border Protection, U.S. Senate, U.S. Courts, U.S. Census Bureau, U.S. Navy, and more.

Benefits and Programs

B&A is proud to offer three robust individual and family medical plans to full time employees, including a Health Savings Account (HSA) option as well as two tiers of dental coverage, vision, life & AD&D, disability, accident, hospital indemnity, and critical illness insurance. In addition to these benefits, B&A employees enjoy paid time off, B&A sponsored trainings and certifications, pet insurance benefits, commuter transit benefits and a free subscription to a virtual exercise platform (NEOU). B&A’s 401(k) plan is available to all employees and includes a company matching contribution.

B&A has launched several programs to focus on employee engagement, wellness, and assistance. These include:

• The B&A Cares program: 30/60/90-day wellness check ins, personal development, financial management, and stress management seminars, and more
• A formal mentorship program
• Job shadowing and cross training opportunities
• Brand Ambassador program
• Employee Assistance Program (EAP) - Access to various support resources to include counseling, legal guidance, financial planning, and more
• Monthly teambuilding events
• B&A Annual Wellness Challenges: #StepWithB&A, #WalkDuringLunchWithB &A, #VolunteeringWithB&A, #ExerciseDuringLunchWithB &A, and more

At B&A, we place significant importance on improving the communities and lives of citizens across the nation through our involvement, technology expertise, and employees. B&A puts an emphasis on charitable efforts in the Northern Virginia area, including Capital Area Food Bank pantry drives, book donations, Hope for Henry Foundation events, and many more. In recognition of all these efforts, B&A has been named a Companies as Responsive Employers (CARE) award recipient by Northern Virginia Family Services and nominated by the Northern Virginia Chamber of Commerce for Outstanding Corporate Citizenship Award.

EEO

B&A provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state and local laws. B&A complies with applicable state and local laws governing non-discrimination in employment in every location in which the company has facilities. This policy covers conduct occurring at B&A’s offices, and other workplaces (including client sites) and all other locations where B&A is providing services, and to all work-related activities.

EEO is the Law

B&A participates in e-Verify. We provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee’s I-9 Form to confirm work authorization.