Remote Databricks - Data Engineer

<\/div>

<\/div>

- - - Currently Collecting Resumes - - -<\/span><\/i><\/b><\/div>

​<\/span>
<\/span><\/div>

Description: <\/b><\/span><\/span><\/span><\/span><\/b><\/span><\/span><\/span>
<\/span><\/span><\/p><\/div>

We are seeking a talented and experienced Databricks Data Engineer to join our dynamic team. The successful candidate will play a crucial role in building and managing data pipelines, processing large datasets, and ensuring efficient and secure data management practices. They will also be responsible for inspiring the adoption of advanced analytics and data science across the organization. <\/span><\/span><\/span><\/span><\/span><\/span><\/span>
<\/p><\/div>

​<\/span>
<\/div><\/span>

Requirements <\/h3>

Security Clearance: None/Secret/Top Secret <\/span><\/b><\/span>
<\/span><\/p>

Location : <\/span><\/b> Remote <\/span><\/span>
<\/span><\/p>

Certifications: <\/span><\/b><\/span>
<\/span><\/p>

- <\/span><\/span> Databricks Certified Data Engineer Associate certification <\/span><\/span><\/span><\/span>
<\/span><\/p>

Education: <\/span><\/b><\/span>
<\/span><\/p>

• Bachelor's degree in a relevant field or equivalent combination of education and experience <\/span><\/span>
  <\/span><\/li>
• 7+ years of experience in the data engineering field <\/span><\/span>
  <\/span><\/li>
• 3+ years of experience in a data analytics environment, preferably in DoD or the intelligence community <\/span><\/span>
  <\/span><\/li>
• Master's degree in a relevant field (may substitute for 3 years of general experience) <\/span><\/span>
  <\/span><\/li><\/ul>

  
  <\/span><\/p>

  Required Skills/Experience: <\/span><\/b><\/span>
  <\/span><\/p>

  • Previous experience in a data engineering role or similar <\/span><\/span>
    <\/span><\/li>
  • Experience with data processing and pipeline management <\/span><\/span>
    <\/span><\/li>
  • Familiarity with industry -standard data engineering platforms and tools <\/span><\/span>
    <\/span><\/li>
  • Strong data manipulation and processing skills <\/span><\/span>
    <\/span><\/li>
  • Proficiency in data engineering tools such as Databricks, Apache Spark, Delta Lake, MLflow, and SQL <\/span><\/span>
    <\/span><\/li>
  • Understanding of the Databricks Lakehouse Platform, its workspace, architecture, and capabilities <\/span><\/span>
    <\/span><\/li>
  • Ability to perform multi -hop architecture ETL tasks using Apache Spark SQL and Python <\/span><\/span>
    <\/span><\/li>
  • Knowledge of incremental data processing in batch and streaming mode <\/span><\/span>
    <\/span><\/li>
  • Familiarity with open -source tools, cloud computing, machine learning, and data visualization <\/span><\/span>
    <\/span><\/li>
  • Strong interpersonal skills and a collaborative work style <\/span><\/span>
    <\/span><\/li>
  • Understanding of security and governance best practices <\/span><\/span>
    <\/span><\/li>
  • Strong problem -solving and analytical skills <\/span><\/span>
    <\/span><\/li>
  • Excellent written and verbal communication abilities <\/span><\/span>
    <\/span><\/li><\/ul>

    Major Duties/Tasks: <\/span><\/b><\/span><\/span><\/span>
    <\/span><\/p>

    • Build and manage data pipelines for data engineering applications <\/span><\/span>
      <\/li>
    • Process and manipulate large datasets efficiently and securely <\/span><\/span>
      <\/span><\/li>
    • Work with data engineering platforms and tools such as Databricks, Apache Spark, Delta Lake, MLflow, and SQL <\/span><\/span>
      <\/li>
    • Maintain best practices around security and governance <\/span><\/span>
      <\/span><\/li>
    • Model data management solutions <\/span><\/span>
      <\/li>
    • Manage, test, and deploy code <\/span><\/span>
      <\/span><\/li>
    • Provide expertise on data concepts to the advanced analytics group <\/span><\/span>
      <\/li>
    • ​<\/span><\/span> Install continuous pipelines of filtered information for data analysts and scientists to access relevant datasets <\/span><\/span>
      <\/span><\/li>
    • Collaborate with cross -functional teams to ensure effective data utilization <\/span><\/span>
      <\/span><\/li><\/ul>

      
      <\/div><\/span>
      

      Benefits <\/h3>

      At Lyteworx, we
      prioritize the well -being and satisfaction of our employees. To
      that end, we offer a comprehensive benefits package that
      includes medical, dental, and vision insurance, as well as life
      and disability insurance options. Our employees also enjoy a
      401(k) plan with employer matching contributions, generous paid
      time off, and flexible scheduling options to help them balance
      their work and personal lives. <\/span>
      <\/span><\/div>
      
      

      
      <\/span><\/div>
      
      

      We believe that our
      employees are our greatest asset, and we are dedicated to providing
      them with the resources and support they need to achieve their goals
      and succeed in their careers. <\/span>
      <\/span><\/div>
      
      

      
      <\/span><\/div>
      
      

      
      <\/span><\/div>
      
      

      • 401K Plan <\/span>
        <\/span><\/span><\/li>
      • Vacation and Paid Time Off
        (PTO)<\/span>
        <\/span><\/span><\/li>
      • Health, Dental & Vision
        Insurance <\/span>
        <\/span><\/span><\/li>
      • Life & Supplemental Life
        Insurance <\/span>
        <\/span><\/span><\/li>
      • Disability & Accidental
        Death & Dismemberment <\/span>
        <\/span><\/span><\/li>
        
        
      • Mental Health Care <\/span>
        <\/span><\/span><\/li>
      • Health Saving Account (HSA)<\/span>
        <\/span><\/li><\/ul>
        
        

        
        <\/div><\/span>