Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer II — AI/ML Pipelines on Databricks (Hybrid)

CoStar Group

Data Engineer II Job Description CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. Homes.com Homes.com is already one of the fastest growing real estate portals in the industry, we are driven to be #1. Just ask Brad Bellflower, Chief Change Officer at Apartments.com. After its acquisition in 2014, Apartments.com quickly turned into the most popular place to find a place. Proven success at the highest level – and we’re doing it again with the new Homes.com. Homes.com is a CoStar Group company with 20+ years' experience in leading and growing digital marketplaces. We pride ourselves on continually improving, innovating, and setting the standard for property search and marketing experiences. With Homes.com we’re building a brand on the cusp of defining the industry. We’re looking for big thinkers, brave leaders, and creative advertising wizards ready to influence a new age of homebuying within a tried-and-true, award-winning company. Learn more about Homes.com . Homes.com is growing quickly and we’re looking for a Data Engineer to help accelerate our growth. This role will be responsible for helping build out sitewide tracking architecture on Homes.com and then feeding that data into user-friendly KPI dashboards which track site performance and product usage and provide day-to-day insights into consumer behavior. This individual will help build and deliver the data engineering architecture for Homes.com and work across all departments to provide analysis and insights for future growth. You will be part of various aspects of our data management, ranging from designing and maintaining automated data infrastructure and delivering Data engineering and Analytics solutions to facilitating data access and analysis for key company teams. This position is in Rosslyn, VA and offers a hybrid schedule of 4 days onsite, 1 day remote. Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Data Factory, and other AWS services. Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks. Building and deploying AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and AWS ML to develop predictive models and drive business insights. Understand various data domains and be able to translate them through data transformations to suit various business needs Oversee automated data infrastructure: Collaborate with software engineering and product teams to streamline data tracking in our products. Ability to integrate data from different sources via cross domain data stitch into existing data model Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data. Hands-on data optimization and query performance Liaise with key company teams (DBA, DevOps, SecOps…) for data accessibility and analysis Mentor and manage engineers and analysts in the normal execution of their responsibilities. Successfully implement software development projects to specification and within scheduled timelines and budget parameters Leverage AWS DevOps and CI/CD best practices to automate the deployment, through terraform, and management of data pipelines and infrastructure. Basic Qualifications Bachelor's degree required from an accredited, not-for-profit, in-person college/university A track record of commitment to prior employers 4+ years of hands-on experience in software development, delivering high-quality solutions Strength in Data Engineering, with strong proficiency in Python, PySpark, and SQL Solid foundation in Object-Oriented Programming principles and best practices Demonstrated success in building and launching data-driven products operating at terabyte scale Ability to translate technical requirements into robust architecture, data models, and ETL strategies Practical experience with cloud-based databases, including both relational and non-relational systems Knowledge of business intelligence software (i.e. Power BI or similar tools) Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions. Preferred Qualifications Hands-on experience or familiarity with big data platforms such as Databricks or Snowflake Proficiency with cloud platforms, including AWS or Azure Experience working with NoSQL databases (e.g., DynamoDB) and object storage systems (e.g., Amazon S3) Practical knowledge of event streaming technologies, especially Kafka Strong analytical and problem-solving skills, with the ability to tackle complex technical challenges Experience leveraging AWS compute and container services for scalable solutions What's In It For You? When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed. We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, tuition reimbursement, and an inter-office exchange program. Our benefits package includes (but is not limited to): Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug Life, legal, and supplementary insurance Virtual and in person mental health counseling services for individuals and family Commuter and parking benefits 401(K) retirement plan with matching contributions Employee stock purchase plan Paid time off Tuition reimbursement On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes Access to CoStar Group’s Diversity, Equity, & Inclusion Employee Resource Groups Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.

#LI-KW1

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing #J-18808-Ljbffr CoStar Group

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer II — AI/ML Pipelines on Databricks (Hybrid) in Arlington, VA vacancy
  • A leading data solutions company in Arlington, VA is seeking a Data Engineer II to design and maintain scalable data pipelines. This role requires expertise in Python and SQL, alongside experience...  ...growth. The position offers a hybrid schedule with 4 days onsite and 1... 
    Pipeline
    Remote work

    CoStar Group, Inc.

    Arlington, VA
    3 days ago
  •  ...Lead Data Engineer (Databricks / AI Solutions) – Washington, D.C. (Hybrid) Randstad is seeking a highly skilled Lead Data Engineer to architect and deliver next...  ...architectures Build and optimize complex data pipelines using Python, Scala, or Java Design and... 
    Databricks
    Pipeline

    Staffing the Universe

    Washington DC
    5 days ago
  •  ...Developer Premium II – Agentic Ai Engineer Duration: 6...  ...Washington, DC 20433 Hybrid Onsite: 4 days...  ...and large scale data engineering environments...  ...and agentic AI pipelines aligned with...  ...App Services, and ML Studio. Integrate...  ..., etc.). Use Databricks for data... 
    Databricks
    Pipeline

    Mindlance

    Washington DC
    3 days ago
  • Data Engineer II CoStar Group (NASDAQ: CSGP) is looking for a Data...  ..., VA and offers a hybrid schedule of 4 days onsite...  ...maintain scalable data pipelines and ETL processes using Databricks, Data Factory, and other...  ...Databricks. Build and deploy AI/ML models: integrate... 
    Databricks
    Pipeline
    Immediate start
    Remote work

    CoStar Group, Inc.

    Arlington, VA
    3 days ago
  • $160k - $180k

     ...Data & AI Engineer The Data & AI Engineer sits within Carlyle...  ...and operating the pipelines, semantic layers, retrieval...  ...store integrations, hybrid search, re-ranking, and...  ..., analytics, or AI/ML are preferred Professional...  ...(e.g., AWS Bedrock, Databricks ML, Snowflake Cortex,... 
    Databricks
    Pipeline
    Work at office

    Carlyle Group

    Washington DC
    3 days ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI Industry/...  ...and analytics engineering focus on leveraging...  ...advanced AI and ML solutions to drive...  ...production-grade RAG pipelines, MCP connections,...  ...Snowflake or Databricks Experience working...  ...application deadlines: #LI-Hybrid... 
    Databricks
    Pipeline
    Full time
    H1b

    PwC

    Washington DC
    1 day ago
  • Visual Lease is seeking a Data Engineer II in Arlington, Virginia, to design and implement scalable data pipelines and maintain data infrastructure. The role requires strong...  ...to build processes using AWS services like Databricks. The candidate will work collaboratively... 
    Databricks
    Pipeline

    Visual Lease

    Arlington, VA
    11 hours ago
  • $152k - $188k

     ...As Sr. Data Engineer II , you’ll work with a cross-functional team to help design...  ...What you’ll do: Work with AI team members to operationalize data pipelines and ML tasks. Provide day-to-day...  ...following technologies: Cloudera, DataBricks, Snowflake, NiFi, Python, SQL,... 
    Databricks
    Pipeline
    Full time
    Work experience placement
    Local area
    Flexible hours

    MetroStar Corporation

    Vienna, VA
    1 day ago
  •  ...Redhorse) is seeking an exceptional Data Engineer to build and maintain the ETL pipeline supporting the development of...  ...establishing and continuously improving an AI/ML analytics platform that aims to...  ...and/or PySpark. Experience with Databricks Experience with preparing data... 
    Databricks
    Pipeline
    Remote job

    Redhorse Corporation

    Falls Church, VA
    1 day ago
  • $149k - $223k

     ...Description: We are seeking an AI and Data Governance Engineer to join our team. The AI...  .... Develop and maintain pipelines to: Synchronize...  ...warehouses/lakes, e.g., Snowflake, Databricks, BigQuery, Redshift,...  ...and concepts AI / ML governance, model registries... 
    Databricks
    Pipeline
    Temporary work
    Work at office

    Holland & Knight

    Washington DC
    3 days ago
  • $85.45k - $158.32k

     ...reassignment/promotion to Data Scientist - AI Engineer position in the Research and...  ...and artificial intelligence pipelines. Graph Architecture...  ...data management tools (e.g., Databricks, Jupyter, Copilot Studio, or...  ...resume. Business Requirements & ML Translation: Ability to... 
    Databricks
    Pipeline
    Work at office
    Remote work
    Flexible hours

    Office of the Inspector General, USPS

    Arlington, VA
    2 days ago
  • $126k

     ...About the team: The ML Data Engineering team powers metadata extraction...  ...a Software Engineer II with strong backend...  ...into production pipelines and deliver impactful,...  ...cutting‑edge generative AI and metadata enrichment...  ...Ruby on Rails, Airflow, Databricks, Spark, APIs, AWS (... 
    Databricks
    Pipeline
    Local area
    Worldwide
    Home office
    Flexible hours

    Scribd, Inc.

    Washington DC
    7 days ago
  •  ...Senior Data Engineer (Labs) Ignite Digital enables...  ...solutions and AI integration for faster...  ...scale modern data pipelines, data models,...  ...Experience supporting AI/ML-enabled analytics...  ...with Snowflake, Databricks, or other data AI...  ..., CA Schedule: Hybrid 1-4 days a week onsite... 
    Databricks
    Pipeline
    For contractors
    Work at office
    1 day per week

    Ignite Digital Services

    Washington DC
    5 days ago
  • $89.26k - $151.74k

     ...Description We are seeking a Data Engineer to support federal...  ...experience with AWS, Databricks, and Python, along...  ..., including data pipelines, transformation, and data...  ...Location This is a hybrid role which may require...  ...Coverage Act. Candidate AI Usage Policy At ICF... 
    Databricks
    Pipeline
    Full time
    Contract work
    Work experience placement

    ICF

    Washington DC
    3 days ago
  • $128.25k - $266.88k

     ...Yahoo Consumer Data Team Position Yahoo serves...  ...some of the brightest engineers you have known to improve...  ...candidate will have strong AI/ML experience to design,...  ...optimize scalable data pipelines and infrastructure that...  ..., we offer flexible hybrid work options that our employees... 
    Pipeline
    Work at office
    Flexible hours

    Yahoo

    Washington DC
    1 day ago
  • Job Title: Data Engineer Location(s): Arlington,...  ...AREA) Workplace: Hybrid Clearance Required...  ...Requisition Type: Pipeline - this is not a current...  ...engineering and ML pipelines using...  ...such as R Shiny, Databricks, AWS, Azure Familiarity...  ...with the help of AI. #J-18808-Ljbffr... 
    Databricks
    Pipeline
    Full time
    For contractors
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Elder Research

    Arlington, VA
    4 days ago
  • $110k - $180k

     ...Virginia Work Schedule: Hybrid; candidates should be...  ...is seeking a Data Engineer to support a large-scale...  ...optimize scalable data pipelines and data products that...  ...-on experience with Databricks, PySpark, Python, SQL,...  ...reporting, analytics, and AI/ML data preparation... 
    Databricks
    Pipeline
    Flexible hours
    2 days per week
    3 days per week

    Intellitech Corporation

    Arlington, VA
    1 day ago
  • $140k - $220k

     ...through advanced engineering, digital transformation...  ...a Distinguished AI/ML Engineer to serve...  ...complex mission data into trusted, explainable...  ..., standing up ML pipelines, and integrating...  ...and integrate hybrid AI systems that combine...  ...pipelines using Databricks, Spark, Flink, or... 
    Databricks
    Pipeline
    Full time
    Remote work

    Frontier Technology

    Washington DC
    2 days ago
  •  ...as a Senior Principal Engineer for Azure Data as a Service (DaaS) and Azure AI Infrastructure team. The...  ...Synapse, Data Factory, Databricks, and ADLS Gen2. Advanced...  ...using Azure Pipelines and/or terraform. Desired...  ...Projects. Exposure to AI/ML platform enablement or... 
    Databricks
    Pipeline
    Internship
    Monday to Friday

    Navy Federal Credit Union

    Vienna, VA
    1 day ago
  • $150k - $170k

     ...management group in Washington, DC is seeking a Data Engineer II to enhance their data engineering...  ...involves building and maintaining data pipelines that support critical business...  ...00, along with excellent benefits in a hybrid work environment. #J-18808-Ljbffr Alphataraxia... 
    Pipeline

    Alphataraxia Management LP

    Washington DC
    1 day ago
  •  ...with modern digital, data, and cloud...  ...are seeking a Data Engineering Manager. This role...  ...data platforms and pipelines for internal initiatives...  ..., reporting, and AI/ML use cases....  ...cloud native and hybrid data platforms, IaaC...  ...Python, SQL, Spark, Databricks, Airflow or equivalent... 
    Databricks
    Pipeline
    Full time
    Contract work
    Part time
    Local area
    Immediate start
    Flexible hours

    Serco

    Washington DC
    3 days ago
  •  ...Senior Cloud Security Engineer to work in our...  ...a massive hybrid ecosystem comprising...  ...protect our assets, data, and identity fabric...  ...from SIEM and Databricks to detect and block...  ...across all tenants. AI/ML Security...  ...Databricks training pipelines from data poisoning... 
    Databricks
    Pipeline
    Work at office

    ECS Limited

    Falls Church, VA
    3 days ago
  • $180k - $200k

     ...investment firm in Washington, DC is looking for a Data Engineer to create robust data pipelines for their ML team. The ideal candidate will possess...  ...data solutions, work with tools like Databricks, and lead projects involving AI technologies. This position offers an annual... 
    Databricks
    Pipeline

    The Carlyle Group

    Washington DC
    1 day ago
  • $135k - $165k

    Macalogic is seeking a Data Engineer to provide support to the Department of Commerce in Washington...  ...will design, maintain, and optimize data pipelines, ETL workflows, and cloud data services to support AI initiatives. This hybrid role requires strong data engineering... 
    Pipeline

    Macalogic

    Washington DC
    11 hours ago
  •  ...Cloud Security Engineer/Architect Tier One Technologies...  ...client. This hybrid Contract-to-Hire...  ...micro-segmentation, and data encryption across AWS...  ...virtualized environments. AI/ML Security Governance (...  ...includes protecting Databricks training pipelines from data poisoning... 
    Databricks
    Pipeline
    Permanent employment
    Contract work
    Immediate start

    A.C.Coy Company

    Falls Church, VA
    3 days ago
  •  ...Data Engineer Washington DC (Day1 onsite) Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark Implement complex data transformations...  ...reporting, analytics, and AI/ML use cases Collaborate with... 
    Databricks
    Pipeline

    Yantran LLC

    Washington DC
    3 days ago
  • $120k

     ...Description Data Engineer - Databricks, PySpark Talent Pool for upcoming assignments Remote...  ...scalable, production-grade data pipelines. Develop and optimize ETL/ELT workflows...  ...Experience in data engineering, AI/ML, analytics, or software development roles... 
    Databricks
    Pipeline
    Remote work
    Work from home

    Orchard , CO

    Washington DC
    1 day ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI Industry/...  ...and analytics engineering focus on leveraging...  ...advanced AI and ML solutions to drive...  ...experience building RAG pipelines or agentic AI...  ...Snowflake or Databricks The salary range...  ...application deadlines: #LI-Hybrid... 
    Databricks
    Pipeline
    Full time
    H1b

    PwC

    Washington DC
    4 days ago
  • $90k - $110k

     ...Data Engineer Washington DC (Day1 onsite) The pay range for this role...  ...develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark Implement complex...  ...reporting, analytics, and AI/ML use cases Collaborate with cross... 
    Databricks
    Pipeline

    Yochana

    Washington DC
    3 days ago
  •  ...Lead Data Engineer (Databricks & AI) Location: Washington, DC (Onsite) Key Responsibilities Technical Leadership: Lead the end-to-end...  ...excellence through code reviews and skills development. Pipeline & Model Delivery: Oversee the construction of complex... 
    Databricks
    Pipeline

    Staffing the Universe

    Washington DC
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer II — AI/ML Pipelines on Databricks (Hybrid). Be the first to apply!