Data Engineer II — AI/ML Pipelines on Databricks (Hybrid)
CoStar Group
Data Engineer II Job Description CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate. Homes.com Homes.com is already one of the fastest growing real estate portals in the industry, we are driven to be #1. Just ask Brad Bellflower, Chief Change Officer at Apartments.com. After its acquisition in 2014, Apartments.com quickly turned into the most popular place to find a place. Proven success at the highest level – and we’re doing it again with the new Homes.com. Homes.com is a CoStar Group company with 20+ years' experience in leading and growing digital marketplaces. We pride ourselves on continually improving, innovating, and setting the standard for property search and marketing experiences. With Homes.com we’re building a brand on the cusp of defining the industry. We’re looking for big thinkers, brave leaders, and creative advertising wizards ready to influence a new age of homebuying within a tried-and-true, award-winning company. Learn more about Homes.com . Homes.com is growing quickly and we’re looking for a Data Engineer to help accelerate our growth. This role will be responsible for helping build out sitewide tracking architecture on Homes.com and then feeding that data into user-friendly KPI dashboards which track site performance and product usage and provide day-to-day insights into consumer behavior. This individual will help build and deliver the data engineering architecture for Homes.com and work across all departments to provide analysis and insights for future growth. You will be part of various aspects of our data management, ranging from designing and maintaining automated data infrastructure and delivering Data engineering and Analytics solutions to facilitating data access and analysis for key company teams. This position is in Rosslyn, VA and offers a hybrid schedule of 4 days onsite, 1 day remote. Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Data Factory, and other AWS services. Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks. Building and deploying AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and AWS ML to develop predictive models and drive business insights. Understand various data domains and be able to translate them through data transformations to suit various business needs Oversee automated data infrastructure: Collaborate with software engineering and product teams to streamline data tracking in our products. Ability to integrate data from different sources via cross domain data stitch into existing data model Develop and maintain secure data warehouses and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data. Hands-on data optimization and query performance Liaise with key company teams (DBA, DevOps, SecOps…) for data accessibility and analysis Mentor and manage engineers and analysts in the normal execution of their responsibilities. Successfully implement software development projects to specification and within scheduled timelines and budget parameters Leverage AWS DevOps and CI/CD best practices to automate the deployment, through terraform, and management of data pipelines and infrastructure. Basic Qualifications Bachelor's degree required from an accredited, not-for-profit, in-person college/university A track record of commitment to prior employers 4+ years of hands-on experience in software development, delivering high-quality solutions Strength in Data Engineering, with strong proficiency in Python, PySpark, and SQL Solid foundation in Object-Oriented Programming principles and best practices Demonstrated success in building and launching data-driven products operating at terabyte scale Ability to translate technical requirements into robust architecture, data models, and ETL strategies Practical experience with cloud-based databases, including both relational and non-relational systems Knowledge of business intelligence software (i.e. Power BI or similar tools) Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions. Preferred Qualifications Hands-on experience or familiarity with big data platforms such as Databricks or Snowflake Proficiency with cloud platforms, including AWS or Azure Experience working with NoSQL databases (e.g., DynamoDB) and object storage systems (e.g., Amazon S3) Practical knowledge of event streaming technologies, especially Kafka Strong analytical and problem-solving skills, with the ability to tackle complex technical challenges Experience leveraging AWS compute and container services for scalable solutions What's In It For You? When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed. We offer you generous compensation and performance-based incentives. CoStar Group also invests in your professional and academic growth with internal training, tuition reimbursement, and an inter-office exchange program. Our benefits package includes (but is not limited to): Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug Life, legal, and supplementary insurance Virtual and in person mental health counseling services for individuals and family Commuter and parking benefits 401(K) retirement plan with matching contributions Employee stock purchase plan Paid time off Tuition reimbursement On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes Access to CoStar Group’s Diversity, Equity, & Inclusion Employee Resource Groups Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.
#LI-KW1
CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing #J-18808-Ljbffr CoStar Group- A leading data solutions company in Arlington, VA is seeking a Data Engineer II to design and maintain scalable data pipelines. This role requires expertise in Python and SQL, alongside experience... ...growth. The position offers a hybrid schedule with 4 days onsite and 1...PipelineRemote work
- ...Lead Data Engineer (Databricks / AI Solutions) – Washington, D.C. (Hybrid) Randstad is seeking a highly skilled Lead Data Engineer to architect and deliver next... ...architectures Build and optimize complex data pipelines using Python, Scala, or Java Design and...DatabricksPipeline
- ...Developer Premium II – Agentic Ai Engineer Duration: 6... ...Washington, DC 20433 Hybrid Onsite: 4 days... ...and large scale data engineering environments... ...and agentic AI pipelines aligned with... ...App Services, and ML Studio. Integrate... ..., etc.). Use Databricks for data...DatabricksPipeline
- Data Engineer II CoStar Group (NASDAQ: CSGP) is looking for a Data... ..., VA and offers a hybrid schedule of 4 days onsite... ...maintain scalable data pipelines and ETL processes using Databricks, Data Factory, and other... ...Databricks. Build and deploy AI/ML models: integrate...DatabricksPipelineImmediate startRemote work
$160k - $180k
...Data & AI Engineer The Data & AI Engineer sits within Carlyle... ...and operating the pipelines, semantic layers, retrieval... ...store integrations, hybrid search, re-ranking, and... ..., analytics, or AI/ML are preferred Professional... ...(e.g., AWS Bedrock, Databricks ML, Snowflake Cortex,...DatabricksPipelineWork at office$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/... ...and analytics engineering focus on leveraging... ...advanced AI and ML solutions to drive... ...production-grade RAG pipelines, MCP connections,... ...Snowflake or Databricks Experience working... ...application deadlines: #LI-Hybrid...DatabricksPipelineFull timeH1b- Visual Lease is seeking a Data Engineer II in Arlington, Virginia, to design and implement scalable data pipelines and maintain data infrastructure. The role requires strong... ...to build processes using AWS services like Databricks. The candidate will work collaboratively...DatabricksPipeline
$152k - $188k
...As Sr. Data Engineer II , you’ll work with a cross-functional team to help design... ...What you’ll do: Work with AI team members to operationalize data pipelines and ML tasks. Provide day-to-day... ...following technologies: Cloudera, DataBricks, Snowflake, NiFi, Python, SQL,...DatabricksPipelineFull timeWork experience placementLocal areaFlexible hours- ...Redhorse) is seeking an exceptional Data Engineer to build and maintain the ETL pipeline supporting the development of... ...establishing and continuously improving an AI/ML analytics platform that aims to... ...and/or PySpark. Experience with Databricks Experience with preparing data...DatabricksPipelineRemote job
$149k - $223k
...Description: We are seeking an AI and Data Governance Engineer to join our team. The AI... .... Develop and maintain pipelines to: Synchronize... ...warehouses/lakes, e.g., Snowflake, Databricks, BigQuery, Redshift,... ...and concepts AI / ML governance, model registries...DatabricksPipelineTemporary workWork at office$85.45k - $158.32k
...reassignment/promotion to Data Scientist - AI Engineer position in the Research and... ...and artificial intelligence pipelines. Graph Architecture... ...data management tools (e.g., Databricks, Jupyter, Copilot Studio, or... ...resume. Business Requirements & ML Translation: Ability to...DatabricksPipelineWork at officeRemote workFlexible hours$126k
...About the team: The ML Data Engineering team powers metadata extraction... ...a Software Engineer II with strong backend... ...into production pipelines and deliver impactful,... ...cutting‑edge generative AI and metadata enrichment... ...Ruby on Rails, Airflow, Databricks, Spark, APIs, AWS (...DatabricksPipelineLocal areaWorldwideHome officeFlexible hours- ...Senior Data Engineer (Labs) Ignite Digital enables... ...solutions and AI integration for faster... ...scale modern data pipelines, data models,... ...Experience supporting AI/ML-enabled analytics... ...with Snowflake, Databricks, or other data AI... ..., CA Schedule: Hybrid 1-4 days a week onsite...DatabricksPipelineFor contractorsWork at office1 day per week
$89.26k - $151.74k
...Description We are seeking a Data Engineer to support federal... ...experience with AWS, Databricks, and Python, along... ..., including data pipelines, transformation, and data... ...Location This is a hybrid role which may require... ...Coverage Act. Candidate AI Usage Policy At ICF...DatabricksPipelineFull timeContract workWork experience placement$128.25k - $266.88k
...Yahoo Consumer Data Team Position Yahoo serves... ...some of the brightest engineers you have known to improve... ...candidate will have strong AI/ML experience to design,... ...optimize scalable data pipelines and infrastructure that... ..., we offer flexible hybrid work options that our employees...PipelineWork at officeFlexible hours- Job Title: Data Engineer Location(s): Arlington,... ...AREA) Workplace: Hybrid Clearance Required... ...Requisition Type: Pipeline - this is not a current... ...engineering and ML pipelines using... ...such as R Shiny, Databricks, AWS, Azure Familiarity... ...with the help of AI. #J-18808-Ljbffr...DatabricksPipelineFull timeFor contractorsWork at officeImmediate startRemote workFlexible hours
$110k - $180k
...Virginia Work Schedule: Hybrid; candidates should be... ...is seeking a Data Engineer to support a large-scale... ...optimize scalable data pipelines and data products that... ...-on experience with Databricks, PySpark, Python, SQL,... ...reporting, analytics, and AI/ML data preparation...DatabricksPipelineFlexible hours2 days per week3 days per week$140k - $220k
...through advanced engineering, digital transformation... ...a Distinguished AI/ML Engineer to serve... ...complex mission data into trusted, explainable... ..., standing up ML pipelines, and integrating... ...and integrate hybrid AI systems that combine... ...pipelines using Databricks, Spark, Flink, or...DatabricksPipelineFull timeRemote work- ...as a Senior Principal Engineer for Azure Data as a Service (DaaS) and Azure AI Infrastructure team. The... ...Synapse, Data Factory, Databricks, and ADLS Gen2. Advanced... ...using Azure Pipelines and/or terraform. Desired... ...Projects. Exposure to AI/ML platform enablement or...DatabricksPipelineInternshipMonday to Friday
$150k - $170k
...management group in Washington, DC is seeking a Data Engineer II to enhance their data engineering... ...involves building and maintaining data pipelines that support critical business... ...00, along with excellent benefits in a hybrid work environment. #J-18808-Ljbffr Alphataraxia...Pipeline- ...with modern digital, data, and cloud... ...are seeking a Data Engineering Manager. This role... ...data platforms and pipelines for internal initiatives... ..., reporting, and AI/ML use cases.... ...cloud native and hybrid data platforms, IaaC... ...Python, SQL, Spark, Databricks, Airflow or equivalent...DatabricksPipelineFull timeContract workPart timeLocal areaImmediate startFlexible hours
- ...Senior Cloud Security Engineer to work in our... ...a massive hybrid ecosystem comprising... ...protect our assets, data, and identity fabric... ...from SIEM and Databricks to detect and block... ...across all tenants. AI/ML Security... ...Databricks training pipelines from data poisoning...DatabricksPipelineWork at office
$180k - $200k
...investment firm in Washington, DC is looking for a Data Engineer to create robust data pipelines for their ML team. The ideal candidate will possess... ...data solutions, work with tools like Databricks, and lead projects involving AI technologies. This position offers an annual...DatabricksPipeline$135k - $165k
Macalogic is seeking a Data Engineer to provide support to the Department of Commerce in Washington... ...will design, maintain, and optimize data pipelines, ETL workflows, and cloud data services to support AI initiatives. This hybrid role requires strong data engineering...Pipeline- ...Cloud Security Engineer/Architect Tier One Technologies... ...client. This hybrid Contract-to-Hire... ...micro-segmentation, and data encryption across AWS... ...virtualized environments. AI/ML Security Governance (... ...includes protecting Databricks training pipelines from data poisoning...DatabricksPipelinePermanent employmentContract workImmediate start
- ...Data Engineer Washington DC (Day1 onsite) Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark Implement complex data transformations... ...reporting, analytics, and AI/ML use cases Collaborate with...DatabricksPipeline
$120k
...Description Data Engineer - Databricks, PySpark Talent Pool for upcoming assignments Remote... ...scalable, production-grade data pipelines. Develop and optimize ETL/ELT workflows... ...Experience in data engineering, AI/ML, analytics, or software development roles...DatabricksPipelineRemote workWork from home$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/... ...and analytics engineering focus on leveraging... ...advanced AI and ML solutions to drive... ...experience building RAG pipelines or agentic AI... ...Snowflake or Databricks The salary range... ...application deadlines: #LI-Hybrid...DatabricksPipelineFull timeH1b$90k - $110k
...Data Engineer Washington DC (Day1 onsite) The pay range for this role... ...develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark Implement complex... ...reporting, analytics, and AI/ML use cases Collaborate with cross...DatabricksPipeline- ...Lead Data Engineer (Databricks & AI) Location: Washington, DC (Onsite) Key Responsibilities Technical Leadership: Lead the end-to-end... ...excellence through code reviews and skills development. Pipeline & Model Delivery: Oversee the construction of complex...DatabricksPipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer II — AI/ML Pipelines on Databricks (Hybrid). Be the first to apply!
- bi data engineer Arlington, VA
- data visualization developer Arlington, VA
- data science developer Arlington, VA
- senior data center engineer Arlington, VA
- sr information security engineer Arlington, VA
- junior big data engineer Arlington, VA
- entry level big data engineer Arlington, VA
- data engineer contract Arlington, VA
- aws data engineer Arlington, VA
- data engineer manager Arlington, VA

