brillio-logo brillio-dark-logo
  • Services
    Services
    • Customer Experience Transformation​ Data and AI
    • Product and Platform Engineering Digital Transformation Consulting
    • Infrastructure, Cloud and Security Design & Content
  • Industries
    Industries
    • Banking, Financial Services and Insurance Life Sciences
    • Telecom and Media Healthcare
    • Hi-Tech​ Retail, Consumer Goods & Distribution
  • AI Studio
  • Our Approach
  • Insights
  • About Us
    About Us
    • Who We Are Leadership
    • Partnerships Sustainability
    • Awards & Recognition Newsroom
  • Careers
  • Contact Us
  • Search
    • Global
    • Mexico Mexico
    • Romania Romania
    • United-Kingdom United Kingdom
Close menu logo logo
Search

  • Customer Experience Transformation​
  • Data and AI
  • Product and Platform Engineering
  • Digital Transformation Consulting
  • Infrastructure, Cloud and Security
  • Design & Content
  • Banking, Financial Services and Insurance
  • Life Sciences
  • Telecom and Media
  • Healthcare
  • Hi-Tech​
  • Retail, Consumer Goods & Distribution
  • Who We Are
  • Leadership
  • Partnerships
  • Sustainability
  • Awards & Recognition
  • Newsroom
    • Global
    • Mexico Mexico
    • Romania Romania
    • United-Kingdom United Kingdom

    Close menu
    • Search
    • Frequently Searched

      Artificial Intelligence Generative AI Responsible AI Data Analytics Machine Learning
    • Related results

      Artificial Intelligence Generative AI Responsible AI Data Analytics Machine Learning
☰ logo logo
background-image
  1. Home
  2. Insights
  3. End-to-End ML Enablement with Azure, Databricks and DevOps
end-to-end ml enablement

Case Study | Technology

End-to-End ML Enablement with Azure, Databricks and DevOps

element

About the Client:

The client is one of the largest debt management companies in Europe, on a mission to help our customers take control of their debt. The client was founded in 2015 following the merger of the UK and German market leaders

Challenge:

The customer struggled with several challenges. The current process for selecting samples and feature engineering involves working with over 50 source tables from various SQL databases, SAS datasets, and Excel files, which, with query development, execution, and contingency planning, would take up to four weeks to complete. Additionally, inconsistent primary keys and column naming conventions require in-depth knowledge of each table.

The current process relies on over 30+ SAS Macros, which output data that must be joined manually, resulting in ad-hoc runs that can take anywhere from 5 minutes to 10 hours per macro for just a month of data.

The customer also needed one view of client credit and debit data and a snapshot of the current ID and data backdated. Since historic records were not captured, a complete picture of how consumers looked in the past was impossible.

Brillio’s Solution:

Brillio leveraged Azure Data Lake and Databricks to build a data lake house and design and build ML data engineering products. We implemented Databricks MLFlow and Azure ML to capture machine learning experiments, model runs, and results and leveraged it as a model registry to store, manage, and load models in production. Additionally, Databricks MLFLow and DevOps were leveraged to build MLOps pipelines to automate ML product integration and deployment across the organizations. The key highlights of the solution include,

  • Implementation of “Sample Selector”, which provides data scientists with pre-built datasets for the most used sources for training testing and validation purposes.

  • Addition of feature stores on Delta Lake that calculate the state and maintain different features over time. Addition of the ability to enable time travel or retro capabilities based on changes in data sources.

  • Deployment of production-ready models in batch and API-based scoring
  • Implementation of Azure DevOps pipelines to manage the release of models into production, including deployment to AKS.
  • Implementation of model validation and data validation notebooks orchestrated by ADF and Databricks post-model score generation or at specific intervals to check score and data correctness.

Business Impact:

Following Brillio’s implementation, the client managed:

  • 90% reduced query execution time on a like-for-like basis by performing sample selection using six aggregated tables, combining source data with consistent primary keys and naming conventions.

  • Faster run times by enabling users to join tables directly, filter queries at the source, and extract only the required data for sample selection.

  • Update data in each feature store family individually across historical data as old as 20+ years with a cumulative run time of 4 hours.

  • Empower the client with multiple views of the consumer credit and debit data and a full view of historic IDs and data and data backdated.

  • Capture and include restated records by keeping historical retros.

  • Align internal processes by linking internal data with external credit and debit bureau data.

  Download Now

Forward-looking thoughts and compelling stories

Blog

Technology

Six ways CX intermediaries are reshaping customer experience
NETWORK & TELECOM

Case Study

Technology

Overhauling UX with a tailored design system for network & customer management software
Website Banner Composable Enterprises

Thought leadership

Technology

Master the art of building a composable enterprise

You define the north star,
We pave the digital path

Let’s Connect
logo logo

info@brillio.com

  • Follow Brillio on Twitter
  • Follow Brillio on Linkedin
  • Follow Brillio on Facebook
  • Follow Brillio on Instagram

Services

  • Customer Experience Transformation​
  • Data and AI
  • Product and Platform Engineering
  • Digital Transformation Consulting
  • Infrastructure, Cloud and Security
  • Design & Content

Industries

  • Banking, Financial Services and Insurance
  • Life Sciences
  • Telecom and Media
  • Healthcare
  • Hi-Tech​
  • Retail, Consumer Goods & Distribution
  • Insights
  • Our Approach
  • About Us
  • Partnerships
  • Contact Us
  • Careers
  • Our Locations

© 2025 Brillio All rights reserved

  • Privacy Policy
  • Terms of use
  • Carbon Accounting Report