About the Client:
The client is one of the largest debt management companies in Europe, on a mission to help our customers take control of their debt. The client was founded in 2015 following the merger of the UK and German market leaders
Challenge:
The customer struggled with several challenges. The current process for selecting samples and feature engineering involves working with over 50 source tables from various SQL databases, SAS datasets, and Excel files, which, with query development, execution, and contingency planning, would take up to four weeks to complete. Additionally, inconsistent primary keys and column naming conventions require in-depth knowledge of each table.
The current process relies on over 30+ SAS Macros, which output data that must be joined manually, resulting in ad-hoc runs that can take anywhere from 5 minutes to 10 hours per macro for just a month of data.
The customer also needed one view of client credit and debit data and a snapshot of the current ID and data backdated. Since historic records were not captured, a complete picture of how consumers looked in the past was impossible.
Brillio’s Solution:
Brillio leveraged Azure Data Lake and Databricks to build a data lake house and design and build ML data engineering products. We implemented Databricks MLFlow and Azure ML to capture machine learning experiments, model runs, and results and leveraged it as a model registry to store, manage, and load models in production. Additionally, Databricks MLFLow and DevOps were leveraged to build MLOps pipelines to automate ML product integration and deployment across the organizations. The key highlights of the solution include,
Business Impact:
Following Brillio’s implementation, the client managed:
