Active Learning for Data Quality Control: A Survey

Open Access
Authors
Publication date 06-2024
Journal Journal of Data and Information Quality
Article number 11
Volume | Issue number 16 | 2
Number of pages 45
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Data quality plays a vital role in scientific research and decision-making across industries. Thus, it is crucial to incorporate the data quality control (DQC) process, which comprises various actions and operations to detect and correct data errors. The increasing adoption of machine learning (ML) techniques in different domains has raised concerns about data quality in the ML field. Conversely, ML’s capability to uncover complex patterns makes it suitable for addressing challenges involved in the DQC process. However, supervised learning methods demand abundant labeled data, while unsupervised learning methods heavily rely on the underlying distribution of the data. Active learning (AL) provides a promising solution by proactively selecting data points for inspection, thus reducing the burden of data labeling for domain experts. Therefore, this survey focuses on applying AL to DQC. Starting with a review of common data quality issues and solutions in the ML field, we aim to enhance the understanding of current quality assessment methods. We then present two scenarios to illustrate the adoption of AL into the DQC systems on the anomaly detection task, including pool-based and stream-based approaches. Finally, we provide the remaining challenges and research opportunitie
Document type Article
Language English
Published at https://doi.org/10.1145/3663369
Downloads
Active Learning for Data Quality Control (Final published version)
Permalink to this page
Back