- Добавил: literator
- Дата: 30-11-2023, 17:00
- Комментариев: 0
Название: Dirty Data Processing for Machine LearningАвтор: Zhixin Qi, Hongzhi Wang, Zejiao Dong
Издательство: Springer
Год: 2024
Страниц: 141
Язык: английский
Формат: pdf
Размер: 10.2 MB
In both the database and Machine Learning communities, data quality has become a serious issue which cannot be ignored. In this context, we refer to data with quality problems as “dirty data.” Clearly, for a given data mining or Machine Learning task, dirty data in both training and test datasets can affect the accuracy of results. Accordingly, this book analyzes the impacts of dirty data and explores effective methods for dirty data processing. Although existing data cleaning methods improve data quality dramatically, the cleaning costs are still high. If we knew how dirty data affected the accuracy of Machine Learning models, we could clean data selectively according to the accuracy requirements instead of cleaning all dirty data, which entails substantial costs. However, no book to date has studied the impacts of dirty data on Machine Learning models in terms of data quality. Filling precisely this gap, the book is intended for a broad audience ranging from researchers in the database and Machine Learning communities to industry practitioners. Readers will find valuable takeaway suggestions on: model selection and data cleaning; incomplete data classification with view-based decision trees; density-based clustering for incomplete data; the feature selection method, which reduces the time costs and guarantees the accuracy of Machine Learning models; and cost-sensitive decision tree induction approaches under different scenarios.
