Comparison of Automated Machine Learning Tools for SMS Spam Message Filtering

Simple item page
dc.contributor.authorSaeed, Waddah
dc.date.accessioned2024-10-15T14:01:10Z
dc.date.available2024-10-15T14:01:10Z
dc.date.issued2021
dc.description.abstractShort Message Service (SMS) is a very popular service used for communication by mobile users. However, this popular service can be abused by executing illegal activities and influencing security risks. Nowadays, many automatic machine learning (AutoML) tools exist which can help domain experts and lay users to build high-quality ML models with little or no machine learning knowledge. In this work, a classification performance comparison was conducted between three automatic ML tools for SMS spam message filtering. These tools are mljar-supervised AutoML, H2O AutoML, and Tree-based Pipeline Optimization Tool (TPOT) AutoML. Experimental results showed that ensemble models achieved the best classification performance. The Stacked Ensemble model, which was built using H2O AutoML, achieved the best performance in terms of Log Loss (0.8370), true positive (1088/1116), and true negative (281/287) metrics. There is a 19.05% improvement in Log Loss with respect to TPOT AutoML and 5.56% improvement with respect to mljar-supervised AutoML. The satisfactory filtering performance achieved with AutoML tools provides a potential application for AutoML tools to automatically determine the best ML model that can perform best for SMS spam message filtering.
dc.funderNo external funder
dc.identifier.citationSaeed, W. (2021) Comparison of Automated Machine Learning Tools for SMS Spam Message Filtering. In: Abdullah, N., Manickam, S., Anbar, M. (eds) Advances in Cyber Security. ACeS 2021. Communications in Computer and Information Science, 1487. Springer, Singapore.
dc.identifier.doihttps://doi.org/10.1007/978-981-16-8059-5_18
dc.identifier.isbn9789811680588
dc.identifier.isbn9789811680595
dc.identifier.issn1865-0929
dc.identifier.issn1865-0937
dc.identifier.urihttps://hdl.handle.net/2086/24315
dc.language.isoen
dc.publisherSpringer
dc.relation.ispartofCommunications in Computer and Information Science
dc.relation.ispartofAdvances in Cyber Security
dc.titleComparison of Automated Machine Learning Tools for SMS Spam Message Filtering
dc.typeBook chapter

Files

License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
4.2 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

School of Computer Science and Informatics