Analysis of Transformer Model Applications
dc.contributor.author | Cabrera-Bermejo, M. I. | |
dc.contributor.author | Del Jesus, M. J. | |
dc.contributor.author | Rivera, A. J. | |
dc.contributor.author | Elizondo, David | |
dc.contributor.author | Charte, F. | |
dc.contributor.author | Perez-Godoy, Maria Dolores | |
dc.date.accessioned | 2023-12-15T14:16:14Z | |
dc.date.available | 2023-12-15T14:16:14Z | |
dc.date.issued | 2023-08-29 | |
dc.description.abstract | Since the emergence of the Transformer, many variations of the original architecture have been created. Revisions and taxonomies have appeared that group these models from different points of view. However, no review studies the tasks faced according to the type of data used. In this paper, the modifications applied to Transformers to work with different input data (text, image, video, etc.) and to solve disparate problems are analysed. Building on the foundations of existing taxonomies, this work proposes a new one that relates input data types to applications. The study shows open challenges and can serve as a guideline for the development of Transformer networks for specific applications with different types of data by observing development trends. | |
dc.funder | No external funder | |
dc.identifier.citation | Cabrera-Bermejo, M.I., Del Jesus, M.J., Rivera, A.J., Elizondo, D., Charte, F., Pérez-Godoy, M.D. (2023) Analysis of Transformer Model Applications. In: García Bringas, P., et al. Hybrid Artificial Intelligent Systems. HAIS 2023. Lecture Notes in Computer Science, 14001. Springer, https://doi.org/10.1007/978-3-031-40725-3_20 | |
dc.identifier.doi | https://doi.org/10.1007/978-3-031-40725-3_20 | |
dc.identifier.isbn | 9783031407246 | |
dc.identifier.uri | https://hdl.handle.net/2086/23400 | |
dc.language.iso | en | |
dc.peerreviewed | Yes | |
dc.publisher | Springer | |
dc.relation.ispartofseries | International Conference on Hybrid Artificial Intelligence Systems | |
dc.researchinstitute | Institute of Artificial Intelligence (IAI) | |
dc.title | Analysis of Transformer Model Applications | |
dc.type | Conference |
Files
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- license.txt
- Size:
- 4.2 KB
- Format:
- Item-specific license agreed upon to submission
- Description: