Penerapan Dekomposisi Matriks untuk Reduksi Kompleksitas Komputasi pada Algoritma Machine Learning
DOI:
https://doi.org/10.37859/jf.v16i1.11166
Abstract
The increasing complexity of machine learning algorithms is often accompanied by higher computational costs particularly when dealing with high-dimensional data. This condition poses significant challenges in terms of computational efficiency and resource utilization. One mathematical approach that can address this issue is the application of linear algebra concepts, specifically matrix decomposition techniques. This study aims to apply matrix decomposition methods to reduce computational complexity in machine learning algorithms without significantly degrading model performance. The proposed approach employs matrix decomposition, such as Singular Value Decomposition (SVD), during the data preprocessing and model training stages. The performance of the algorithms is evaluated by comparing their behavior before and after the application of matrix decomposition in terms of computational time, accuracy, and memory efficiency. The experimental results demonstrate that matrix decomposition can significantly reduce computational complexity and improve learning efficiency, while maintaining stable or only slightly reduced accuracy. These findings indicate that matrix decomposition is an effective and practical approach for optimizing machine learning algorithms, particularly for large-scale and high-dimensional datasets.
Downloads
References
S. H. Setiyani, E. Noersasongko, and A. Affandy, “Classification of Breast Cancer Histopathology Images with Attention-Based Multiple Instance Learning Method,” Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, Oct. 2025, doi: 10.22219/kinetik.v10i4.2310.
D. Ayuastina, I. Made, and B. Suksmadana, “Perancangan Model Machine Learning Untuk Pembuatan Aplikasi Rekomendasi Menggunakan Data Pengenalan Wajah,” Jurnal Nasional Komputasi dan Teknologi Informasi (JNKTI), vol. 7, no. 6, p. 2024, 2024, [Online]. Available: https://www.kaggle.com/code/crn4tww/dog-emotions-classifier
K.-L. Du, M. N. S. Swamy, Z.-Q. Wang, and W. H. Mow, “Matrix Factorization Techniques in Machine Learning, Signal Processing, and Statistics,” Mathematics, vol. 11, no. 12, p. 2674, Jun. 2023, doi: 10.3390/math11122674.
V. Atluri, K. Heidary, and J. Bland, “Performance Evaluation of Machine Learning Algorithms in Reduced Dimensional Spaces,” Journal of Cyber Security, vol. 6, no. 1, pp. 69–87, 2024, doi: 10.32604/jcs.2024.051196.
M. Gyimadu and G. Bell, “A Comparative Analysis of Principal Component Analysis (PCA) and Singular Value Decomposition (SVD) as Dimensionality Reduction Techniques,” Apr. 13, 2025, Royal Society of London. doi: 10.1098/rsta.2015.0202.
H. Duong Thi, K. Hoang Manh, V. Trinh Anh, T. Pham Thi Quynh, and T. Nguyen Viet, “Dimensionality Reduction with Truncated Singular Value Decomposition and K-Nearest Neighbors Regression for Indoor Localization,” 2023. [Online]. Available: www.ijacsa.thesai.org
A. I. Nurfauzi and A. T. Wibowo, “Evaluating Non-Negative Matrix Factorization and Singular Value Decomposition for Skincare Recommendation Systems,” Journal on Computing, vol. 9, no. 3, pp. 220–231, 2024, doi: 10.34818/indojc.2024.9.3.983.
Khoerul Rahman and Diny Syarifah Sany, “Linear Algebra for Modern Statistics: Efficiency and Interpretability Challenges in Regression and PCA,” Jurnal Ilmiah Informatika dan Komputer, vol. 2, no. 1, pp. 59–63, Jun. 2025, doi: 10.69533/tsygq116.
M. A. Melgarejo, A. Pérez, D. Ruiz, A. Casas, F. González, and V. González de Lena Alonso, “Implementation of Principal Component Analysis (PCA)/Singular Value Decomposition (SVD) and Neural Networks in Constructing a Reduced-Order Model for Virtual Sensing of Mechanical Stress,” Sensors, vol. 24, no. 24, p. 8065, Dec. 2024, doi: 10.3390/s24248065.
C. Zhang, K. Gai, and S. Zhang, “Matrix normal PCA for interpretable dimension reduction and graphical noise modeling,” Pattern Recognit., vol. 154, p. 110591, Oct. 2024, doi: 10.1016/j.patcog.2024.110591.
R. Katende, “Efficient Matrix Decomposition for High-Dimensional Structured Systems: Theory and Applications,” Sep. 2024, [Online]. Available: http://arxiv.org/abs/2409.06321
B. Jonnalagadda and S. Becker, “Evaluation of data driven low-rank matrix factorization for accelerated solutions of the Vlasov equation,” PLoS One, vol. 20, no. 6, p. e0325304, Jun. 2025, doi: 10.1371/journal.pone.0325304.
R. A. Wahyu Fibriyanti and K. Karyati, “Aplikasi Dekomposisi Nilai Singlar Matriks Quaternion terhadap Perbaikan Citra Low dan High Pass Filtering,” Jurnal Sains Dasar, vol. 11, no. 1, pp. 7–15, May 2022, doi: 10.21831/jsd.v11i1.41951.
R. Agustin Wahyu Fibriyanti, “APLIKASI DEKOMPOSISI NILAI SINGULAR MATRIKS QUATERNION TERHADAP PERBAIKAN CITRA LOW DAN HIGH PASS FILTERING APPLICATION OF QUATERNION MATRIX SINGULAR VALUE DECOMPOSITION ON LOW AND HIGH PASS FILTERING,” 2022.
A. Z. Prayogo et al., “Komparasi Metode Dekomposisi Matriks Menilai Kelebihan dan Kekurangan SVD, QR, dan LU dalam Aplikasi Aljabar Linear A B S T R A K INFORMASI ARTIKEL,” 2024. [Online]. Available: https://ejournal.upi.edu/index.php/JEM
D. Olteanu, N. Vortmeier, and Ɖorđe Živanović, “Givens rotations for QR decomposition, SVD and PCA over database joins,” VLDB Journal, vol. 33, no. 4, pp. 1013–1037, Jul. 2024, doi: 10.1007/s00778-023-00818-9.
Shailesh P. Dhome and Harshada C. Gore, “Matrix Factorization Techniques in Machine Learning from Dimensionality Reduction to Recommender System,” International Journal of Latest Technology in Engineering Management & Applied Science, vol. 14, no. 13, pp. 219–222, Oct. 2025, doi: 10.51583/IJLTEMAS.2025.1413SP044.
C. D. Usman, Farikhin, and Titi Udjiani, “Comparison of Matrix Decomposition in Null Space-Based LDA Method,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 8, no. 3, pp. 361–367, Jun. 2024, doi: 10.29207/resti.v8i3.5637.
B. Kim, “Dimensionality and data size reduction using singular value decomposition,” Issues in Information Systems, vol. 25, no. 3, pp. 231–237, 2024, doi: 10.48009/3_iis_2024_118.
M. A. Melgarejo, A. Pérez, D. Ruiz, A. Casas, F. González, and V. González de Lena Alonso, “Implementation of Principal Component Analysis (PCA)/Singular Value Decomposition (SVD) and Neural Networks in Constructing a Reduced-Order Model for Virtual Sensing of Mechanical Stress,” Sensors, vol. 24, no. 24, p. 8065, Dec. 2024, doi: 10.3390/s24248065.
L. B. V. de Amorim, G. D. C. Cavalcanti, and R. M. O. Cruz, “The choice of scaling technique matters for classification performance,” Dec. 2022, doi: 10.1016/j.asoc.2022.109924.
Y.-S. Kim, M. K. Kim, N. Fu, J. Liu, J. Wang, and J. Srebric, “Investigating the impact of data normalization methods on predicting electricity consumption in a building using different artificial neural network models,” Sustain. Cities Soc., vol. 118, p. 105570, Jan. 2025, doi: 10.1016/j.scs.2024.105570.
X. Zhao, “Singular Value Decomposition,” Theoretical and Natural Science, vol. 125, no. 1, pp. 54–59, Jul. 2025, doi: 10.54254/2753-8818/2025.GL24952.
T.-X. Cao Thi, “Singular value decomposition and applications in data processing and artificial intelligence,” HPU2 Journal of Science: Natural Sciences and Technology, vol. 2, no. 3, pp. 34–41, Dec. 2023, doi: 10.56764/hpu2.jos.2023.2.3.34-41.
H. D. Thi, K. H. Manh, V. T. Anh, T. P. T. Quynh, and T. N. Viet, “Dimensionality Reduction with Truncated Singular Value Decomposition and K-Nearest Neighbors Regression for Indoor Localization,” International Journal of Advanced Computer Science and Applications, vol. 14, no. 10, 2023, doi: 10.14569/IJACSA.2023.0141034.
J. A. S. Cenita, P. R. F. Asuncion, and J. M. Victoriano, “Performance Evaluation of Regression Models in Predicting the Cost of Medical Insurance,” Apr. 2023, doi: 10.25147/ijcsr.2017.001.1.146.
E. R. Putri and D. B. Arianto, “Attribution-ShareAlike 4.0 International Some rights reserved Perbandingan Performa Algoritma Metode Bagging dan Boosting pada Prediksi Konsentrasi PM 10 di Jakarta Utara,” 2024, doi: 10.25077/TEKNOSI.v10i1.2024.74-80.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Safira Hasna Setiyani, Yusiana Rahma
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Copyright Notice
An author who publishes in the Jurnal FASILKOM (teknologi inFormASi dan ILmu KOMputer) agrees to the following terms:
- Author retains the copyright and grants the journal the right of first publication of the work simultaneously licensed under the Creative Commons Attribution-ShareAlike 4.0 License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal
- Author is able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book) with the acknowledgement of its initial publication in this journal.
- Author is permitted and encouraged to post his/her work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of the published work (See The Effect of Open Access).
Read more about the Creative Commons Attribution-ShareAlike 4.0 Licence here: https://creativecommons.org/licenses/by-sa/4.0/.
_(1).png)
