Deteksi Ekspresi Wajah Manusia Menggunakan Metode Convolutional Neural Network

Authors

  • Christian Cahyaningtyas Institut Shanti Bhuana
  • Mira Institut Shanti Buana
  • Chandra Gudiato Institut Shanti Buana
  • Maya Sari Institut Shanti Buana

DOI:

https://doi.org/10.37859/jf.v15i1.9119
Keywords: deteksi, ekspresi wajah, convolutional neural network

Abstract

Detecting emotions based on human facial expressions has long been a focus of research in the field of psychology that identifies the relationship between expressions and a person's emotional state. Deep learning has the ability to learn data representations with a high level of abstraction, allowing models to make predictions or decisions based on big data without human intervention and deep learning can also understand and classify an object. One of the main breakthroughs in the field of deep learning is the convolutional neural network, its advantage is that it has very good performance results in various tasks in image processing. In this study, research will be conducted on detecting human facial expressions using the convolutional neural network method by conducting several experiments. Image data will be processed using the python programming language and the dataset used is data sourced from the official kaggle.com website, namely FER2013. Based on the results of training the convolutional neural network model for facial expression recognition, the highest accuracy reached 60% at the 60th epoch with batch sizes of 64 and 128. When viewed based on the graph produced, the best model training was carried out with a batch size of 128 epoch 60. While the confusion matrix produced by batch size 64 epoch 60, the resulting model is more balanced in detecting expressions. And the classification report produced has no significant difference

Downloads

Download data is not yet available.

References

D. Setiawan, S. Widodo, T. Ridwan, and R. Ambari, “Perancangan Deteksi Emosi Manusia berdasarkan Ekspresi Wajah Menggunakan Algoritma VGG16,” Syntax J. Inform., vol. 11, no. 01, pp. 01–11, 2022, doi: 10.35706/syji.v11i01.6594.

N. Djamsi, D. R. Chandranegara, and Z. Sari, “Mendeteksi Ekspresi Wajah dengan Meninjau Iris Mata Menggunakan Metode Transformasi Hough dan K-Nearest,” REPOSITOR, vol. 5, no. 1, pp. 575–580, 2023.

Z. Pramuditha, Adeyuni, Suroso, and M. Fadhli, “Deteksi Wajah Dengan Model Arsitektur VGG 19 Pada Metode Convolutional Neural Network,” Sist. J. Sist. Inf., vol. 13, no. 5, pp. 1998–2007, 2024.

A. S. Guntoro, E. Julianto, and D. Budiyanto, “Pengenalan Ekspresi Wajah Menggunakan Convolutional Neural Network,” J. Inform. Atma Jogja, vol. 3, no. 2, pp. 155–160, 2022, doi: 10.24002/jiaj.v3i2.6790.

I. Azhar and Fitriyani, “Implementasi Algoritma Convolutional Neural Network Dalam Deteksi Emosi Manusia Berdasarkan Ekspresi Wajah,” eProsiding Tek. Inform., vol. 1, no. 1, pp. 112–118, 2020.

M. A. Fadilla, H. Setiawan, and M. Ramadhan, “Implementasi Metode Convolutional Neural Network (CNN) Pada Sistem Deteksi Emosi Dari Ekspresi Wajah Manusia Dengan Aplikasi Android Sebagai Antarmuka Pengguna,” J. Ilmu Komput. dan Sist. Inf., vol. 9, no. 4, pp. 126–138, 2023.

M. Y. A. Thoriq, K. E. Permana, and I. A. Siradjuddin, “Deteksi Wajah Manusia Berbasis One Stage Detector Menggunakan Metode You Only Look Once (Yolo),” J. Teknoinfo, vol. 17, no. 1, pp. 66–73, 2023, doi: 10.33365/jti.v17i1.1884.

N. Dewi and F. Ismawan, “Implementasi Deep Learning Menggunakan Convolutional Neural Network Untuk Sistem Pengenalan Wajah,” Fakt. Exacta, vol. 14, no. 1, pp. 34–43, 2021, doi: 10.30998/faktorexacta.v14i1.8989.

N. R. Fauziyya and T. Rahajoeningroem, “Metoda Convolutional Neural Network (CNN) untuk Pendeteksi Tangga pada Alat Pemandu Arah bagi Penyandang Tunanetra,” Telekontran J. Ilm. Telekomun. Kendali dan Elektron. Terap., vol. 8, no. 2, pp. 145–153, 2020, doi: 10.34010/telekontran.v8i2.4709.

I. Maulana, N. Khairunisa, and R. Mufidah, “Deteksi Bentuk Wajah Menggunakan Convolutional Neural Network (CNN),” JATI (Jurnal Mhs. Tek. Inform., vol. 7, no. 6, pp. 3348–3355, 2023, doi: 10.36040/jati.v7i6.8171.

S. Zahrah, Azhar, and M. Abdi, “Sistem Deteksi Wajah Untuk Pencatatan Kehadiran Mahasiswa Di Kelas Menggunakan Metode Convolutional Neural Network,” JAISE J. Artif. Intell. Softw. Eng., vol. 2, no. 1, pp. 1–5, 2022.

A. K. Muttaqiin, H. Yuana, and M. T. Chulkamdi, “Implementasi Algoritma Convolutional Neural Network Untuk Pengenalan Ekspresi Wajah,” J. Ris. Sist. Inf. Dan Tek. Inform., vol. 8, no. 2, pp. 772–792, 2023, [Online]. Available: https://tunasbangsa.ac.id/ejurnal/index.php/jurasik.

A. P. Saputri, A. Taqwa, and S. Soim, “Analisis Deteksi Objek Citra Digital Menggunakan Algoritma YOLO dan CNN dengan Arsitektur REPVGG Pada Sistem Pendeteksian dan Pengenalan Ekspresi Wajah,” Syntax Lit. J. Ilm. Indones., vol. 7, no. 9, pp. 13068–13080, 2022.

J. Roosandriantini, R. Putranda, Y. Wahyuningsih, Y. Christela, Oktaviani, and E. Y. Christin, “Face Expression Recognizer Dengan Convolutiona Neural Network Untuk Membantu Penderita Autisme Mengenali Ekspresi Wajah Seseorang,” JITET (Jurnal Inform. dan Tek. Elektro Ter., vol. 11, no. 3, pp. 336–342, 2023.

P. Musa, W. K. Anam, S. B. Musa, W. Aryunani, R. Senjaya, and P. Sularsih, “Pembelajaran Mendalam Pengklasifikasi Ekspresi Wajah Manusia dengan Model Arsitektur Xception pada Metode Convolutional Neural Network,” Rekayasa. J. Sci. Technol., vol. 16, no. 1, pp. 65–73, 2023, doi: 10.21107/rekayasa.v16i1.16974.

P. A. Nugroho, I. Fenriana, and R. Arijanto, “Implementasi Deep Learning Menggunakan Convolutional Neural Network (CNN) Pada Ekspresi Manusia,” J. ALGOR, vol. 2, no. 1, pp. 12–21, 2020.

E. Y. Christin and Y. Wahyuningsih, “Implementasi Convolutional Neural Network Pada Pengenalan Ekspresi Wajah Untuk Anak Usia Dini,” Semin. Nas. Ilmu Terap., pp. 1–8, 2023.

J. H. Niasmara and I. K. D. Nuryana, “Sistem Deteksi Ekspresi Siswa Dalam E-Learning Menggunakan Metode Convolutional Neural Network (CNN),” JINACS (Journal Informatics Comput. Sci., vol. 06, no. 02, pp. 551–556, 2024.

F. Aure, R. Rokhana, R. Sigit, and B. S. B. Dewantara, “Fusi Algoritma K-Means dan CNN untuk Klasifikasi Emosi pada Anak,” Techo.COM, vol. 22, no. 3, pp. 622–634, 2023, doi: 10.33633/tc.v22i3.8667.

A. N. Ridho, G. Mellyka, F. Saputra, and A. P. A. Masa, “Implementasi Metode Convolutional Neural Network (CNN) Untuk Klasifikasi Gambar Mobil dan Motor Menggunakan Keras,” J. Jambo Digit., vol. 1, no. 1, pp. 54–64, 2024, doi: 10.1201/9781032622408-13.

S. N. Amartama, A. N. Hidayah, P. K. Sari, and R. A. Ramadhani, “Implementasi Convolutional Neural Network (CNN) dalam Pengenalan Pola Penulisan Tangan,” Semin. Nas. Teknol. Sains, vol. 3, no. 1, pp. 133–138, 2024, doi: 10.29407/stains.v3i1.4155.

M. D. Darojat, Y. A. Sari, and R. C. Wihandika, “Convolutional Neural Network untuk Klasifikasi Citra Makanan Khas Indonesia,” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 5, no. 11, pp. 4764–4769, 2021, [Online]. Available: http://j-ptiik.ub.ac.id.

A. S. Ritonga and I. Muhandhis, “Analisis dan Implementasi Metode Viola-Jones dan CNN pada Sistem Deteksi Kantuk Real-Time,” J. Ilm. IT CIDA Disem. Teknol. Inf., vol. 10, no. 1, pp. 53–66, 2024.

A. L. Seandrio, A. H. Pratomo, and M. Y. Florestiyanto, “Implementation of Convolutional Neural Network ( CNN ) in Facial Expression Recognition Implementasi Convolutional Neural Network ( CNN ) Pada Pengenalan Ekspresi Wajah,” Telemat. J. Inform. dan Teknol. Inf., vol. 18, no. 2, pp. 211–221, 2021, doi:

31515/telematika.v18i2.4823.

L. M. R. Rere, S. Usna, and Soegijanto, “Studi Pengenalan Ekspresi Wajah Berbasis Convolutional Neural Network,” Semin. Nas. Teknol. Inf. dan Komun. STI&K, vol. 3, pp.

Downloads

Published

2025-05-23

Issue

Vol. 15 No. 1 (2025): Jurnal FASILKOM (teknologi inFormASi dan ILmu KOMputer)

Section

Articles

License

Copyright Notice

An author who publishes in the Jurnal FASILKOM (teknologi inFormASi dan ILmu KOMputer) agrees to the following terms:

  • Author retains the copyright and grants the journal the right of first publication of the work simultaneously licensed under the Creative Commons Attribution-ShareAlike 4.0 License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal
  • Author is able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book) with the acknowledgement of its initial publication in this journal.
  • Author is  permitted and encouraged to post his/her  work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of the published work (See The Effect of Open Access).

Read more about the Creative Commons Attribution-ShareAlike 4.0 Licence here: https://creativecommons.org/licenses/by-sa/4.0/.