Hasil Terjemahan ChatGPT: Analisis Akurasi, Akseptabilitas dan Keterbacaan pada Berita Sky News Arabia

Jamaluddin Shiddiq; Muhammad Fahrun Nadhif; Muhammad Nur Kholis; Ali Jum’ah

doi:10.69493/ajoal.v2i2.61

Authors

Jamaluddin Shiddiq Suez Canal University
Muhammad Fahrun Nadhif Universitas Islam Negeri Walisongo Semarang
Muhammad Nur Kholis Universitas Islam Negeri Raden Mas Said Surakarta
Ali Jum’ah Suez Canal University

DOI:

https://doi.org/10.69493/ajoal.v2i2.61

Keywords:

chatgpt, quality, translation, arabic news

Abstract

The emergence of ChatGPT has transformed the landscape of translation. Despite some criticisms associated with its use, ChatGPT is widely recognized and utilized by the public, particularly in the translation process. Consequently, it is essential to conduct a quality assessment of ChatGPT's translation outcomes to evaluate the extent to which these translations are contextual and accurately convey the intended message of the source language. This paper aims to analyze the quality of ChatGPT's translation results, focusing on accuracy, acceptability, and readability of Arabic news texts. This research employs a qualitative descriptive methodology with a literature review approach. The data sources consist of selected news articles from the Sky News Arabia news page, specifically in the categories of education, health, and sports. These were selected using the simple random sampling technique. Data collection methods include documentation and literature review. The research findings will be analyzed using content analysis based on Nababan's translation quality assessment model, which encompasses accuracy, acceptability, and readability. The results indicate that, overall, the translations produced by ChatGPT achieve high scores in accuracy, acceptability, and readability in news articles sourced from Sky News Arabia.

Downloads

Download data is not yet available.

References

Aeni, Rusmita, Lalu Jaswadi Putera, and Boniesta Zulandha Melani. “The Accuracy of ChatGPT in Translating Linguistics Text in Scientific Journals.” Didaktik: Jurnal Ilmiah PGSD STKIP Subang 10, no. 1 (2024): 59–68.

Al-Salman, Saleh, and Ahmad S Haider. “Assessing the Accuracy of MT and AI Tools in Translating Humanities or Social Sciences Arabic Research Titles into English: Evidence from Google Translate, Gemini, and ChatGPT.” International Journal of Data and Network Science, 2024. https://api.semanticscholar.org/CorpusID:271237784.

Babaali, Baligh, Mohammed Salem, and Nawaf R Alharbe. “Breaking Language Barriers with ChatGPT: Enhancing Low-Resource Machine Translation between Algerian Arabic and MSA.” International Journal of Information Technology, 2024, 1–10.

Budi, Wisnu Setya, and Febi Ariani Saragih. “Analisis Kualitas Terjemahan Teks Bahasa Jepang Ke Bahasa Indonesia Dengan Bing Translator.” KLAUSA (Kajian Linguistik, Pembelajaran Bahasa, Dan Sastra) 5, no. 1 (2021): 45–62. https://doi.org/10.33479/klausa.v4i02.408.

Cahyaningrum, Ika Oktaria. “Chat GPT vs Google Translate for Translation.” In The 3 International Symposium on The Practice of Coexistence in Islamic Culture, 450, 2024.

Dahia, Ismail, and Mohammed Belbacha. “Machine-Learning-Based English Quranic Translation: An Evaluation of ChatGPT.” International Journal of Linguistics, Literature and Translation, 2024. https://api.semanticscholar.org/CorpusID:272111278.

Faiz, Aiman, and Imas Kurniawaty. “Tantangan Penggunaan ChatGPT Dalam Pendidikan Ditinjau Dari Sudut Pandang Moral.” Edukatif: Jurnal Ilmu Pendidikan 5, no. 1 (2023): 456–63.

Faris, Hamzah, and Maman Abdurrahman. “Analisis Penerjemahan Bahasa Arab Ke Bahasa Indonesia Melalui Artificial Intelligence Chat GPT.” Al-Af’idah Jurnal Pendidikan Dan Pengajaran Bahasa Arab 7, no. 2 (2023): 222–33.

Fitriani, Eva, Alimuddin Sa’ban Miru, Mustari S Lamada, and Eva Fitrani. “Analisis Tentang Pemahaman, Persepsi Dan Aspek ChatGPT Oleh Mahasiswa Jurusan Teknik Informatika Dan Komputer FT UNM: Pengaruh, Keuntungan, Pengalaman, Privasi, Kepuasan Dan Ketepatan Waktu.” JIMU:Jurnal Ilmiah Multidisipliner, 2024. https://api.semanticscholar.org/CorpusID:272980922.

Gao, Ruiyao, Yumeng Lin, Nan Zhao, and Zhenguang G Cai. “Machine Translation of Chinese Classical Poetry: A Comparison among ChatGPT, Google Translate, and DeepL Translator.” Humanities and Social Sciences Communications 11, no. 1 (2024): 835. https://doi.org/10.1057/s41599-024-03363-0.

Ghassemiazghandi, Mozhgan. “An Evaluation of ChatGPT’s Translation Accuracy Using BLEU Score.” Theory and Practice in Language Studies, 2024. https://api.semanticscholar.org/CorpusID:269562159.

Hakiki, Ahmad Sirojul, Syapalarisa Sulthoni, Nurul Devi, and Abdul Aziz. “Analisis Hasil Terjemah Google Translate Dan ChatGPT Bahasa Arab-Indonesia: Studi Komparatif.” Language Education 1, no. 1 (2023): 35–53.

Handoyo, Emanuel Ristian, Jessica Sugiarto, Amanda Lolo, and Karen Chai. “Identifikasi Pengaruh Penggunaan ChatGPT Terhadap Kemampuan Berfikir Mahasiswa Di Universitas Atma Jaya Yogyakarta Prodi Sistem Informasi Angkatan 2021.” KONSTELASI: Konvergensi Teknologi Dan Sistem Informasi, 2023. https://api.semanticscholar.org/CorpusID:266503249.

Hasanah, U, M R Jambak, and M Zawawi. “Nilai Akurasi Hasil Penerjemahan Teks Sastra Menggunakan Chat GPT (Generative Pre-Training Transformer).” In ICONITIES (International Conference on Islamic Civilization and Humanities), 1:435–48, 2023.

Hidayati, Niswatin Nurul, and Dewi Hidayatun Nihayah. “Google Translate, ChatGPT or Google Bard AI: A Study toward Non-English Department College Students’ Preference and Translation Comparison.” Inspiring: English Education Journal 7, no. 1 (2024): 14–33.

Iriyani, Sri Astuti, Elyakim N.S Patty, Abu Rizal Akbar, Ridwan Idris, and Bhujangga Ayu Putu Priyudahari. “Studi Literatur Pemanfaatan Teknologi Chat GPT Dalam Pendidikan.” UPGRADE : Jurnal Pendidikan Teknologi Informasi 1, no. 1 (2024): 9–16. https://doi.org/10.30812/upgrade.v1i1.3151.

Khanna, Praneet, Gagandeep Dhillon, Venkata Buddhavarapu, Ram Verma, Rahul Kashyap, and Harpreet Grewal. “Artificial Intelligence in Multilingual Interpretation and Radiology Assessment for Clinical Language Evaluation (AI-MIRACLE).” Journal of Personalized Medicine, 2024. https://doi.org/10.3390/jpm14090923.

Maulana, Muhammad Jafar, and Cecep Darmawan. “Penggunaan ChatGPT Dalam Pendidikan Berdasarkan Perspektif Etika Akademik.” Bhineka Tunggal Ika; Kajian Teori Dan Praktik Pendidikan PKN 10, no. 1 (2023): 58–66.

Maulidina, Nurul. “Komparasi Teknik Penerjemahan Chatgpt Dan Bing Chat Pada Teks Berita Kesehatan Jiwa Mawdoo3. Com.” Fakultas Adab dan Humaniora UIN Syarif HIdayatullah Jakarta, 2024.

Misnawati Misnawati. “ChatGPT: Keuntungan, Risiko, Dan Penggunaan Bijak Dalam Era Kecerdasan Buatan.” Prosiding Seminar Nasional Pendidikan, Bahasa, Sastra, Seni, Dan Budaya 2, no. 1 SE-Articles (April 21, 2023): 54–67. https://doi.org/10.55606/mateandrau.v2i1.221.

Nababan, Mangatur, and Ardiana Nuraeni. “Pengembangan Model Penilaian Kualitas Terjemahan.” Kajian Linguistik Dan Sastra 24, no. 1 (2012).

Nurfaiza, Nurfaiza. “Pengaruh Penggunaan ChatGpt Dalam Pembelajaran Terjemah Indonesia-Arab.” At-Turost: Journal of Islamic Studies, 2024, 99–113.

Putri, Aliifah Nabila, and Tatang Tatang. “Perbandingan Antara Google Translate Dan Artifical Intelligence Dalam Menerjemahkan Dari Bahasa Arab Ke Bahasa Indonesia.” Jurnal Pendidikan Tambusai 8, no. 2 (2024): 19690–96.

Ramadhan, Fikri Kurnia, Muhammad Irfan Faris, Ikhsan Wahyudi, and Mia Kamayani Sulaeman. “Pemanfaatan Chat GPT Dalam Dunia Pendidikan.” Jurnal Ilmiah Flash 9, no. 1 (2023): 25–30.

Saimin, Afriazil Arief, Rinaldi Supriadi, and Mohamad Zaka Al Farisi. “Analisis Kesalahan Penerjemahan Teks Bahasa Indonesia Ke Dalam Bahasa Arab Pada ChatGPT (Studi Analisis Morfologi Dan Sintaksis).” Naskhi: Jurnal Kajian Pendidikan Dan Bahasa Arab 6, no. 2 (2024): 1–12.

Salmi, Juniarty, and Angela Atik Setiyanti. “Persepsi Mahasiswa Terhadap Penggunaan Chatgpt Di Era Pendidikan 4.0.” Jurnal Ilmiah Wahana Pendidikan 9, no. 19 (2023): 399–406.

Suharmawan, Wahid. “Pemanfaatan Chat GPT Dalam Dunia Pendidikan.” Education Journal : Journal Educational Research and Development 7, no. 2 SE-Articles (January 9, 2024): 158–66. https://doi.org/10.31537/ej.v7i2.1248.

Sun, Rui. “Evaluating the Translation Accuracy of ChatGPT and DeepL Through the Lens of Implied Subjects.” Arab World English Journal For Translation and Literary Studies, 2024. https://api.semanticscholar.org/CorpusID:273488901.

Vaswani, Ashish, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. “Attention Is All You Need.” In 31st Conference on Neural Information Processing Systems, 2017.

Yuxin, Cheng, Ruochen Wang, Jiawei Chen, Chao Yijun, Aliye Maimaitili, and Haoruo Zhang. “Context-Based AI Translation From a Globalization Perspective: A Case Study of ChatGPT.” Sino-US English Teaching, 2023. https://api.semanticscholar.org/CorpusID:265005194.

Zein, Afrizal. “Dampak Penggunaan ChatGPT Pada Dunia Pendidikan.” Jurnal Informatika Utama 1, no. 2 SE-Articles (November 30, 2023): 19–24. https://doi.org/10.55903/jitu.v1i2.151.