Ensuring Reliability: Adaptation and Validation of the AI Anxiety Scale (AIAS) in Indonesia

(1) Shifa Ramadini Mail (Faculty of Psychology, University of Mercu Buana Yogyakarta, Indonesia)
(2) * Ratri Pratiwi Mail (Faculty of Psychology, University of Mercu Buana Yogyakarta, Indonesia)
*corresponding author

Abstract


This study aims to adapt Wang and Wang’s Artificial Intelligence Anxiety Scale (2019) into the context of Indonesian culture and language. The research involved 222 respondents, consisting of 89 males and 133 females, aged between 15 and over 35 years old. The adaptation process followed six stages: (1) initial translations by translators with different backgrounds, (2) synthesis of the translations into a single version, (3) back-translation by native speakers of the source language, (4) content validation by an expert committee, (5) testing the pre-final version on relevant subjects, and (6) submission of documentation for evaluation. Reliability testing was conducted using Cronbach’s alpha, while logical validity was assessed with Aiken’s V and construct validity using confirmatory factor analysis (CFA). The results indicated that the adapted scale had high reliability, with a Cronbach’s alpha value of 0.916, and adequate validity, with an Aiken’s V value greater than 0.50. The confirmatory factor analysis demonstrated a good model fit, with an RMSEA value of 0.066, CFI of 0.938, and TLI of 0.927. The Indonesian version of the Artificial Intelligence Anxiety Scale is deemed valid and reliable, making it suitable for use in Indonesia

Keywords


AI Anxiety; Adaptation Scale; Job Replacement; Technology Anxiety; Confirmatory Factor Analysis

   

DOI

https://doi.org/10.47679/jopp.7210452025
      

Article metrics

Read: 1387 | Download: 3273

   

Cite

   

Full Text

Download

References


Acemoglu, D. & Restrepo, P. (2017). Robots and jobs: Evidence from US labor markets. Voxeu. Accessed on November 4, 2023 from https://voxeu.org/article/robots-and-jobs-evidence-us.

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012.

American Psychological Association. (2023, September 7). Worried about AI in the workplace? You’re not alone. https://www.apa.org/topics/healthy-workplaces/artificial-intelligence-workplace-worry

Azwar, S. (2018). Penyusunan skala psikologi. Yogyakarta, Indonesia: Pustaka Pelajar.

Azwar, S. (2020). Dasar-dasar psikometrika. Yogyakarta, Indonesia: Pustaka Pelajar.

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186-3191. https://doi.org/10.1097/00007632-200012150-00014.

Bentler P. M. (1990). Comparative fit indexes in structural models. Psychological bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238

Bollen, K.A. (1989). Structural equations with latent variables. John Wiley and Sons, Inc., New York. https://doi.org/10.1002/9781118619179

Brooks, A. (2019). The benefits of AI: 6 societal advantages of automation. Rasmussen University. Accessed on November 4, 2023 from https://www.rasmussen.edu/degrees/technology/blog/benefits-of-ai/.

Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research (2nd ed.). Guilford Press.

Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen, & J. S. Long (Eds.), Testing Structural Equation Models (Vol. 154, pp. 136-162). Newbury Park, CA: Sage Focus Editions.

Chaudhuri, S., Krishnan, L. R. K., & Poorani, S. (2022). Impact of using ai in manufacturing industries. Journal of the International Academy for Case Studies, 28(S4), 1-10.

Copeland, B. J. (1998). Artificial intelligence (AI) | Definition, examples, types, applications, companies, & facts. Encyclopedia Britannica. Accessed on November 4, 2023 from https://www.britannica.com/technology/artificial-intelligence.

Cox, J. (2023, 30 April). Perkembangan AI: Para pekerja yang takut kehilangan pekerjaan karena kecerdasan buatan. BBC News Indonesia. Accessed from https://www.bbc.com/indonesia/articles/c51ley190njo.

Davahli, M. R., Karwowski, W., Sonmez, S., & Apostolopoulos, Y. (2020). The hospitality industry in the face of the COVID-19 pandemic: Current topics and research methods. International Journal of Environmental Research and Public Health, 17(20), 7366. https://doi.org/10.3390/ijerph17207366.

Direktorat Jenderal Kekayaan Negara, Kementerian Keuangan RI. (2023). Pemanfaatan kecerdasan buatan dalam lembaga pemerintah: meningkatkan efisiensi dan pelayanan publik yang lebih baik.. Accessed on November 4, 2023 from https://www.djkn.kemenkeu.go.id/kpknl-manado/baca-artikel/16383/Pemanfaatan-Kecerdasan-Buatan-dalam-Lembaga-Pemerintah-Meningkatkan-Efisiensi-dan-Pelayanan-Publik-Yang-Lebih-Baik.html.

Eyüp, B., & Kayhan, S. (2023). Pre-service Turkish language teachers’ anxiety and attitudes toward artificial intelligence. International Journal of Education and Literacy Studies, 11(4), 43-56. https://doi.org/10.7575/aiac.ijels.v.11n.4p.43.

Fernandez, J. (2018). The ball of wax we call HR analytics. Strategic HR Review, https://doi.org/10.1108/SHR-09-2018-0077.

Frey, C. B., & Osborne, M. A. (2017). The future of employment: How susceptible are jobs to computerisation? Technological Forecasting and Social Change, 114, 254–280. https://doi.org/10.1016/j.techfore.2016.08.019.

Gillespie, N., Lockey, S., & Curtis, C. (2021). Trust in artificial intelligence: A five country study. The University of Queensland and KPMG Australia. https://doi.org/10.14264/e34bfA3

Gleichgerrcht, E., Munsell, B. C., Alhusaini, S., Alvim, M. K. M., Bargalló, N., Bender, B., … ENIGMA-Epilepsy Working Group. (2021). Artificial intelligence for classification of temporal lobe epilepsy with ROI-level MRI data: A worldwide ENIGMA-Epilepsy study. NeuroImage. Clinical, 31, 102765. https://doi.org/10.1016/j.nicl.2021.102765.

Gupta, R., Tanwar, S., Tyagi, S., & Kumar, N. (2019). Tactile internet and its applications in 5G era: A comprehensive review. International Journal of Communication Systems, 32(14), e3981. https://doi.org/10.1002/dac.3981

Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H., & Jeste, D. V. (2019). Artificial intelligence for mental health and mental illnesses: An overview. Current Psychiatry Reports, 21(11). https://doi.org/10.1007/s11920-019-1094-0

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.

Huang, M. H., & Rust, R. T. (2018). Artificial intelligence in service. Journal of Service Research, 21(2), 155-172.

Hu, L.T. and Bentler, P.M. (1999) Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55. http://dx.doi.org/10.1080/10705519909540118

Ivanov, S., Gretzel, U., Berezina, K., Sigala, M., & Webster, C. (2019). Progress on robotics in hospitality and tourism: A review of the literature. Journal of Hospitality and Tourism Technology. https://doi.org/10.1108/JHTT-08-2018-0087.

Johnson, D. G., & Verdicchio, M. (2017). AI anxiety. Journal of the Association for Information Science and Technology, 68(9), 2267-2270. https://doi.org/10.1002/asi.23867.

Kim, J., Kadkol, S., Solomon, I., Yeh, H., Soh, J. Y., Nguyen, T. M., Choi, J. Y., Lee, S., Srivatsa, A. V., Nahass, G. R., & Ajilore, O. (2023). AI anxiety: A comprehensive analysis of psychological factors and interventions. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4573394.

Kumar, V., Rajan, B., Venkatesan, R., & Lecinski, J. (2019). Understanding the role of artificial intelligence in personalized engagement marketing. California Management Review, 61(4), 135-155, https://doi.org/10.1177/0008125619859317.

Kuzey, C., Uyar, A., & Delen, D. (2014). The impact of multinationality on firm value: A comparative analysis of machine learning techniques. Decision Support Systems, 59, 127-142. https://doi.org/10.1016/j.dss.2013.11.001.

Lazarus, R., & Folkman, S. (1984). Stress, Appraisal, and Coping. New York: Springer.

Lemay, D. J., Basnet, R. B., & Doleck, T. (2020). Fearing the robot apocalypse: Correlates of AI anxiety. International Journal of Learning Analytics and Artificial Intelligence for Education (iJAI), 2(2), 24. https://doi.org/10.3991/ijai.v2i2.16759

Makmur, M. F., & Alijoyo, F. A. (2023). Dampak kecerdasan buatan terhadap creator, brand, dan agensi. SEIKO: Journal of Management & Business, 6(2), 128-140. ISSN: 2598-831X.

Manzalini, A. (2020). Quantum communications in future networks and services. Quantum Reports, 2(1), 221-232. https://doi.org/10.3390/quantum2010014.

McKinsey & Company. (2019). Automation and the future of work in Indonesia. McKinsey. Accessed on November 4, 2023 from https://www.mckinsey.com/featured-insights/asia-pacific/automation-and-the-future-of-work-in-indonesia.

Mishra, K. N., & Chakraborty, C. (2020). A novel approach toward enhancing the quality of life in smart cities using clouds and IoT-based technologies. In Digital Twin Technologies and Smart Cities (pp. 19-35). Springer, Cham. https://doi.org/10.1007/978-3-030-18732-32.

Nam, T. (2019). Citizen attitudes about job replacement by robotic automation. Futures, 109, 39-49. https://doi.org/10.1016/j.futures.2019.04.005.

Organisation for Economic Co-operation and Development (2019). Artificial intelligence in society. OECD Publishing

Pew Research Center. (2019, December 31). 5. The future of work in the automated workplace. Pew Research Center’s Social & Demographic Trends Project. Accessed on November 4, 2023 from https://www.pewresearch.org/social-trends/2019/03/21/the-future-of-work-in-the-automated-workplace/

Pwc. (2019). Sizing the prize: Exploiting the AI revolution, what’s the real value of AI for your business and how can you capitalise? PwC’s Global Artificial Intelligence Study. Accessed on November 4, 2023 from https://www.pwc.com/gx/en/issues/data-and-analytics/publications/artificial-intelligence-study.html.

Ravi, K., & Ravi, V. (2015). A survey on opinion mining and sentiment analysis: tasks, approaches and applications. Knowledge-based systems, 89, 14-46. https://doi.org/10.1016/j.knosys.2015.06.015.

Rhee, T., & Jin, X. (2021). The effect of job anxiety of replacement by artificial intelligence on organizational members’ job satisfaction in the 4th industrial revolution era: The moderating effect of job uncertainty. Journal of Digital Convergence, 19(7), 1-9. https://doi.org/10.14400/JDC.2021.19.7.001.

Ririh, K. R., Laili, N., Wicaksono, A., & Tsurayya, S. (2020). Studi komparasi dan analisis SWOT pada implementasi kecerdasan buatan (Artificial Intelligence) di Indonesia. J@ti Undip: Jurnal Teknik Industri, 15(2), 122-133. https://doi.org/10.14710/jati.15.2.122-133.

Robertson, J. (2014). Human rights vs. robot rights: Forecasts from Japan. Critical Asian Studies, 46(4), 571-598. https://doi.org/10.1080/14672715.2014.960707.

Singh, S., Sharma, P. K., Yoon, B., Shojafar, M., Cho, G. H., & Ra, I. H. (2020). Convergence of blockchain and artificial intelligence in IoT network for the sustainable smart city. Sustainable Cities and Society, 63, 102364.

Steiger J. H. (1990). Structural model evaluation and modification: an interval estimation approach. Multivariate behavioral research, 25(2), 173–180. https://doi.org/10.1207/s15327906mbr2502_4

Terzi, R. (2020). An adaptation of artificial intelligence anxiety scale into Turkish: Reliability and validity study. International Online Journal of Education and Teaching (IOJET), 7(4). 1501-1515. http://iojet.org/index.php/IOJET/article/view/1031.

Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10. https://doi.org/10.1007/BF02291170

Tuomi, I. (2018). The Impact of artificial intelligence on learning, teaching, and education. Policies for the future, Eds. Cabrera, M., Vuorikari, R & Punie, Y., EUR 29442 EN, Publications Office of the European Union, Luxembourg, ISBN 978-92-79-97257-7, https://doi.org/10.2760/12297 JRC113226.

Visintin, F, Porcelli, I, & Ghini, A (2014). Applying discrete event simulation to the design of a service delivery system in the aerospace industry: a case study. Journal of Intelligent Manufacturing, Springer, https://doi.org/10.1007/s10845-013-0742-1.

Vroom, V. (1964). Work and Motivation. Wiley and Sons, New York.

Wang, Y., & Wang, Y. (2019). Development and validation of an artificial intelligence anxiety scale: An initial application in predicting motivated learning behavior. Interactive Learning Environments, 30(4), 619-634. https://doi.org/10.1080/10494820.2019.1674887.

Wheaton, B., Muthen, B., Alwin, D. F., & Summers, G. F. (1977). Assessing reliability and stability in panel models. Sociological Methodology, 8, 84-136. https://doi.org/10.2307/270754


Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Ratri Pratiwi, Shifa Ramadini

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Creative Commons License
All publications by the Utan Kayu Publishing [e-ISSN: 2715-4807, p-ISSN: 2715-4785] is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.