Ensuring Reliability: Adaptation and Validation of the AI Anxiety Scale (AIAS) in Indonesia

Authors

  • Shifa Ramadini Faculty of Psychology, University of Mercu Buana Yogyakarta, Indonesia
  • Ratri Pratiwi Faculty of Psychology, University of Mercu Buana Yogyakarta, Indonesia

DOI:

https://doi.org/10.47679/jopp.7210452025

Keywords:

AI Anxiety, Adaptation Scale, Job Replacement, Technology Anxiety, Confirmatory Factor Analysis

Abstract

This study aims to adapt Wang and Wang’s Artificial Intelligence Anxiety Scale (2019) into the context of Indonesian culture and language. The research involved 222 respondents, consisting of 89 males and 133 females, aged between 15 and over 35 years old. The adaptation process followed six stages: (1) initial translations by translators with different backgrounds, (2) synthesis of the translations into a single version, (3) back-translation by native speakers of the source language, (4) content validation by an expert committee, (5) testing the pre-final version on relevant subjects, and (6) submission of documentation for evaluation. Reliability testing was conducted using Cronbach’s alpha, while logical validity was assessed with Aiken’s V and construct validity using confirmatory factor analysis (CFA). The results indicated that the adapted scale had high reliability, with a Cronbach’s alpha value of 0.916, and adequate validity, with an Aiken’s V value greater than 0.50. The confirmatory factor analysis demonstrated a good model fit, with an RMSEA value of 0.066, CFI of 0.938, and TLI of 0.927. The Indonesian version of the Artificial Intelligence Anxiety Scale is deemed valid and reliable, making it suitable for use in Indonesia

References

Acemoglu, D., & Restrepo, P. (2017). Robots and jobs: Evidence from US labor markets. VoxEU. https://voxeu.org/article/robots-and-jobs-evidence-us

Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012

Azwar, S. (2018). Penyusunan skala psikologi. Pustaka Pelajar.

Azwar, S. (2020). Dasar-dasar psikometrika. Pustaka Pelajar.

Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238

Bollen, K. A. (1989). Structural equations with latent variables. John Wiley & Sons. https://doi.org/10.1002/9781118619179

Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.

Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). SAGE Publications.

Chaudhuri, S., Krishnan, L. R. K., & Poorani, S. (2022). Impact of using AI in manufacturing industries. Journal of the International Academy for Case Studies, 28(S4), 1–10. https://www.abacademies.org/articles/impact-of-using-ai-in-manufacturing-industries-15318.html

Copeland, B. J. (1998). Artificial intelligence. Encyclopaedia Britannica. https://www.britannica.com/technology/artificial-intelligence

Cox, J. (2023, April 30). Perkembangan AI: Para pekerja yang takut kehilangan pekerjaan karena kecerdasan buatan. BBC News Indonesia. https://www.bbc.com/indonesia/articles/c51ley190njo

Davahli, M. R., Karwowski, W., Sonmez, S., & Apostolopoulos, Y. (2020). The hospitality industry in the face of the COVID-19 pandemic: Current topics and research methods. International Journal of Environmental Research and Public Health, 17(20), Article 7366. https://doi.org/10.3390/ijerph17207366

Direktorat Jenderal Kekayaan Negara, Kementerian Keuangan Republik Indonesia. (2023, August 29). Pemanfaatan kecerdasan buatan dalam lembaga pemerintah: Meningkatkan efisiensi dan pelayanan publik yang lebih baik. https://www.djkn.kemenkeu.go.id/kpknl-manado/baca-artikel/16383/Pemanfaatan-Kecerdasan-Buatan-dalam-Lembaga-Pemerintah-Meningkatkan-Efisiensi-dan-Pelayanan-Publik-Yang-Lebih-Baik.html

Eyüp, B., & Kayhan, S. (2023). Pre-service Turkish language teachers’ anxiety and attitudes toward artificial intelligence. International Journal of Education and Literacy Studies, 11(4), 43–56. https://doi.org/10.7575/aiac.ijels.v.11n.4p.43

Fernandez, J. (2019). The ball of wax we call HR analytics. Strategic HR Review, 18(1), 21–25. https://doi.org/10.1108/SHR-09-2018-0077

Frey, C. B., & Osborne, M. A. (2017). The future of employment: How susceptible are jobs to computerisation? Technological Forecasting and Social Change, 114, 254–280. https://doi.org/10.1016/j.techfore.2016.08.019

Gillespie, N., Lockey, S., & Curtis, C. (2021). Trust in artificial intelligence: A five country study. The University of Queensland & KPMG Australia. https://doi.org/10.14264/e34bfA3

Gleichgerrcht, E., Munsell, B. C., Alhusaini, S., Alvim, M. K. M., Bargalló, N., Bender, B., Bernasconi, A., Bernasconi, N., Bernhardt, B., Blackmon, K., Caligiuri, M. E., Cendes, F., Concha, L., Desmond, P. M., Devinsky, O., Doherty, C. P., Domin, M., Duncan, J. S., Focke, N. K., . . . Bonilha, L. (2021). Artificial intelligence for classification of temporal lobe epilepsy with ROI-level MRI data: A worldwide ENIGMA-Epilepsy study. NeuroImage: Clinical, 31, Article 102765. https://doi.org/10.1016/j.nicl.2021.102765

Graham, S., Depp, C., Lee, E. E., Nebeker, C., Tu, X., Kim, H., & Jeste, D. V. (2019). Artificial intelligence for mental health and mental illnesses: An overview. Current Psychiatry Reports, 21(11), Article 116. https://doi.org/10.1007/s11920-019-1094-0

Gupta, R., Tanwar, S., Tyagi, S., & Kumar, N. (2019). Tactile internet and its applications in 5G era: A comprehensive review. International Journal of Communication Systems, 32(14), Article e3981. https://doi.org/10.1002/dac.3981

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2019). Multivariate data analysis (8th ed.). Cengage Learning.

Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Huang, M.-H., & Rust, R. T. (2018). Artificial intelligence in service. Journal of Service Research, 21(2), 155–172. https://doi.org/10.1177/1094670517752459

Ivanov, S., Gretzel, U., Berezina, K., Sigala, M., & Webster, C. (2019). Progress on robotics in hospitality and tourism: A review of the literature. Journal of Hospitality and Tourism Technology, 10(4), 489–521. https://doi.org/10.1108/JHTT-08-2018-0087

Johnson, D. G., & Verdicchio, M. (2017). AI anxiety. Journal of the Association for Information Science and Technology, 68(9), 2267–2270. https://doi.org/10.1002/asi.23867

Kim, J., Kadkol, S., Solomon, I., Yeh, H., Soh, J. Y., Nguyen, T. M., Choi, J. Y., Lee, S., Srivatsa, A. V., Nahass, G. R., & Ajilore, O. (2023). AI anxiety: A comprehensive analysis of psychological factors and interventions. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4573394

Kumar, V., Rajan, B., Venkatesan, R., & Lecinski, J. (2019). Understanding the role of artificial intelligence in personalized engagement marketing. California Management Review, 61(4), 135–155. https://doi.org/10.1177/0008125619859317

Kuzey, C., Uyar, A., & Delen, D. (2014). The impact of multinationality on firm value: A comparative analysis of machine learning techniques. Decision Support Systems, 59, 127–142. https://doi.org/10.1016/j.dss.2013.11.001

Lazarus, R. S., & Folkman, S. (1984). Stress, appraisal, and coping. Springer Publishing Company.

Lemay, D. J., Basnet, R. B., & Doleck, T. (2020). Fearing the robot apocalypse: Correlates of AI anxiety. International Journal of Learning Analytics and Artificial Intelligence for Education, 2(2), 24. https://doi.org/10.3991/ijai.v2i2.16759

Lerner, M. (2024, January 30). Worried about AI in the workplace? You’re not alone. American Psychological Association. https://www.apa.org/topics/healthy-workplaces/artificial-intelligence-workplace-worry

Makmur, M. F., & Alijoyo, F. A. (2023). Dampak kecerdasan buatan terhadap creator, brand, dan agensi. SEIKO: Journal of Management & Business, 6(2), 128–140.

Manzalini, A. (2020). Quantum communications in future networks and services. Quantum Reports, 2(1), 221–232. https://doi.org/10.3390/quantum2010014

McKinsey & Company. (2019). Automation and the future of work in Indonesia. https://www.mckinsey.com/featured-insights/asia-pacific/automation-and-the-future-of-work-in-indonesia

Mishra, K. N., & Chakraborty, C. (2020). A novel approach toward enhancing the quality of life in smart cities using clouds and IoT-based technologies. In M. Farsi, A. Daneshkhah, A. Hosseinian-Far, & H. Jahankhani (Eds.), Digital twin technologies and smart cities (pp. 19–35). Springer. https://doi.org/10.1007/978-3-030-18732-3_2

Nam, T. (2019). Citizen attitudes about job replacement by robotic automation. Futures, 109, 39–49. https://doi.org/10.1016/j.futures.2019.04.005

Organisation for Economic Co-operation and Development. (2019). Artificial intelligence in society. OECD Publishing. https://doi.org/10.1787/eedfee77-en

Parker, K., Morin, R., & Horowitz, J. M. (2019, March 21). 5. The future of work in the automated workplace. Pew Research Center. https://www.pewresearch.org/social-trends/2019/03/21/the-future-of-work-in-the-automated-workplace/

PwC. (2019). Sizing the prize: Exploiting the AI revolution—What's the real value of AI for your business and how can you capitalise? https://www.pwc.com/gx/en/issues/data-and-analytics/publications/artificial-intelligence-study.html

Ravi, K., & Ravi, V. (2015). A survey on opinion mining and sentiment analysis: Tasks, approaches and applications. Knowledge-Based Systems, 89, 14–46. https://doi.org/10.1016/j.knosys.2015.06.015

Rhee, T., & Jin, X. (2021). The effect of job anxiety of replacement by artificial intelligence on organizational members’ job satisfaction in the 4th industrial revolution era: The moderating effect of job uncertainty. Journal of Digital Convergence, 19(7), 1–9. https://doi.org/10.14400/JDC.2021.19.7.001

Ririh, K. R., Laili, N., Wicaksono, A., & Tsurayya, S. (2020). Studi komparasi dan analisis SWOT pada implementasi kecerdasan buatan (artificial intelligence) di Indonesia. J@ti Undip: Jurnal Teknik Industri, 15(2), 122–133. https://doi.org/10.14710/jati.15.2.122-133

Robertson, J. (2014). Human rights vs. robot rights: Forecasts from Japan. Critical Asian Studies, 46(4), 571–598. https://doi.org/10.1080/14672715.2014.960707

Singh, S., Sharma, P. K., Yoon, B., Shojafar, M., Cho, G. H., & Ra, I. H. (2020). Convergence of blockchain and artificial intelligence in IoT network for the sustainable smart city. Sustainable Cities and Society, 63, Article 102364. https://doi.org/10.1016/j.scs.2020.102364

Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25(2), 173–180. https://doi.org/10.1207/s15327906mbr2502_4

Terzi, R. (2020). An adaptation of artificial intelligence anxiety scale into Turkish: Reliability and validity study. International Online Journal of Education and Teaching, 7(4), 1501–1515. https://www.iojet.org/index.php/IOJET/article/view/1031

Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. https://doi.org/10.1007/BF02291170

Tuomi, I. (2018). The impact of artificial intelligence on learning, teaching, and education: Policies for the future (M. Cabrera, R. Vuorikari, & Y. Punie, Eds.; EUR 29442 EN). Publications Office of the European Union. https://doi.org/10.2760/12297

Visintin, F., Porcelli, I., & Ghini, A. (2014). Applying discrete event simulation to the design of a service delivery system in the aerospace industry: A case study. Journal of Intelligent Manufacturing, 25, 1135–1152. https://doi.org/10.1007/s10845-013-0742-1

Vroom, V. H. (1964). Work and motivation. John Wiley & Sons.

Wang, Y.-Y., & Wang, Y.-S. (2022). Development and validation of an artificial intelligence anxiety scale: An initial application in predicting motivated learning behavior. Interactive Learning Environments, 30(4), 619–634. https://doi.org/10.1080/10494820.2019.1674887

Wheaton, B., Muthén, B., Alwin, D. F., & Summers, G. F. (1977). Assessing reliability and stability in panel models. Sociological Methodology, 8, 84–136. https://doi.org/10.2307/270754

Downloads

Published

2025-06-09

How to Cite

Ramadini, S., & Pratiwi, R. (2025). Ensuring Reliability: Adaptation and Validation of the AI Anxiety Scale (AIAS) in Indonesia. Journal of Psychological Perspective, 7(2), 151–160. https://doi.org/10.47679/jopp.7210452025

Issue

Section

Empirical Research

Citation Check

Similar Articles

1 2 3 4 5 6 7 8 9 > >> 

You may also start an advanced similarity search for this article.