Exploring the Use of Explainable Artificial Intelligence (XAI) in Production and Operations: A Systematic Review

Document Type : Original Article

Authors

1 Associate Professor, Faculty of Management & Accounting, College of Farabi, University of Tehran, Iran.

2 Ph.D. Candidate, Faculty of Management and Accounting College of Farabi, University of Tehran, Iran.

Abstract
Today, with the development of artificial intelligence, its application in different areas, including production and operations, has expanded. Explainable artificial intelligence (XAI) is a new research topic that has emerged with the development of artificial intelligence. This study aimed to investigate the applications of XAI in production and operations using the systematic review approach. For this purpose, a systematic review of the most recent studies published in the Science Direct, Scopus, and Emerald knowledge bases was conducted. After screening through different stages, 29 articles were reviewed and analyzed. The results showed that publications on XAI have been on an upward trend in recent years, with a significant increase observed from 2021 to 2024. Also, the fields of engineering, production, decision-making, and computer science are the major areas in which recent studies have been published. The results also suggested that the largest scope of XAI application was observed at the organizational level, followed by the industrial level. Based on the findings, the fields of production and operations, followed by logistics and supply chain, were the most frequently studied areas. Regarding the methods used, the SHAP method was the most commonly applied method in the XAI studies, followed by Integrated Gradient and SVM methods. In general, the results of this study showed that XAI is a new field of research that is gradually developing in terms of methodology and areas of application.

Keywords

Subjects


 

Arinez, J. F., Chang, Q., Gao, R. X., Xu, C., & Zhang, J. (2020). Artificial intelligence in advanced manufacturing: Current status and future outlook. Journal of Manufacturing Science and Engineering, 142(11), 110804.
Babaeian Amini, A., Hakimzade, H., & Noorani, V. (2012). Determining the maximum output flow due to the splitting of the earthen dam using artificial intelligence. Civil and Environmental Engineering (Technical College), 40(3), 63-80.
Boden, M. A. (1998). Creativity and artificial intelligence. Artificial intelligence, 103(1-2), 347-356.
Brito, L. C., Susto, G. A., Brito, J. N., & Duarte, M. A. V. (2023). Fault Diagnosis using eXplainable AI: A transfer learning-based approach for rotating machinery exploiting augmented synthetic data. Expert Systems with Applications, 232 (1), 120860.
Chowdhury, M., & Sadek, A. W. (2012). Advantages and limitations of artificial intelligence. Artificial intelligence applications to critical transportation issues, 6(3), 360-375.
De Loë, R. C., Melnychuk, N., Murray, D., & Plummer, R. (2016). Advancing the state of policy Delphi practice: a systematic review evaluating methodological evolution, innovation, and opportunities. Technological Forecasting and Social Change, 104 (1), 78-88.
Goyal, K., Kumar, P., & Verma, K. (2024). XAI-empowered IoT multi-sensor system for real-time milk adulteration detection. Food Control, 164(1), 110495.
Holzinger, A., Langs, G., Denk, H., Zatloukal, K., & Müller, H. (2019). Causability and explainability of artificial intelligence in medicine. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(4), e1312.
Keivanpour, M., Javideh, M., & Ebrahimi, M. (2009). Computerized Crime Analysis Using Artificial Intelligence And Datamining For Crime Detection.Detective 2(7), 98-117.
Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence, 267 (1), 1-38.
Nagy, B., Szabados-Nacsa, Á., Fülöp, G., Nagyné, A. T., Galata, D. L., Farkas, A., Marosi, G. (2023). Interpretable artificial neural networks for retrospective QbD of pharmaceutical tablet manufacturing based on a pilot-scale developmental dataset. International Journal of Pharmaceutics, 633 (1), 122620.
Nallakaruppan, M., Shankar, N., Bhuvanagiri, P. B., Padmanaban, S., & Khan, S. B. (2024). Advancing solar energy integration: Unveiling XAI insights for enhanced power system management and sustainable future. Ain Shams Engineering Journal, 15(6), 102740.
Okoli, C., & Schabram, K. (2015). A guide to conducting a systematic literature review of information systems research. SSRN Electronic Journal, 10 (1), doi: 10.2139/ssrn.1954824.
Quiñones, D., & Rusu, C. (2017). How to develop usability heuristics: A systematic literature review. Computer standards & interfaces, 53 (1), 89-122.
Sengers, F., Wieczorek, A. J., & Raven, R. (2019). Experimenting for sustainability transitions: A systematic literature review. Technological Forecasting and Social Change, 145 (1), 153-164.
Silva, M. (2015). A systematic review of Foresight in Project Management literature. Procedia Computer Science, 64 (1), 792-799.
Soroush, E., & Monajemi, A. (2018). A Philosophical reflection on Artificial Intelligence in Clinical Practice: Epistemological approach. Philosophy of Science, 7(14), 27-58.
Subramaniyan, M., Skoogh, A., Bokrantz, J., Sheikh, M. A., Thürer, M., & Chang, Q. (2021). Artificial intelligence for throughput bottleneck analysis–State-of-the-art and future directions. Journal of Manufacturing Systems, 60 (1), 734-751.
Tahari-Mehrjerdi, M.-H., Babaei-Maybodi, H., & Taghizadeh-Mehrjerdi, R. (2012). Energy Consumption Modeling and Forecasting in Iran’s Transportation Sector: Application of Artificial Intelligence Models. Planning and Budgeting, 17(1), 29-47.
Tolan, S., Pesole, A., Martínez-Plumed, F., Fernández-Macías, E., Hernández-Orallo, J., & Gómez, E. (2021). Measuring the occupational impact of ai: tasks, cognitive abilities and ai benchmarks. Journal of Artificial Intelligence Research, 71 (1), 191-236.
Van Zyl, C., Ye, X., & Naidoo, R. (2024). Harnessing eXplainable artificial intelligence for feature selection in time series energy forecasting: A comparative analysis of Grad-CAM and SHAP. Applied Energy, 353(1), 122079.
Vilone, G., & Longo, L. (2020). Explainable artificial intelligence: a systematic review. arXiv preprint, 10(1), doi:  arXiv:2006.00093.
Vishnevskiy, K., Karasev, O. (2016). Challenges and Opportunities for Corporate Foresight. In: Gokhberg, L., Meissner, D., Sokolov, A. (eds) Deploying Foresight for Policy and Strategy Makers. Science, Technology and Innovation Studies. Springer, Cham. https://doi.org/10.1007/978-3-319-25628-3_5
Yarmohammadian, M., Mohammadi, E., & Movahhedi, F. (2011). standards for compiling review articles on health system, health information management, health services management.
Zhang, B., Anderljung, M., Kahn, L., Dreksler, N., Horowitz, M. C., & Dafoe, A. (2022). Ethics and governance of artificial intelligence: a survey of machine learning researchers. Paper presented at the IJCAI, dio: 10.48550/arXiv.2105.02117.
Zhang, C., & Lu, Y. (2021). Study on artificial intelligence: The state of the art and future prospects. Journal of Industrial Information Integration, 23, 100224.
Zhao, S., Blaabjerg, F., & Wang, H. (2020). An overview of artificial intelligence applications for power electronics. IEEE Transactions on Power Electronics, 36(4), 4633-4658.