Effectiveness Analysis of Nadine Implementation at Indonesia’s MoF: A Combined Approach Using Importance-Performance Analysis and Causal Relationship Analysis
Article Sidebar
Main Article Content
Abstract
Research Originality — This study provides a unique empirical examination of technology acceptance within Indonesia's public administration system. Unlike previous research, which often focuses on developed countries, this study addresses a gap by analyzing challenges and strategies specific to a developing nation. It contributes to the innovation diffusion theory and the unified theory of acceptance and use of technology (UTAUT) by offering real-world data on the adoption of a digital system within a government institution.
Research Objectives — To evaluate the effectiveness of the NADINE (Digital Official Script System) application implemented by Indonesia's Ministry of Finance (MOF). Specifically, it investigates user satisfaction, identifies areas for improvement, and explores the relationship between policy success and the Application's performance.
Research Methods — A quantitative survey approach is employed, collecting data from over 2,500 MOF employees. Importance-performance analysis is used to assess user satisfaction and prioritize key areas for improvement. Correlation and regression analyses examine the relationship between policy success and the Application's effectiveness. Additionally, a word cloud analysis is conducted to extract insights from user feedback.
Empirical Results — Findings indicate high user satisfaction with both the Policy and the NADINE application. Despite the positive reception, areas such as user interface and navigation require improvement. A strong positive correlation is observed, demonstrating a close link between policy effectiveness and application performance. Regression analysis further confirms this influence, suggesting that improvements in the Application can enhance policy outcomes.
Implications — The study highlights the importance of relative advantage, compatibility, and ease of use in user acceptance of digital government systems. Key recommendations include enhancing user training and optimizing the user interface to improve the overall user experience. These findings provide valuable insights for policymakers and system developers in designing and implementing digital solutions in public administration, particularly in developing country contexts.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright notice can be accessed here
References
Addo, A., & Senyo, P. (2020). Digitalization and government corruption in developing countries: Towards a framework and research agenda. Academy of Management Proceedings, 2020(1). 10.5465/ambpp.2020.16765abstract
Agyekum, K., Akli-Nartey, E. E. K., Kukah, A. S., & Agyekum, A. K. (2023). Importance-performance analysis (IPA) of the indoor environmental quality (IEQ) of an EDGE-certified building in Ghana. International Journal of Building Pathology and Adaptation, 41(1), 36-50. 10.1108/IJBPA-03-2021-0040
Alblooshi, S., & Abdul Hamid, N. A. B. (2022). The effect of performance expectancy on actual use of e-learning throughout the mediation role of behaviour intention. Journal of E-Learning and Higher Education. 10.5171/2022.628490
Alidousti, S., & Sahli, F. (2024). National and sectoral information technology planning: A systematic literature review. International Journal of Public Sector Management. 10.1108/IJPSM-09-2023-0286
Almatrodi, I., & Skoumpopoulou, D. (2023). Organizational routines and digital transformation: An analysis of how organizational routines impact digital transformation transition in a Saudi university. Systems, 11(5). 10.3390/systems11050239
Atique, M., Htay, S. S., Mumtaz, M., Khan, N. U., & Altalbe, A. (2024). An analysis of e-governance in Pakistan from the lens of the Chinese governance model. Heliyon, 10(5), e27003. 10.1016/j.heliyon.2024.e27003
Babcock, H. M. (2005). A civic-republican vision of domestic dependent nations in the twenty-first century: Tribal sovereignty re-envisioned, reinvigorated, and re-empowered. Utah Law Review.
Cahyarini, B. R., & Samsara, L. (2021). The challenges of digital competency implementation towards world-class bureaucracy. Jurnal Borneo Administrator, 17(2), 123-137. 10.24258/jba.v17i2.825
Ciancarini, P., Giancarlo, R., & Grimaudo, G. (2024). Digital transformation in the public administrations: A guided tour for computer scientists. IEEE Access, 12, 3363075. 10.1109/ACCESS.2024.3363075
Conde, M. A., & Wasiq, S. (2021). Digital transformation of business challenges and issues in developing countries. Journal of Information Systems and Digital Technologies, 3(1), 23-37. 10.31436/jisdt.v3i1.149
Costaner, L., Lisnawita, L., & Guntoro, G. (2024). Importance performance analysis of patient satisfaction with fuzzy logic at the Rumbai maternity clinic. SISTEMASI, 13(1), 12-23. 10.32520/stmsi.v13i1.3527
Daniel, J., & Ndumbaro, F. (2022). A descriptive study of infrastructure capabilities for digital records preservation among selected public institutions in Tanzania. University of Dar Es Salaam Library Journal, 16(2), 145-160. 10.4314/udslj.v16i2.10
David, A., Yigitcanlar, T., Li, R. Y. M., Corchado, J. M., Cheong, P. H., Mossberger, K., & Mehmood, R. (2023). Understanding local government digital technology adoption strategies: A PRISMA review. Sustainability (Switzerland), 15(12), 9645. 10.3390/su15129645
Di Giulio, M., & Vecchi, G. (2023). Implementing digitalization in the public sector: Technologies, agency, and governance. Public Policy and Administration, 38(2), 145-162. 10.1177/09520767211023283
Dobrolyubova, E., Klochkova, E., & Alexandrov, O. (2019). Digitalization and effective government: What is the cause and what is the effect? Communications in Computer and Information Science, 1048, 57-71. 10.1007/978-3-030-37858-5_5
Dwivedi, S., Gupta, D., Agrawal, R., Mishra, A., Gaikwad, S. V., Kushwaha, V., Raghuwanshi, S., & Hasan, A. (2024). Profiling of OTT viewers and their perception mapping using advanced technological models. International Journal of Religion, 5(1), 15-29. 10.61707/vf9h1w64
Edwards, D. W. (2021). Critical infrastructure literacies and/as ways of relating in big data ecologies. Computers and Composition, 61, 102653. 10.1016/j.compcom.2021.102653
Enaifoghe, A., & Ndebele, N. (2023). Examining the barriers to the adoption and integration of information communication technologies as e-government in Africa. International Journal of Research in Business and Social Science, 12(7), 112-125. 10.20525/ijrbs.v12i7.2723
Escobar, F., Almeida, W. H. C., & Varajão, J. (2023). Digital transformation success in the public sector: A systematic literature review of cases, processes, and success factors. Information Polity, 28(1), 12-28. 10.3233/IP-211518
Darawsha, E. (2023). The role of information and communication technology in public sector administration: The readiness of the local authorities in the Arab sector in Israel. Tuijin Jishu/Journal of Propulsion Technology, 44(2), 210-225. 10.52783/tjjpt.v44.i2.210
Gai, S., Fu, J., Rong, X., & Dai, L. (2023). Importance–performance analysis and improvement of an urban park's cultural ecosystem services based on users' perspectives: A Beijing case study. Journal of Asian Architecture and Building Engineering, 22(2), 135-150. 10.1080/13467581.2022.2049800
Gauthier-Beaupré, A., Battistini, B. J., Kuziemsky, C., & Jutai, J. W. (2023). Policymaker perspectives on self-management of disease and disabilities using information and communication technologies. Health Research Policy and Systems, 21(1), 45. 10.1186/s12961-023-01004-7
Gayatri, G., Jaya, I. G. N. M., & Rumata, V. M. (2023). The Indonesian digital workforce gaps in 2021–2025. Sustainability, 15(1), 754. 10.3390/su15010754
Gray, J., Gerlitz, C., & Bounegru, L. (2018). Data infrastructure literacy. Big Data and Society, 5(2), 1-12. 10.1177/2053951718786316
Hafseld, K. H. J., Hussein, B., & Rauzy, A. B. (2021). An attempt to understand complexity in a government digital transformation project. International Journal of Information Systems and Project Management, 9(3), 35-49. 10.12821/ijispm090304
Hameed, M. A., & Counsell, S. (2014). Establishing relationships between innovation characteristics and IT innovation adoption in organizations: A meta-analysis approach. International Journal of Innovation Management, 18(1), 1450007. 10.1142/S1363919614500078
Hammerschmid, G., Breaugh, J., & Rackwitz, M. (2024). Intergovernmental collaboration in the context of digital transformation: State-of-the-art and theoretical notions. In Collaborating for Digital Transformation: How Internal and External Collaboration Can Contribute to Innovate Public Service Delivery (pp. 123-145). 10.4337/9781803923895.00011
Heidari, I., Eshlaghy, A. T., & Seyyed Hoseini, S. M. (2023). Sustainable transportation: Definitions, dimensions, and indicators – Case study of importance-performance analysis for the city of Tehran. Heliyon, 9(10), e20457. 10.1016/j.heliyon.2023.e20457
Hokka, J. (2022). Welfare data society? Critical evaluation of the possibilities of developing data infrastructure literacy from user data workshops to public service media. In Transforming Communication (pp. 75-89). 10.1007/978-3-030-96180-0_12
Hooda, A., Gupta, P., Jeyaraj, A., Giannakis, M., & Dwivedi, Y. K. (2022). The effects of trust on behavioral intention and use behavior within e-government contexts. International Journal of Information Management, 67, 102553. 10.1016/j.ijinfomgt.2022.102553
Indrabudiman, A., Handayani, W. S., & Faeni, D. P. (2019). Implementation of importance performance analysis methods as government internal supervisory apparatus (GISA) performance measurements in Indonesian provinces. International Journal of Recent Technology and Engineering, 8(2 Special Issue 4), 789-798. 10.35940/ijrte.B1176.0782S419
Jedynak, M., Czakon, W., Kuźniarska, A., & Mania, K. (2021). Digital transformation of organizations: What do we know and where to go next? Journal of Organizational Change Management, 34(3), 1-12. 10.1108/JOCM-10-2020-0336
Kagoya, S. (2020). The use of digital transformation to address education challenges caused by COVID-19 in developing countries. Social Sciences, 9(6), 245-256. 10.11648/j.ss.20200906.14
Kattel, R., & Mergel, I. (2019). Estonia's digital transformation. In Great Policy Successes (pp. 345-362). 10.1093/oso/9780198843719.003.0008
Khliborob, N., Boiarsky, O., & Zabolotna, H. (2023). Implementation of the principles of administrative procedure in the provision of digital public services: EU experience and Ukrainian practice. Baltic Journal of Economic Studies, 9(3), 207-213. 10.30525/2256-0742%2F2023-9-3-207-213
Kuhlmann, S., & Heuberger, M. (2023). Digital transformation going local: Implementation, impacts, and constraints from a German perspective. Public Money and Management, 43(2), 123-134.
10.1080/09540962.2021.1939584
Lee, S., & Liu, P. (2023). Examining customers' perceptions of high-end ethnic dining in the United States: An application of importance-performance analysis. International Journal of Hospitality and Tourism Administration, 24(2), 123-137. 10.1080/15256480.2021.1981184
Lemieux, V. L. (2016). One step forward, two steps backward? Does e-government make governments in developing countries more transparent and accountable? In One Step Forward, Two Steps Backward? Does E-Government Make Governments in Developing Countries More Transparent and Accountable? (pp. 112-125). 10.1596/23647
Nalbandyan, A. A., Savinskiy, A. V., & Finley, J. T. (2024). Role of digital technologies in transformation of economics, finance, and public administration. International Trade and Trade Policy, 9(4), 154-168.
10.21686/2410-7395-2023-3-154-168
Namagembe, F., Nakakawa, A., Tulinayo, F. P., Proper, H. A., & Overbeek, S. (2023). Towards an e-government enterprise architecture framework for developing economies. Complex Systems Informatics and Modeling Quarterly, 2023(35), 12-29. 10.7250/csimq.2023-35.02
Nielsen, M. M., & Jordanoski, Z. (2020). Digital transformation, governance, and coordination models: A comparative study of Australia, Denmark and the Republic of Korea. Proceedings of the 21st Annual International Conference on Digital Government Research.
10.1145/3396956.3396987
Oey, E., Librianne, G., Elvira, E., & Irawan, D. A. (2023). Comparing two ways of integrating fuzzy Kano and importance-performance analysis: With a case study in a beauty clinic. International Journal of Productivity and Quality Management, 38(3), 245-262.
10.1504/IJPQM.2023.129604
Pandey, P., Madhusudhan, M., & Singh, B. P. (2023). Quantitative research approach and its applications in library and information science research. Access: An International Journal of Nepal Library Association, 2(01), 35-50.
10.3126/access.v2i01.58895
Park, H., & Samijadi, M. F. (2021). Citizens' perception of e-government in Korea: Importance-performance analysis on users' satisfaction and behavioral intention. Journal of Public Administration and Governance, 11(2), 95-109. 10.5296/jpag.v11i2.18677
Puentes-Poloche, M., Guzmán Rincón, A., & Cala-Vitery, F. (2023). Implementation of the digital government public policy in Colombia: Lessons learned from public entities. F1000Research, 12, 45-60. 10.12688/f1000research.139586.1
Recskó, M., & Aranyossy, M. (2024). User acceptance of social network-backed cryptocurrency: A unified theory of acceptance and use of technology (UTAUT)-based analysis. Financial Innovation, 10(1), 25-40.
10.1186/s40854-023-00511-4
Robertson, F. A., & Samy, M. (2020). Rationales for integrated reporting adoption and factors impacting on the extent of adoption: A UK perspective. Sustainability Accounting, Management and Policy Journal, 11(2), 150-167. 10.1108/SAMPJ-02-2019-0042.
Rogers, Everett M. (2003). Diffusion of Innovations, 5th Edition. Free Press.
Rogers, E.M., Singhal, A. and Quinlan, M.M. (2009) Diffusion of innovations. In: Stacks, D. and Salwen, M., Eds., An Integrated Approach to Communication Theory and Research, Lawrence Erlbaum Associates, Mahwah, 418-434.
Rosmayanti, V., Noni, N., & Patak, A. A. (2022). Students' acceptance of technology use in learning English pharmacy. International Journal of Language Education, 6(3), 45-59.
10.26858/ijole.v6i3.24144
Sabani, A., Deng, H., & Thai, V. (2019). Evaluating the development of e-government in Indonesia. ACM International Conference Proceeding Series. 10.1145/3305160.3305191
Saleem, M. A., Afzal, H., Ahmad, F., Ismail, H., & Nguyen, N. (2023). An exploration and importance-performance analysis of bus rapid transit systems' service quality attributes: Evidence from an emerging economy. Transport Policy, 141, 56-70.
10.1016/j.tranpol.2023.07.010
Senyo, P. K., Effah, J., & Osabutey, E. L. C. (2021). Digital platformisation as public sector transformation strategy: A case of Ghana's paperless port. Technological Forecasting and Social Change, 162, 120387.
10.1016/j.techfore.2020.120387
Shashyna, M., Gudz, P., Pankova, A., Benchak, O., & Nemyrovska, O. (2023). Modernization of public administration in Eastern Europe in the context of implementation of digitalization. Eastern-European Journal of Enterprise Technologies, 12(3), 45-60.
10.15587/1729-4061.2023.285746
Singhal, P., Pahle, M., Kalkuhl, M., Levesque, A., Sommer, S., & Berneiser, J. (2022). Beyond good faith: Why evidence-based Policy is necessary to decarbonize buildings cost-effectively in Germany. Energy Policy, 169, 113191. 10.1016/j.enpol.2022.113191
Srimathi, H., & Krishnamoorthy, A. (2019). Paperless administration in Indian higher education. International Journal of Engineering and Advanced Technology, 8(4), 760-764.
Sun, M., Liu, J., & Lu, J. (2024). Digital literacy in Africa: Exploring its relationship with infrastructure, Policy, and social inequality. African Journalism Studies, 45(2), 145-162.
10.1080/23743670.2024.2329705
Sutter, F., & Kihara, A. (2019). Determinants of successful implementation of digital literacy project in public primary schools in Baringo County, Kenya. Journal of Entrepreneurship and Project Management, 4(1), 67-80. 10.47941/jepm.297
Tan, X. (2021). Innovation diffusion theory and social embeddedness: A new perspective. https://api.semanticscholar.org/CorpusID:248149720
Udovenko, I. (2022). Public governance in digital transformation: From electronic document exchange to digital ecosystems. Analysis and Forecasting. IMEMO Journal, 2, 32-42.
10.20542/afij-2022-2-32-42
Urquizo, J., Singh, P., Lansdale, D., Sanchez, N., Bermudez, K., Easlick, T., Lawrence, C., Wacker, N., Cooper, K., Choi, C. H., Huhmann, M., Sullivan, J., Cordova, J., & Martin, C. (2020). Laying the foundations for a digital literacy program in the Galapagos Islands. 2020 IEEE Global Humanitarian Technology Conference.
10.1109/GHTC46280.2020.9342878
Venkatesh, V., Thong, J. Y. L., & Xu, X. (2003). Unified theory of acceptance and use of technology: A synthesis and the road ahead. Journal of the Association for Information Systems, 17(5), 328-376. 10.17705/1jais.00428
Villumsen, S., Faxvaag, A., & Nøhr, C. (2019). Development and progression in Danish eHealth policies: Towards evidence-based policymaking. Studies in Health Technology and Informatics, 264, 145-160.
10.3233/SHTI190390
Wandaogo, A. (2022). Does digitalization improve government effectiveness? Evidence from developing and developed countries. Applied Economics, 54(33), 3905-3919.
10.1080/00036846.2021.2016590
Wang, J., Li, X., Wang, P., Liu, Q., Deng, Z., & Wang, J. (2023). Research trend of the unified theory of acceptance and use of technology theory: A bibliometric analysis. Sustainability, 14(1), 10-25. 10.3390/su14010010
Wong, M. S., Hideki, N., & George, P. (2011). The use of importance-performance analysis (IPA) in evaluating Japan's e-government services. Journal of Theoretical and Applied Electronic Commerce Research, 6(2), 17-30.
10.4067/S0718-18762011000200003
Wu, X., Liao, H., & Zhang, C. (2023). Importance-performance analysis to develop product/service improvement strategies through online reviews with reliability. Annals of Operations Research, 320(3), 145-162.
10.1007/s10479-023-05594-x
Xu, S., Kee, K. F., Li, W., Yamamoto, M., & Riggs, R. E. (2023). Examining the diffusion of innovations from a dynamic, differential-effects perspective: A longitudinal study on AI adoption among employees. Communication Research.
10.1177/00936502231191832
Yuen, K. F., Cai, L., Qi, G., & Wang, X. (2021). Factors influencing autonomous vehicle adoption: An application of the technology acceptance model and innovation diffusion theory. Technology Analysis and Strategic Management, 33(5), 654-669. 10.1080/09537325.2020.1826423
Zeebaree, M., & Aqel, M. (2021). A weight-analysis technique of existing research on e-government implementation challenges in developing countries. Journal of Optimization in Industrial Engineering, 14(1), 95-108. 10.22094/JOIE.2020.677842.