Download as pdf or txt
Download as pdf or txt
You are on page 1of 13

International Journal of Public Administration

ISSN: (Print) (Online) Journal homepage: https://www.tandfonline.com/loi/lpad20

The Socio-Economic Efficiency of Digital


Government Transformation

Anna Sanina, Aleksey Balashov & Mariia Rubtcova

To cite this article: Anna Sanina, Aleksey Balashov & Mariia Rubtcova (2021): The Socio-
Economic Efficiency of Digital Government Transformation, International Journal of Public
Administration, DOI: 10.1080/01900692.2021.1988637

To link to this article: https://doi.org/10.1080/01900692.2021.1988637

Published online: 26 Oct 2021.

Submit your article to this journal

Article views: 90

View related articles

View Crossmark data

Full Terms & Conditions of access and use can be found at


https://www.tandfonline.com/action/journalInformation?journalCode=lpad20
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION
https://doi.org/10.1080/01900692.2021.1988637

The Socio-Economic Efficiency of Digital Government Transformation


a b c
Anna Sanina , Aleksey Balashov , and Mariia Rubtcova
a
International Laboratory for Digital Transformation in Public Administration, HSE University, Moscow, Russia; bDepartment of Management in
Social Sphere, Saint Petersburg State Institute of Psychology and Social Work, Saint Petersburg, Russia; cDepartment of Social Management
and Planning, Saint Petersburg State University, Saint Petersburg, Russia

ABSTRACT KEYWORDS
The article is devoted to the understanding of digital government transformation (DGT) as key to Digital government; digital
improving public administration and governance. The paper complements the debate regarding government transformation;
DGT rationale in public administration, providing theoretical and empirical analysis of its socio- public governance;
economic impact and performance in governance. The empirical part is based on two regression innovation in the public
sector; socio-economic
analyses exploring indicators of DGT and public administration performance. The article concludes efficiency
that (1) DGT is understood as innovation, but innovation in the public sector is also commonly
associated with DGT, (2) this innovation helps to reshape the governance to match the society’s
needs, (3) the policy-based approach to DGT is not enough explanation of its rationale and
efficiency, and (4) there are certain improvements in the socio-economic sphere that are related
to DGT and thus help one understand its meaning for the contemporary world.

Introduction
innovation in the public sector. Digital technologies help
Digital technologies have significantly changed the routine to automate and improve data processing and filtering,
of public administration and governance, as well as the information codification, and knowledge distribution.
working environment of civil servants (Wirtz et al., 2020). In the public sector, digital technologies are now used
They include knowledge management software, e-govern­ most often in situations where there is a large amount of
ment services, process automation systems, virtual agents, data, a lack of people and experts for its analysis, and the
predictive analysis and data visualization, etc. The imple­ existence of a routine process that can be automated and
mentation of these technologies is one of the leading trends improved over time. As a result, it becomes possible to
of contemporary society, with a significant impact on the reduce administrative workloads, solve resource alloca­
social and economic processes taking place in society. tion problems, and perform more complex tasks with
However, there are research gaps on the impact of digital the help of machine-based technology, especially artifi­
transformation on government performance. On the one cial intelligence (AI) (Giovanni et al., 2020). The wide­
hand, the introduction of digital technologies into the spread introduction of these technologies has led to the
practice of governance is obvious and necessary, since concept of transformation of the public administration
modern technologies leave no alternative but the digitaliza­ and governance. For many researchers, politicians, and
tion of an increasing number of administrative and man­ civil servants, it is obvious that the point of no return for
agement functions and procedures (Tangi et al., 2021). On modern public administration has passed, and the intro­
the other hand, there are risks and difficulties associated duction of new digital technologies is already becoming
with introducing technologies that are not fully developed routine.
and entrusting them with real management processes. On the other hand, digital technologies are some of
These risks make the authorities hesitate and view digital the most important innovations in public administra­
technologies as an auxiliary mechanism of public admin­ tion (Curtis, 2019). The development of many spheres of
istration or, in some cases, prevent the introduction of public life, including the state of cities, medicine, educa­
digital technologies into public administration processes. tion, logistics, transport, defense, and others depends on
Studies discuss using digital technologies from two the degree of development of digital technologies in
points of view. On the one hand, implementation of public administration (Giovanni et al., 2020). Digital
digital technologies is one of the best mechanisms for technologies research is still lacking, and there is

CONTACT Anna Sanina anna.g.sanina@gmail.com International Laboratory for Digital Transformation in Public Administration, HSE University,
Moscow, Russia.
© 2021 Taylor & Francis Group, LLC
2 A. SANINA ET AL.

a special need to understand the benefits of using digital which the largest number of articles was published
technologies in the public sector (Bannister & Connolly, around 2016 (Reis et al., 2019), as digital technology
2020; Panagiotopoulos et al., 2019). Governments and had the biggest impact on the public sector that year.
administration authorities need to understand all func­ However, after 2016, the number of articles on digitali­
tional abilities of these technologies for their use in the zation in public administration decreased, which can be
public sector, and they must understand the reasons for explained by a series of scandals related to the protection
using them (Wirtz et al., 2020). This task prompts dis­ of personal data, when many digital systems demon­
cussions of whether digital technologies are really good strated their vulnerability to cyberattacks (Kushzhanov
for public administration and whether they contribute & Aliyev, 2018).
to the transformation of governance in a positive way. Since 2018, research on digitalization of the public
For many authorities, digital technologies implementa­ sector has switched to the broader topic of digital gov­
tion means serious risks. Aside from technical risks, ernment transformation (DGT). Much of the work on
these risks are associated with a decrease in human DGT was published after 2018 (Curtis, 2019; Giovanni
control over the decisions made, the inability to influ­ et al., 2020; Lindgren & van Veenstra, 2018; Tangi et al.,
ence the assessment of the quality of these decisions, and 2021). The first papers were exploratory sketches and
the consequences of a shrinking workforce. conference abstracts. The most complete presentation of
The range of applicability of digital technologies in this concept can be found in the article by Tangi et al.
public administration is wide. Their applications are (2021), which defines DGT as “second-order organiza­
potentially relevant to every area of public administra­ tional changes enabled by digital technologies trans­
tion. At the same time, the implementation of digital forming the way organizations are structured and
technologies largely depends on a fundamental under­ organized and resulting in a new state, from the point
standing of whether or not these technologies are posi­ of view of processes, culture, roles, relationships, and
tive for the development of public administration. possibly all aspects of the organization” (p. 2).
Despite the up-to-date experience of digitalization of Digital transformation includes two elements:
public administration allowing one to draw certain con­ a technical system, which is possible due to the develop­
clusions proving the importance of digital technologies ment of technology, and a social system, which includes
for public administration, there are still many questions all elements of the technical system environment and
about the effectiveness of the digital transformation of has a great impact on social elements (Bostrom &
public administration. Heinen, 1977). Thus, DGT is fundamentally different
This paper is motivated by these concerns and uncer­ from the previous view of the digitalization of public
tainties. Its goal is twofold. First, it aims to provide administration. If digitalization was of secondary impor­
empirical understanding of the concept of digital govern­ tance and was supposed to help existing management
ment transformation (DGT) from the point of view of its structures to better perform their functions, then DGT
socio-economic efficiency. Second, it seeks evidence on involves a radical revision of the management structures
the impact of DGT, complementing the debate on themselves.
whether or not it can be associated with some positive Much of the DGT research was inspired by the intro­
trends. The rest of the article is organized as follows. The duction of AI in public administration and governance.
literature review section explores the terminology issues A significant part of DGT, AI suggests the ability of
and key aspects of DGT research in public administra­ a computer system to engage in intelligent behavior
tion. The methodology section explores the empirically similar to that of a human, which means the ability to
based features of the definition of digital government perceive, understand, make decisions, and learn in con­
transformation in contemporary governance that can be ditions of a certain autonomy, designed to achieve spe­
found internationally; additionally, it describes the cific goals. In real life, there is disillusionment with
research questions as well as the set of data employed. intelligent management systems and their potential in
The results section summarizes the estimation results. solving managerial tasks. Perhaps this is also the reason
The last section provides the key findings of the research that, as will be demonstrated, studies of AI are more
and matches them with the broader field of discussion. about technological sites and less about human/social
features and consequences. It is important to note that
every transformation should have a goal and take into
Literature review
account both technical and social aspects; therefore, the
Digital government transformation (DGT) is a relatively development of digital government technologies should
new issue in public administration. It is a continuation be accompanied by changes in organizational character­
of the broader topic of public sector digitalization, on istics and have a positive effect. There has been some
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 3

discussion around the question of the positive effects of The socio-economic efficiency of public administra­
DGT. For example, Weerakkody et al. (2011, p. 321) tion as such is not often the subject of discussion
note that digital transformation should enable the deliv­ (Afonso, Schuknecht, & Tanzi, 2020; Aristovnik,
ery of public sector services, taking into account such 2012). Moreover, these discussions are not related to
aspects as efficiency, transparency, accountability, and the issues of digital transformation of public adminis­
citizenship. tration, and the proposed performance criteria do not
Still, if we look at the available research, not all of these imply the mandatory use of digital technologies. The
aspects have been well studied. DGT’s transparency, analysis of the literature demonstrates that theoretical
accountability, and citizen-centeredness have received studies of DGT and its implementation rarely center on
more research attention than its effectiveness. The politi­ the question of how digital transformation and public
cal implications of digital transformation are most often administration efficiency are related. DGT is seen more
explored. DGT is better at ensuring transparency, control as a tool for political and organizational change. Only
over corruption, and the degree of participation and sup­ the most recent studies (Bannister & Connolly, 2020;
port from citizens (Carter & Belanger, 2005; Cordella & Tangi et al., 2021) are beginning to wonder what ben­
Tempini, 2015; Luna-Reyes & Gil-Garcia, 2014; Torfing efits DGT can bring to the development of the socio-
et al., 2021). In addition, researchers are interested in the economic system, despite some fundamental research
practice of digitalization, possible obstacles and user that predicted that DGT is the very condition for the
reach, ways of organizing project teams for the imple­ development of public administration in the near
mentation of digital technologies, ways of obtaining future in a direction that does not contradict current
financial support, etc. (Al-Emadi & Anouze, 2018; trends in the development of society. By definition and
Ashaye & Irani, 2019; Cegarra-Navarro et al., 2012). by nature, public administration cannot lag far behind
EUPACK research also focuses on this side of DGT, high­ society either technologically or conceptually
lighting online services, e-government users, pre-filled (Farazmand, 2017). Today, knowledge is being created
forms, online service completion, barriers to public sector and used faster than ever, and new technologies are
innovation, ease of doing business, and services to busi­ constantly changing the way tasks are executed
nesses as key indicators (EUPACK, 2018). (Henman, 2020). Although competition in the public
Some of the research focuses on the benefits of digitali­ sector is not a critical factor in development, the need
zation for the public sector itself and shows that organiza­ for public organizations to keep pace with innovation
tional change is needed. DGT will reduce bureaucracy and in the private sector is now viewed as a serious poten­
overcome the structural inefficiencies of the current gov­ tial for the development of the government (Wirtz
ernment (Cordella & Bonina, 2012; Cordella & Tempini, et al., 2020). While feeling the difference between the
2015). This policy-based approach to digital government as ease of interaction with the private sector and outdated,
a result of DGT allows us to shift attention from the inefficient mechanisms for cooperation with the public
internal efficiency of the public sector to the processes of sector, the confidence of citizens in the government
value creation occurring outside it and raise the question of tends to decrease (Shin, 2021). Consequently, the rejec­
what social benefits arise during the digital transformation tion of DGT undermines the very foundations of gov­
(Bannister & Connolly, 2020; Panagiotopoulos et al., 2019). ernance. Therefore, it is necessary to proceed from
Among the general requirements for the implementation empirical data and discover which characteristics of
of DGT technologies in the public sector is the support of DGT stand out as significant at the practical level.
the government and ministries, suggesting participation in The theoretical analysis of DGT shows that it is
the development process and the exchange of experience; understood as the most important innovation that
government funding that allows focusing on creating pub­ should help to change public administration and
lic good without attracting significant investment; no then the economy and society. To investigate this
requirements for creating a formal governance structure; widespread suggestion empirically, is necessary to
the possibility for innovations throughout the technology conduct a deeper analysis to answer the following
creation and implementation process; and forming research questions:
a multidisciplinary team of experts in technology develop­
ment (Shin, 2021; De Vries et al., 2016). The general RQ1: Does digital innovation in the public sector affect
principles of the introduction of DGT technologies in the the efficiency of public administration?
public sector are partnership, openness, experimental, and RQ2: Do DGT technologies have an impact on the
public in nature (Kuziemski & Misuraca, 2020). socio-economic performance of public administration?
4 A. SANINA ET AL.

Methodology Online Services Index (OSI), ICT Infrastructure


Development Index (TII), and Human Capital
The key DGT indicators
Index (HCI).
To understand DGT from the point of view of its socio- The Online Services Index (OSI) reflects differences
economic efficiency and to develop the empirically based in e-government development levels between countries.
features of understanding DGT in public administration The ICT Infrastructure Development Index (TII) is the
and governance, it is important to make a set of examples arithmetical average of five indicators: estimated
of DGT applications acknowledged by both researchers Internet users per 100 residents, the number of main
and practitioners as working solutions for the public sector. telephone lines per 100 inhabitants, the number of
For that, we have explored the major policy-related and mobile subscribers per 100 residents, the number of
governance-related sources providing the analytics of par­ wireless broadband subscribers per 100 residents, and
ticular indicators related to DGT and its effectiveness (i.e., the number of fixed broadband subscribers per 100
the World Bank, The World Health Organization, United residents. The Human Capital Index (HCI) is
Nations Development Programme, the United Nations a weighted average of four indicators: adult literacy,
E-Government Survey, the University of Gothenburg’s total enrolment ratio (total number of enrolled students
Quality of Government Basic Dataset, and the Global as a percentage of the school-age population), expected
Competitiveness Index). We have explored the theoretical years of studying, and average years of studying.
support of each particular indicator, looking for the studies Therefore, in the dependent variable, regression (Y) is
that help to prove the positive impact of any DGT steps the HDI (or one of its components), and one of the
onto the social and/or economical issue performed by the independent variables (X) is the E-Government
indicators. The result of this analysis is presented in the Development Index (or one of its components).
Table 1. The source of the empirical data used in the study is
the official website of the World Bank (https://data.
worldbank.org/indicator). All variables of the regression
analysis are presented in Table 2.
Data
To answer the second research question, the regres­
To answer the research questions, a regression analysis sion analysis of the introduction of artificial intelligence
models the relationship between the set of explanatory in public administration is conducted. The indicators of
variables and the dependent variable. Regarding the first public administration are those presented in the 2018
research question, this paper uses the human develop­ European Commission study on measuring public
ment and potential index (HDI) and its main compo­ administration (Van Dooren, 2018). Particularly, this
nents: expected lifespan at birth, education index, and study uses the following indicators with global coverage:
GDP per capita, which are used as an indicator of the World Bank Governance Indicators; World
effectiveness of public administration. This index allows Competitiveness Yearbook, World Economic Forum;
for measuring the level of socio-economic development of and Quality of Government, University of Gothenburg.
the country and reflects the standard of living of citizens, World Bank Governance Indicators (WBGI) is one of
which is the most important indicator used in estimating the most well-known and widely used indicators for
the efficiency of the economy. Thus, it can be considered measuring public administration. It combines data
as a referent of public administration efficiency. Expected from commercial and non-profit organizations, has
lifespan reflects longevity, the education index is the level operated since 1996, and covers about 200 countries.
of education and combines the expected and average The World Bank defines governance as a broad concept
years of education, and real GDP per capita, adjusted for that needs to take into account aspects such as transpar­
the local cost of living (PPP), reflects the standard of living ency and accountability, political stability and the
in the country. absence of violence, government effectiveness, quality
The UN Global E-Government Development Index of regulation, rule of law, and the fight against
(publicadministration.un.org) of the United Nations is corruption.
an indicator of innovation in public administration. The World Competitiveness Yearbook (WCY) of the
This comprehensive indicator estimates the ability of World Economic Forum is also a tool for measuring
public authorities to use information and communication public administration. WCY has been in existence
technologies (ICT) to provide public services to citizens. since 2004 and covers more than 100 countries. This
This index includes estimates for three components: the report is based on the Global Competitiveness Index
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 5

Table 1. The interconnection of GDT implementation and positive changes in government performance indicators.
Studies proving the interconnection of GDT implementation and
Indicator Source positive changes of the indicator
Government Effectiveness World Bank Governance Indicators, The Kaufmann et al. (1999); Krishnan et al. (2017); Amavilah et al.
Quality of Government Basic Dataset, (2017); Asongu et al. (2018); Ezcurra and Rios (2020); Islam and
University of Gothenburg McGillivray (2020); Emara and El Said (2021)
Control of Corruption World Bank Governance Indicators Kaufmann et al. (1999); Krishnan et al. (2017); Amavilah et al.
(2017); Asongu et al. (2018); Ezcurra and Rios (2020); Islam and
McGillivray (2020); Van de Walle and Migchelbrink (2020);
Emara and El Said (2021)
Political Stability and Absence of Violence/ World Bank Governance Indicators Kaufmann et al. (1999); Memon and Awan (2017); Krishnan et al.
Terrorism (2017); Asongu et al. (2018); Ezcurra and Rios (2020); Islam and
McGillivray (2020); Emara and El Said (2021).
Regulatory Quality World Bank Governance Indicators Kaufmann et al. (1999); Krishnan et al. (2017); Amavilah et al.
(2017); Asongu et al. (2018); Ezcurra and Rios (2020); Islam and
McGillivray (2020); Emara and El Said (2021)
Rule of Law World Bank Governance Indicators Kaufmann et al. (1999); Krishnan et al. (2017); Amavilah et al.
(2017); Ezcurra and Rios (2020); Islam and McGillivray (2020);
Emara and El Said (2021)
Voice and Accountability World Bank Governance Indicators, The Kaufmann et al. (1999); Krishnan et al. (2017); Asongu et al.
Global Competitiveness Index, World (2018); Ezcurra and Rios (2020); Hassan and Lee (2019); Islam
Economic Forum and McGillivray (2020); Emara and El Said (2021)
Quality of the education system The Global Competitiveness Index, World Yunis et al. (2017); Kelley and Simmons (2019)
Economic Forum
Health The Global Competitiveness Index, World Yunis et al. (2017); Kelley and Simmons (2019); Twizeyimana and
Economic Forum Andersson (2019)
Security The Global Competitiveness Index, World Kelley and Simmons (2019); Twizeyimana and Andersson (2019)
Economic Forum
Transparency of government policymaking The Global Competitiveness Index, World Hassan and Lee (2019); Twizeyimana and Andersson (2019)
Economic Forum
Future orientation of government (FOG) The Global Competitiveness Index, World Yunis et al. (2017)
Economic Forum
The Bayesian Corruption Indicator The Quality of Government Basic Dataset, Standaert (2015); Chen and Neshkova (2020)
University of Gothenburg
Performance of Democratic Institutions The Quality of Government Basic Dataset, Charron and Lapuente (2018); Tarverdi et al. (2019); Van de Walle
University of Gothenburg and Migchelbrink (2020)
Public Services The Quality of Government Basic Dataset, Charron and Lapuente (2018); Van de Walle and Migchelbrink
University of Gothenburg (2020)
State Legitimacy The Quality of Government Basic Dataset, Boräng et al. (2017); Suzuki and Hur (2020)
University of Gothenburg
ICRG Indicator of Quality of Government The Quality of Government Basic Dataset, Boräng et al. (2017); Suzuki and Hur (2020)
University of Gothenburg
Corruption Perception Index The Quality of Government Basic Dataset, Basyal et al. (2018); Suzuki and Hur (2020)
University of Gothenburg, Transparency
Internationala
E-Government Innovation (Development?) United Nations E-Government Survey Ali et al. (2018); Basyal et al. (2018); Yıldırım and Bostancı (2021)
Index
Specialists in R&D (per million people) The World Bank Lemke et al. (2019)
Exports of high-tech products (% of The World Bank Amavilah et al. (2017)
industrial exports)
The registered number of new businesses The World Bank Krishnan et al. (2017)
The ratio of the employed and the The World Bank Ma and Zheng (2018)
population, 15+, the total (%) (modeled
estimate of the ILO)
Total tax rate (% of commercial profits) The World Bank Kochanova et al. (2020)
Telecommunications infrastructure index United Nations E-Government Survey Faid et al. (2020)
Online service index United Nations E-Government Survey Szopiński and Staniewski (2017); Faid et al. (2020)
Public spending per student, average (% of The World Bank Amavilah et al. (2017)
GDP per capita)
Public spending on education, total (% of The World Bank Amavilah et al. (2017)
GDP)
GNI per capita, PPP The World Bank Szopiński and Staniewski (2017); Pérez-Morote et al. (2020); Faid
et al. (2020)
Unemployment, total (% of the total The World Bank Szopiński and Staniewski (2017); Ma and Zheng (2018)
workforce) (modeled estimate of ILO)
Labour force participation rate (LF_partrate), The World Bank Ma and Zheng (2018)
total (% of the total population aged 15+)
(national estimate)
Nurses and midwives (per 1000 people) The World Bank, The World Health Szopiński and Staniewski (2017); Ma and Zheng (2018)
Organization
Adolescent fertility rate (number of births The World Bank, The World Health Amavilah et al. (2017); Pérez-Morote et al. (2020)
per 1,000 women aged 15–19 years) Organization
Education index United Nations Development Programme Szopiński and Staniewski (2017); Pérez-Morote et al. (2020)
Rurality The World Bank Sharma and Mishra (2017); Pérez-Morote et al. (2020)
6 A. SANINA ET AL.

Table 2. Variables of the regression analysis of the introduction of innovation in the public sector.
Y X What X reflects
GNI per capita (PPP) E-Government Innovation Index (EGovt_index) Innovations in public sector
Specialists in R&D (per million people) Science and technological
Exports of high-tech products (% of industrial exports) progress
The registered number of new businesses Entrepreneurship
The ratio of the employed and the population, 15+, the total (%) (modeled estimate of the ILO) Employment
Total tax rate (% of commercial profits) Taxes
Education index Telecommunications infrastructure index Innovations in public sector
Online services index
Public spending per student, average (% of GDP per capita) Education
Public spending on education, total (% of GDP)
GNI per capita, PPP Income
Unemployment, total (% of the total workforce) (modeled estimate of ILO) Unemployment
Labour force participation rate (LF_partrate), total (% of the total population aged 15+) (national Labor force participation rate
estimate)
The expected GNI per capita, PPP Income
lifespan Nurses and midwives (per 1000 people) Health care availability
Adolescent fertility rate (number of births per 1,000 women aged 15–19 years) Adolescent fertility
Education index Education
Online services index (OSI) Innovations in public sector
Telecommunications infrastructure index (TII)
HDI Online services index Innovations in public sector
Telecommunications infrastructure index

(tcdata360.worldbank.org/), which includes 12 competi­ ranking contains an improved methodology and


tiveness indicators based on open information as well as broader country coverage (194) compared to 2017
the knowledge of thousands of experts from around the (35). The index consists of 11 indicators, combined
world. In public administration, the index measures by four groups: management and administration, infra­
corruption and transparency as well as education, structure and data, skills and education, and public
health, social infrastructure, and others. services.
The third indicator, the quality of the government, is As part of the study, the components of the World
presented in the study of the European Commission as Bank Governance Indicators, World Competitiveness
the most fully reflective of the state of public adminis­ Yearbook, and Quality of Government are used as an
tration. It has been developed at the University of independent variable: Government AI Readiness Index,
Gothenburg’s Institute for Public Administration or one of its components.
(https://qog.pol.gu.se/data) since 2008 and contains The sources of empirical evidence used in the study
data on the quality of government, political system, are the official website of the World Bank (data.world­
civil society, conflict and violence, religion, and various bank.org/indicator), the official website of the World
areas of public life such as education, energy, infrastruc­ Economic Forum (https://reports.weforum.org), and
ture, environment, health, migration, social security, the official website of the University of Gothenburg.
and others. This indicator covers about 200 countries. All variables of pair regressions are represented in
Among the main indicators of DGT covering coun­ Table 3.
tries of the world, researchers today highlight the follow­ The regression analysis includes 194 countries; the
ing: the 2018 AI Index report from Stanford University, number of observations varies from 194 (AI startups,
the Global AI Index by Tortoise Media, and Government 2019) to 2,134 (government procurement of advanced
Artificial Intelligence Readiness (Moltzau, 2019). technology products, 2007–2019). All the regressions are
The indicator aimed at measuring AI specifically in suspected to have heteroscedasticity, so they are evalu­
public administration is the Government AI Readiness ated with robust errors. A multicollinearity test with the
Index, first developed by Oxford Insights and vif() function showed that multicollinearity does not
International Development Research Centre (oxfordin­ affect the coefficients and p-values.
sights.com) and published in 2017. Its purpose is to
determine how well governments of different countries
Results
are taking advantage of artificial intelligence in the
provision of public services. Therefore, the results of The empirical investigation shows some significant (coeffi­
the rating should reflect the ability of governments of cient of determination equal to 0.6 and higher) relation­
different countries to use the innovative potential of AI. ships between the variables. Table 4 summarizes
The study uses the 2017 and 2019 index, but the 2019 statistically significant relationships that help answer the
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 7

Table 3. Variables of the regression analysis of the introduction of AI in the public sector.
Source Y, variables of governance X, variables of AI
World Bank Governance Government Effectiveness Data availability
Indicators Government procurement of advanced technology products
Data capability (in government)
Technology skills
AI startups
(Private sector) innovation capability
Digital public services
Importance of ICTs to government vision of the future
Control of Corruption AI Readiness
Political Stability and Absence of Violence/Terrorism Data availability
Regulatory Quality Government procurement of advanced technology products
Rule of Law Data capability (in government)
Voice and Accountability Technology skills
AI startups
(Private sector) innovation capability
Digital public services
Importance of ICTs to government vision of the future
The Global Competitiveness Quality of the education system AI Readiness
Index, World Economic Health Data availability
Forum Security Government procurement of advanced technology products
Transparency of government policymaking Data capability (in government)
Accountability Technology skills
AI startups
(Private sector) innovation capability
Digital public services
Importance of ICTs to government vision of the future
Future orientation of government (FOG) Data availability
Government procurement of advanced technology products
Data capability (in government)
Technology skills
AI startups
(Private sector) innovation capability
Digital public services
Importance of ICTs to government vision of the future
The Quality of Government The Bayesian Corruption Indicator AI Readiness
Basic Dataset, University Performance of Democratic Institutions Data availability
of Gothenburg Public Services Government procurement of advanced technology products
State Legitimacy Data capability (in government)
ICRG Indicator of Quality of Government Technology skills
Rule of Law AI startups
Corruption Perceptions Index (Private sector) innovation capability
Digital public services
Importance of ICTs to government vision of the future
Government Effectiveness Data availability
Government procurement of advanced technology products
Data capability (in government)
Technology skills
AI startups
(Private sector) innovation capability
Digital public services
Importance of ICTs to government vision of the future

first research question, i.e., whether or not the innovation HDI itself. Therefore, the linear regression of HDI indi­
in the public sector affects the efficiency of public cators to public sector innovation suggests that innova­
administration. tion contributes to the efficiency of public administration.
According to the data, public sector innovation indi­ A linear link is found between some indicators, i.e., GDP
cators have an impact on the components of HDI; parti­ per capita and the e-government index; the telecommu­
cularly, GNI per capita is influenced by the e-government nications infrastructure index and the education index;
index, the education index is influenced by the telecom­ the online services index and life expectancy; the telecom­
munications infrastructure index, and the expected life­ munications infrastructure, online services, and the HDI.
span is influenced by the online services index. At the Figure 1 provides a graphic representation of the regres­
same time, the last two indicators have an impact on the sion results.
8 A. SANINA ET AL.

Table 4. Regression analysis (1).


Dependent variable:
GNI_percap Educ_index Lifeexp HDI
OLS OLS OLS OLS
(1) (2) (3) (4)
Constant −12,180.45** 0.72*** 68.25*** 0.50***
(5,508.07) (0.09) (0.99) (0.004)
EGovt_index 43,325.61***
(5,488.34)
Tax_rate −109.75***
(34.37)
Employment 124.39*
(73.15)
High_Tech 167.56***
(56.07)
New_businesses −0.01
(0.01)
Tech_RD 7.94***
(1.09)
OSI −0.04 7.70*** 0.07***
(0.06) (1.05) (0.01)
TII 0.46*** 0.50***
(0.06) (0.02)
Govt_exp_perstudent −0.005***
(0.002)
Unempl 0.005**
(0.002)
Govt_exp_educ 0.005
(0.01)
LF_partrate −0.003**
(0.001)
GNI_percap 0.0000***
(0.0000)
Nurses 0.11*
(0.07)
Fertility −0.10***
(0.01)
Educ_index 5.15***
(1.28)
Observations 188 278 458 1,095
R2 0.73 0.30 0.74 0.75
Adjusted R2 0.72 0.28 0.74 0.75
Residual Std. Error 8,304.61 (df = 181) 0.15 (df = 271) 4.17 (df = 452) 0.08 (df = 1092)
F Statistic 79.56*** (df = 6; 181) 19.26*** (df = 6; 271) 261.04*** (df = 5; 452) 1,654.85*** (df = 2; 1092)
*p**p***p < .01

To answer Research Question 2 regarding DGT technologies significantly contribute to the


whether or not DGT technologies have an impact transformation and general improvement of the
on the performance of public administration, the mechanisms of public administration.
significant results of regression models are presented Still, some points need deeper exploration and
in Table 5. research. According to the results of the first regression
According to the results of the regression analysis, analysis, where the dependent variable is the quality
DGT indicators have a significant impact on public index of the education system, there is an inverse con­
sector performance; particularly, the digital skills nection between indicators. In particular, when the index
index affects the education quality index, the index of technological skills increases by 1 point, the indicator
of data capabilities of the government affects the of the quality of the education system decreases by 41.88.
performance of government and public services, and The same type of connection can be observed in that
the index of the importance of ICT for the govern­ when the index of government’s ability to work with data
ment affects the indicator of the government’s readi­ increases by 1 unit, the index of public services decreases.
ness for the future. At the same time, the Such connections show that there are some fundamental
Government AI Readiness Index has an impact on inconsistencies between the old, traditional approach to
legislation quality. Hence, the regression of public public administration and the introduction of artificial
sector indicators to DGT indicators suggests that intelligence with positive results.
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 9

Figure 1.

Table 5. Regression analysis (2).


Dependent variable:
Quality_of_education WGI_reg WGI_effect FOG ffp_ps
OLS OLS OLS OLS OLS
(1) (2) (3) (4) (5)
Constant 247.56*** 8.32*** −16.09*** 229.28*** 11.57***
(11.61) (2.51) (3.12) (10.93) (0.22)
Digit_skills −41.88***
(2.68)
AI_Readiness_score 10.19***
(0.5)
AI_Readiness_data_capability 115.32***
(5.30)
Importance_ICT_gov −40.51***
(2.69)
AI_datacapability_govt −10.90***
(0.38)
Observations 128 228 192 128 176
R2 0.66 0.65 0.71 0.64 0.83
Adjusted R2 0.66 0.65 0.71 0.64 0.83
Residual Std. Error 23.07 (df = 126) 18 (df = 226) 16 (df = 190) 23.93 (df = 126) 1 (df = 174)
F Statistic 245.1*** (df = 1; 126) 419*** (df = 1; 226) 473*** (df = 1; 190) 226.2*** (df = 1; 126) 840*** (df = 1; 174)
*p**p***p < .01
10 A. SANINA ET AL.

Discussion and conclusion the new reality; it should match the society technologi­
cally and conceptually (Farazmand, 2017). Third, the
Empirical studies show that DGT plays a very important
policy-based approach to DGT is not enough explana­
role in developing, transforming, and reshaping the
tion of its rationale and efficiency; there are certain
public sector in terms of socio-economic efficiency.
improvements in the socio-economic sphere that are
This study, as well as a number of previous studies
related to DGT and thus help one to understand its
(Shin, 2021; Vries et al., 2016; Dwivedi et al., 2021),
meaning for the contemporary world.
show that DGT can help public governance to be effec­
tive in the contemporary world. In particular, our study
shows that digital innovation in the public sector affect Acknowledgments
the efficiency of public administration, at least as a tool
for human development and potential, and thus we can The article was prepared within the framework of the Basic
conclude that any systematic attempt at digital transfor­ Research Program at HSE University. We are grateful to our
colleagues for their comments and suggestions. We are also
mation could lead to a better society and governance. thankful to Galina Shabanova, student of the HSE Master’s
Also, the DGT technologies have a statistically signifi­ Programme “Urban Development and Governance,” who
cant impact on the socio-economic performance of pub­ greatly assisted with the empirical part of this study.
lic administration, not only on the politically-related
issues of democratization, participation, and transpar­
ency. This socio-economic side of DGT and public Disclosure statement
administration performance definitely needs deeper No potential conflict of interest was reported by the author(s).
research and practical discussion.
Unlike the previous research, this investigation
reveals an important role of DGT in determining how Funding
to better use limited resources, enabling authorities to
This work was supported by the HSE University Basic
more efficiently fulfill their responsibilities to citizens
Research Program.
and to plan resources for the future. Of course, there
are challenges and “dark sides” (Wirtz et al., 2020) of
DGT implementation in governance, and various legal, ORCID
social, and ethical considerations should be thought
through and tested. Still, this study shows that DGT Anna Sanina http://orcid.org/0000-0001-9635-0280
Aleksey Balashov http://orcid.org/0000-0003-3219-085X
improves governance performance significantly in Mariia Rubtcova http://orcid.org/0000-0003-4003-4988
terms of socio-economic effectiveness in particular.
With that empirically proved background, DGT should
become a central point and reason for a shift in public References
administration and governance. Since important social Afonso, A. Schuknecht, L., Tanzi, V. (2020). The size of
processes such as education and public services are entirely government. EconPol Working Paper, No. 46, ifo Institute
conditioned by a traditionalist (non-DGT) approach to - Leibniz Institute for Economic Research at the University
management in general, they cannot give a positive result of Munich, Munich. http://hdl.handle.net/10419/221806
when implementing DGT without fundamental transfor­ Al-Emadi, A., & Anouze, A. L. (2018). Grounded theory
analysis of successful implementation of e-government pro­
mations in authorities’ attitudes and readiness for major jects: Exploring perceptions of e-government authorities.
shifts in the processes of governance (Dwivedi et al., 2021). International Journal of Electronic Government Research,
In a broader way, our study shows that today, the 14(1), 23–52. https://doi.org/10.4018/IJEGR.2018010102
development of public administration mechanisms has Ali, M. A., Hoque, M. R., & Alam, K. (2018). An empirical
reached the stage at which it becomes impossible to investigation of the relationship between e-government
development and the digital economy: The case of Asian
improve its efficiency without the introduction of
countries. Journal of Knowledge Management, 22(5),
DGT. The theoretical analysis and empirically observed 1176–1200. https://doi.org/10.1108/JKM-10-2017-0477
features of DGT’s efficiency allow justifying its rationale Amavilah, V., Asongu, S. A., & Andrés, A. R. (2017). Effects of
and developing the key points of DGT in governance. globalization on peace and stability: Implications for gov­
These points are the following: ernance and the knowledge economy of African countries.
Technological Forecasting and Social Change, 122(C),
First, DGT is understood as innovation, but innova­
91–103. https://doi.org/10.1016/j.techfore.2017.04.013
tion in the public sector is also commonly associated Aristovnik, A. (2012). Measuring relative efficiency in health
with DGT. Second, this innovation helps to reshape and education sector: The case of East European countries.
governance because it cannot work in an old way in Actual Problems of Economics, 136(10), 305–314 https://
INTERNATIONAL JOURNAL OF PUBLIC ADMINISTRATION 11

www.researchgate.net/publication/285661429_Measuring_ K., Kizgin, H., Kronemann, B., Lal, B., Lucini, B., Medaglia,
relative_efficiency_in_health_and_education_sector_The_ R., and Le Meunier-FitzHugh, K., Le Meunier-FitzHugh, L.
case_of_East_European_countries . C., Misra, S., Mogaji, E., Sharma, S.K., Singh, J.B.,
Ashaye, O. R., & Irani, Z. (2019). The role of stakeholders in the Raghaven, V., Raman, R., Rana, N. P., Samothrakis, S.,
effective use of e-government resources in public services. Spencer, J., Tamilmani, K., Tubadji, A., Walton, P.,
International Journal of Information Management, 49(7), Williams, M.D. (2021). Artificial Intelligence (AI):
253–270. https://doi.org/10.1016/j.ijinfomgt.2019.05.016 Multidisciplinary perspectives on emerging challenges,
Asongu, S. A., Efobi, U., & Tchamyou, V. S. (2018). Globalisation opportunities, and agenda for research, practice and
and governance in Africa: A critical contribution to the policy. International Journal of Information Management,
empirics. International Journal of Development Issues, 17(1), 57, 101994. https://bradscholars.brad.ac.uk/handle/10454/
2–27. https://doi.org/10.1108/IJDI-04-2017-0038 17208
Bannister, F., & Connolly, R. (2020). The future ain’t what it Emara, N., & El Said, A. (2021). Financial inclusion and economic
used to be: Forecasting the impact of ICT on the public growth: The role of governance in selected MENA countries.
sphere. Government Information Quarterly, 37(1), № International Review of Economics & Finance, 75(4), 34–54.
101410. https://doi.org/10.1016/j.giq.2019.101410 https://doi.org/10.1016/j.iref.2021.03.014
Basyal, D. K., Poudyal, N., & Seo, J. W. (2018). Does EUPACK. (2018) A comparative overview of public adminis­
E-government reduce corruption? Evidence from tration characteristics and performance in EU28.
a heterogeneous panel data model. Transforming Luxembourg: Publications Office of the European Union.
Government: People, Process and Policy, 12(2), 134–154. https://doi.org/10.2767/13319
https://doi.org/10.1108/TG-12-2017-0073 Ezcurra, R., & Rios, V. (2020). Quality of government in
Boräng, F., Nistotskaya, M., & Xezonakis, G. (2017). The European regions: Do spatial spillovers matter? Regional
quality of government determinants of support for Studies, 54(8), 1032–1042. https://doi.org/10.1080/
democracy. Journal of Public Affairs, 17(1–2), 1643. 00343404.2019.1665644
https://doi.org/10.1002/pa.1643 Faid, G., Tariq, M. M., Ishtiaq, A., Zeynvand, V. L., Meyer, D. F., &
Bostrom, R. P., & Heinen, J. S. (1977). MIS problems and Máté, D. (2020). The nexus of E-government and increased
failures: A socio- technical perspective. MIS Quarterly, 1 productivity relative to income level comparison. Business,
(3), 17–32. https://doi.org/10.2307/248710 Management and Economics Engineering, 18(1), 88–105
Carter, L., & Belanger, F. (2005). The utilization of https://doi.org/10.3846/bme.2020.12067 .
e-government services: Citizen trust, innovation and accep­ Farazmand, A. (2017). Governance reforms: The good, the
tance factors. Information Systems Journal, 15(1), 5–25. bad, and the ugly; and the sound: Examining the past and
https://doi.org/10.1111/j.1365-2575.2005.00183.x exploring the future of public organizations. Public
Cegarra-Navarro, J.-G., Pachón, J. R. C., & Cegarra, J. L. M. Organization Review, 17(4), 595–617. https://doi.org/10.
(2012). E-government and citizen’s engagement with local 1007/s11115-017-0398-y
affairs through e-websites: The case of Spanish municipali­ Giovanni, L., Codagnone, C., Misuraca, G., Gineikyte, V., and
ties. International Journal of Information Management, 32(5), Barcevicius, E., et al. (2020). Exploring digital government
469–478. https://doi.org/10.1016/j.ijinfomgt.2012.02.008 transformation: A literature review. Proceedings of the 13th
Charron, N., & Lapuente, V. (2018). Quality of government in International Conference on Theory and Practice of
EU regions: Spatial and temporal patterns. QOG Working Electronic Governance (ICEGOV 2020). Association for
Paper Series, 1(1). Computing Machinery, New York, NY, USA, 502–509.
Chen, C., & Neshkova, M. I. (2020). The effect of fiscal trans­ https://doi.org/10.1145/3428502.3428578
parency on corruption: A panel cross-country analysis. Hassan, M. H., & Lee, J. (2019). Policymakers’ perspective about
Public Administration, 98(1), 226–243. https://doi.org/10. e-Government success using AHP approach. Transforming
1111/padm.12620 Government: People, Process and Policy, 13(1), 93–118.
Cordella, A., & Bonina, C. (2012). A public value perspective https://doi.org/10.1108/TG-03-2018-0017
for ICT enabled public sector reforms: A theoretical Henman, P. (2020). Improving public services using artificial
reflection. Government Information Quarterly, 29(4), intelligence: Possibilities, pitfalls, governance. Asia Pacific
512–520. https://doi.org/10.1016/j.giq.2012.03.004 Journal of Public Administration, 42(4), 209–221. https://
Cordella, A., & Tempini, N. (2015). E-government and organiza­ doi.org/10.1080/23276665.2020.1816188
tional change: Reappraising the role of ICT and bureaucracy in Islam, M. R., & McGillivray, M. (2020). Wealth inequality,
public service delivery. Government Information Quarterly, 32 governance and economic growth. Economic Modelling, 88
(3), 279–286. https://doi.org/10.1016/j.giq.2015.03.005 (C) , 1–13. https://doi.org/10.1016/j.econmod.2019.06.017
Curtis, S. (2019). Digital transformation—the silver bullet to Kaufmann, D., Kraay, A., & Zoido-Lobatón, P. (1999).
public service improvement? Public Money and Governance matters. World Bank.
Management, 39(5), 322–324. https://doi.org/10.1080/ Kelley, J. G., & Simmons, B. A. (2019). Introduction: The
09540962.2019.1611233 power of global performance indicators. International
De Vries, H., Bekkers, V., & Tummers, L. (2016). Innovation Organization, 73(3), 491–510. https://doi.org/10.1017/
in the public sector: A systematic review and future research S0020818319000146
agenda. Public Administration, 94(1), 146–166. https://doi. Kochanova, A., Hasnain, Z., & Larson, B. (2020). Does
org/10.1111/padm.12209 e-Government improve government capacity? Evidence
Dwivedi, Y.K., Hughes, L., Ismagilova, E., Aarts, G., Coombs, from tax compliance costs, tax revenue, and public procure­
C., Crick, T., Duan, Y., Dwivedi, R., Edwards, J., Eirug, A., ment competitiveness. The World Bank Economic Review,
Galanos, V., Ilavarasan, P.V., Janssen, M., Jones, P., Kar, A. 34(1), 101–120. https://doi.org/10.1093/wber/lhx024
12 A. SANINA ET AL.

Krishnan, S., Teo, T. S., & Lymm, J. (2017). Determinants of Shin, D. (2021). The effects of explainability and causability on
electronic participation and electronic government matur­ perception, trust, and acceptance: Implications for explain­
ity: Insights from cross-country data. International Journal able AI. International Journal of Human-Computer Studies.
of Information Management, 37(4), 297–312. https://doi. Vol 146, 102551.
org/10.1016/j.ijinfomgt.2017.03.002 Standaert, S. (2015). Divining the level of corruption: A Bayesian
Kushzhanov, N., & Aliyev, U. (2018). Digital space: Changes in state-space approach. Journal of Comparative Economics, 43
society and security awareness. Bulletin of the National (3), 782–803. https://doi.org/10.1016/j.jce.2014.05.007
Academy of Sciences of the Republic of Kazakhstan, 1(371), Suzuki, K., & Hur, H. (2020). Bureaucratic structures and orga­
94–101 http://www.bulletin-science.kz . nizational commitment: Findings from a comparative study of
Kuziemski, M., and Misuraca, G. (2020). AI governance in the 20 European countries. Public Management Review, 22(6),
public sector: Three tales from the frontiers of automated 877–907. https://doi.org/10.1080/14719037.2019.1619813
decision-making in democratic settings. Telecommunications Szopiński, T., & Staniewski, M. W. (2017). Manifestations of
Policy, 44(6), 101976. https://doi.org/10.1016/j.telpol.2020. e-government usage in post-communist European
101976 countries. Internet Research, 27(2), 199–210. https://doi.
Lemke, F., Taveter, K., Erlenheim, R., Pappel, I., Draheim, D., org/10.1108/IntR-01–2015-0011
& Janssen, M. (2019). Stage models for moving from Tangi, L., Janssen, M., Benedetti, M., & Noci, G. (2021). Digital
e-government to smart government. In International government transformation: A structural equation model­
Conference on Electronic Governance and Open Society: ling analysis of driving and impeding factors. International
Challenges in Eurasia (pp. 152–164). Springer, Cham. Journal of Information Management, 60, 102356. https://
Lindgren, I., & van Veenstra, A. (2018). Digital government doi.org/10.1016/j.ijinfomgt.2021.102356
transformation: A case illustrating public e-service develop­ Tarverdi, Y., Saha, S., & Campbell, N. (2019). Governance,
ment as part of public sector transformation. Proceedings of the democracy and development. Economic Analysis and Policy,
19th Annual International Conference on Digital Government 63, 220–233. https://doi.org/10.1016/j.eap.2019.06.005
Research: Governance in the Data Age. Association for Torfing, J., Ferlie, E., Jukić, T., & Ongaro, E. (2021). A theoretical
Computing Machinery, New York, NY, USA, Article 38, framework for studying the co-creation of innovative solutions
1–6. https://doi.org/10.1145/3209281.3209302 . and public value. Policy & Politics 49(2). https://doi.org/10.
Luna-Reyes, L., & Gil-Garcia, R. (2014). Digital government 1332/030557321X16108172803520
transformation and internet portals: The co-evolution of tech­ Twizeyimana, J. D., & Andersson, A. (2019). The public value
nology, organizations, and institutions. Government of E-Government–A literature review. Government
Information Quarterly 31(4). https://doi.org/10.1016/j.giq. Information Quarterly, 36(2), 167–178. https://doi.org/10.
2014.08.001 1016/j.giq.2019.01.001
Ma, L., & Zheng, Y. (2018). Does e-government performance Van de Walle, S., & Migchelbrink, K. (2020). Institutional
actually boost citizen use? Evidence from European quality, corruption, and impartiality: The role of process
countries. Public Management Review, 20(10), 1513–1532. and outcome for citizen trust in public administration in
https://doi.org/10.1080/14719037.2017.1412117 173 European regions. Journal of Economic Policy
Memon S.A., and Awan J.H. (2017). Transformation Towards Reform, 1–19. https://doi.org/10.1080/17487870.2020.
Cyber Democracy: A Study on Contemporary Policies, 1719103
Practices, and Adoption Challenges for Pakistan. Handbook of Van Dooren, W. (2018). Measuring public administration:
Cyber-Development, Cyber-Democracy and Cyber-Defense, 1–20. A feasibility study for better comparative indicators in the
Moltzau, A. (2019, December 4). The global artificial intelli­ EU. Publications Office of the European Union. https://ec.
gence indexes 2018–2019. An overview of different indexes europa.eu/social/main.jsp?catId=738&langId=en&pubId=
measuring AI around the world. Towards Data Science. 8122&furtherPubs=yes
https://towardsdatascience.com/the-global-artificial- Weerakkody, V., Janssen, M., & Dwivedi, Y. (2011).
intelligence-indexes-2018-2019-1b0d0dce5f60 Transformational change and business process reengineer­
Panagiotopoulos, P., Klievink, B., & Cordella, A. (2019). Public ing (BPR): Lessons from the British and Dutch public
value creation in digital government. Government Information sector. Government Information Quarterly, 28(3), 320–328.
Quarterly, 36(4), 101421. https://doi.org/10.1016/j.giq.2019. https://doi.org/10.1016/j.giq.2010.07.010
101421 Wirtz, B. W., Weyerer, J. C., & Sturm, B. J. (2020). The dark
Pérez-Morote, R., Pontones-Rosa, C., & Núñez-Chicharro, M. sides of artificial intelligence: An integrated AI governance
(2020). The effects of e-government evaluation, trust and the framework for public administration. International Journal
digital divide in the levels of e-government use in European of Public Administration, 43(9), 818–829. https://doi.org/10.
countries. Technological Forecasting and Social Change, 154, 1080/01900692.2020.1749851
119973. https://doi.org/10.1016/j.techfore.2020.119973 Yıldırım, S., & Bostancı, S. H. (2021). The efficiency of
Reis, J., Santo, P.E., and Melão, N. (2019). Artificial intelli­ e-government portal management from a citizen perspec­
gence in government services: a systematic literature review tive: Evidences from Turkey. World Journal of Science,
Proceedings of the World Conference on Information Technology and Sustainable Development, 18(3), 259–273.
Systems and Technologies, 241–252. https://doi.org/10.1108/WJSTSD-04-2021-0049
Sharma, R., & Mishra, R. (2017). Investigating the role of Yunis, M., El-Kassar, A.-N., & Tarhini, A. (2017). Impact of
intermediaries in adoption of public access outlets for deliv­ ICT-based innovations on organizational performance: The
ery of e-Government services in developing countries: An role of corporate entrepreneurship. Journal of Enterprise
empirical study. Government Information Quarterly, 34(4), Information Management, 30(1), 122–141. https://doi.org/
658–679. https://doi.org/10.1016/j.giq.2017.10.001 10.1108/JEIM-01-2016-0040

You might also like