Evidence-Based Policy-Making

for Indonesia

Research Intelligence
February 2020
Alexander van Servellen
Senior Consultant, Research Intelligence
Elsevier, Singapore
 Analysis of Indonesia that identifies
key performance areas and
Objectives
implications for Indonesian
Research-Policy

Introduction 1

Evidence-based Policy-making (analysis) 2

Next Steps 3
1.Introduction
SciVal is a big-data Analytics tool that helps policy-makers
more efficiently and effectively invest in research to
maximize performance and impact

360 degree Evaluation and Set and measure

analysis to inform benchmarking to research Key
strategic planning monitor Performance
e.g. Strengths, performance Indicators.
weaknesses,
gaps

Accelerate and Talent recruitment Support and win

maximize and retention grants by
demonstrating
institutional and
specific strengths
cross institutional
collaboration
Scopus is one of the main data sources, while we also
source patent citation data from the biggest patent
offices and news information via Newsflo.

Publication,
Citation, usage data

Publication, citation and Scopus usage data, mass media mentions, patent-article
citations

Times Higher Education and QS have exclusive partnership with Elsevier (Scopus) for
the global as well as regional rankings of the institutions.

Times Higher Education and QS have exclusive long-term partnerships with

Elsevier (Scopus) for the World University Rankings.
These institutions in South East Asia use SciVal for strategic planning
SciVal subscription includes consultancy as a service

Quarterly Quarterly review

Customization
trainings for key with Policy-
Analysis &
analysts and makers and plan
Strategy
admins for the next year.
2. Evidence-Based
Policy-Making
Research Analytics are already being used world wide

• Research analytics provide quantitative analysis of academic literature

such as quantifying the scholarly influence or impact of a paper, an author,
institution, a specific partnership etc.

• Quantitative analysis compliments qualitative analysis, and is accepted and

used by Universities and Government organizations to evaluate and
provide evidence base for decisions (funding, recruitment, promotion etc.)

• It’s therefore important to have a high quality data and a flexible platform to
facilitate fair analysis.

• It’s also important to analysts learn the basic principles of evaluation, and
how to interpret metrics.
Make smart Decisions by “triangulating” information

Combining expert opinion

Reliable with quantitative data on
data research performance,
helps you justify policy-
decisions and measure
their impact

Strategic
Your Experts External Review
Planning
for
Research

Expert
Peer
opinion
review
SciVal includes many types if metric to measure various aspects of research
performance
Productivity metrics Collaboration metrics
Scholarly Output Authorship Count
h-indices (h, g, m) Number of Citing Countries
Citation Impact metrics Collaboration (geographical)
Citation Count Academic-Corporate Collaboration
Citations per Publication Disciplinarity metrics
Cited Publications Journal count
h-indices (h, g, m) Journal category count
Field-Weighted Citation Impact Views metrics
Publications in Top Percentiles Views
Publications in Top Journal Percentiles Views per publication
Collaboration Impact (geographical) Field-Weighed Views Impact
Academic-Corporate Collaboration Impact
Economic Impact metrics
Societal Impact metrics Citing Patents
Mass Media Mentions Patent-Cited Scholarly Output
Media Exposure Patent-Citations Count
Field-Weighted Mass Media Patent-Citations per Scholarly Output
Input metrics Journal Metrics
Awarded Grants CiteScore
SJR
SNIP
 What is Indonesia’s
research performance
and trend?
Indonesia produced 119,423 papers between 2014-2019 which received
280,407 citations, which is equal to 11% less citations than world average.

FWCI of 0.89 indicates

11% less citations than
world average which is
1.00
Indonesia’s research volume is growing fast but quality indicators such as percentage
of papers in top journals, highly cited papers, and FWCI show declining trends
 How does Indonesia
compare to other
countries in our region?
Indonesia surpassed Malaysia in terms of total publication volume when
including all content types.
However when including only Articles and Reviews, Indonesia produces
marginally less scientific papers than Singapore and Malaysia leads
When looking at all papers published in Q1 journals, Singapore leads the
way and Indonesia produces lowest volumes of papers in top journals
In terms of Field-Weighted Citation-Impact Singapore again leads while
Indonesia shows lowest and declining levels of citations
What are the subject and
discipline strengths of
Indonesian research?
Indonesia’s research strengths include Medicine and Earth and Planetary
Sciences, which are both highly cited. Engineering is the highest volume
subject, but receives less than world average citations

World-average =1.00
Indonesia’s pockets of research excellence include General Medicine in
which citation impact is over 4x world level and, Global and Planetary
Change, Forestry, Cardiology, Automotive Engineering, Geophysics etc.
Subject Area Subcategory Scholarly Output Field-weighted Citation Impact
Medicine General Medicine 1657 4.90
Environmental Science Global and Planetary Change 306 1.95
Agricultural and Biological Sciences Forestry 625 1.52
Medicine Cardiology and Cardiovascular Medicine 260 1.48
Social Sciences Social Sciences (miscellaneous) 453 1.44
Engineering Automotive Engineering 336 1.42
Earth and Planetary Sciences Geophysics 464 1.33
Earth and Planetary Sciences Oceanography 422 1.19
Earth and Planetary Sciences Geochemistry and Petrology 543 1.16
Chemical Engineering Catalysis 233 1.16
Social Sciences Sociology and Political Science 885 1.15
Mathematics Modeling and Simulation 590 1.14
Earth and Planetary Sciences Geology 300 1.13
Immunology and Microbiology General Immunology and Microbiology 218 1.12
Chemical Engineering Bioengineering 340 1.10
Social Sciences Geography, Planning and Development 1410 1.09
Arts and Humanities General Arts and Humanities 1303 1.09
Physics and Astronomy General Physics and Astronomy 20209 1.08
Earth and Planetary Sciences Atmospheric Science 244 1.05
Social Sciences General Social Sciences 1771 1.04
Medicine Infectious Diseases 991 1.04
Environmental Science Management, Monitoring, Policy and Law 1549 1.03
Materials Science Polymers and Plastics 342 1.03
Earth and Planetary Sciences General Earth and Planetary Sciences 11757 1.02
Mathematics Control and Optimization 2605 1.01
Indonesia’s strength in General Medicine in being driven by Universitas
Indonesia especially when it comes to quality (citation impact).
Indonesia’s strength in Global and Planetary Change, is being driven by
CIFOR and IPB while some others also produce high FWCI research
Which globally Prominent
or “hot” topics is
Indonesia active in?
Indonesia is active in many of the world’s 1% most Prominent topics,
ranging across many fields
Indonesia’s top highly Prominent research topics include Biodiesel,
transesterification, and Geopolymers; Inorganic Polymers, both topics in
which Indonesia is highly cited
 Globally, the papers
in this topic were
cited 10% more than This topic belongs
average to world’s top 1%
most Prominent
Globally this topic
consists of 4,093
papers
Indonesia is world #4 country in Biodiesel research and receives most
citations. UNDIP leads Indonesia in the topic

Countries World Institutions

Corporates Indonesian Institutions

Indonesia’s strength in Biodiesel; Transesterification is largely based on the
work of the below 5 researchers.
 Globally, the papers
in this topic were This topic belongs
cited 46% more than to world’s top 5%
average most Prominent
Globally this topic
consists of 566
papers
Indonesia is world #1 country in Palm oils; oil; Palm expansion research and
IPB the number #1 institution in the world in this field.

Countries World Institutions

Government Indonesian Institutions

Top 5 authors in the world in Palm oils; oil; Palm expansion research reveal
author from IPB as #2 author in the world, but low citations (FWCI). The
others could be good candidates for recruitments and/or collaboration
 How much does
Indonesia collaborate
Internationally and what
is the impact?
There is a positive correlation of 0.91 between how much a country collaborates
internationally (%) and the total Field-Weighted Citation Impact of the entire
country. Countries which collaborate more are cited more often!
Looking at the top 10 countries Indonesia collaborates with, we see that the
resulting co-publications are all cited many times higher than world average!

World average
FWCI = 1.00
Indonesia’s percentage of Internationally collaborated papers has aggressively
declined from over 55% in 2010 to less than 20% in 2019.

70

Switzerland
Interational Collaboration as Percentage of Country

60 Singapore
Denmark
Netherlands
50
Malaysia
Thailand
40
output

Taiwan
United States
30 Japan
South Korea
20 China
India
Indonesia
10
2010 2011 2012 2013 2014 2015 2016 2017 2018 2019
What kind of Innovation
has Indonesian research
contributed to?
 106 Indonesian
research papers
were cited by
175 patents

The cited
research papers
were related to
the these
keyphrases
Example of a Patent citing Indonesian research paper is this one by Signpath
Pharma INC related to chemotherapeutic agent
Indonesian Institutions producing the most papers cited by Patents
Next Steps
Work with Alexander, your Elsevier Consultant, to
customize your analysis and generate implications for
Indonesia Science Policy, and train your staff.

Quarterly Quarterly review

Customization
trainings for key with Policy-
Analysis &
analysts and makers and plan
Strategy
admins for the next year.
 Thank you

Alexander van Servellen

Senior Consultant, Research Intelligence
a.vanservellen@elsevier.com
Elsevier Singapore