Lectures and Talks in

Scholarly Communication

Bibliometric Analysis in Action

Dr. Adi Wijaya, MKom*)

Presented at BA Workshop, BRIN, Jakarta

Nov 22nd, 2023

*) Lecturer/Researcher at Universitas Indonesia Maju, Jakarta

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Short Bio Expertise:

Dr. Adi Wijaya, SKM, MKom App. & Use Case Pro & Master
Machine Learning Pro & Master
Data Engineering Pro

Contact:
R Programming
•Telegram: @adiwjj Data Mining
•Email: adiwjj@gmail.com | adiwjj@uima.ac.id Data Scientist
Project Management
•HP/WA: +62-838-789-19-456 Software Testing
SDLC

I am a lecturer and research fellow at the Universitas Indonesia Data Governance Foundation
Maju (UIMA), Jakarta. Apart from that, I am also involved in data
science, data governance, enterprise architecture, and software Certified ATLAS.ti Professional Trainer
development. Received a Doctor in Electrical Engineering (2021) at
the Dept. of Electrical and Information Engineering, Universitas Project Management Essentials Certified
Gadjah Mada. My research topics are information processing, data
mining and machine learning, and health-related informatics Scrum Fundamentals Certified
including brain-computer interface.
TOGAF 9 Foundation Certification

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Outline
► Bibliometric Analysis (BA): what and why?
► Published Paper on BA
► How to conduct BA
► BA Challenges
► BA Opportunities
► BA Use Case
► Miscellaneous

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Tools
Bibliometric Analysis Data Visualization

Data Cleaning and Retrieval Reference Management

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 (another) Tools

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Bibliometric Analysis: what and why?

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Key Papers

Accessed on Oct 21st, 2023

20.30 WIB

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 What is BA?
►A method used in literature reviews to guide researchers
towards influential works and map research fields without bias
(Zupic and Cater, 2015)

►BA main purposes: (Donthu et al., 2021; Zupic and Cater, 2015)
» performance analysis BA can focus on structure, dynamics, or
» science mapping specific research questions (Zupic and Cater, 2015)

►BA mainly deals with extensive datasets, often comprising

hundreds or thousands of studies (Donthu et al., 2021; Zupic and Cater, 2015)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Type of Analysis in BA

1 Co-author analysis Memetakan hubungan/kolaborasi antar author/afiliasi/negara

2 Co-occurrence analysis Memetakan state-of-the-art terkait suatu topik riset

3 Citation analysis Memetakan author/source/paper yang berpengaruh

4 Bibliographic coupling analysis Memetakan topik riset yang trending

5 Co-citation analysis Memetakan fondasi/landasan sebuah topik/model/konsep

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Bibliographic coupling vs. Co-citation Analysis

Bibliographic coupling Analysis

► Research Front
► Research Trend

Citing paper
Paper title Present times
some different
papers have
the same
number of
references Past times
Cited paper
Reference
► Research Foundation
► Knowledge Base

Co-citation Analysis

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Benefit of BA?

1 Co-author analysis Tokoh/Ilmuwan Penting Potensi Kolaborasi

2 Co-occurrence analysis Konsep Penting Posisi Riset Klasterisasi Topik Emerging Topics

3 Citation analysis Tokoh/Ilmuwan Penting Target Publikasi Key Paper

4 Bibliographic coupling analysis Research Front Research Evolution

5 Co-citation analysis Research Foundation Knowledge Base

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Published Paper on BA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA in various digital databases

Accessed on
Aug 14th, 2023
13.00 WIB

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Papers using BA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 How to conduct Bibliometric Analysis

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

BA steps
Define Aims/Research Objective

Formulate Research
Questions (RQs)

Formulate Search
Strategy

Collect Paper
(based on search strategy)

Conduct Network
Analysis

Answer

RQ1 RQ2 RQn

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Novelty

Jika sudah ada paper BA dengan topik yang similar tunjukkan perbedaan dengan paper yang ditulis…

Kent Baker, H., Pandey, N., Kumar, S., & Haldar, A. (2020).
A bibliometric analysis of board diversity: Current status, development, and future research directions.
Journal of Business Research, 108, 232–246. https://doi.org/10.1016/j.jbusres.2019.11.025

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA Challenges

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA Challenges

Research objective precision

Articulating Clear
Research Objectives Scope of study
and Scope Suitability Evaluation

Relevant Analysis Techniques

Selecting
Appropriate BA Data-Technique Alignment
Techniques Analysis Techniques Integration

Search strategy
Ensuring High-
Quality and Relevant Data Accuracy
Data Collection Data pre-processing technique

Data Visualization
Communicating and
Presenting Results Writing alignment
Donthu, N., Kumar, S., Mukherjee, D., Effectively Outlet alignment
Pandey, N., & Lim, W. M. (2021).
How to conduct a bibliometric analysis: An
overview and guidelines. Journal of
Business Research, 133, 285–296.

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Penempatan di Paper
Introduction Methods Results and Discussion
► What and why ► Data Collection ► brief explanation concerning the
Search strategy structure of presenting results in
addressing the research problem.
Data Accuracy
Data pre-processing technique ► Results and analysis related to RQs
► Existing research
Data Visualization
► Analysis technique Writing alignment
Relevant Analysis Techniques
► Research Gap Data-Technique Alignment
► overview and the implications on the
field of study and practical issues.
Scope of study Analysis Techniques Integration Outlet alignment
Suitability Evaluation

► Research Questions + Research Aims

Research objective precision Urutan pengerjaan

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Contoh…

Source: https://academic-publishing.org/index.php/ejel/article/view/3097
adiwjj@gmail.com Lectures and Talks in Scholarly Communication
 Introduction (1/2)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Introduction (2/2)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Methods (1/2)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Methods (2/2)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results and Discussion (1/2)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results and Discussion (2/2)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA Opportunities

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

Primary Studies Secondary Studies New opportunities

BA BA  Content Analysis

ScR BA  ScR ScoRBA

SLR MA BA  SLR SLNA

NMA BA  MA BibMA

Direct flow BA – Bibliometric Analysis ScoRBA – Scoping Review based on BA

ScR – Scoping Review SLNA – Systematic Literature Network Analysis
Precursor SLR – Systematic Literature Review BibMA – Bibliometric and Meta Analysis
MA – Meta-analysis
NMA – Network Meta-analysis
adiwjj@gmail.com Lectures and Talks in Scholarly Communication
 Papers using BA+CA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Papers using BA+CA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Papers using ScoRBA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Papers using SLNA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Papers using BA+MA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA Opportunity
► Journal/Conference Article
► Chapter 2 of Thesis/Dissertation using BA
► Research collaboration
► Enter/explore new research topic
► As Precursor of SLR, ScR, MA
► Can be combined with:
» SLR → SLR + BA → SLNA (Systematic Literature Network Analysis)
» ScR → ScR + BA → ScoRBA (Scoping Review based on BA)
» MA → BA + MA → BibMA (Bibliometric and Meta-analysis)

SLR = Systematic Literature Review

ScR = Scoping Review
MA = Meta-analysis

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 RQ answered by BA

(Zupic and Tomaz, 2015) Zupic, I., & Čater, T. (2015).

Bibliometric Methods in Management and Organization.
Organizational Research Methods, 18(3), 429–472.

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 RQ answered by BA

Prominent RQs

Ranjbar-Sahraei, B., & Negenborn, R. R. (2017).

Research positioning & trend identification:
A data-analytics toolbox (version 2.2).
Delft University of Technology.

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA use case

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 BA use case ― e-Learning in Higher Education
Mapping Research Profiles and Future Directions in e-Learning
in Higher Education: A Bibliometric and Content Analysis

Research Aims
Mapping research profiles
e-learning in higher education
Identify future directions

Research Questions:
1. What is the state-of-the-art map of e-learning in higher education research? research profiles

2. What are the emerging and trending research topics in e-learning in higher
education? research profiles
3. What future works could be done in e-learning in higher education research? future directions

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Search Strategy
►Database : Scopus
►Keyword : [Title-Keyword-Abstract]
» education* OR curricul* AND  Block 1
» “higher education” OR university OR college AND  Block 2
» “online learning” OR e-learning OR elearning OR “e learning” OR “blended learning”  Block 3
►Time Span : 2016 – 2021
►Type of Paper : article (journal)
►Language : English
►Open Access : Gold OA

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Search Results

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Export the data

Pilih CSV atau BibTex

(csv lebih direkomendasikan)

Wajib dipilih, agar file CSV compatible baik

untuk VOSviewer maupun BibliometriX

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Analysis Technique ― research structure

research profiles future directions

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Let’s modeling…

  


adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results – RQ#1 State-of-the-art

Increasing…(good news)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 VOSviewer + Tableau

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results – RQ#1 State-of-the-art
Prolific-Influential Sources

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 VOSviewer + Tableau

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results – RQ#1 State-of-the-art
Prolific-Influential Author

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 VOSviewer → Co-occurrence → Author Keyword

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results – RQ#1 State-of-the-art

Thing of Interest:

» Number of clusters (+ its color)

» Prominent/interesting cluster member
» Main theme for each cluster
» Relationship between clusters

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results – RQ#2 Emerging/Trending Topics
Niche/Isolated theme Core/Motor theme

Basic/Interdisciplinary theme

Emerging or Declining theme

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results ― RQ#2 Emerging/Trending Topics

Thing of Interest:
» Novel and Old topics for each cluster
» Relationship map of a novel topic

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Results ― RQ#3 Future Works

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Paper Review…

Research problem…

Future work…
adiwjj@gmail.com Lectures and Talks in Scholarly Communication
 Paper Review…

Research problem…

Future work…
adiwjj@gmail.com Lectures and Talks in Scholarly Communication
 Miscellaneous

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Common (different) steps in SLR, BA, SLNA, and ScoRBA
ScoRBA [ScRBA]
Collect Paper
(based on search strategy)

Select Eligibility Study

(inclusion criteria)

Conduct Network Analysis

(co-occurrence analysis)

Cluster
1
Cluster
2
Cluster
N

Identify Related Papers &

Extract Data

SLR – Systematic Literature Review

BA – Bibliometric Analysis PAGER reporting
SLNA – Systematic Literature Network Analysis
ScoRBA – Scoping Review based on BA
adiwjj@gmail.com Lectures and Talks in Scholarly Communication
 IEEE Xplore CSV → Scopus CSV

Action #1 → Replace
Kolom “Author Keywords”,
replace titik koma [;] menjadi titik koma + spasi [; ]

Action #2 → Rename Title Source title Year Cited by

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 PubMed TXT to WoS-like CSV
1 Lakukan pencarian di PubMed 5 Save ke format Excel

2 Save hasil pencarian

6 Buka file hasil export dgn Excel

3 Aktifkan BibliometriX (via R command) 7 Replace isi kolom “DE”

replace titik koma [;] menjadi

4 Import PubMed text file ke BibliometriX
titik koma + spasi [; ]

8 Save as ke CSV, maka file dapat dibuka di OpenRefine*, VOSviewer**, BibliometriX***

*) untuk merge/thesaurus | **) open sebagai file WoS | ***) open via Load bibliometrix file(s)

adiwjj@gmail.com Lectures and Talks in Scholarly Communication

 Lectures and Talks in
Scholarly Communication

Thank you…

adiwjj@gmail.com Lectures and Talks in Scholarly Communication