Professional Documents
Culture Documents
SSRN Id4385643
SSRN Id4385643
Sciences (ICCDI-2023)
Abstract: The popularity of Blockchain among researchers, developers, and tech-savvy is reaching the sky. Due to the Blockchain's growing attractiveness to
the new crowd, anyone familiar with cryptocurrencies must be aware of Blockchain. Blockchain technology provides trust in an untrusted environment of
computation and technology. Blockchain has the potential to store, manage and share information in a decentralized manner. This decentralized blockchain
property makes this technology robust and immutable to external malicious activities. In this paper, we have conducted a study to measure and assess the
performance of various blockchain platforms named Ethereum (private Deployment), Hyperledger Besu Ethereum Client, and Hyperledger Fabric. The
performance analysis, such as throughput, resource utilization, and latency, are also calculated. The results show that the Hyperledger Fabric performed very
well compared to Ethereum and Hyperledger Besu in all the performance measures.
Keywords: Hyperledger Fabric, Hyperledger Caliper, Ethereum, Hyperledger Besu, Chaincode, Smart Contract, Blockchain.
Abbreviation
A HLF: Hyperledger Fabric
1. Introduction B DLT: Distributed Ledger Technology
C MSP: Membership Service Provider
Blockchain technology has become extremely popular with the advent of
D SPoT: Single point of truth
cryptocurrencies and is continuously expanding exponentially. Blockchain
E SPoF: Single point of failure
is a continually updated and maintained list of transactions and an
F PoET: Proof-of-Elapsed Time
immutable decentralized ledger. Blockchain is recognized as the missing
G VSCC: Validation System Chaincode
trust layer for the internet. When a block is joined to the chain of the
H MVCC: Multiversion Concurrency Control
Blockchain, it is nearly impossible to delete or change the block since the
I IBFT: Istanbul Byzantine Fault Tolerance
attacker has to change the previous blocks too. Satoshi Nakamoto [1]
J OS: Operating System
introduced the P2P electronic cash system and popularized this DLT among
K Avg.: Average
society. Later, V. Buterin [2] introduced Ethereum, and the reach of
L TPS: Transaction per second
blockchain technology expanded to include an extensive and vast range of
applications. Buterin presented a paper on next-generation smart contracts public blockchain, and Multichain, Corda, and Hyperledger Fabric are
and decentralized application platforms referring to the limitation of the examples of private blockchains. Private blockchain systems additionally
bitcoin scripting language, such as the lack of Turing completeness. ensure that the Blockchain doesn't branch through the usage of specific
Ethereum supports all kinds of computation, including loops, and supports protocols. Hyperledger Fabric is a private blockchain that has emerged as a
the state of the transaction. Ethereum provides the functionality of a smart popular solution for many business problems and applications. Hyperledger
contract, a self-executing contract that permits trusted transactions between Fabric offers a wide range of use cases, flexibility, and ease of
parties without a central authority. A blockchain network can be private or implementation, making it popular among developers and researchers. The
public. The blockchain concept, which serves as the foundational core data public blockchain network has significantly more security, performance,
structure of public networks such as Ethereum [3], and Bitcoin [1], allows scalability, and transparency issues than the private network. Business
any participants to join the network, and that causes the problems such as solutions require low latency and high throughput blockchain networks to
high transaction fees, high resource consumption, low throughput, and rapidly handle the transaction in less time with minimal computational
many more. An essential characteristic of such systems is the anonymity of resources. With the advent of blockchain technology, people have been
the participants in public blockchain networks. A permissioned network is introduced to various public, private, and consortium blockchains. However,
ideal for businesses that need authenticated participants, and every performance concerns persist; therefore, offering a practical yet effective
transaction is verified by the authorized gatekeeper rather than an unknown solution is essential. The contribution of this study is to:
participant. To address the growing need for business-level blockchain • Offer an empirical analysis of the performance of blockchain
applications in many industries and businesses, developers presented a systems.
novel framework in response to this new archetype. This new private and • Evaluate the key metrics such as throughput, latency, and other
permissioned Blockchain only allows identifiable or authorized participants factors and analyze the significant variation in performance
to join the network, providing better information sharing, security, and • The performance of Hyperledger version v2.x, Ethereum, and
increased performance. A private blockchain is faster than a Besu are analyzed in this study, which also aids in understanding
the circumstances in which one platform facilitates higher
performance than the other platforms.
1
2. Preliminary Knowledge
2.1. Ethereum
Performance
consumption
Throughput
Success rate
Blockchain
Scalability
Resource
Latency
Authors
Year
Monrat et al. [18] 2020 Ethereum, HLF, Corda, Quorum Yes Yes Yes Yes No No
Dabbagh et al. [16] 2020 HLF, Ethereum Yes No Yes Yes Yes Yes
Khan et al. [11] 2022 HLF Yes Yes Yes Yes Yes No
Woznica et al. [20] 2022 HLF, Iroha, Sawtooth Yes Yes Yes Yes No No
Our study 2022 HLF, Ethereum, Hyperledger Besu Yes No Yes Yes Yes Partially yes
orderer's signature on the block, evaluate against the VSCC validation, They conducted experiments that introduced the optimization, such as
and then MVCC validation [12]. parallel VSCC validation, MSP cache and read/write during MVCC and
commit phase. Kuzlu et al. [15] analyzed the performance of HLF v1.4 in
terms of latency, throughput, and scalability by varying transaction counts,
speed, and types with the help of the Hyperledger caliper benchmarking
3. Related Work tool. The experimental results show that query types of transactions can
handle 200 transactions per second without any substantial network latency.
This section and Table 1 depict the performance evaluation performed on Dabbagh et al . [16] the performance of HLF and Ethereum using Fabric
the Hyperledger Fabric and other blockchain platforms, which assists versions v1.4.x, v1.3.0, v1.2.0, v1.1.0, and Ethereum 1.2.1. on latency,
developers, researchers, and readers in determining the compatible and throughput, success rate, and resource consumption. The results from the
suitable Blockchain based on industry requirements. experiments show that the Hyperledger Fabric outperforms Ethereum in
terms of throughput and latency, while Ethereum has an exceedingly high
3.1. Performance studies on Hyperledger Fabric: resource consumption and transaction success rate. Pongnumkul et al. [17]
investigated the execution time, throughput, and latency of Hyperledger
Nasir et al. [13] investigated the Hyperledger Fabric platform's Fabric v0.6 and the private Ethereum blockchain in varying workloads of
performance. They developed their own smart contract (chaincode) for up to 10000 transactions. The paper analyzed that the HLF achieved high
transferring virtual money. The experiment was carried out on throughput and low latency in the given workload.
Hyperledger Fabrics v1.0 and v0.6. The performance metrics such as
latency, throughput, and execution time are evaluated by variation in the 3.2. Performance studies on other Blockchain Platforms:
workload up to 10000 Tx. Results. The platform's scalability is then
calculated by making the variation in the number of nodes up to 20, and Monrat et al. [18] evaluated the scalability and performance of private
the results are compared. The experimental results show that v1.0 blockchain platforms, incorporating Quorum, Corda, Ethereum, and
performed significantly well as compared to v0.6. Dreyer et al. [14] Hyperledger Fabric. The platforms are evaluated and examined in terms of
conducted a study analyzing the performance of Fabric version 2.0, throughput and network latency by making variations in the number of
the avg. transaction latency, transaction failure rate, and network Docker Engine v20.10.21
throughput and scalability are assessed by varying the network size. The Docker Compose v1.28.5
results show that Iroha's minimal latency is independent of transaction
Benchmarking tool Hyperledger Caliper v0.4.2, Latest
sending rate or network size.
Programming Language Go language, JavaScript
IDE VSCode
4. Methodology
The methodology adopted in this study is employed to measure the HLF permits the developer to use any consensus protocol, including SOLO,
performance metrics and analyze the performance of these different KAFKA, and RAFT. The databases supported by the HLF are CouchDB and
blockchain platforms. The result obtained from this study can assist the Level DB. The CouchDB is used here in the deployment model.
practitioner, developer, and learner in understanding bottlenecks and
adopting a suitable platform for business application development. 4.3. Benchmarking Tool and Test Environment:
To benchmark Blockchain's performance, the Hyperledger Caliper tool [21]
4.1. Key metrics definitions:
is incorporated in this study. The Hyperledger Caliper represents the
Key metrics must be measured and analyzed to study the blockchain multiple-client thread; one client (load-generating) submits the transaction to
platform's effectiveness. There are four primary vital metrics: Success Rate: the blockchain network on the participant's behalf, and another (observing
the success rate in the experiment depicts the count of successful client) checks for the status of the submitted transaction. Caliper provides the
transactions out of all the transactions sent. Latency: The benchmarking user with a predefined solution to test the Blockchain, such as Hyperledger
tool evaluates the max. Latency, min. Latency and avg. Latency. The Besu harnessing the Ethereum adapter, Ethereum, Hyperledger Fabric, and
latency is the time elapsed between the initialization of the request and the FISCO BCOS.
time the response is received. Throughput: Throughput is measured in
transactions per second, representing the number of transactions
successfully performed in a second. The high throughput with low latency
is an admirable feature in a blockchain. Resource Consumption: The
resource consumption depicts CPU usage, memory usage, and Network IO
in the Blockchain.
5. Experimental Results
The study's results incorporate the tests of all the parameters defined in the
performance metrics. The test results are analyzed as follows:
Figure 5 shows that the Hyperledger Fabric version v2.2 has fewer
successful transactions than the other platform. The issue that appeared
during the execution of the transfer function was related to the MVCC
read_conflict. According to Chacko et al. [22], the MVCC read conflicts
occur when there is an increased time between the endorsement and
validation of a transaction. Ethereum and Besu have a 100% success rate
and outperform the HLF. Figure 5 also illustrates that the "query" type
of transactions has a 100% success rate in all the blockchain platforms.
REFERENCES