Professional Documents
Culture Documents
Deployment Resource Requirements On Nodes
Deployment Resource Requirements On Nodes
2023, 19:42
Number of 1 node 3 or 4 nodes 9, 12, 17, or 24 nodes 1. WAN and PON features are available in a four-node minimum
nodes/VMs cluster and unavailable in a three-node minimum cluster.
2. WAN features are available in a 12- or 24-node distributed
cluster and are unavailable in a 9- or 17-node distributed cluster.
3. A 9-node distributed cluster contains 3 service nodes, 3 service
middleware nodes, and 3 big data analysis software nodes.
A 12-node cluster contains 4 service nodes, 4 service middleware
nodes, and 4 big data analysis software nodes.
A 17-node distributed cluster contains 7 service nodes, 5 service
middleware nodes, and 5 big data analysis software nodes.
A 24-node distributed cluster contains 8 service nodes, 8 service
middleware nodes, and 8 big data analysis software nodes.
4. In Huawei physical machine deployment scenarios, you are
advised to use Huawei standard-configuration physical machines to
deploy a single-node system or a minimum cluster. When
deploying a distributed cluster, you are advised to use virtualization
technology. One physical machine can be virtualized into a
CPU (on- 40 vCPUs, 2.2 48 vCPUs, 2.2 20 vCPUs, 2.2 GHz or 1. The CPU needs to be exclusively occupied and cannot be
premises GHz or higher GHz or higher higher dominant overcommitted. The dominant frequency cannot be lower than 2.2
deployment dominant dominant frequency GHz.
and HCS frequency frequency 2. Each physical machine has two CPUs. The number of vCPUs
deployment (logical cores) on a physical machine is the number of physical
scenarios) cores times the number of threads that can run on each core
through the use of hyperthreading. For example, if a physical
server has two x-core Intel CPUs that run two threads per core, this
server has 2 x 2 x x vCPUs in total.
Memory 128 GB 128 GB Service node: 96 GB The memory must be exclusively occupied in virtualization
Service middleware deployment mode.
node: 64 GB
Disk System disk: System disk: Service middleware 1. RAID is required for system disks, for example, RAID 1 or RAID
600 GB 600 GB node: 600 GB 10.
Data disk: 1200 Data disk: 1800 Service node: 600 GB 2. In a single-node system scenario, it is recommended that the
GB GB Big data analysis data disks of the big data analysis software be configured in RAID
software node: 1 or 10 mode to ensure reliability. In a cluster scenario, the data
System disk: 300 GB disks of the big data analysis software are deployed in 1:3
redundancy mode, so RAID 0 can be used on these data disks.
Data disk: 1800 GB to
7000 GB 3. I/O requirements: 5000 IOPS for 4 KB random write and 4000
IOPS for 4 KB random read.
Run the following command to check random write I/O:
fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --
name=test --filename=/opt/rand_test --bs=4k --iodepth=64 --
size=4096M --readwrite=randwrite -runtime=600
Run the following command to check random read I/O:
fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --
name=test --filename=/opt/rand_test --bs=4k --iodepth=64 --
size=4096M --readwrite=randread -runtime=600
4. In distributed deployment mode, the data disk size varies
depending on the cluster specifications. A 9- or 12-node distributed
cluster requires 1800 GB data disks whereas a 17- or 24-node
cluster requires 7000 GB data disks.
5. In the Huawei public cloud scenario, select ultra-high I/O for