Analytics platform

System Architecture and Installation

Guidelines Document
Version 6.6
CONTENTS
1 About this Document ..................................................................................................................................... 2
2 System Architecture ...................................................................................................................................... 4
2.1 High level description ........................................................................................................................... 4
2.2 Architecture hardware diagram .......................................................................................................... 4
2.3 VMware vSphere ..................................................................................................................................... 5
2.4 VMware vSAN .......................................................................................................................................... 5
3 System installation Guidelines..................................................................................................................... 6
3.1 Hardware physical mount ..................................................................................................................... 6
3.2 Network configurations ......................................................................................................................... 6
3.3 Hardware upgrade ................................................................................................................................. 6
3.4 vSphere servers’ installation................................................................................................................ 6
3.5 Virtual Machines (VMs) installation ..................................................................................................... 7

1 ABOUT THIS DOCUMENT

This document describes the Analytics platform architecture and define the installation
process.
Change Log
Version Change content Creator/Modifier Date
1.0 First Draft H.E. 21/8/2023
2 SYSTEM ARCHITECTURE

2.1 HIGH LEVEL DESCRIPTION

Our Analytics environment use Kubernetes application cluster architecture.

We use VMware vSphere and vSAN as virtualization infrastructure for our Kubernetes
cluster.

We use multitier security architecture to ensure our components segregation.

2.2 ARCHITECTURE HARDWARE DIAGRAM

Interconnection LLD example:
2.3 VMWARE VSPHERE
We chose VMware vSphere as our virtualization infrastructure.

VMware vSphere® uses the power of virtualization to transform data centers into
simplified cloud computing infrastructures, enabling IT organizations to deliver flexible
and reliable IT services. The two core components of vSphere are VMware ESXi™ and
VMware vCenter Server®

A vSphere cluster is a set of ESXi hosts configured to share resources such as processor,
memory, network, and storage.

2.4 VMWARE VSAN

We chose VMware vSAN as our storage solution.

VMware vSAN is a software-defined, enterprise storage solution that supports hyper-

converged infrastructure (HCI) systems.

vSAN is fully integrated with VMware vSphere, as a distributed layer of software within
the ESXi hypervisor.
3 SYSTEM INSTALLATION GUIDELINES
Our analysis platform installation process is divided to the below phases:

3.1 HARDWARE PHYSICAL MOUNT

In this phase the customer responsible to mounts all hardware and network connections
in his data center and perform all related physical installation, cabling, and power up
steps based on the manufacturer’s installation guidelines.

3.2 NETWORK CONFIGURATIONS

The customer should set all network configurations, over all hardware components,
based on the project network plan and the manufacture guidelines.

3.3 HARDWARE UPGRADE

All related firmware and drivers should be installed and upgrade by the customer based
on the manufacture recommendations and best practice.

3.4 VSPHERE SERVERS’ INSTALLATION

Below configurations should be done by the customer based on VMware guidelines and
the virtualization plan:
• vSphere and vSAN licensing
• vSphere clusters configurations
• vSphere hosts configurations
• vSAN configurations
• vCenter HA configurations
• Tests

Installation guide of VMWare vSphere:

vCenter Server Installation and Setup - VMware vSphere 7.0
Installation guide for vSAN:
vSAN Planning and Deployment - VMware vSphere 7.0
Requirements:
- vSphere version must be at least 7.0u3
- vSphere user with the permissions to manage all volumes related actions, should be provided to us
for installation scripts preparations.
- Data Store URL name should be provided to us for installation scripts preparations.
- vCenter name should be provided to us for installation scripts preparations.
- vCenterIP
-
 - A Storage Policy should be created. must be a thin type, preferable to define RAID-6.
The storage URL name should be provided to us for installation scripts preparations.

- We are using the following Storage Policy rules (as example):

3.5 VIRTUAL MACHINES (VMS) INSTALLATION

Below configurations will be done by our DevOps team:

Voyager will provide two VM templates:

1. Jenkins/Admin VM

2. Basic VM

Voyager will create the following VMs from the given templates.
(names and Ips are examples)
• VMs configuration based on the below table.
 • All Ips should be based on the same subnet in class c (e.g. 192.168.10.x/24).

Virtual Machines configuration table:

VMName Hostname vCPU RAM(GB) VM HDD Storage HDD
600-jenkins-1 600-jenkins-1 4 32 100 1000-2000
600-nfs-1 600-nfs-1 2 16 100 2000-5000
601-master-1 601-master-1 2 16 100
601-master-2 601-master-2 2 16 100
601-master-3 601-master-3 2 16 100
601-node-01 601-node-01 16 64 100
601-node-02 601-node-02 16 64 100
601-node-03 601-node-03 16 64 100
601-node-04 601-node-04 16 64 100
601-node-05 601-node-05 16 64 100
601-node-06 601-node-06 16 64 100
601-node-07 601-node-07 16 64 100
601-node-08 601-node-08 16 64 100
601-node-09 601-node-09 16 64 100
601-node-10 601-node-10 16 64 100
601-node-11 601-node-11 16 64 100
601-node-12 601-node-12 16 64 100
601-node-13 601-node-13 16 64 100
601-node-14 601-node-14 16 64 100
601-node-15 601-node-15 16 64 100
601-node-16 601-node-16 16 64 100
601-node-17 601-node-17 16 64 100
601-node-18 601-node-18 16 64 100
601-node-19 601-node-19 16 64 100
601-node-20 601-node-20 16 64 100
601-node-21 601-node-21 16 64 100
601-node-22 601-node-22 16 64 100
601-node-23 601-node-23 16 64 100
601-node-24 601-node-24 16 64 100
604-node-1 604-node-1 8 32 100
604-node-2 604-node-2 8 32 100
604-node-3 604-node-3 8 32 100
604-node-4 604-node-4 8 32 100
602-solr-1 602-solr-1 8 32 100 2000
602-solr-2 602-solr-2 8 32 100 2000
602-solr-3 602-solr-3 8 32 100 2000
602-solr-4 602-solr-4 8 32 100 2000
602-zookeeper-1 602-zookeeper-1 2 8 100
602-zookeeper-2 602-zookeeper-2 2 8 100
602-zookeeper-3 602-zookeeper-3 2 8 100