Professional Documents
Culture Documents
VTVCable Solution Description 20-10-22
VTVCable Solution Description 20-10-22
Legal Information
Copyright and ©MediaKind 2020. All rights reserved. No part of this document may be
Trademarks: reproduced in any form without the written permission of the copyright
owner. All trademarks mentioned herein are the property of their
respective owners.
Disclaimer and The contents of this document are subject to revision without notice due
Confidentiality: to continued progress in methodology, design and manufacturing.
MediaKind shall have no liability for any error or damage of any kind
resulting from the use of this document.
Contacts
Tze Min Liew Sanjip Subudhi
Mobile: Mobile:
2
Error! Unknown document property name.
Error! Unknown document property name.
Contents
1 Introduction ................................................................. 5
1.1 Purpose and Scope .......................................................... 5
1.2 Document Audience ......................................................... 5
2 Solution Summary ........................................................ 6
3 Solution Proposal .......................................................... 7
3.1 VTV Requirement: ........................................................... 7
3.2 VOD encoding and Packaging flow...................................... 7
3.3 Linear content Flow and Packaging ..................................... 8
3.4 Integration Points ............................................................ 9
3.4.1 VSPP Hardware Sizing: ................................................... 10
3.4.2 VSPP Software Sizing: .................................................... 11
3.4.3 VSPP On Premises Hardware Detailed BOM ....................... 11
3.4.4 MKEO HW and SW Detailed BOM ..................................... 14
4 MediaKind Encoding on Demand (MKEO) .................... 15
4.1.1 MKEO Deployment Models............................................... 16
5 Video Storage and Processing Platform (VSPP) .......... 17
5.1.1 VSPP Hardware Deployment ............................................ 18
5.2 VSPP Supported Use Cases ............................................. 19
5.2.1 OTT Live Service ............................................................ 19
5.2.2 Ingest Resiliency ........................................................... 19
5.2.3 Catch-Up TV Service ...................................................... 19
5.2.4 Video on Demand (VOD) Service ..................................... 20
5.2.5 Just-in-Time Packaging (JITP) ......................................... 20
5.2.6 Just-in-Time Encryption (JITE) ........................................ 20
5.3 VSPP Architecture .......................................................... 21
5.3.1 VSPP Manager ............................................................... 21
5.3.2 VSPP Nodes and Pod ...................................................... 21
5.4 VSPP Management Tool .................................................. 24
5.5 VSPP Diagnostics Suite ................................................... 25
3
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
Term Definition
ABR Adaptive Bit Rate
cDVR Cloud DVR
CDN Content Delivery Network
DRM Digital Rights Management
DVR Digital Video Recorder
EPG Electronic Program Guide
GLF Global Listings Format
HLS HTTP Live Streaming
HSS HTTP Smooth Streaming
JITP Just in Time Packaging
JITX Just in time transcoding
KMS DRM Key Management Server
MSS Microsoft Smooth Streaming
NMS Network Monitoring System
OTT Over-The-Top
SPTS Single Programme Transport Stream
URL Uniform Resource Locator
VOD Video on Demand
VSPP Video Storage and Processing Platform
4
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
1 Introduction
5
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
2 Solution Summary
The proposed solution is based on MediaKind Video Storage and Processing Platform
(VSPP) and, with pre-integration MediaKind Encoding On-Demand (MKEO) to help tailor
VTV requirement. The solutions help and enable a smooth workflow for content ingest
and effectively manage the content life cycle including ingest, process, and distribute
digital assets.
MediaKind MKEO solutions is ready to be deployed in the cloud; and had been tested
and interworked with Google Cloud Platform (GCP). Unless otherwise stated, the
solution components described in this documentation are all designed to be deployed
on premise or VTV cable datacenter.
6
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
3 Solution Proposal
Content is ingested in the watch folder, VTV CMS create the workflow based on the rule
defined CMS normalized the content before the transcoding.
The MediaKind Encoding On-Demand (MKEO) provide a fast, high performance file to
file based transcoding solution.
Using MKEO (MediaKind encoding on demand) all assets are transcoder in the desire
bitrate profile. All the transcoded MBR mezzanine files are stored in a shared asset
storage which can be accessed by VSPP packagers.
It is recommended to use NFS v4 for shared asset storage. NFS based file system is
deployed to build an end-to-end VoD solution.
7
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
To support different types of clients, VoD assets are packaged in different ABR streaming
formats (such as HLS, HSS, and DASH).
VSPP packaging systems:
Just-in-time On-demand Packaging (VoD PULL System): assets are stored in
mezzanine formats. Just-in-time packagers (JITP) will convert assets into the
required ABR format when the asset is pulled from the client.
CDN is used to cache the commonly viewed VoD assets and thus limit traffic to core
components (origin server)
MediaKind Controller (MKC) will be used for management and also to manage the
License Server. MKC provides the ability to accurately monitor, control and ensure
service availability.
The use cases defined by VTV cable and part of this proposal are the Catchup TV and Live
OTT streaming Via CDN. while the architecture is prepared also to support additional
use cases such as cloud DVR, DVR re-assetization to VOD (Live to VOD).
8
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
9
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
Alternatively, if Sigma can tunnel through the FP WV PR key exchange requests from
VSPP to the Apple Google Microsoft DRM KMS, then VSPP can continue to use the
existing FP WV PR key request/response HTTPS APIs.
10
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
11
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
12
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
13
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
Instead of using the G8-1044 server hardware, Vietcom can procure and setup the
server hardware that comply with the minimum spec that is equivalent to MediaKind’s
G8-1044 as below:
Component Description Qty
Chassis 1U Bare Bones w/ 1 Power Supply and Include Intel 1
Server Board S2600WFT (“Wolf Pass”)
Power Supply 1100W AC Common Redundant Power Supply 1
(Platinum Efficiency)
Processor Intel® Xeon® processor Scalable Family – Gold 6140 : 2
140W – 18C @ 2.3GHz – Turbo : 3.4 non-AVX2 / 3.0
AVX2 / 2.5 AVX512
Memory RDIMM 8 GB – DDR4 , 2666MHz , ECC , CL19 , 1.2V , 12
Registered , DIMM , Single Rank
Hard Drive Intel® SSD DC S4500 Series, 240GB, 2.5in SATA 6Gb/s, 1
3D1, TLC
Network Intel® Ethernet Network Connection OCP X557-T2 1
Dual 10GB10BASE-T OCP module
Rail Kit Enhanced value rail kit set 1
Bezel Branded Ericsson 1U Bezel 1
Remote Management Intel® Remote Management Module Lite 2 1
Module
Operating System CentOS 7.3 ISO Mastering 1
Packaging Packaging Set, G6-G7 1000 and 2000 Series 1
Options
Optional 10GB Intel® Ethernet Converged Network Adapter X710- 1
Network Board #2 DA2, retail unit. (Dual port)
Direct Attached Cable Intel® Ethernet SFP+ Twinaxial Cable; 1m (requires 2 2
for 10GB Module units)
14
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
15
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
16
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
17
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
As the VSPP platform requires throughput and storage capacity that can also scale out,
we will recommend VTV to use the certified and tested bare metal COTS HP servers.
For example, each server is interconnected with 25GE or 40GE interconnect; and which
guarantee the disk throughput and I/O meet the throughput requirement.
Based on the assumptions in previous section, the system requirement of VSPP will be as
follow:
Full Resilience VSPP Components
2 x Admin/Controller Servers (with 1+1)
1 x Diagnostic Servers
N x Storage Nodes (with n+1)
Supported Use Cases
18,250 hours of VOD in HD (50 hours per day x 365 days a year)
56 x HD with 4 hours rolling buffer, 7 days catchup
Proposed Server Hardware:
Admin/Controller: HPE DL360 Gen10
Diagnostics: HPE DL360 Gen10
Storage Nodes: HPE DL380G10 24x2TB effective storage of with 96TB and
effective throughput of 14.4Gbps each.
18
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
19
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
asset, the Ad Decision Server can decide if Ads should be replaced or skipped during the
playback.
20
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
server network path (LA URL). These parameters are used by the Client device to request
the credentials and decrypt the content in an ongoing manner.
The VSPP Manager is an application server that controls and orchestrates the entire
VSPP activities and flows. Manager dynamically control and load balances the virtual
video server clusters (pods) in a real-time environment in terms of storage capacity
allocation, content processing capabilities, ingest and streaming throughput. In addition
to managing the pods, the Manager communicates with the operator Back Office (BO)
infrastructure using multiple interfaces. These interfaces assist the manager to control
content acquisition, session allocation, recording scheduling, Ad-insertion capabilities,
content encryption management, and other session control capabilities.
It is important to note that the Manager application is responsible for control and
system management activities only and does not handle the actual data flow.
The basic production VSPP deployment is based on a single pair of Manager Application
servers configured in (1+1) Active-Backup redundancy architecture interconnected with
a DB entity.
The VSPP Solution requires an in-memory database system that delivers a high-speed
performance and provides extremely fast access to critical configuration and service
data of the Video software layer. All the production deployments utilize an in-memory
database. As opposed to traditional databases, the in-memory database may scale to
hundreds of thousands of transactions per second (IOPS), thereby reducing latency in
the overall VSPP system functionality.
Nodes are the COTS (Commercial Off-The-Shelf) servers, which present a basic storage
and computing element. Nodes run the Linux-OS and the VSPP software stack and are
responsible for the actual data flow: ingest, processing (e.g. transcoding, encryption,
packaging, Ad-insertion), storage and streaming of the content.
Nodes can be comprised from a different number of HDDs and use different HDD
configurations according to the required workload and special purpose of the cluster,
21
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
such as high-capacity HDDs (12TB, 14TB) for storage of huge volume of VOD, and SSD for
high throughput streaming of popular channels.
The VSPP provides a linear scalability model for the shared storage capacity, total
streaming throughput and processing resources for the entire cluster of nodes, whereby
each aggregated node contributes its
5.3.2.2 Pod
A pod is the basic logical block of the system. A pod represents a virtual video server
entity, which clusters together a number of nodes interconnected within a LAN topology
via the standard 1 GigE management and 10GigE / 25GigE / 40GigE full mesh
interconnection networks.
According to the linear scalability model, all nodes aggregated in the single pod
contribute their physical resources to the entire cluster in terms of storage capacity, CPU
power, ingest effort, streaming throughput and processing resources. Each pod defines
unified name-space scale-out storage. The recorded content can be optionally dispersed
across the nodes within the pod in different configurable approaches to accommodate
the most optimized redundancy scheme.
As a current constraint, all nodes in the pod can be comprised from different storage
capacity metrics; however, the number of physical disks must be similar across all the
nodes in the pod.
Generally, a single pod scale is limited by interconnection network bandwidth
constraints, as a full mesh high throughput interconnection is required between all the
nodes in a pod in-order to transfer the dispersed chunks of the data on the fly during the
ingest or streaming of the content.
The MediaKind VSPP provides a High Availability (HA) architecture, based on a single pair
of Manager Application servers configured in (1+1) Active-Backup redundancy
architecture interconnected with a DB HA entity, warrantying 99.999% of service
availability. Below are described the concepts that allows to fulfil with this requirement.
22
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
As a final point in the ingest process the content is optionally segmented to small chunks
(~1MB) and dispersed across the entire cluster to provide better storage capacity
efficient and ensure the highest reliability level and most advanced content redundancy
scheme. The following concepts are implemented by the VSPP as a content storage
model.
The VSPP uses efficient write coalescing and optimized space allocations algorithms to
maintain sequential workloads for concurrent writes. Without these algorithms, multiple
writes may be interleaved and lose their sequential IO pattern to the drive offering
reduced performance.
The VSPP utilizes a coherent collaborative storage cache, which is used internally to pre-
fetch read IO and eliminates Disk IO jitters that could affect real time IO requirements
for video applications.
The VSPP stripes the data (per the recorded asset) across multiple drives and nodes in
the pod. This ensures both, high level of available parallel IO and also perfect IO load
balancing across the entire storage cluster.
The VSPP implements a unique scale-out, distributed file-system, which uses much less
overhead for data protection. Instead of replicating or even triplicating the data chunks,
the VSPP uses a distributed data protection scheme using either XOR parity chunks for
RAID5 like use cases and erasure codes for RAID6+ use cases. This ensures both better
capacity efficiency as well as writes IO efficiency, which is paramount for video
application specifically on a large scale.
23
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
The VSPP Management Console allows performing the following monitoring and
management tasks and activities depending on the user’s defined role as described
above:
Configuring and management of channels, different profiles, settings and
parameters used by VSPP applications and features.
View and update the VSPP cluster in terms of physical resources. Manage/add
nodes, pods.
View and monitor in real time environment different application aspects of the
platform
Managing the licensing engine.
Managing users and their accounts.
Monitoring various operational aspects such as: video streaming session’s
dashboard, VSPP status, and general system status and errors.
Enables to search for recorded video assets, and streaming sessions.
Provides capability to view and monitor a general status of the system and the
manage Channels Map in the form of RSS feeds.
24
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
On the functional plane, the VSPP Diagnostics suite offers the following monitoring,
diagnostics and analytics capabilities and interfaces:
Real-time monitoring and alerting on system health metrics and service
performance KPI’s.
Dashboards - visualization (graphs) of system health and performance over a
time
Offline reports – system and service level performance monitoring and business
level analysis.
25
Error! Unknown document property name.
Error! Unknown document property name.
VTV Cable
- End of Document –
26
Error! Unknown document property name.
Error! Unknown document property name.