Professional Documents
Culture Documents
CDES Webform
CDES Webform
1 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
2019-04-24 PA1
Contents
1 Introduction........................................................................................ 3
2 Description......................................................................................... 3
2.1 Online web-from request................................................................... 3
2.2 Online web-form submission GUI ..................................................... 4
2.3 Download of Data.............................................................................. 6
2.4 Approval ............................................................................................ 6
2.5 Scheduler .......................................................................................... 6
2.6 Output Data Format .......................................................................... 7
3 P3 Data File Types ............................................................................ 7
4 Appendix............................................................................................ 7
4.1 P3 Parquet Format ............................................................................ 7
4.1.1 Connection Test (CT)........................................................................ 8
4.1.2 Latency Test Report (LTR) ............................................................... 9
4.1.3 Network Information Report (NIR) .................................................. 11
4.1.4 Network Traffic/Throughput Report (NTR) ..................................... 12
4.1.5 Voice Calls (VC) .............................................................................. 14
4.2 Supported browsers ........................................................................ 16
Ericsson Internal
3 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
1 Introduction
As part of Crowdsourcing Data Exploitation System (CDES) Web form system, users can
request raw P3 data. Users requesting these data are from various customer units within
Ericsson domain.
This document provides details about list of inputs required from the user for submitting
the request. Apart from this, the document also describes about list of activities performed
by Admin so as to process the data and get transferred to the corresponding user.
2 Description
Users interested to access P3 data should fill up a mandatory online web-form with minimal
set of fields. Original data from P3 is in parquet format which internally gets converted to
CSV before sharing the same.
Online web-form will be accessed only within Ericsson (ECN) network and needs SIGNUM
& LAN Password for login. These details are required for the system to authenticate user
against LDAP server. Following are the list of mandatory fields which should be filled by
the requestor:
Country Name Yes Name of the country for which data is being requested
List of file types (CT, LTR, NIR, NTR, VC) for which data is being
File Type Yes
request
Ericsson Internal
4 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
NFS
https://cdes.p3.datarequest.edosdp.ericsson.se/
Here, user must click on the button “Webform Page” to redirect to submission form
(mentioned in below section).
Login page will request for your Ericsson Network user and password.
2019-04-24 PA1
Fields Signum, Email and Name are automatically filled with the user Ericsson information.
Apart from these, user has to fill up other details like Project Name, Country, Region
(Optional), Destination Details, File Types & Purpose.
As part of new release, “Region” field is introduced where-in user can now select a
corresponding area/region (rectangular) from the Map. Following is the screenshot of the
same:
Ericsson Internal
6 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
Note: Click on button and select the area by drawing a rectangle over the map. Once
the area is selected, click on Apply button to identify Latitude & Longitude values for the
selected area.
Now, user has the flexibility to download the data from the GUI. By default, all the list of
downloads for the corresponding user will be listed from where user can select any entry
for download.
Note: By default, this data will be retained for 5 days for user to download.
2.4 Approval
Once user submits with required details, an approval request is sent to Admin. Here, admin
checks for all required details and can either APPROVE/REJECT based on the details
filled up.
Once approved, the process of data transfer is initiated from AWS S3 bucket to the Central
CDES System where-in the data gets converted from Parquet to CSV and shared with the
user.
Note: This functionality is only applicable for users having Admin privileges.
2.5 Scheduler
A java scheduler is configured whose purpose is to transfer data for all the approved
requests. This job of this scheduler is to verify the database for any pending approvals and
initiate data transfer accordingly.
(A) NFS:
In this type of request, data transfer takes place from source Ericsson AWS S3 bucket to
CDES system and converted into CSV format. After this, data is transferred to hosting
server and the same is mounted on an NFS system. An email is sent to the requester for
configuring their system to map with NFS mounted server.
Ericsson Internal
7 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
In this type of request, data transfer takes place from source Ericsson AWS S3 bucket to
CDES system and converted into CSV format. After this, data is transferred to hosting
server from where a link will be shared to user for download of data over HTTPS.
When scheduler successfully transfers data, the parquet format will be internally converted
to CSV (readable). This is again compressed to save space in the disk.
With the help of this format, users can analyze data easily.
4 Appendix
This section covers details about how parquet format looks when data is landed into AWS
S3 bucket.
Ericsson Internal
8 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
Note: This section is added just to provide information about parquet format. The final data
transfer is in CSV format.
Contains details of all connection tests and executed approximately every 15 min on every
device.
message spark_schema {
optional binary CT_Id (UTF8);
optional binary ServerIp (UTF8);
optional binary TestTimestamp (UTF8);
optional binary ScreenState (UTF8);
optional boolean Success;
optional int64 DurationTcpConnect;
optional int64 DurationHttpReceive;
optional int64 DurationHttpGetCommand;
optional int64 DurationDNS;
optional int64 BytesRead;
optional binary LocationTimestamp (UTF8);
optional binary LocationProvider (UTF8);
optional float LocationLatitude;
optional float LocationLongitude;
optional float LocationAltitude;
optional double LocationTransX;
optional double LocationTransY;
optional float LocationAccuracyVertical;
optional float LocationAccuracyHorizontal;
optional int64 LocationAge;
optional float LocationSpeed;
optional binary LocationCountry (UTF8);
optional binary LocationCity (UTF8);
optional binary RadioCdmaBaseStationId (UTF8);
optional binary RadioCdmaBaseStationLatitude (UTF8);
optional binary RadioCdmaBaseStationLongitude (UTF8);
optional binary RadioCdmaNetworkId (UTF8);
optional binary RadioCdmaSystemId (UTF8);
optional binary RadioConnectionType (UTF8);
optional binary RadioFlightMode (UTF8);
optional binary RadioGsmCellId (UTF8);
optional int32 RadioGsmCellIdAge;
optional binary RadioGsmLAC (UTF8);
optional binary RadioMCC (UTF8);
optional binary RadioMNC (UTF8);
optional binary RadioBrand (UTF8);
optional binary RadioCountry (UTF8);
optional binary RadioNetworkType (UTF8);
optional binary RadioNetworkGeneration (UTF8);
optional binary RadioHRCellId (UTF8);
optional binary RadioRNCId (UTF8);
optional binary RadioeNodeBId (UTF8);
optional binary RadioOperatorName (UTF8);
optional binary RadioServiceState (UTF8);
optional int32 RadioRXLevel;
Ericsson Internal
9 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
Contains results of the latency test. A latency test is following every CT.
message spark_schema {
optional binary NIRId (UTF8);
optional binary TestTimestamp (UTF8);
optional binary ScreenState (UTF8);
optional binary LocationTimestamp (UTF8);
Ericsson Internal
10 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
2019-04-24 PA1
message spark_schema {
optional binary NIRId (UTF8);
optional binary TestTimestamp (UTF8);
optional binary ScreenState (UTF8);
optional binary LocationTimestamp (UTF8);
optional binary LocationProvider (UTF8);
optional float LocationLatitude;
optional float LocationLongitude;
optional float LocationAltitude;
optional double LocationTransX;
optional double LocationTransY;
optional float LocationAccuracyVertical;
optional float LocationAccuracyHorizontal;
optional int64 LocationAge;
optional float LocationSpeed;
optional binary LocationCountry (UTF8);
optional binary LocationCity (UTF8);
optional binary RadioCdmaBaseStationId (UTF8);
optional binary RadioCdmaBaseStationLatitude (UTF8);
optional binary RadioCdmaBaseStationLongitude (UTF8);
optional binary RadioCdmaNetworkId (UTF8);
optional binary RadioCdmaSystemId (UTF8);
optional binary RadioConnectionType (UTF8);
optional binary RadioFlightMode (UTF8);
optional binary RadioGsmCellId (UTF8);
optional int32 RadioGsmCellIdAge;
optional binary RadioGsmLAC (UTF8);
optional binary RadioMCC (UTF8);
optional binary RadioMNC (UTF8);
optional binary RadioBrand (UTF8);
optional binary RadioCountry (UTF8);
optional binary RadioNetworkType (UTF8);
optional binary RadioNetworkGeneration (UTF8);
optional binary RadioHRCellId (UTF8);
optional binary RadioRNCId (UTF8);
Ericsson Internal
12 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
message spark_schema {
optional binary NTRId (UTF8);
optional binary TimestampBin (UTF8);
optional binary Technology (UTF8);
optional binary TrafficDirection (UTF8);
optional int64 ThroughputRv;
optional int64 ThroughputRvConcurrent;
Ericsson Internal
13 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
2019-04-24 PA1
message spark_schema {
optional binary VCId (UTF8);
optional binary Start_TestTimestamp (UTF8);
optional binary Start_LocationTimestamp (UTF8);
optional binary Start_LocationProvider (UTF8);
optional float Start_LocationLatitude;
optional float Start_LocationLongitude;
optional float Start_LocationAltitude;
optional double Start_LocationTransX;
optional double Start_LocationTransY;
optional float Start_LocationAccuracyVertical;
optional float Start_LocationAccuracyHorizontal;
optional int64 Start_LocationAge;
optional float Start_LocationSpeed;
optional binary Start_LocationCountry (UTF8);
optional binary Start_LocationCity (UTF8);
optional binary Start_RadioCdmaBaseStationId (UTF8);
optional binary Start_RadioCdmaBaseStationLatitude (UTF8);
optional binary Start_RadioCdmaBaseStationLongitude (UTF8);
optional binary Start_RadioCdmaNetworkId (UTF8);
optional binary Start_RadioCdmaSystemId (UTF8);
optional binary Start_RadioConnectionType (UTF8);
optional binary Start_RadioFlightMode (UTF8);
optional binary Start_RadioGsmCellId (UTF8);
optional int32 Start_RadioGsmCellIdAge;
optional binary Start_RadioGsmLAC (UTF8);
optional binary Start_RadioMCC (UTF8);
optional binary Start_RadioMNC (UTF8);
optional binary Start_RadioBrand (UTF8);
optional binary Start_RadioCountry (UTF8);
optional binary Start_RadioNetworkType (UTF8);
optional binary Start_RadioNetworkGeneration (UTF8);
optional binary Start_RadioHRCellId (UTF8);
Ericsson Internal
15 (16)
Prepared (Subject resp) No.
2019-04-24 PA1
2019-04-24 PA1
Following are the list of browsers supported for accessing this system:
1. Google Chrome
2. Mozilla Firefox