Streaming Audio and Video

60-520 Seminar Topic

Instructor: Dr. A. K. Aggarwal

Presented By
Mostafa Monwar

1
What is Streaming Technology
A technique for transferring data such that it can be processed
as a steady and continuous stream, client does not have to
download the entire file to view it.
Data

Network Source

The portion in the buffer

The portion client is viewing
2
 Advantages

 It reduces download time

 It provides steady service
 Slower systems can take advantage of streaming technology

 Provide service on demand

Applications are utilizing this technology are:

Streaming Video, IP telephony, Internet Radio, Distance
learning, Videoconferencing, Interactive games and so on
3
 Disadvantages

 It is difficult to keep the service steady if the bandwidth

is low

 The maintenance of streaming server is relatively

expensive

 Packet loss may occur during the transmission

4
3 types of delivery methods of
streaming media

 Streaming Stored Audio and Video

 Streaming Live Audio and Video

 Real-Time Interactive Audio and Video

5
 Media Player or Helper
Application
Three main streaming media companies or
products are:
RealPlayer (RealNetworks),
Media Player (Microsoft) and
QuickTime (Apple).
Three basic tasks of media players:
 Decompression
 Jitter Removal
 Error Correction 6
Accessing Audio & Video
thru a Web server

Web
Browser HTTP
Client Web Server
With Audio
Files
Files
Media
Player

7
 Accessing Audio & Video
thru a Meta File

Web HTTP request /response

Client
Browser
for meta file Web
meta file Server
HTTP

Media Audio/Video file

Player requested and sent
using HTTP

A meta file contains information of URL, type of encoding, etc

about the audio/video file that is to be streamed. 8
 RTSP Diagram

HTTP request/response
Client Web
Browser Web
Server
meta file
RTSP Streaming Command
Streaming
Media Server
Player RTP Audio / Video
Content

HTTP is insufficient for user interaction. With streaming server

audio/video file can be sent over UDP,
9
Protocols

 RTSP: Real Time Streaming Protocol

 RTP : Real-time transfer Protocol

10
RTSP

 RTSP is a industry standard Internet application

level protocol
 RTSP is a framework for delivering and
transmission of multicast data stream

 RTSP is a protocol that allows a media player to

control the transmission of a media stream for
exchanging control information

11
 RTSP Message Format
Start Line
Message Header
……
Message Header
CRLF
[message body]
Request-Line
Method SP Request-URI SP RTSP-Version CRLF
Status-Line
RTSP-Version SP Status Code SP Reason Phrase CRLF

Header Field-name : field-value CRLF

12
RTSP Features
 RTSP works in the conjunction with RTP to
deliver streaming audio & video content
 RTSP maintains a server state during
transmission unlike HTTP
 Client-Server architecture
 Overcome the limitations of HTTP. RTSP
enhance HTTP functions
 RTSP provides the synchronization of events

13
 RTP

 RTP is used to transmit real-time data

 RTP encapsulate segments

Payload Sequence Timestamp Synchronization Misc

type number source identifier

14
RTSP Operation
HTTP GET
Web Web
HTTP
Browser Presentation Description File Server

Setup

Play
Media Media
Media Stream
Player Player RTSP
Pause

Teardown

15
Presentation Description File
<title> Music </title>
<session> <group language=en lipsync>
<switch>
<track type=audio
e=”PCMU/8000/1”
src=”rtsp://audio.com/music/audio.en/lofi”>
<track type=audio
e=”DV14/16000/2” pt=”90 DV14/8000/1”
src=”rtsp://audio.com/music/audio.en/hifi”>
</switch>
<track type=”video/jpeg”
src=”rtsp://video.com/music/video”>
</group> </session> 16
Fixed Playout Delay
Playout
Schedule
p-r
Packets Missed
generated playout
Packet Playout
received Schedule
p`-r

rp p`
17
Forward Error Correction
Original
1 2 3 4
stream

1 1 2 2 3 3 4
Redundancy
Internet
1 3 4 Received
1 2 LOSS stream

1 2 3 4
Reconstructed stream
18
 Interleaving
Original Stream

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

1 5 9 13 2 6 10 14 3 7 11 15 4 8 12 16
Interleaved Stream
Received Stream
1 5 9 13 2 6 10 14 LOSS 4 8 12 16

1 2 4 5 6 8 9 10 12 13 14 16
Reconstructed Stream 19
References
http://www.rtsp.org/
http://www.cs.helsinki.fi/u/jmanner/Courses/seminar_pape
rs/rtsp.pdf
http://www.javvin.com/protocol/rfc2326.pdf
http://www.cs.columbia.edu/~hgs/rtp/
James F. Kurose, Keith W. Ross. Computer Networking,
2nd Edition, Addison Wesley Longman, Inc, 2003.
http://www.webopedia.com/TERM/R/RTSP.html

20
Any Questions

21