Ethernet:

A look at the Ubiquitous Wired

Networking Technology and
Why it Makes Sense for a Service Provider

Page 1
Before I Share My Views…

“At lectures, symposia, seminars, or

educational courses, an individual
presenting information on IEEE standards
shall make it clear that his or her views
should be considered the personal views of
that individual rather than the formal
position, explanation, or interpretation of the
IEEE.”

IEEE-SA Standards Board Operation Manual (subclause 5.9.3)

Page 22
Page
 Agenda
Overview
History and structure of Ethernet

Evolution of Ethernet
Key Historic Projects and Emerging Technologies

Why Ethernet makes sense for a Service Provider?

Emerging applications requirements

Concluding remarks

Page 33
Page
Ethernet: History and Relation to 802
• History of LMSC
– 1st meeting Feb 1980. Originally known as the
Technical Committee on Computer Communications
(TCCC or “T-Triple-C”). Originally LAN, MAN scope
added later
• LMSC consists of
– SEC (802.0): Sponsor Executive Committee
– WGs/TAGs (802.x): Working Groups and Technical
Advisory Groups
• Examples of Active WGs/TAGs
– Notice the historic success of odd numbered groups!
– 802.1, 802.3, 802.11, 802.15, 802.16, 802.17, 802.18,
802.19, 802.20, 802.21
Page 44
Page
Ethernet: Organization and Process
• Organization
– Each Working Group has its own leadership and projects called
Task Forces
– Each TF has its own leadership. Exists for the duration of the
project
– For Ethernet, 802.3 and its membership make up the Working
Group.

• Process
– Idea starts as a “Call For Interest” and then goes through a long,
thorough and strict process before becoming a standard.
Requires 75% approval (individual)
– Day-to-day technical work is done in a group operating under .3
(SG/TF)
– Work has to be approved by .3. Ensures compatibility etc. w/ prior
projects
Page 55
Page
 IEEE 802 Working Groups
IEEE 802 Sponsor Executive Committee

IEEE 802.1 IEEE 802.11 IEEE 802.15

IEEE 802.3
Bridging, Architecture Wireless LAN Wireless Personal Area
Ethernet Working Group
Working Group Working Group Networks Working Group

IEEE 802.16 IEEE 802.17 IEEE 802.18 IEEE 802.19

Broadband Wireless Resilient Pack Ring Radio Regulatory Coexistence
Access Working Group Working Group Technical Advisory Group Technical Advisory Group

IEEE 802.20
Mobile Broadband IEEE 802.21 IEEE 802.22
Wireless Access Media Independent Wireless Regional Area
Working Group Handoff Networks Working Group

Page 66
Page
 IEEE 802 Working Groups
• 802.1 - Protocol layers above the MAC & LLC layers
• 802.3 – Ethernet-based Local Area Networks (LANs) OSI Reference
• 802.11 – Wireless Local and Metropolitan Area Networks (LANs/MANs) Model
• 802.15 – Personal Area Networks or short distance wireless networks (WPANs)
Application
• 802.16 - Wireless Broadband Metropolitan Area Networks (WBMANs)
• 802.17 - Development and deployment of Resilient Packet Ring (RPR) networks in Presentation
Local, Metropolitan, and Wide Area Networks (LANs, MANs, WANs)
• 802.18 - Radio Regulatory Technical Advisory Group ("RR-TAG") Session

• 802.19 - Coexistence between wireless standards and reviews coexistence assurance Transport
(CA) documents produced by the wireless working groups
• 802.20 - Mobile Broadband Wireless Access (MBWA) Network

• 802.21 - Handover and interoperability between networks Data Link

• 802.22 - Wireless Regional Area Networks (WRANs)
Physcial

Medium

Page 77
Page
 Agenda
Overview
History and structure of Ethernet

Evolution of Ethernet
Key Historic Projects and Emerging Technologies

Why Ethernet makes sense for a Service Provider?

Emerging applications requirements

Concluding remarks

Page 88
Page
 IEEE 802.3 Ethernet PHY Types
Rate (b/s)

100G Key:

10G - Backplane - Co-axial

- Twin-axial - Twisted pair
1000M
- Multimode Fibre - Single-mode Fibre

100M - Voice grade copper - Point to Multipoint

Fibre
10M

1M
0.1 1 10 102 103 104 105
Distance (m)

Page 99
Page
9
HSSG IEEE Std 802.3u-1995 100Mb/s Ethernet Standard
formed approved

From 100M to 100G over the last 15 years

High Speed Study Group IEEE P802.3u 100Mb/s Ethernet Task Force
N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J

1993 1994 1995

Task Force Working group Sponsor

review ballot ballot

D1 D2 D3 D4 D5
IEEE P802.3u PAR Approved

HSSG IEEE Std 802.3z-1998 1Gb/s Ethernet Standard

formed approved
High Speed Study Group IEEE P802.3z 1Gb/s Ethernet Task Force
N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J

1996 1997 1998

Task Force Working group

Sponsor ballot
review ballot

D1 D2 D3 D4 D5
IEEE P802.3z PAR Approved

HSSG IEEE Std 802.3ae-2002 10Gb/s Ethernet Standard

formed approved
High Speed Study Group IEEE P802.3ae 10Gb/s Ethernet Task Force
M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J

1999 2000 2001 2002

Task Force Working group

Sponsor ballot
review ballot

IEEE P802.3ae PAR Approved D1 D2 D3 D4 D5

HSSG IEEE P802.3ba 40Gb/s and 100Gb/s Ethernet Standard

formed approved
High Speed Study Group IEEE P802.3ba 40Gb/s and 100Gb/s Ethernet Task Force Planned
J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J J A S O N D J F M A M J

2006 2007 2008 2009 2010

Task Force Working group

Sponsor ballot
review ballot

IEEE P802.3ba PAR Approved D1 D2 D3

Page 10
Page 10
GROWING APPLICATION
SPACE

Page 11
Page 11
 Higher Speed Ethernet Penetration
Campus/ Service
Data Center
Enterprise Provider

Core Core

Distribution Aggregation

Wiring
Closet
Access Distribution

Clients Servers Residential

Page 12
Page 12
Ethernet in the First Mile

Page 13
Page 13
 The Key Piece of the Access Puzzle
• 10G EPON will provide the solution for high definition
content distribution
• Complements work on 10G for data centers, and AV Bridges
• Drives higher BW in the CO and aggregation network
– Similar use for 4G wireless backhaul

Central Office Distribution Home network

>10G Ethernet

10G EPON
Video
server L2 switch OLT
passive AV
splitter bridge

VOIP gateway ONU

Page 14
Page 14
KEY HISTORIC PROJECTS:
POE

Page 15
Page 15
 Power over Ethernet
20W PTZ CAM 3~7W IP Phone > 15W PC 18W Wi-Fi AP/RG

Powered Device (PD)

Power Sourcing Equipment (PSE)

Switch, Router, Gateway, Set-top Box

Page 16
Page 16
 PoE Architecture: Switch

Power Sourcing Equipment (PSE) Powered Device (PD)

8
SPARE SPARE
7
5 SPARE
SPARE
4

6
DATA
3
10/100 10/100
EPHY 2 EPHY
DATA
1

P
44V to 57V POE - PSE POE – PD

DC-DC
N Converter
Wire Side

Type 1 (AF) =15.4W Type 1 (AF) =12.95W

Isolated Side Type 2 (AT) = 30W
PSE = Power Sourcing Equipment
Type 2 (AT) = 25.5W
PD = Powered Device

Page 17
Page 17
 PoE/P Enhanced Layer 2 Operation
PoE/P can also Classic
be completely operation
turned off. requires
Ethernet worst case
communication budgeting,
can be used to allocation
turn other
subsystems off In-efficient,
also wasteful use of
power supplies,
backup (UPS)

Dynamic power
budgeting
raises system,
supply
Continuous Power efficiencies.
Re-Classification via L2 Smart allocation
allows feature
scalability with
power budget. Page 18
Page 18
KEY HISTORIC PROJECTS:
EEE

Page 19
Page 19
 Ethernet Traffic Profiles
• Snapshot of a File Server with 1 Gb Ethernet link
– Shows time versus utilization (trace from LBNL)

utilization <=1.0 %
Start time 12:33 PM 2/8/2007 (30 min)

Page 20
Page 2020
 Motivation – A Link Perspective
Typical switch with 24 ports
• High port count triple 10/100/1000 Mb/s
speed switches
– Linear relationship of
power consumption to
number of active links
– Aggregate savings
attractive in putting
inactive links in LPI
Various computer NICs averaged
• Low port count 10G
systems
– Idle power savings on
a single link attractive

Results from 1st order (rough) measurements – all incremental AC power

Page 21
Page 2121
 Low Power Idle Overview
Assert LPI Deassert LPI
Active Low-Power Hold Active

Refresh

Refresh

DATA/
Data/

Sleep

Wake
Alert
IDLE

IDLE

IDLE
Quiet Quiet Quiet
Tw_PHY
Ts Tq Tr
Tw_sys
Wait a minimum of Tw_Sys before sending data (Tw_sys >= Tw_PHY)

• Low Power Idle (LPI) – PHY powers down during idle

periods
• During power-down, maintain coefficients and
synchronization to allow rapid return to Active state
• Wake times for the respective twisted-pair PHYs:
– 100BASE-TX: Tw_PHY <= 30 usec
– 1000BASE-T: Tw_PHY <= 16.5 usec
– 10GBASE-T: Tw_PHY < ~8 usec (2 modes)
• PHY power in LPI mode ~20-40% of normal (depends
on type and implementation)
Page 22
Page 22
 Application – Wiring Closet
EEE
Enabled GigE or 10G
Links (for <100Meter Links)

Wiring Closet

EEE Enabled
Clients

EEE Enabled
Gig Switch

Wireless LAN

EEE
Enabled GigE
Links

Opportunity for future >10G

EEE-enabled aggregation
Cu links
Page 23
Page 23
Application – Data Center and TOR
Data Center Rack

EEE
Enabled GigE or 10G
Links (for <100Meter Links)

EEE
Enabled 1 and 10GBASE-T
Links

EEE Gphy Enabled Opportunity for future >10G

Server Controller EEE-enabled Cu links

Page 24
Page 24
KEY HISTORIC PROJECTS:
POE

Page 25
Page 25
 What is AV bridging?
• IEEE 802.1AS: Precise Timing in an 802 network
– (< 1uS synchronization, <100 nS clock jitter, ~100 pS achievable)
• IEEE 802.1Qat: End to end QoS bandwidth and latency reservations
• IEEE 802.1Qav: Network bridge (Ethernet switch) enhancements
– guaranteed latency <250 uS per hop,
• IEEE 802.1BA: Audio Video Network Systems (plug-and-play profile)
– Do all with very low cost adder (approaching zero) to meet CE market requirements.
• Ethernet AV is the first wave Ubiquitous
… but not the last “no-excuses”
“WiFi-AV”
VoIP & Video home connectivity IEEE 802.11aa
Phone
Guaranteed MoCA-AVB
BW & QoS

Ethernet EthernetAV
IEEE 802.1BA
AV/802 Convergence
Precise BW Reservation Ethernet Switch
Timing & Admission Ctrl Enhancements

Enhancements
Page 26
Page 26
 Application - AVB home network

DVD

DVR/PVR

1. Listening to satellite radio on EAV receiver, link between receiver and switch
2. Start playing DVD on a screen in another room
3. DVR/PVR set to record “Survivor” from satellite receiver at 8:00 pm on Thursday

Migration towards multiple low-latency uncompressed native HD streams driving BW

Page 27
Page 27
EMERGING PROJECTS

Page 28
Page 28
 Extended EPON

Example contribution taken from ExEPON_1111_xu_1.pdf

Page 29
Page 29
EPoC

Page 30
Page 30
EPON/EPoC Applications

Page 31
Page 31
RTPGE Study Group

Page 32
Page 32
 Agenda
Overview
History and structure of Ethernet

Evolution of Ethernet
Key Historic Projects and Emerging Technologies

Why Ethernet makes sense for a Service Provider?

Emerging applications requirements

Concluding remarks

Page 33
Page 33
Ethernet: Convergence and Leverage
Broadband Access
Content Providers

Broadband Internet
Access Networks Backbone Networks Content
Networks

Internet Backbone
Networks Research
Enterprise Networks
Networks
Internet eXchange and
Interconnection Points

Data Centers and Research, Education

and Government
Enterprise
Page 34
Page 34
Convergence
• Connectivity convergence
– Ethernet is the ubiquitous connectivity technology
– From the home to the core, convergence is occurring
• Consumer, Enterprise, SP, Backhaul, Datacenter, HPC etc.
– Drives higher volumes, lower cost
– Eliminates unnecessary protocol conversions
– Conventional connections within the home migrating to
Ethernet. E.g. HDTVs already have Ethernet connectors
• Network architecture convergence
– Different “types” of networks have increasingly more
similarities than differences. E.g. access and distribution
– Higher layer feature requirement differences certainly
exist but can be transparent to the connectivity layer
• Ethernet has a well understood maturity curve
Page 35
Page 35
Converging Network Architectures
Core
Layer

L3 Aggregation

Ethernet
Layer

L2 Aggregation
Layer

Access
Layer

Similar Architectures for SP, DC, Enterprise Etc.

Page 36
Page 36
Leverage
• Technology leverage
– Family of technologies running natively on Ethernet
• E.g. EEE, PoEP, AVB, HSE, MACSec, Link Aggregation
– Keeps the L2 stack simple by running native
– Technologies are “free” when you run Ethernet
• Media leverage
– Family of technologies supporting variety of media at each speed
– No need to reinvent solutions for new application spaces like the
home or core, simply build on Ethernet. Hybrid solutions possible
• Speed and cost point leverage
– Family of technologies supporting variety of speeds and cost points
– No need to reinvent solutions for new application spaces like the
home or access, simply build on Ethernet
• System leverage
– E.g. An EFM interface is a new interface to existing switch fabrics
• Si and sub-system leverage
– E.g. Low cost 100M/1G switches, optical sub assemblies etc.
Page 37
Page 37
Ethernet Leverage: 10G/1G EPON Ex.
CO
XAUI
XAUI
PHY XAUI
XCVR XAUI
OLT 10GBASE-R PHY GW
(X) (Y) 1:32
1000BASE-X XCVR 10GBASE-R ONU MAC
SGMII (Y) 1000BASE-X (X) PHY
SGMII
OLT
(X)
CPE
Switch
10G

OLT
(X)

• High level re-use:

• Updated ONU Si
• High Level re-use: • Standard Phys
• New OLT Si • Standard interfaces
• Standard Phys
• Standard interfaces
• Standard switching Si

Page 38
Page 38
Growing Application Space:
Variety of Content, Providers, Users
Any Content Over Any Media Anywhere, Anytime

Home
Voice Network
Cable
Service Provider

Telephone
Service Provider Enterprise
Video Network

Satellite
Service Provider

Data Mobile
Network
Wireless
Service Provider

Page 39
Page 39
 Emerging Apps and their Requirements
• Focus on application requirements
– Diverse applications distilled to succinct requirements
– Ability to focus on requirements driven by convergence
• Traditional application requirements
– Bandwidth, QoS HSE
• New reqs driven by constant connectivity, on
demand, user generated content and virtualization
• Broad new requirements
– Latency guarantee AVB
– Energy cost per bit EEE
– Security .1AE
DCB
– Congestion
Page 40
Page 40
 Other Network Requirements
• Requirements passed across network boundaries
– E.g. Across SP/CP networks, access/home
• Power feeding
– Used in remote surveillance, RFID, WAP LAN, VoIP etc.
• Features integrated into single box for customers
• Network aware connectivity in home / AV systems
– Different sources/users of data. Eliminate connections
– Similar to data networks. Ethernet appearing on HDTV

Page 41
Page 41
 Other Network Requirements
• Unified and strong management
– 802.3 has monolithic management structure
– SNMP MIBs heavily used by 802.1 and 802.3
• 802.3.1 is a new project that will consolidate all Ethernet MIBs
– Reuse of LLDP for dynamic link management
• Reduces mgmt protocols. 802.3bc consolidating Ethernet TLVs
• Legacy support via hybrid networks
– Would be great if all deployments were new
– BUT, we have to support legacy infrastructure e.g.
legacy telephony cable in MDUs
– EFM and Ethernet allows for hybrid infrastructure where
bringing the fiber closer to the home is seamless and
without any protocol conversions or additional boxed
Page 42
Page 42
 Agenda
Overview
History and structure of Ethernet

Evolution of Ethernet
Key Historic Projects and Emerging Technologies

Why Ethernet makes sense for a Service Provider?

Emerging applications requirements

Concluding remarks

Page 43
Page 43
 Concluding Remarks
• Ethernet is the ubiquitous wired connectivity
– < 0.01m to 1,000s of KMs
– 10Mb/s to 10Gb/s
– Backplane to fiber (and everything in between)
• Ethernet is constantly evolving
– Expanding its rate-reach
– Expanding its scope e.g. EFM, RTPGE
– Projects go through a well defined process
• Traditional and emerging application spaces demanding
BW at lower cost structure
– Consumer, enterprise, data center and access
• Access portion of the network is critical
– Growing the access portion via higher B/W and strong support for
multi-services is key to enabling emerging application requirements

Page 44
Page 44
 Concluding Remarks
• Many factors have to be considered to pick a solution
– (a) Geography (b) Installed base (e.g. Coax, Cu, fiber) (c) Density
(MDU vs. single residence) (d) Availability of end-services and
content (e) Government regulation and cooperation (f) Demand
• Plenty of access solutions available
– EFM, 10GEPON, APON, BPON, GPON and others continue to
provide very rich solution sets to the access problem
• BUT standardizing on Ethernet can enable emerging
applications and their reqs at low-cost with legacy support
– Strong leverage and convergence of Ethernet
– Native powerful and simple layer 2 for access, aggregation, core…
– Leverage of growing technologies over Ethernet like EEE, AVB,
HSE, MACSec, PoEP, ExEPON, EPoC
– Hybrid architectures to support legacy infrastructures
• SIEPON is a unique entity based project that builds on the
successful Ethernet family of standards addressing
interoperability needs of providers by completing the
ecosystem of EPON standards.
Page 45
Page 45
 Additional Resources
• Ethernet Home Page: www.ieee802.org/3/
– All past & present Ethernet projects
• EEE White Paper
– http://www.broadcom.com/collateral/wp/EEE-WP101-R.pdf
• EFM White Paper by Diab, Frazier, Pesavento
http://www.ethernetalliance.org/technology/white_papers/ethernets
olutions.pdf
• Ethernet in the First Mile: Access for Everyone
– Book on EFM by Diab, Frazier
http://shop.ieee.org/ Product = STDSP1144
http://standards.ieee.org/standardspress/titles/ethfirstmile.html
http://www.amazon.com/Ethernet-First-Mile-Access-
Everyone/dp/0738148385/sr=11-
1/qid=1167213945/ref=sr_11_1/104-1448287-5375156
• Download published Ethernet standards
– Free after 6 months: http://standards.ieee.org/getieee802/
Page 46
Page 46
 Additional EEE Resources
EEN White Paper
• English:
http://www.broadcom.com/collateral/wp/EEE-WP102-R.pdf

Wikibon Whitepaper
• Networks Go GrEEn:
http://wikibon.org/wiki/v/Networks_Go_GrEEN

Broadcom EEN Public Area

http://www.broadcom.com/products/features/energy_efficient_networ
k.php

IEEE P802.3az Web Area

http://www.ieee802.org/3/az
Page 47
Page 47
 Broadcom WINs EEE Awards!
Broadcom wins 2010 Best Electronic Design Award for its broad and
extensive new portfolio of EEE products. Broadcom engineer
recognized for leadership

• ED Award (under Communications – Wired Category):

http://electronicdesign.com/article/news/Electronic-Design-Announces-
2010-Best-Electronic-Design-Award-Winners.aspx

• ED Article that was the basis of the award:

http://electronicdesign.com/article/communications/IEEE-And-Broadcom-
Bring-Forth-Energy-Efficient-Ethernet.aspx

• Broadcom press release on the award:

http://www.broadcom.com/press/release.php?id=s542639

• Broadcom Engineer wins TechAmerica’s David Packard innovation

award in the Green Tech / Smart Grid category for driving Broadcom’s
EEN portfolio
http://www.broadcom.com/press/release.php?id=s614065

Page 48
Page 48
THANK YOU

Page 49