1 / 39

Telecommunications Industry Association TR-30.3/10-04-011 By Teleconference April 26, 2010

Telecommunications Industry Association TR-30.3/10-04-011 By Teleconference April 26, 2010. Standards Based Network Model for Evaluating Multimedia Transmission Performance Over IP. Jack Douglass VP of Marketing and Business Development Chairman of TIA TR30.3 Committee. Agenda.

finola
Download Presentation

Telecommunications Industry Association TR-30.3/10-04-011 By Teleconference April 26, 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Telecommunications Industry Association TR-30.3/10-04-011 By Teleconference April 26, 2010

  2. Standards Based Network Model for Evaluating Multimedia Transmission Performance Over IP Jack Douglass VP of Marketing and Business Development Chairman of TIA TR30.3 Committee

  3. Agenda • Standards Based IP Network Model • ITU-T G.1050 / ANSI TIA-921 • G.1050-2007 / TIA-921A • Top Down Approach • G.1050–201X / TIA-921B (proposed revision) • Bottom-Up Approach • Example Results • Applications for G.1050/TIA-921 IP Network Model

  4. Standards Based IP Network ModelITU-T G.1050 / ANSI TIA-921 • Committees • TIA TR30.3 Committee • ITU-T SG12 Question 14 • Range of test scenarios • Video, VoIP and Data • “Real-World” Network Characteristics • Service Level Agreements (SLAs) based impairments (ITU-T Y.1541) • Well-Managed • Partially-Managed • Unmanaged conditions

  5. Top Down ApproachG.1050-2007 / TIA-921A (Current Model) • Surveyed many networks to evaluate the jitter and loss characteristics (Bursty, Not Random) • Level of the impairment characteristics were adjusted to match the service levels in Y.1541 • Created impairment combinations based on Impairment Severity Levels and LAN/Access Rates • Multiple Two State Time Series Modified Gilbert-Elliott / Markov Models were used to emulate loss and delay characteristics • Emulated bursty packet loss and jitter that are similar to the surveyed network characteristics • Time based model with pre-calculated delay and loss

  6. Network Architecture Types of Access Links QoS controlled Edge Routing MTU Size Packet Loss (Frame Loss) Out of order packets One Way Delay (Latency) Variable Delays (Jitter) Occupancy (Background Traffic, Congestion, Network Load) Route Flapping Network faults Link Failures Network Impairments

  7. Network TopologiesITU-T G.1050-2007 / TIA-921A Core IP Network LAN A LAN B DUT B Local Access A Local Access B DUT A Route flapping Link Failures One-way delay Jitter Packet loss Packet Reorder Access Rates ---------------- Occupancy level Qos Edge Router Access Rates ---------------- Occupancy level Qos Edge Router LAN Rates ----------------- Occupancy level Packet loss LAN Rates ----------------- Occupancy level Packet loss LAN-to-LAN IP Network Model Core IP Network DUT A LAN B DUT B Local Access B Route flapping Link Failures One-way delay Jitter Packet loss Packet Reorder Access Rates ---------------- Occupancy level Qos Edge Router LAN Rates ----------------- Occupancy level Packet loss Core-to-LAN

  8. Test Profiles based on ITU-T Y1541ITU-T G.1050-2007 / TIA-921A Different test profiles for different Service Level Agreements (SLAs)

  9. 8 Impairment Severity CombinationsITU-T G.1050-2007 and TIA-921A Impairment Severity Combinations

  10. LAN-Access Rate CombinationsITU-T G.1050-2007 and TIA-921A 15 Core-to-LAN (Excluding IPTV≤ 3 Mbit/s) Rate Combinations 120 Impairment Combinations (15 rates * 8 Severities) 168 LAN-to-LAN Scenario Rate Combinations 1344 Impairment Combinations (168 rates * 8 Severities) 6 IPTV Core-to-LAN (> 3 Mbit/s) Rate Combinations 48 Impairment Combinations (6 rates * 8 Severities)

  11. Testing with Fixed Levels of IP Impairments Fixed Packet Jitter Fixed Jitter & Packet Loss • Real IP Network Impairments Vary Over Time significantly over time and are bursty in nature • IP Impairment network emulators exist today that provide fixed or semi-fixed levels of IP impairments.

  12. Real World Impairment Characteristics Good Bad Route Flap Link Failure Severe 1344 General Model 120 Core to LAN ≤ 3 Mbit/s 48 Core to LAN > 3 Mbit/s

  13. 1XA 1XB 1XC 1XD 1XE 1XF 1XG 1XH IP Impairments IPTV Testing G.1050-2007/TIA-921A 48 Core to LAN > 3 Mbit/s Impairment Combinations

  14. Reasons Revising G.1050-2007 / TIA-921A • Increased Realism • Keep in step with evolving IP network • Reduced number of test cases • Small set of Standard Long Duration Test Cases • Focused Test Cases for transient impairments such as link failures and route flaps • Short burst tests (15 seconds) for voice/video subjective testing and fax • True bi-directional model • Ability to test with mixed traffic • Statistically repeatable tests • Ability for users to customize test cases and use their own .pcap files to model interferers. • Methods for verifying that test equipment implementations match the model

  15. Bottom-Up ApproachG.1050-201X / TIA-921B (Revised Model) • Model interfering traffic • Capture different types of real network traffic • Create Packet Delay Variation (PDV) Histograms from captured traffic • Make interferers scalable • Model the Mechanisms that cause Jitter, Delay and Loss • Packet loss and delay are caused by interferers and self-interferers • Model of each Network Element (Core, Access, LAN) • Capture characteristics of each Network Elements • Capture characteristics of Access and LAN technologies • DSL, Cable, Fiber Optic, WiMAX, LTE; LAN – Wi-Fi, Ethernet, HPNA • Bandwidth Throttling, Smoothing and Shaping Effects of network elements • Bi-directional characteristics • Model Quality of Service (QoS) • Adjust and scale the amounts and types of interfering traffic • Match Surveyed Network Characteristics • Match Service Levels in Y.1541 • A similar model is being considered in ITU-T SG15 Question 13 – G.8261 Target Release Q4/10

  16. Test Profiles based on ITU-T Y1541 ITU-T G.1050-201X / TIA-921B (Revised Model) Different test profiles for different Service Level Agreements (SLAs) Same Profiles

  17. Impairment Combination Table Combinations TBD

  18. Network TopologiesITU-T G.1050-201X / TIA-921B (Revised Model) LAN-to-LAN IP Network Model Core-to-LAN Same Network Topologies

  19. LAN and Access Block Diagram ITU-T G.1050-201X / TIA-921B (Revised Model) Edge Router DSLAM / CMTS / OLT DSL Modem / Cable Modem / ONT Firewall LAN Wired Wireless Residential Gateway • Test Streams • IPTV • Web Video • VoIP / FoIP • DATA • Network Interferers • TCP • Peer-to-Peer • POP3 email protocol • HTTP web browsing • Web Video (You Tube, Hulu) • VoIP • FoIP • Gaming • Network Interferers • TCP • Peer-to-Peer • POP3 email protocol • HTTP web browsing • Web Video (You Tube, Hulu) • VoIP • FoIP • Gaming

  20. Capturing “Real-World” Characteristics • Capture Packet Delay Variation (PDV) characteristics • Access and LAN Technologies • Different types of Interferers (network traffic ) using .pcap (from Wireshark) • Result is composite Packet Delay Variation (PDV) for combined Access/LAN and Interferers

  21. Disturbanceloadgenerator Input packets Output packets LinkLatency + Basic Model Element ITU-T G.1050-201X / TIA-921B Disturbanceloadgenerator Disturbanceloadgenerator Store/ Fwd Simulated Packet Queue with Loss Multiple cascaded instances of this model

  22. Network Model Structure (Simplified) DSLAM/ CMTS OLT DSL Modem/Cable Modem/ONT Firewall/Router Stream Under Test Edge Router 20Mb/s or 30Mb/s 1G LAN 100M 100M 1G STB 1ms 0ns 100ns IPTV 64kB buffer 64kB buffer 64kB buffer 64kB buffer Stream Under Test HTTP HTTP POP3 Interferers From PCAP Composite Interference

  23. HTTP Interference Characteristics Delay (milliseconds) Packet Delay Variation (PDV) Histogram Delay vs. Time

  24. IPTV Interference (VBR) Characteristics Delay (milliseconds) Packet Delay Variation (PDV) Histogram Delay vs. Time

  25. POP3 Interference Characteristics Delay (milliseconds) Packet Delay Variation (PDV) Histogram Delay vs. Time

  26. Example #1 Edge Router DSLAM / CMTS / OLT DSL Modem / Cable Modem / ONT Firewall LAN Wired Wireless Residential Gateway Access DSL 20Mb/s Network Interferers PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Network Interferers PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Test Streams STB#1 IPTV – SD 2Mb/s – QoS 1

  27. PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Example #1 Network Interferers Test Streams STB#1, IPTV – SD 2Mb/s – QoS 1 Access DSL 20Mb/s

  28. Example #1 Test Stream Packet Delay Variation (PDV) Histogram Delay vs. Time Test Streams STB#1, IPTV – SD 2Mb/s – QoS 1 Access DSL 20Mb/s

  29. Example #2 Edge Router DSLAM / CMTS / OLT DSL Modem / Cable Modem / ONT Firewall LAN Wired Wireless Residential Gateway Access DSL 20Mb/s Network Interferers PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Network Interferers PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Test Streams STB#1, IPTV – HD 8Mb/s – QoS 1

  30. PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Example #2 Network Interferers Test Streams STB#1, IPTV – HD 8Mb/s – QoS 1 Access DSL 20Mb/s

  31. Example #2 Test Stream Packet Delay Variation (PDV) Histogram Delay vs. Time Test Streams STB#1, IPTV – HD 8Mb/s – QoS 1 Access DSL 20Mb/s

  32. Example #3 Edge Router DSLAM / CMTS / OLT DSL Modem / Cable Modem / ONT Firewall LAN Wired Wireless Residential Gateway Access DSL 30Mb/s Network Interferers PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Network Interferers PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Test Streams STB#1, IPTV – HD 8Mb/s – QoS 1

  33. PC#1, HTTP web browsing – QoS 2 PC#2, POP3 email protocol – QoS 2 STB#2, IPTV – SD (2 Mb/s) – QoS 1 STB#3 , IPTV – SD (2 Mb/s) – QoS 1 Example #3 Network Interferers Test Streams STB#1, IPTV – HD 8Mb/s – QoS 1 Access DSL 30Mb/s

  34. Example #3 Test Stream Packet Delay Variation (PDV) Histogram Delay vs. Time Test Streams STB#1, IPTV – HD 8Mb/s – QoS 1 Access DSL 30Mb/s

  35. A B C ApplicationsG.1050/TIA-921– Compare the Encoders and STBs Imp Gen A B C Video Encoders STBs G.1050-2007 / TIA-921A Impairments • Compatibility of Encoder and Decoder • Effectiveness Decoders to conceal network errors • Stability of STB under network conditions • Regression Testing • Standard, Definitive, Repeatable set of tests representing Real-World IP Network Conditions

  36. ApplicationsG.1050/TIA-921– Emulate Field Problems, Error Correcting, Server Loading Imp Gen RUDP D Server A Server G.1050-2007 / TIA-921A Impairments • Emulate field problems • Emulate effectiveness of error correcting scheme • Test Loading of A&D Server in presence of Network Errors • Test ability of system to meet required specifications • Standard, Definitive, Repeatable set of tests representing Service Levels

  37. ApplicationsG.1050/TIA-921 – Effectiveness of FEC Imp Gen FEC Equipment FEC Equipment Video Server G.1050-2007 / TIA-921A Impairments • Emulate effectiveness of Forward Error Correcting (FEC) Techniques and Equipment • Test ability of FEC to meet required specifications • Standard, Definitive, Repeatable set of tests representing Real-World IP Network Conditions

  38. ApplicationsG.1050/TIA-921 – General Network Emulation DUT B DUT B DUT A Imp Gen Test Any Type of Network Equipment under Real-World Network Characteristics

  39. TR30.3 and ITU-T SG12 Welcome Your Input to Make G.1050 More Accurate

More Related