Traffic measurement and analysis in an organic enterprise data center

Ashkan Aghdai, Fan Zhang, Nadun Dasanayake, Kang Xi, H. Jonathan Chao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Enterprise data centers (EDCs) are critical infrastructure to large enterprises, government agencies, research institutions, etc. They are used to support a variety of off-the-shelf and customized services. EDCs are different from cloud data centers (CDCs) in two major aspects. Firstly, an EDC is usually built over time and consists of old and new equipment. Secondly, the type of services and applications in EDCs are quite different from those in CDCs. Therefore, we expect that the traffic characteristics in EDCs would also be different from those in CDCs. While most existing data center measurements were from CDCs, we performed extensive traffic measurement and analysis in an EDC that provided multiple services to over a million users. We present the data center architecture, measurement methodology, measurement results, and analysis. The results include traffic matrix, traffic distribution, flow characteristics, and TCP characteristics. Our research reveals that the traffic characteristics in the EDC are indeed quite different from the reported results in CDCs. For example, the traffic matrix tends to be sparse rather than all-to-all. Based on the analysis we provide a few guidelines for EDC design, optimization, and anomaly detection. As the first most extensive study on EDC traffic, our work provides valuable information to future EDC design and implementation, and also helps researchers develop insights into the differences and similarities between EDCs and CDCs.

Original languageEnglish (US)
Title of host publicationIEEE International Conference on High Performance Switching and Routing, HPSR
Pages49-55
Number of pages7
DOIs
StatePublished - 2013
Event2013 IEEE 14th International Conference on High Performance Switching and Routing, HPSR 2013 - Taipei, Taiwan, Province of China
Duration: Jul 8 2013Jul 11 2013

Other

Other2013 IEEE 14th International Conference on High Performance Switching and Routing, HPSR 2013
CountryTaiwan, Province of China
CityTaipei
Period7/8/137/11/13

Fingerprint

Industry
Critical infrastructures

Keywords

  • data center networks
  • traffic characteristics
  • traffic measurement

ASJC Scopus subject areas

  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this

Aghdai, A., Zhang, F., Dasanayake, N., Xi, K., & Chao, H. J. (2013). Traffic measurement and analysis in an organic enterprise data center. In IEEE International Conference on High Performance Switching and Routing, HPSR (pp. 49-55). [6602289] https://doi.org/10.1109/HPSR.2013.6602289

Traffic measurement and analysis in an organic enterprise data center. / Aghdai, Ashkan; Zhang, Fan; Dasanayake, Nadun; Xi, Kang; Chao, H. Jonathan.

IEEE International Conference on High Performance Switching and Routing, HPSR. 2013. p. 49-55 6602289.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Aghdai, A, Zhang, F, Dasanayake, N, Xi, K & Chao, HJ 2013, Traffic measurement and analysis in an organic enterprise data center. in IEEE International Conference on High Performance Switching and Routing, HPSR., 6602289, pp. 49-55, 2013 IEEE 14th International Conference on High Performance Switching and Routing, HPSR 2013, Taipei, Taiwan, Province of China, 7/8/13. https://doi.org/10.1109/HPSR.2013.6602289
Aghdai A, Zhang F, Dasanayake N, Xi K, Chao HJ. Traffic measurement and analysis in an organic enterprise data center. In IEEE International Conference on High Performance Switching and Routing, HPSR. 2013. p. 49-55. 6602289 https://doi.org/10.1109/HPSR.2013.6602289
Aghdai, Ashkan ; Zhang, Fan ; Dasanayake, Nadun ; Xi, Kang ; Chao, H. Jonathan. / Traffic measurement and analysis in an organic enterprise data center. IEEE International Conference on High Performance Switching and Routing, HPSR. 2013. pp. 49-55
@inproceedings{756a011eafc847c4b35c17feb719ff3d,
title = "Traffic measurement and analysis in an organic enterprise data center",
abstract = "Enterprise data centers (EDCs) are critical infrastructure to large enterprises, government agencies, research institutions, etc. They are used to support a variety of off-the-shelf and customized services. EDCs are different from cloud data centers (CDCs) in two major aspects. Firstly, an EDC is usually built over time and consists of old and new equipment. Secondly, the type of services and applications in EDCs are quite different from those in CDCs. Therefore, we expect that the traffic characteristics in EDCs would also be different from those in CDCs. While most existing data center measurements were from CDCs, we performed extensive traffic measurement and analysis in an EDC that provided multiple services to over a million users. We present the data center architecture, measurement methodology, measurement results, and analysis. The results include traffic matrix, traffic distribution, flow characteristics, and TCP characteristics. Our research reveals that the traffic characteristics in the EDC are indeed quite different from the reported results in CDCs. For example, the traffic matrix tends to be sparse rather than all-to-all. Based on the analysis we provide a few guidelines for EDC design, optimization, and anomaly detection. As the first most extensive study on EDC traffic, our work provides valuable information to future EDC design and implementation, and also helps researchers develop insights into the differences and similarities between EDCs and CDCs.",
keywords = "data center networks, traffic characteristics, traffic measurement",
author = "Ashkan Aghdai and Fan Zhang and Nadun Dasanayake and Kang Xi and Chao, {H. Jonathan}",
year = "2013",
doi = "10.1109/HPSR.2013.6602289",
language = "English (US)",
pages = "49--55",
booktitle = "IEEE International Conference on High Performance Switching and Routing, HPSR",

}

TY - GEN

T1 - Traffic measurement and analysis in an organic enterprise data center

AU - Aghdai, Ashkan

AU - Zhang, Fan

AU - Dasanayake, Nadun

AU - Xi, Kang

AU - Chao, H. Jonathan

PY - 2013

Y1 - 2013

N2 - Enterprise data centers (EDCs) are critical infrastructure to large enterprises, government agencies, research institutions, etc. They are used to support a variety of off-the-shelf and customized services. EDCs are different from cloud data centers (CDCs) in two major aspects. Firstly, an EDC is usually built over time and consists of old and new equipment. Secondly, the type of services and applications in EDCs are quite different from those in CDCs. Therefore, we expect that the traffic characteristics in EDCs would also be different from those in CDCs. While most existing data center measurements were from CDCs, we performed extensive traffic measurement and analysis in an EDC that provided multiple services to over a million users. We present the data center architecture, measurement methodology, measurement results, and analysis. The results include traffic matrix, traffic distribution, flow characteristics, and TCP characteristics. Our research reveals that the traffic characteristics in the EDC are indeed quite different from the reported results in CDCs. For example, the traffic matrix tends to be sparse rather than all-to-all. Based on the analysis we provide a few guidelines for EDC design, optimization, and anomaly detection. As the first most extensive study on EDC traffic, our work provides valuable information to future EDC design and implementation, and also helps researchers develop insights into the differences and similarities between EDCs and CDCs.

AB - Enterprise data centers (EDCs) are critical infrastructure to large enterprises, government agencies, research institutions, etc. They are used to support a variety of off-the-shelf and customized services. EDCs are different from cloud data centers (CDCs) in two major aspects. Firstly, an EDC is usually built over time and consists of old and new equipment. Secondly, the type of services and applications in EDCs are quite different from those in CDCs. Therefore, we expect that the traffic characteristics in EDCs would also be different from those in CDCs. While most existing data center measurements were from CDCs, we performed extensive traffic measurement and analysis in an EDC that provided multiple services to over a million users. We present the data center architecture, measurement methodology, measurement results, and analysis. The results include traffic matrix, traffic distribution, flow characteristics, and TCP characteristics. Our research reveals that the traffic characteristics in the EDC are indeed quite different from the reported results in CDCs. For example, the traffic matrix tends to be sparse rather than all-to-all. Based on the analysis we provide a few guidelines for EDC design, optimization, and anomaly detection. As the first most extensive study on EDC traffic, our work provides valuable information to future EDC design and implementation, and also helps researchers develop insights into the differences and similarities between EDCs and CDCs.

KW - data center networks

KW - traffic characteristics

KW - traffic measurement

UR - http://www.scopus.com/inward/record.url?scp=84889038771&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84889038771&partnerID=8YFLogxK

U2 - 10.1109/HPSR.2013.6602289

DO - 10.1109/HPSR.2013.6602289

M3 - Conference contribution

SP - 49

EP - 55

BT - IEEE International Conference on High Performance Switching and Routing, HPSR

ER -