Challenges in the capture and dissemination of measurements from high-speed networks

Paper type: 
Journal Paper
Richard G. Clegg, Mark Withall, Andrew Moore, Iain Phillips, David Parish, Miguel Rio, Raul Landa, Hamed Haddadi, Konstantinos Kyriakopoulos, Jordan Auge, Richard Clayton and David Salmon
IET Communications, 3(6) p. 957-96, 2009
The production of a large-scale monitoring system for a high-speed network leads to a number of challenges. These challenges are not purely techinical but also socio-political and legal. The number of stakeholders in a such a monitoring activity is large including the network operators, the users, the equipment manufacturers and of course the monitoring re- searchers. The MASTS project (Measurement at All Scales in Time and Space) was created to instrument the high-speed JANET Lightpath net- work, and has been extended to incorporate other paths supported by JANET(UK). Challenges the project has faced have included: simple access to the network; legal issues involved in the storage and dissemination of the captured information, which may be personal; the volume of data cap- tured and the rate at which this data appears at store. To this end the MASTS system will have established four monitoring points each captur- ing packets on a high speed link. Traffic header data will be continuously collected, anonymised, indexed, stored and made available to the research community. A legal framework for the capture and storage of network measurement data has been developed which allows the anonymised IP traces to be used for research purposes.
This paper describes the initial results from the MASTS project a measurement project focusing on the JANET UK academic network.
author={Clegg, R.G. and Withall, M.S. and Moore, A.W. and Phillips, I.W. and Parish, D.J. and Rio, M. and Landa, R. and Haddadi, H. and Kyriakopoulos, K. and Auge, J. and Clayton, R. and Salmon, D.},
journal={Communications, IET},
title={Challenges in the capture and dissemination of measurements from high-speed networks},
Subject area: