Challenges in the capture and dissemination of measurements from high-speed networks

Submitted by richard on Mon, 11/30/2009 - 00:00
Richard G. Clegg, Mark Withall, Andrew Moore, Iain Phillips, David Parish, Miguel Rio, Raul Landa, Hamed Haddadi, Konstantinos Kyriakopoulos, Jordan Auge, Richard Clayton and David Salmon
IET Communications, 3(6) p. 957-96
The production of a large-scale monitoring system for a high-speed
network leads to a number of challenges. These challenges are not purely
techinical but also socio-political and legal. The number of stakeholders
in a such a monitoring activity is large including the network operators,
the users, the equipment manufacturers and of course the monitoring re-
searchers. The MASTS project (Measurement at All Scales in Time and Space) was created to instrument the high-speed JANET Lightpath net-
work, and has been extended to incorporate other paths supported by
Challenges the project has faced have included: simple access to the
network; legal issues involved in the storage and dissemination of the
captured information, which may be personal; the volume of data cap-
tured and the rate at which this data appears at store. To this end the
MASTS system will have established four monitoring points each captur-
ing packets on a high speed link. Traffic header data will be continuously
collected, anonymised, indexed, stored and made available to the research
community. A legal framework for the capture and storage of network
measurement data has been developed which allows the anonymised IP
traces to be used for research purposes.

This paper describes the initial results from the MASTS project a measurement project focusing on the JANET UK academic network.

author={Clegg, R.G. and Withall, M.S. and Moore, A.W. and Phillips, I.W. and Parish, D.J. and Rio, M. and Landa, R. and Haddadi, H. and Kyriakopoulos, K. and Auge, J. and Clayton, R. and Salmon, D.},
journal={Communications, IET},
title={Challenges in the capture and dissemination of measurements from high-speed networks},
Paper type
Subject area