Mahasen: distributed storage resource broker

Abstract

Modern day systems are facing an avalanche of data, and they are being forced to handle more and more data intensive use cases. These data come from many forms and shapes: Sensors (RFID, Near Field Communication, Weather Sensors), transaction logs, Web, social networks etc. As an example, weather sensors across the world generate a large amount of data throughout the year. Handling these and similar data require scalable, efficient and reliable very large storages with support for efficient metadata based searching. This paper present Mahasen, a highly scalable storage for high volume data intensive applications built on top of a peer-to-peer layer. In addition to scalable storage, Mahasen also supports searching built on top of the Distributed Hashtable (DHT).