Cloud-Aware Processing of MapReduce-Based OLAP Applications

Han, H., Lee, Y.C., Choi, S., Yeom, H.Y. and Zomaya, A.Y.

As the volume of data to be processed in a timely manner soars, the scale of computing and storage systems has much trouble keeping up with such a rate of explosive data growth. A hybrid cloud combining two or more clouds is emerging as an appealing alternative to expand local/private systems. However, the effective use of such an expanded cloud system is limited primarily by low network bandwidth and high latency between clouds (i.e., large intercloud data transmission overheads) when applications/services span across clouds, and they deal with large data in particular. Online analytical processing (OLAP) applications are a typical class of data-intensive application. These applications process multi-dimensional analytical queries dealing with `big data' (or data warehouses). In this paper, we address the effective processing of MapReduce-based OLAP applications in a hybrid-cloud environment, and present a (hybrid) cloud-aware OLAP system incorporating data filtering techniques. Our system filters out unnecessary data for intercloud transmission with the ultimate goal of optimizing the performance to cost ratio, or cost efficiency. Based on experimental results obtained using two large-scale data analysis benchmarks, our system demonstrates its efficacy in improving the cost efficiency with the reduction in intercloud network traffic from 76%-99%.

Cite as: Han, H., Lee, Y.C., Choi, S., Yeom, H.Y. and Zomaya, A.Y. (2013). Cloud-Aware Processing of MapReduce-Based OLAP Applications. In Proc. Parallel and Distributed Computing 2013 (AusPDC 2013) Adelaide, Australia. CRPIT, 140. Javadi, B. and Garg, S.K. Eds., ACS. 31-38

(from crpit.com) (local if available)