A scalable communication runtime for clouds
J Ekanayake, J Jackson, W Lu… - 2011 IEEE 4th …, 2011 - ieeexplore.ieee.org
2011 IEEE 4th International Conference on Cloud Computing, 2011•ieeexplore.ieee.org
Leveraging cloud computing to acquire the necessary computation resources to scale out
parallel applications is becoming common practice. However, many such applications also
require communication and synchronization between processes. Although, commercial
cloud platforms provide ready access to scalable compute and storage services,
implementing communication and synchronization between cooperating processes and
efficiently exchanging arbitrary size messages remains a challenge for application …
parallel applications is becoming common practice. However, many such applications also
require communication and synchronization between processes. Although, commercial
cloud platforms provide ready access to scalable compute and storage services,
implementing communication and synchronization between cooperating processes and
efficiently exchanging arbitrary size messages remains a challenge for application …
Leveraging cloud computing to acquire the necessary computation resources to scale out parallel applications is becoming common practice. However, many such applications also require communication and synchronization between processes. Although, commercial cloud platforms provide ready access to scalable compute and storage services, implementing communication and synchronization between cooperating processes and efficiently exchanging arbitrary size messages remains a challenge for application developers. In clouds, durable queues provide basic abstractions for communication. However, they are not sufficient for applications that require transferring arbitrary size messages or for applications that require higher level abstractions such as broadcast. Furthermore, direct socket based communication is susceptible to various fluctuations common in data center environments. We envision a solution to this problem that leverages scalable storage services, queues, and direct socket based communication. Publish/subscribe (pub/sub) is a well-known communication pattern that can achieve the above capabilities in a loosely coupled fashion, which is highly desirable in cloud environments where most services are asynchronous. In this paper, we describe the architecture of a pub/sub library implemented on a commercial cloud computing platform, which can be used to develop various parallel applications. We also present an evaluation of our implementation using both micro benchmarks and a real world application. Together, these demonstrate that our approach is both effective and scalable in performing communication and synchronization in cloud scale applications.
ieeexplore.ieee.org
Showing the best result for this search. See all results