Cloud intelligence: agents within an InterCloud

PDF version | Permalink

Kwang Mong Sim

26 November 2013

Intelligent agents can automatically establish service contracts, integrate resources, coordinate concurrent workflow and schedule parallel execution of tasks in multiple clouds.

An important aspect of cloud computing is creating the illusion that infinite computing resources are available on demand. As a single cloud does not have infinite physical computing resources, an InterCloud, which is an interconnected global ‘cloud of clouds’, enables cloud systems to cooperate with each other, allowing each cloud to tap into the resources of other clouds to satisfy consumers' requests.1 InterCloud resource pooling and sharing involve combining resources through cooperation among clouds, mapping, scheduling and coordinating shared resources, and establishing contracts between providers and consumers.

Agent-based computing provides a natural paradigm for automating interactions among complex interconnected systems such as an InterCloud. Agents are computer systems that are capable of making decisions independently and interacting with other agents through cooperation, coordination and negotiation. Since the resources and control in an InterCloud are distributed among different clouds, an InterCloud can be modelled as a multiagent system with individual clouds as autonomous components. In 2009, I introduced agent-based cloud computing, a new area involving the construction of agents for bolstering composition, scheduling, workflow, negotiation and discovery of cloud resources.2, 3

As cloud computing evolves, integrating cloud services from different providers will become complex. Cloud brokers could remove this complexity by sourcing and integrating different services from multiple clouds and delivering unified services to consumers. To automate cloud service composition, we devised a focused-selection contract net protocol (FSCNP) for dynamically selecting cloud services, and service capability tables (SCTs) to record the list of clouds and their services.4 Our empirical results demonstrate that agents using FSCNP and SCTs can successfully compose a unified cloud service using a set of resources from different clouds.

Bag-of-tasks (BoT) applications are composed of multiple independent tasks with no execution ordering constraints, and can be highly parallelized for execution in multiple clouds. Scheduling independent tasks in a set of heterogeneous computing resources has been shown to be a so-called NP-complete problem.5 To deal with this challenging problem, we devised a family of 14 cloud scheduling heuristics, based on the remaining allocation times of cloud resources and an elastic cloud resource allocation mechanism.6 They were integrated into an agent-based approach for scheduling and executing BoTs. Agents in our testbed autonomously select cloud resources from a pool of cloud providers and concurrently schedule and execute BoTs in this heterogeneous set of cloud resources. Using Amazon's Elastic Compute Cloud (EC2) as a case study, we explored how we can deploy our agent-based resource allocation mechanism to commercial clouds.7

Supporting cloud workflow execution involves allocating and composing a collection of heterogeneous resources from different clouds and coordinating the task execution using these resources, taking into consideration the ordering constraints. Using Petri-net-based methodologies to enable agents to synchronize and coordinate concurrent workflow, we devised an agent-based approach for supporting workflow execution involving resources from multiple clouds.8 Our empirical results demonstrate that our agents can effectively execute concurrent cloud workflows and deal with different levels of parallelism and ordering constraints.

The challenge in cloud service negotiation is to establish service-level agreements (SLAs) among stakeholders. My cloud negotiation mechanism bolsters multilateral negotiations between consumers and cloud brokers, and concurrent negotiations between a broker and multiple groups of providers.9 Since each consumer can submit its service requests to many brokers and each broker can accept requests from many consumers, I modelled their negotiation activities using a many-to-many negotiation model. Consumer agents and broker agents (representing consumers and brokers, respectively) negotiate to establish SLAs for satisfying consumers' service requirements. To combine a set of services from multiple cloud providers, a broker needs to establish SLAs with multiple providers via concurrent negotiations. A broker agent carries out parallel negotiations with multiple groups of provider agents (representing cloud providers). In each negotiation thread, broker and provider agents negotiate to establish an SLA for a different type of cloud resource.

In another work, we compared our cloud negotiation mechanism with Amazon EC2's spot pricing model and showed that our mechanism allows consumers to both save cost and utilize the cloud service without interruption.10

The problem in cloud service discovery is to run queries against the cloud services registered in the search engine's database by matching consumers' functional, technical and budgetary requirements. We developed a proof-of-concept search engine called Cloudle for discovering cloud services.11 Cloudle consists of a service discovery agent that consults a cloud ontology for determining the similarities between providers' service specifications and consumers' service requirements. It accepts as its inputs functional, technical and budgetary requirements from consumers, reasons about the similarities among cloud services, and determines different levels of matching between the respective prices and schedules of a consumer and a provider.

Our works on agent-based cloud computing show that agents are appropriate mechanisms for automating complex interactions within an InterCloud. We believe that agents will play a significant role in shaping the intelligent InterCloud vision. An InterCloud could be populated by a society of agents representing InterCloud participants (see Figure 1). In an intelligent InterCloud, the economic encounters between consumers and providers will be modelled as a multilateral negotiation whereby consumer agents negotiate with provider agents to search for the best price deal. The interactions between ‘home’ clouds requiring resources from other ‘foreign’ clouds will consist of parallel negotiation activities between home and foreign cloud agents to form InterCloud coalitions.

Agents automating the interactions among participants in an InterCloud.

Our future work in agent-based cloud computing will devise an agent-based economic model for bolstering consumer-to-cloud negotiation and cloud-to-cloud negotiation. We will also integrate our ideas of agent-based cloud service composition, scheduling and workflow into OpenStack, a cloud operating system that controls large pools of compute, storage and networking resources.12


Kwang Mong Sim
University of Kent

Kwang Mong Sim is chair of computer science and director of the Computational Economics and Multiagent Systems Laboratory. He is also the associate editor-in-chief of Applied Intelligence, and associate editor of IEEE Transactions on Cybernetics and the International Journal of Cloud Computing.He has published 150 papers in the areas of multiagent systems, cloud/grid computing, information retrieval and evolutionary computing.

  1. D. Bernstein, E. Ludvigson, K. Sankar, S. Diamond and M. Morrow, Blueprint for the InterCloud—protocols and formats for cloud computing interoperability, IEEE ICIW, pp. 328-336, 2009.

  2. K. M. Sim, Agent-based cloud computing, IEEE Trans. Services Comput. 5 (4), pp. 564-577, 2012.

  3. K. M. Sim, Agent-based cloud commerce, Proc. IEEE IEEM, pp. 717-721, 2009.

  4. J. O. Gutierrez-Garcia and K. M. Sim, Agent-based cloud service composition, Appl. Intell. 38 (3), pp. 436-464, 2013.

  5. J. Bruno, E. G. Coffman Jr. and R. Sethi, Scheduling independent tasks to reduce mean finishing time, Commun. ACM 17 (7), pp. 382-387, 1974.

  6. J. O. Gutierrez-Garcia and K. M. Sim, Family of heuristics for agent-based elastic cloud bag-of-tasks concurrent scheduling, Future Generat. Comput. Syst. 29 (7), pp. 1682-1699, 2013.

  7. J. O. Gutierrez-Garcia and K. M. Sim, Agents for cloud resource allocation: an Amazon EC2 case study, Proc. FGIT-GDC/CA, pp. 544-553, 2011.

  8. J. O. Gutierrez-Garcia and K. M. Sim, Agent-based cloud workflow execution, Integr. Comput. Aided Eng. 19 (1), pp. 39-56, 2012.

  9. K. M. Sim, Complex and concurrent negotiations for multiple interrelated e-markets, IEEE Trans. Cybernet. 43 (1), pp. 230-245, 2013.

  10. S. Son and K. M. Sim, A price-timeslot negotiation for cloud service reservation, IEEE Trans. Syst. Man Cybernet. B 42 (3), pp. 713-728, 2012.

  11. J. Kang and K. M. Sim, Cloudle: a multi-criteria cloud service search engine, Proc. IEEE Asia-Pacific Services Comput. Conf., pp. 339-346, 2010.

  12. OpenStack is an open source cloud operating system. Accessed 2 October 2013.

DOI:  10.2417/3201311.005153