EGI-In SPIRE Scenario 6 Peter Solagna EGI

EGI-In. SPIRE Scenario 6 Peter Solagna – EGI. eu 3/19/2018 EGI-In. SPIRE RI-261323 1 www. egi. eu

VM/Resource state change notification What scenario 6 enables: • Resource providers to notify interested parties about changes in the user's VM state or a proposed state change in the VMM. • End user to build automated VM management and reactive workflows in user space. • Standards for the messages format and transport have to be explored EGI-In. SPIRE RI-261323 www. egi. eu

What has been done Kick start of the scenario • Sent an email to the fedclouds ML • Request for collaboration • Request for use case from user communities • Identified the steps for the scenario fulfillment • Created the Wiki Page to collect: • Description of the scenario & steps • Collaborators for the working group • Summary tables for the notifications implemented by the technologies and the standards • Missing: timeline for the scenario fulfillment • Missing: only one collaborator joined Started the collection of notification sys. implementations EGI-In. SPIRE RI-261323 www. egi. eu

Steps of Scenario 6 Information gathering steps 1. List the notification system adopted by the technology deployed in the testbed 1. 2. 3. 4. Collect users requirements List the currently available standards and map them into the technologies implemented in the testbed Map users requirements into the notification mechanisms available in the testbed Identify a core set of features. Identify if there are standards eligible to be suggested as common standards. Operative steps 5. 6. Technology providers should provide the “status change” notifications through standard formats and transport protocols. User communities should test these notification mechanisms in their workflows, or implementing a client prototype. Missing steps? 7. … EGI-In. SPIRE RI-261323 www. egi. eu

Notification systems currently in use VM Manager What is automatically notified Any standard in the message format used Message transport protocol Open Nebula States of VM No Users have to query the cloud resources. Result in XML Cloud. Sigma Open. Stack WNo. De. S …. EGI-In. SPIRE RI-261323 ? ? Not clear yet, still at Atom 1. 0 blueprint stage ? Pub. Sub. Hubbub (PSH) ? ? ? www. egi. eu

Standards Standard name Messages format/transport Comments Atom 1. 0 Message Implemented by Open. Stack Pub. Sub. Hubub (PSH) Transport Implemented by Open. Stack Active. MQ Transport Already used by the EGI’s monitoring and accounting infrastructure • I will extend this table by the next teleconf meeting – adding more columns for a comparative view of the features • Please, if you are familiar with other standards extend it adding new rows EGI-In. SPIRE RI-261323 www. egi. eu

Active/Passive notifications • Active: resource provider sends a notification message to the user when the status of an owned VM changes, or when a specific event occurs • Passive: users poll all their VMs for their status • To implement any automated workflow passive notifications should be available through a PI • Open. Stack enables active notification • Open. Nebula enables only passive notification through the OCCI interface • Others Tech Providers? EGI-In. SPIRE RI-261323 www. egi. eu

What users want? Scenario 6, so far, has no support of users requirements • Would the applications workflows implement active/passive VM status monitoring? • About what different users want to be notified? • Status changes • After an amount wall-clock time • Expected downtimes of the service • Would be useful for users to have periodic summary messages, containing statistics about the number of VMs running/suspended/. . • Would it be in scope? • Is it critical for users the encryption of notification messages? • Notifications shouldn’t contain sensitive data • Encrypted payload of the notification messages • HTTPS connection • Other? EGI-In. SPIRE RI-261323 www. egi. eu

After the information gathering • Within the working group (and hopefully with some users representative), analyze the requirements, mapping them on the currently available technologies and standards • Agree on a set of features that are critical and should go into the blueprint • Start to test those features on the Fedclouds -TF’s testbeds • How to test them? • Dummy “hello world” style? • Any chance to have real use case to test? EGI-In. SPIRE RI-261323 www. egi. eu

Conclusions The work for the scenario is started but it needs to speed up • Collaborators • Now: for the information gathering/analysis process • Near future: for the use cases testing • Collect information about the current notifications system implemented (and planned) • Use cases from users EGI-In. SPIRE RI-261323 www. egi. eu