PayforUse in the EGI Marketplace Sy Holsinger EGI

Pay-for-Use in the EGI Marketplace Sy Holsinger, EGI Foundation Senior Strategy and Policy Officer EGI P 4 U Po. C Chair www. egi. eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number 654142

Content • Brief Pay-for-Use Overview – Rationale – History – Different business models • Pay-for-Use in the EGI Marketplace – Changes impacting EGI P 4 U – Options for P 4 U providers – P 4 U Requirements for Marketplace • Future Demand • Next Steps 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 2

Pay-for-Use: Rationale • • Not about replicating commercial offerings – Provide additional mechanisms for groups with funds to access resources – Support continued service delivery (e. g. cost recovery, new sources of revenue) – Increase customer base (e. g. high level of requirements; service guarantees) – Create new opportunities to support research and innovation (academia/industry partnerships) Focus – Research and innovation activities – Pre-commercial applications – Dedicated high-level consultancy and support (e. g. application porting) – Competitive pricing (not undermining market) Not an overhaul of the current system 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 3

Pay-for-Use: History • 2013: Exploratory Document • 2014: Kick-off of Proof of Concept • 2015: Tool adaption (GOCDB, Accounting Portal, e-GRANT) (preproduction) • 2016: Formalization (moving to production) – Provider agreement – Documentation (provider; customer) – Letter of Intent (Lo. I) • Formally signed document confirming individual organization ability and willingness to offer services on a paid basis • Includes access policies – Responding to tenders (ESA; Helix. Nebula) – Transition from e-GRANT to Marketplace (focus of 2017) 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 4

Pay-for-Use: State of Play • • Moved from alpha -> production Shift from e-GRANT to Marketplace had substantial impact on activity plans – Focus on providing requirements for P 4 U functionality and processes – Created temporary wikipage to publicly host all P 4 U information (e. g. business models; pricing) – Processes in place • P 4 U Results – – – 1 st financial exchange facilitated by EGI: IBM->PSNC (others within NGIs e. g. IFCA, INFN) Under discussion: Terradue, NUMECA, Cloud. SME, Blue. Bridge, ELIXIR 6 signed Lo. Is: • CESGA (ES); CSC (FI); 100%IT (UK); IFCA (ES); IISAS (SL); PSNC (PL) https: //wiki. egi. eu/wiki/Pay-for-use Providers involved in P 4 U Po. C: ~30 Actively working on enabling P 4 U: 8 -10 Letters of Intent received: 6 Avg. price (HTC/cloud): € 0. 05/h Knowledge of P 4 U capability is slowly increasing interest and demand 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 5

Pay-for-Use Business Models to be supported by the Marketplace 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 6

Marketplace Concepts • Promote – Facilitate EGI service requests – Offer an opportunity for EGI participants (NGIs/EIROs) to promote services – Include approved services from third party partners (under discussion) • Discover and Request – Customers can not only more easily discover, but request services • Authentication – Allow log-in through the Check-in service (AAI) • Integrate – Keeping look and feel of the new EGI main website – Ensure harmonized integration with existing EGI tools • e. g. e-GRANT, LTo. S (Access) – 2 Marketplace platforms explored/tested • Open. IRIS and Presta. Shop 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 7

Pay-for-Use Po. C: Initial Business Scenario 1. Publishes Services 2. Searches Service / Price List 11. Makes payment 3. Selects / Submits Request 4. Agrees SLA 10. Provides Invoice & Reports Customer 8. Adds Users / 9. Uses Services 7. Allocates Capacity Service Provider 5. Informs About New Customer 6. Creates VO Virtual Organization 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 Broker 8

Pay-for-Use Po. C: Initial Business Scenario 1. Publishes Services 2. Searches Service / Price List 11. Makes payment 3. Selects / Submits Request 4. Agrees SLA 10. Provides Invoice & Reports Customer 8. Adds Users / 9. Uses Services 7. Allocates Capacity Service Provider 5. Informs About New Customer 6. Creates VO Virtual Organization 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 Broker 9

Business Scenario: Broker Role Publishes Services Searches Service / Price List Customer Selects / Submits Request Informs About New Customer Agrees SLA / Handles Payment Agrees OLA Adds Users / Uses Services Broker Creates VO Allocates Capacity Service Provider Virtual Organization 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 10

Business Scenario: Broker Role Searches Publishes Service / Price List Customer Selects / Submits Request Informs About New Customer Agrees SLA / Handles Payment Agrees OLA Adds Users / Uses Services Broker Creates VO Allocates Capacity Service Providers Virtual Organization 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 11

We knew that the EGI Marketplace would eventually impact Pay-for-use So now what? 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 12

EGI P 4 U Po. C: Life before the Marketplace Completed • Registry extensions added to set prices • Accounting Portal information • e-GRANT Broker/User Interface – Special pool type: pay-for-use (w/ price) – Importing prices from Registry – User self-allocation: supported matching pools enabled for customers – Automatic finding and presenting the cheapest allocation that suited requested parameters – Presenting cost of overall allocation Missing • Front-end graphical user interface • Billing function 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 13

Marketplace Prototype: Prestashop http: //marketplace. egi. eu/ Satisfies the GUI + billing…… but 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 14

Still need a Client Area: e-GRANT? • Registry of the service requests • Notification system • Operator dashboard Basically – Manage OLAs and SLAs – Download service reports • Customer dashboard – Check their service requests – Approve SLAs – Download SLAs and service reports • Report engine All features under Discussion – Automate service report (information from ARGO) – SLA / OLA status report (low priority) 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 15

Pay-for Use Options: Where do they go in the Marketplace? 1. Under service category, each service is differentiated according to the access mode: for free or for pay – e. g. “General purpose instance” and “General purpose instance for pay” • Single entry under EGI, thus acting as a sort of broker • And/or individual provider offers listed separate, but aggregated on the service level, direct contracts between customers and providers 2. Adding the pay-for-use attributes directly in the service options (product in the marketplace) – Flag “for pay” to be added in the service options – EGI acts as an initial broker 3. Add an additional category related to the pay-for-use providers – Under this category all the providers will be listed – Under each provider, all its products will be listed 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 16

Pay-for Use: Option 1 Separate entries for Pay-for-Use (+) User knows from the start which products are for payment (+) Better product management for providers (-) Potential to blow up the list of entries reducing the ease of finding services as there is basically a duplication of each (see next slide) 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 17

Pay-for Use: Option 1 a: One common EGI entry (+) Reduces # of service entries (+) Hides the multi-provider aspect from the user, showing a single contact point (-) Requires the broker model to be matured 10/22/2021 Option 1 b: One entry per provider (+) Better product management for providers (-) Greatly increases # of service entries (-) Puts responsibility of provider selection on the user and reduces the ease of service discovery P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 18

e-GRANT Integration One common EGI entry Ø Step 1: Mapping Marketplace order to e -GRANT Resource request • • Option 1: P 4 U Resource request is created. User can choose from providers who fulfil the request Option 2: EGI broker chooses for the user Ø Step 2: Connecting Resource Request with provider’s resources available in the system; creation of draft SLA (e. GRANT) Ø Step 3: Resource and price negotiation (e-GRANT) Ø Step 4: SLA signing (e-GRANT) 10/22/2021 One entry per provider Ø Step 1: Mapping Marketplace order to e-GRANT Resource request • Draft SLA already in place • Connection to provider’s resource pool already in place Ø Step 2: Connecting Resource Request with provider’s resources available in the system; creation of draft SLA (e-GRANT) Ø Step 3: Resource and price negotiation (e-GRANT) Ø Step 4: SLA signing (e-GRANT) P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 19

Associating Providers to Products Option 1 a (one product solution) • Able to specifically select which providers are associated to which product 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 20

Pay-for Use: Option 2 One general entry per service Payment options exposed based on selected criteria (+) Reduces # of service entries (+) User knows from the start which options are for payment (-) A lot more complicated to implement technically (-) Requires well-thought out mapping of selection criteria to provider 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 21

Pay-for Use: Option 3 Pay-for-Use Area (+) Better product management for providers (+) Avoids mixing with free services (-) Not clear where to mention P 4 U in the structure (-) Need to answer the question “why pay” more explicitly 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 22

Info to Provide/Collate All Options • • 10/22/2021 Offers flexible algorithms based on product attributes and for different products EGI Marketplace specification and attribute model (e. g. cores, RAM, storage, technology, etc. ) o Additional requirement on P 4 U providers - might not map to pricing model/packages – need to customize o Back-off access (TBC) o How to handle potential joint offers P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 23

Fit. SM Paid Trainings In-House Open Registration • One single product entry • No current online solution 10/22/2021 • One product entry per course • Currently using Eventbrite P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 24

P 4 U Requirement Summary • Computing/Data/Storage services – Option 1: Under service category, each service is differentiated according to the access mode: for free or for pay • Preferred in the short-term, but not perfect – Option 2: Adding the pay-for-use attributes directly in the service options • Interesting option, but too complicated in the short-term, to be evaluated in a second stage – Option 3: Add an additional category related to the pay-for-use providers • Not sure if it is just P 4 U providers or if individual providers will have their own space, a ”store” in which is managed by them • Fit. SM – 2 types of trainings that required different product entry fields – We have all of the information/categories needed 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 25

Where’s the demand? 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 26

Training Infrastructure as a Service (TIaa. S) • Existing service in EGI Service Catalogue: • Opportunity to develop pricing model https: //www. egi. eu/services/training-infrastructure/ – NUMECA International Contact through EGI Business Engagement Programme (Oct Webinar) Commercial applications around Computational Fluid Dynamics Leverage Uber. Cloud containers Ran training using EGI cloud providers CESNET and FZ Jülich as underlying infrastructure as a trial (20 VMs, 8 v. CPU cores, 8 GB RAM, 100 GB storage each) https: //www. egi. eu/blog/egi-supports-belgian-sme-in-cfd-training-24 -nov-2016/ • Due to success, they are interested in our price model for future • • – R&D projects and future commercial trainings – H 2020 project EDISON • Defining the competences and skills framework, body of knowledge and model curriculum for the new profession of the data scientist • EGI offering training infrastructure to support Virtual Labs (amongst other activities) – Opportunity to define business model (already potential interest from universities) 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 27

Broker Model: Marine Fisheries Example Early Adopters Use Case 1 Wider Outreach Becoming a common model for sector specific Use Case 1 Marine Fisheries SLA/ Contract CRM Paid Free SLA Legal Entity OLA Mediation SUPM CRM UA/ Contract SUPM UA SUPM OLA/ Contract 10/22/2021 EGI SP P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 OLA 28

EOSC-hub: Digital Innovation Hub • EOSC-hub: Joint project proposal between EGI, EUDAT, INDIGO-Data. Cloud (and 100+ partners) submitted in March 2017 within EINFRA-12 a (~€ 30 M) • 13 WPs, one of which is dedicated evolving business development activities with the private sector Definition of EC Digital Innovation Hub (DIH) Ecosystems of SMEs, large industries, startups, researchers, accelerators, and investors. They aim to create the best conditions for long-term business success for all involved. This concept of providing any SME, wherever it is located, with access to advanced technologies and competences for mastering their digital transformation is key for Europe to remain competitive. Objectives • Create a Pan-European network of Digital Innovation Hubs (DIHs). • Help ensure that every company, small or large, high-tech or not, can grasp the digital opportunities. 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 29

EOSC-hub DIH: WP/Task Structure WP 9 Joint Digital Innovation Hub T 9. 1 T 9. 2 T 9. 3 Joint DIH ecosystem • [PM 1 -PM 36] • • • Business Pilots • [PM 1 -PM 33] • • • Commercialization Support • [PM 6 -PM 36] 10/22/2021 • • • Overall creating, building, expanding of the JIH ecosystem; management and coordination Collaboration with regional, national and pan-European Innovation Hubs Deployment/customisation/management of the DIH platform/tools Monitoring/measuring impact Previously selected SMEs to run pilots to get DIH running (1 st half of project only) – obtained through open calls (6 in total) Ensuring access to the required services Providing technical support Monitoring the progress Assessing and validating results (supported by T 9. 3). Identifying additional experiments through outreach activities, new business contacts, or opportunities coming from the competence centres Identification of the business opportunities resulting from the pilots; business model development and implementation (interface with WP 2. 3) Ecosystem technology transfer process models Mentoring program towards pilots and CC’s Defining pre-commercial agreements P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 30

So what in the world do we do now? 10/22/2021 P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 31

Actions moving forward • Ensure customers can request the different kind of paid services: – Computing/Data/Storage services (x 2) • Individual Provider entries • EGI entry as a broker of multiple providers – Training Infrastructure-as-a-Service • Define a pricing model – Fit. SM trainings • In-house and open registration • Issues (time is short, so let’s be pragmatic) – Current MP specifications potentially too complex for pricing models/packages – Separate entries for free/paid limit “freemium” models; not clear the difference – Cannot do the exercise “offline” (we tried) e. g. doc, spreadsheet; must walk through the backoffice to do an actual product entry for meaningful feedback • Set up meetings starting with those who have provided the Lo. I? P 4 U in EGI Marketplace – EGI Conf 2017 Catania – 10 May 2017 • Demand is coming as options are known 10/22/2021 32

Thank you for your attention. Questions? www. egi. eu This work by Parties of the EGI-Engage Consortium is licensed under a Creative Commons Attribution 4. 0 International License.