Design and Implementation of an Incentive System for

  • Slides: 54
Download presentation
Design and Implementation of an Incentive System for Sharing Distributed Computing Resources - Master

Design and Implementation of an Incentive System for Sharing Distributed Computing Resources - Master Thesis Defense - Dongho Son Supervisor: Prof. James Won-Ki Hong Distributed Processing and Network Management (DPNM) Laboratory Dept. of Computer Science and Engineering POSTECH, Pohang, Korea donghoson@postech. ac. kr 2017. 12. 14. 1/41

Table of Contents • Introduction • Related Work • Design • Implementation • Evaluation

Table of Contents • Introduction • Related Work • Design • Implementation • Evaluation • Conclusion 2/41

Introduction 3/41

Introduction 3/41

Introduction § User behaviors Off Peak Source: https: //techcrunch. com/2011/11/18/financial-times-mobile/ Peak Off Peak 4/41

Introduction § User behaviors Off Peak Source: https: //techcrunch. com/2011/11/18/financial-times-mobile/ Peak Off Peak 4/41

Introduction § Idle computing devices… ? Idle Storage And Computing 5/41

Introduction § Idle computing devices… ? Idle Storage And Computing 5/41

Related Work 6/41

Related Work 6/41

Grid. Coin § Combine the processing power of all individual users • For the

Grid. Coin § Combine the processing power of all individual users • For the purposes of scientific research − Alien radio signals, DNA sequencing, Weather prediction model, etc. • Reward volunteer computing performed upon the BOINC platform − Berkeley Open Infrastructure for Network Computing § Grid. Coin(GRC) • • The coin miners(researchers) can be compensated for participating in BOINC Launched on October 16, 2013 Market Cap: $26 million (약 292 억원) 1 GRC = $0. 06843 (약 75원) 7/41

Golem § Decentralized supercomputer • • An open-sourced project, creating a global market for

Golem § Decentralized supercomputer • • An open-sourced project, creating a global market for computing power Connects computers in a peer-to-peer network Enables anyone to rent resources of other users’ machines It is focused on CGI rendering § Golem Network Token (GNT) • • The resource provider can be compensated for their computing resources ICO on April 18, 2017 Market Cap: $250 million (약 2, 700 억원) 1 GNT = $0. 302836 (Start at $0. 01) Source: https: //golem. network/doc/Golemwhitepaper. pdf https: //coinmarketcap. com/currencies/golem-network-tokens 8/41

Fog. Coin § Rental Service + Fog Computing • Enables any computing device to

Fog. Coin § Rental Service + Fog Computing • Enables any computing device to host software services and process data • Borrow the computing power around you instead of the cloud § Fog. Coin • Fog. Coin tokens are on sale from November 30, 2017 by Active. Works. − Initial Coin Offering − https: //cheddar. com/videos/new-cryptocurrency-to-hit-the-market-in-november Source: http: //www. aetherworks. com/ 9/41

Design 10/41

Design 10/41

Keywords § Main features Resource Rental ISAC coin Payment Decentralized ISAC Idle Storage and

Keywords § Main features Resource Rental ISAC coin Payment Decentralized ISAC Idle Storage and Computing Incentive Model Less Cost & More Profit 11/41

Overview High Performance Computing Resources Payment for Usage (Cryptocurrency) Client ISAC Individual Computing Resources

Overview High Performance Computing Resources Payment for Usage (Cryptocurrency) Client ISAC Individual Computing Resources Cryptocurrency Providers 12/41

High Level Design § Scenario Request MSG Provider 1 : Address Provider 2 :

High Level Design § Scenario Request MSG Provider 1 : Address Provider 2 : Address Provider 3 : Address Providers’ Address Client Provider 1 : Address Provider 2 : Address Provider 3 : Address Info Provider 1 Info Provider 2 Info Provider 3 13/41

High Level Design § Scenario Provider 1 : Address Provider 2 : Address Provider

High Level Design § Scenario Provider 1 : Address Provider 2 : Address Provider 3 : Address Client : Docker Image URL Client Provider 1 Provider 2 Provider 3 14/41

System Architecture ISAC Agent Client : Contract Manager : Resource Monitor ISAC Network ISAC

System Architecture ISAC Agent Client : Contract Manager : Resource Monitor ISAC Network ISAC Payment Peer DB Pricing Manager Matching Manager Unit Price Market ISAC Agent : Task Manager : Client Agent : Provider Agent Providers 15/41

Sequence Diagram Client ISAC Payment ISAC Network Providers Update Computing Resources Info Request Computing

Sequence Diagram Client ISAC Payment ISAC Network Providers Update Computing Resources Info Request Computing Resources Update Unit Price of Computing Resources Clients-Providers Matching Provide Task Image URL Push Task Image Return results Run Tasks Request Total Price Payment for usage 16/41

Coin Market § ICO(Initial Coin Offering) • Company Stock • A new project Token(Coin)

Coin Market § ICO(Initial Coin Offering) • Company Stock • A new project Token(Coin) Investor ICO New Project Financing Investor 17/41

ISAC Coin Market ①/② ⑤/④ Investors Cryptocurrency Exchange : Transactions in cryptocurrency market ①

ISAC Coin Market ①/② ⑤/④ Investors Cryptocurrency Exchange : Transactions in cryptocurrency market ① : Buy ISAC coin ② : Sell ISAC coin ③ : Pay ISAC coin ④ ⑤ ② ① : Transactions in computing resource market ④ : Cash ⑤ : ISAC coin ③ Clients Providers 18/41

Incentive Model § Usage-Based Pricing • Pay for usage based on resource usage •

Incentive Model § Usage-Based Pricing • Pay for usage based on resource usage • Can lower cost for consumers as they pay in proportion to their consumption § Time-Dependent Pricing • Divides the day into peak and off-peak hours • Shifts demand from congested periods to off-peak times § Auction-Based Pricing • Introduces a model of users choosing their usage time based on congestion, price offers, and preferences. 19/41

Incentive Model § Usage-Based Pricing 20/41

Incentive Model § Usage-Based Pricing 20/41

Incentive Model § Usage-Based Pricing • Assume that the number of cores and the

Incentive Model § Usage-Based Pricing • Assume that the number of cores and the Memory size have been agreed with providers. 21/41

Incentive Model CPU cost/hour ($) § Usage-Based Pricing CPU cost/hour ($) Time(h) 22/41

Incentive Model CPU cost/hour ($) § Usage-Based Pricing CPU cost/hour ($) Time(h) 22/41

Incentive Model § Time-Dependent Pricing Off Peak Source: https: //techcrunch. com/2011/11/18/financial-times-mobile/ Peak Off Peak

Incentive Model § Time-Dependent Pricing Off Peak Source: https: //techcrunch. com/2011/11/18/financial-times-mobile/ Peak Off Peak 23/41

Incentive Model § Auction-Based Pricing $12 $10 $5 $3 < Clients > $10 $12

Incentive Model § Auction-Based Pricing $12 $10 $5 $3 < Clients > $10 $12 < Providers > 24/41

Implementation 25/41

Implementation 25/41

Implementation § Hardware • Linux Ubuntu machine § Software • Docker − An open-source

Implementation § Hardware • Linux Ubuntu machine § Software • Docker − An open-source software that packages applications in containers • Kubernetes − An open-source system for automating deployment, scaling and management of containerized applications − Be used to manage Docker images and failover recovery • XAMPP − An open-source cross-platform web server solution § Others • Ethereum − The second most valuable digital currency • Solidity − A contract-oriented programming language for writing smart contracts • Ethereum Virtual Machine (EVM) Geth − The Ethereum smart contracts byte-code execution environment − Solidity is compiled to bytecode that is executable on the EVM 26/41

Implementation § ISAC platform Docker Container Client Docker Hub t on r. C e

Implementation § ISAC platform Docker Container Client Docker Hub t on r. C e k oc D Container r ne i a D oc k er Docker Container Co nt ai ne r Container Application Kubernetes ISAC Agent Provider 1 Provider 2 Provider 3 27/41

Implementation § ISAC Agent 28/41

Implementation § ISAC Agent 28/41

Implementation § ISAC Agent 0. 007 0. 004 0. 006 29/41

Implementation § ISAC Agent 0. 007 0. 004 0. 006 29/41

Implementation § ISAC Payment 30/41

Implementation § ISAC Payment 30/41

Evaluation 31/41

Evaluation 31/41

Evaluation § Usage Monitoring • Ngin. X in docker container − Web server software

Evaluation § Usage Monitoring • Ngin. X in docker container − Web server software • c. Advisor & Kubernetes − Provides container users an understanding of the resource usage § Cost Calculation • Cost per an hour based on each provider’s policy • Cost per a day 32/41

Evaluation 33/41

Evaluation 33/41

Incentive Model § Usage-Based Pricing 34/41

Incentive Model § Usage-Based Pricing 34/41

Evaluation 0. 07 General ISAC with Time-dependent Pricing Cost per an hour($) 0. 06

Evaluation 0. 07 General ISAC with Time-dependent Pricing Cost per an hour($) 0. 06 0. 05 0. 04 0. 03 0. 02 0. 01 0 1 2 3 4 5 6 7 8 9 10 11 12 13 Time(h) 14 15 16 17 18 19 20 21 22 23 24 35/41

Evaluation 36/41

Evaluation 36/41

Conclusion 37/41

Conclusion 37/41

Conclusion 38/41

Conclusion 38/41

Conclusion § An Incentive System for Sharing Distributed Computing Resources • ISAC − ISAC

Conclusion § An Incentive System for Sharing Distributed Computing Resources • ISAC − ISAC Network − ISAC Agent − ISAC Coin • Incentive Model − Usage-Based Pricing − Time-Dependent Pricing − Auction-Based Pricing • Less cost for clients & Create profit for providers § Future work • • Refinement of extension Detailed incentive model Build a more complete implementation Security issue 39/41

Q&A 40/41

Q&A 40/41

References 41/41

References 41/41

References § Fog Computing • https: //www. pubnub. com/blog/moving-the-cloud-to-the-edge-computing § Cryptocurrency • https: //blockgeeks.

References § Fog Computing • https: //www. pubnub. com/blog/moving-the-cloud-to-the-edge-computing § Cryptocurrency • https: //blockgeeks. com/guides/what-is-cryptocurrency § Bit. Torrent • https: //m. blog. naver. com/Post. View. nhn? blog. Id=manhdh&log. No=220038243469&pro xy. Referer=https%3 A%2 F%2 F § Golem • https: //golem. network/doc/Golemwhitepaper. pdf • https: //coinmarketcap. com/currencies/golem-network-tokens/ • http: //cryptotrader. website/what-is-golem-platform-and-introduction-to-golem-gnttoken-price-and-market-trader-exposed/ § Fog. Coin • http: //www. aetherworks. com • https: //fogcoin. io/documents/Fog. Coin-Whitepaper. pdf 42/41

Risk Management § Task Verification Peers Client Tas k Verification Provider Peers § Whitelist

Risk Management § Task Verification Peers Client Tas k Verification Provider Peers § Whitelist & Blacklist WHITELIST Result Provider Client BLACKLIST 43/41

44/41

44/41

§ Global Public Cloud Market Size, 2011 To 2020 Source: Forrester Research, Inc. 45/41

§ Global Public Cloud Market Size, 2011 To 2020 Source: Forrester Research, Inc. 45/41

§ Fog Computing THINGS Source: https: //www. pubnub. com/blog/moving-the-cloud-to-the-edge-computing 46/41

§ Fog Computing THINGS Source: https: //www. pubnub. com/blog/moving-the-cloud-to-the-edge-computing 46/41

§ Fog Computing Mechanism R 4 R 3 T 1 T 2 R 1

§ Fog Computing Mechanism R 4 R 3 T 1 T 2 R 1 R 2 T 3 T 4 R 3 R 4 T 1 T 2 T 3 R 1 R 2 T 1 ~ T 4 : Task R 1 ~ R 4 : Result 47/41

Introduction VS. On-Premise Cloud 48/41

Introduction VS. On-Premise Cloud 48/41

Introduction § The explosion of “Things” connected to the Internet… Source: Cisco. 49/41

Introduction § The explosion of “Things” connected to the Internet… Source: Cisco. 49/41

Introduction § Cryptocurrency Bitcoin Market Cap $275 Billion Ethereum Market Cap $45 Billion Ripple

Introduction § Cryptocurrency Bitcoin Market Cap $275 Billion Ethereum Market Cap $45 Billion Ripple Market Cap $9. 6 Billion Rental Task Mining 50/41

Types of Sharing § Share • To have or use something at the same

Types of Sharing § Share • To have or use something at the same time as someone else: • To divide food, money, goods, etc. and give part of it to someone else: File Sharing Source: https: //dictionary. cambridge. org/ko/%EC%82%AC%EC%A 0%84/%EC%98%81%EC%96%B 4/share Storage Sharing Computing Sharing 51/41

Bit. Torrent § A communication protocol for peer-to-peer file sharing File A Torrent File

Bit. Torrent § A communication protocol for peer-to-peer file sharing File A Torrent File of A Hash value of A Piece 1 Piece 2 Download torrent file of A Peer List Client ad nlo Tracker Server Upl ce 1 e i P oad Dow File A Download Piece 2 Piece 1 Piece 3 Piece 5 Peer 1 (Leecher) Source: https: //m. blog. naver. com/Post. View. nhn? blog. Id=manhdh&log. No=220038243469&proxy. Referer=https%3 A%2 F%2 F Peer 2 (Seeder) Pie ce 1 File A Piece 1 Piece 2 Piece 3 Piece 4 Piece 1 Peer 3 (Leecher) 52/41

Dropbox § One place for all your stuff, wherever you are. Cloud Basic Free

Dropbox § One place for all your stuff, wherever you are. Cloud Basic Free Storage (GB, TB) Charge Plus $9. 99/month Professional $19. 99/month 2 GB 1 TB + Client 53/41

Cloud Computing Providers § The delivery of computing services over the Internet 101011 Code

Cloud Computing Providers § The delivery of computing services over the Internet 101011 Code PC Mobile Cloud Database Charge Service Client Server 54/41