1 / 21

A P2P Distributed Computing Platform: Korea@Home

A P2P Distributed Computing Platform: Korea@Home. 2004.1.28(Wed) C.Y. ‘ Connor ’ Park chan@kisti.re.kr KISTI Supercomputing Center. Overview. Korea@Home ( KatH ) : A Software Platform for Distributed Computing using Volunteer Computer Resources Features Hybrid Peer-to-Peer architecture

Download Presentation

A P2P Distributed Computing Platform: Korea@Home

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. A P2P Distributed Computing Platform:Korea@Home 2004.1.28(Wed) C.Y. ‘Connor’ Park chan@kisti.re.kr KISTI Supercomputing Center

  2. Overview • Korea@Home (KatH) : A Software Platform for Distributed Computing using Volunteer Computer Resources • Features • Hybrid Peer-to-Peer architecture • Secure PKI-based Security and Digital Signature • Web Services with SOAP messaging

  3. Motivation • To take advantage of and stimulate ‘Broadband Network Infrastructure in Korea’ • To meet the growing needs of computing power for applications • Funded by ‘Ministry of Information and Communication (MIC)’

  4. Broadband Network Infrastructure in Korea • Over 10M Broadband network (xDSL, Cable) households (over 70% penetration) – 2002.11 • Over 58.4% of PCs with Pentium3+

  5. Science SETI@Home, climateprediction.net Life Science Folding@Home, FightAIDS@Home Cryptography Distributed.net, RSAttack576 Mathematics Mersenne Prime Search, Pi(x) Project Internet Grub, CycleTrader Financial MoneyBee Games ChessBrain Miscellaneous DALiWorld Similar Projects from http://www.aspenleaf.com/distributed/index.html

  6. Project History • 2002. 4. • MIC launchedthe pilot project ‘Korea@Home’ • Application : Virtual Screening for New Drug Design • 2002. 8. • First pilot production and test • Client/Server Architecture Model • 2002. 12. • Second pilot production and test • 2003. 4. • Regularize the project “P2P Internet-based Distributed Computing Platform Development” • 2003. 9. • Announcement of Hybrid P2P-style Distributed Computing Platform

  7. Cooperation Cooperation Cooperation Architecture Agent Agent Agent Distribution Distribution Internet Distribution Agent Distribution Subscription Job Request Large-scale Application Resource Management

  8. Agent Agent Agent Agent KatH Server Job Distribution • Authentication • Working Specification Request • Is there any job for me to work? • Who has the job data? Internet • Getting data, working, and returning result to server

  9. 2002 Pilot Projects • Application : Virtual Screening for New Drug Design • Client-Server Architecture • An Agent • Receives about 400KB-size file • Executes during 20 minutes per working unit • Returns about 190KB-size file • Total number of working job units : 50,000

  10. Calculating Active Site PMI Calculating Ligand PMI Structure Analysis Virtual Screening Target Protein Chemical DB Share Analysis Clinical Demo Mass-produce New Drug Disease Protein Ligand DB Virtual High-Throughput Screening + + Client 1 + + Client 2 Server + + Looking for Drug Candidate Client 3 Internet

  11. Experimental Results • 1st Test • 1,217 installed agents • 2002.8.22-9.2 • Max 53.5 Gflops / Avg. 31.78 Gflops • 2nd Test • 6,472 installed agents • 2003.2.6-2.14 • Max 644 Gflops / Avg. 470.6 Gflops ※ World Top Rank 124 - 629.7 Gflops: IBM xSeries Cluster Xeon 2.8 GHz - Myrinet/ 192 (from http://www.top500.org, 2003.6)

  12. Intention of Participation Korea@Home Understanding Intention of Providing Resources Providing with Compensation (7.2%) Don’t (2.9%) Don’t Know (33.3%) Well-Understanding (44.9%) Keep up Providing (59.5%) Providing later (30.4%) Understanding roughly (21.8%) • 67.7% of Netizen already know what is Distributed Computing and Korea@Home. • 89.9% of Netizen have intention of providing their PC resources.

  13. 2003 Progresses • P2P data distribution • New Applications • Virtual Screening for New Drug Design • Global Risk Management for financial investment • 3D image rendering • Supplementary plug-in • Remote backup service

  14. Futurework • Make P2P agents more intelligent and cooperative with each other. • A set of APIs for application developers • Fault-tolerance : checkpointing & rollback recovery • IPv6 version • Open-Source (?) • Windows-only  Unix version

  15. Thanks a lot! ^^ chan@kisti.re.kr, http://www.koreaathome.org

  16. Design Goals • Application Developers (Job Requester) • Convenience • They should be able to use easily. • Flexibility • The platform is general enough to be used by various applications. • Correctness • The platform should return correct results.

  17. Design Goals • PC agents (Resource Providers) • Transparency • PC users are not disturbed in their own works. • Reliability • It’s reliable not to make any security and privacy problem. • Reward • There is any kind of compensation, even just in mind.

  18. Design Goals • Platform • Scalability • Performance should be improved according to the growth of agents. • Adaptability • It should put up with the dynamic features of Internet.

  19. Implementation Choices • Web Services • SOAP messaging over https • Request-Response Model • It is Agents’ duty to make most decisions. • PKI-based certification and Digital Signature for files Make server as simple as possible, and Make PC agents more intelligent

  20. Functional Classification • Resource Management • Authentication, Certification • Simple accounting • Scheduling and Job distribution • Job distribution with hybrid P2P style • Result gathering • Client Management • Client authentication • Application preparation to work • Digital signing • Result returning to client

  21. Networking Issues • Network Security • DoS, Spoofing, Sniffing, … • Variable Connection • Dial-up, cable, xDSL, T1/E1, … • IPv6, WiFi, Bluetooth, … • Network Unobtrusiveness • Background/shared communication • Transparency (Firewall/NAT)

More Related