1 / 23

Hai Jin Huazhong University of Science and Technology hjin@hust

ChinaGrid Experience with GT4. Hai Jin Huazhong University of Science and Technology hjin@hust.edu.cn. Outline. Overview of ChinaGrid Experiences with GT4 Highly Available Dynamic Infrastructure Execution Management Data Management and Transferring Security Future Works. ChinaGrid.

declan
Download Presentation

Hai Jin Huazhong University of Science and Technology hjin@hust

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ChinaGrid Experience with GT4 Hai Jin Huazhong University of Science and Technology hjin@hust.edu.cn

  2. Outline • Overview of ChinaGrid • Experiences with GT4 • Highly Available Dynamic Infrastructure • Execution Management • Data Management and Transferring • Security • Future Works

  3. ChinaGrid • First phase from 2003 to 2005 • 12 key universities as initiative, 20 key universities now • 15 Tflop/s computing power • 150TB storage • Run 5 domain-specific application grids • Supported by CGSP

  4. SJTU PKU XJTU NEU ZSU SCUT HUST BUAA NUDT SEU Remote Fluid Image education THU dynamics SDU processing grid grid Massive grid information Bioinformatics processing grid grid ChinaGrid Supporting Platform (CGSP) High performance computing environment (campus grid) Layered Infrastructure of ChinaGrid

  5. CGSP Architecture

  6. CGSP Overview GPE VEGA GTK

  7. Data Center (CGSP) Proxy (CGSP) Job Manager (CGSP) Resource-Index (CGSP) JAVA WS Core (WSRF) MDS2 MetaData-Man (CGSP) WorkFlow (CGSP) HyperService (CGSP) C WS Core (WSRF) WS-Index InterDomain (CGSP) RemoteDeploy (CGSP) Portal SDK (CGSP) Topologic (CGSP) HotDeploy (CGSP) Programming Toolkits (CGSP) GT3.9 and CGSP 1.0 GSI New GridFTP Pre-WS GRAM WS-Security RFT WS-GRAM CSF (contribution) CAS RLS Python Bindings (contributed) SimpleCA OGSI-DAI Authz Framework XIO pyGlobus (contributed) Security Data Management Resource Management Information Services WS Core

  8. Goals of Cooperation • ChinaGrid contributions to global grid community • Keep the advanced feature of ChinaGrid • Improve the interoperability widely for whole grid community

  9. Experience with GT4: HAND • HAND: Highly Available dyNamic Deployment Infrastructure • ChinaGrid and Globus started sharing ideas and codes from June 2005 • Hot deploy branch now almost ready for release • CGSP 2.0 release candidates also import certain features from Globus

  10. HAND (1) Container-Level Deployment Service-Level Deployment

  11. Container level deployment advantages Clear workflow Service level deployment advantages Flexible management HAND (2)

  12. More approaches to deploy Better Performance (against Tomcat) HAND (3)

  13. HAND (4) • Achievement • A release candidate for GT 4.2 • A co-authored paper submitted to HPDC’06 • A excellent cooperation and communication channel • Win-win experience on international cooperation

  14. CGSP Container Contribute to Globus Toolkit 4.2

  15. Experience with GT4:Execution Management • Early experience to enhance the BPEL (ActiveBPEL) to WSRF-compatible • Support for JSDL specification • Support multiple schedule in a common framework • WSRF compatible Web service • Hyper Services (Virtual Service) • Composite Services • Legacy application encapsulated in GRS

  16. Job Submitter Submission Monitor Control Workflow Deployment Execution Management (2) Job Manager JMI Workflow Agent Job Queue Monitor/Control Agent Inter-domain Agent State Database Workflow Manager Execution Engine Load Balancer Database General Service Invoker Workflow Invoker JSDL Parser and GRS Invoker BPEL Engine BPEL Engine BPEL Engine Job Executors CGSP Service Container GT4.0.x Java WS Core CGSP GRS Container Apache Axis1.2.xContainer

  17. Applications Storage Resource mass storage heterogeneous other applications mass data intensive widely distributed low access latency CGSP Data Management research limited storage collaboration distributed education Users Experience with GT4:Data Management & Transferring

  18. Application-level Striped Transfer Based on GridFTP protocol Striping algorithm and slice & replica selection algorithm Parallel transfer Graphical User Interfaces A common graphicaltransfer clientwhich can serve as: A GridFTP Client ACGSP Transfer Client A user-level file system viewable through Windows Explorer Remote I/O Dragging and Dropping …. Data Management & Transferring (2)

  19. GT GSI is composed of a set of command-line tools to manage certificates, and a set of Java classes to easily integrate security into our web services. GSI offers programmers the following features Transport-level and message-level security Authentication through X.509 digital certificates Several authorization schemes Credential delegation and single sign-on Different levels of security: container, service, and resource CGSP User certificate at Portal level Username-passwd & Credential (pkcs12) Sys-service & Gen-service Job is executed by cgsp-module with user info including username,group and domain info) Job security is guaranteed by message-level security Support the composite job security cgsp-ac-config.xml Support dynamic security resource properties SecurityContextService SecurityTokenCenter FeedbackService Experience with GT4: Security

  20. Future Works • High dynamicity and autonomy containers • CDDLM, WSDM, WS-ReliableMessage • Complicated deployment policies and infrastructure • WS-Agreement, BPEL4Deployment • ActiveBPEL engine running on GT4 • Interoperable middleware or agents • GRS and GRAM • Information Center and MDS4 • Security

  21. Thanks! Hai JinHuazhong University of Science and TechnologyWuhan, 430074, Chinahjin@hust.edu.cnhttp://grid.hust.edu.cn/hjin/

More Related