1 / 19

Morris Riedel (on behalf of many others that couldn’t attend OGF21)

Building a formal OGF group and Open Discussions (BOF) Grid Visualization and Steering (GridVizSteer) Community Meeting. Morris Riedel (on behalf of many others that couldn’t attend OGF21) Forschungszentrum Jülich (FZJ) / Jülich Supercomputing Centre (JSC). OGF IPR Policies Apply.

hall-sharpe
Download Presentation

Morris Riedel (on behalf of many others that couldn’t attend OGF21)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Building a formal OGF group and Open Discussions (BOF)Grid Visualization and Steering(GridVizSteer) Community Meeting Morris Riedel (on behalf of many others that couldn’t attend OGF21) Forschungszentrum Jülich (FZJ) / Jülich Supercomputing Centre (JSC)

  2. OGF IPR Policies Apply • “I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy.” • Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: • the OGF plenary session, • any OGF working group or portion thereof, • the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, • the ADCOM, or any member thereof on behalf of the ADCOM, • any OGF mailing list, including any group list, or any other list functioning under OGF auspices, • the OGF Editor or the document authoring and review process • Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions. • Excerpt from Appendix B of GFD-C.1: ”Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.” • OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process. 2

  3. Outline 3

  4. Outline • History • Reasons for formal group • Charter Process • New Challenges • Possible Milestones • Ongoing: Firewall Challenges 4

  5. History 5

  6. History • What is the GridVizSteer Community? • A non-formal community around Visualization and application steering within Grids & e-Science Infrastructures • How often we meet? • Pairs meet at confernces/events: e.g. COVS/UNICORE & gLogin • At OGF Visualization/Steering Workshops/Meetings… • … • OGF19: http://www.ogf.org/gf/event_schedule/index.php?id=562http://www.ogf.org/gf/event_schedule/index.php?id=624 • OGF20: http://www.ogf.org/gf/event_schedule/index.php?id=678http://www.ogf.org/gf/event_schedule/index.php?id=782 • OGF21: http://www.ogf.org/gf/event_schedule/index.php?id=893 • Who is involved? • (Among others)… Dieter Kranzlmueller, Helen Wright, Morris Riedel, Andre Merzky, Ray Idaszak, Claudio Silva, Thilo Kielmann, Pascal Kleijer, Stephen Pickles, Martin Turner, Amril Nazir, Wolfgang Frings, Mark Riding, John Brooke, Ken Brodlie, Shantenu Sha, Ian Grimstead, Arihiro Yoshida, … 6

  7. New Challenges 7

  8. New Challenges • Uptake of steering/visualization technologies usage moderate • Challenge: Encourage end-users/make more simpler software • Develop Standards… • Computational Steering towards peta-scale HPC systems • Application steering at large-scale HPC Systems different than current approaches • e.g. 1 master, n worker paradigma harder possible towards 1 Mio CPUs • Talk from Morris about COVS @FZJ: role of steering will change • Huge amount of data from much CPU+Memory, Steering to decrease data size • Automatic instrumentation of scientific code for steering?! • Autonomic Steering in certain areas… • Steering workflows within the code… • … 8

  9. Reasons for Formal Group 9

  10. Reasons for Formal Group (1) • Long history of meetings at OGF… • …, OGF19 Chapel Hill, OGF20 Manchester, OGF21 Seattle,… • Unformal group: No email lists, no place to put documents, no tracker, no formal organizers (e.g. chairs), … • GOAL: Using the OGF infrastructure for groups would be very helpful • European e-Infrastructures in production • There is a demand of these technologies in e-Infrastructures • GEANT + EGEE and DEISA with support from OMII-Europe • Their common middleware’s UNICORE, Globus, gLite, OMII-UK still have no default services for visualization/steering • Even if many research has been undertaken the last years… • GOAL: Make/Identify visualization/steering services ready for production(!!!) 10

  11. Reasons for Formal Group (2) • Lack of steering/visualization standard in Grids • Although followed by SAGA in some part • Still no standard way of instrument code for steering… • GOAL: Support/Find/Improve standards in this area if possible • Exchange more on a peer-2-peer basis instead of a real group character • Even having several workshops still much peer-2-peer collaborations • GOAL: Improve our information exchange and collaboration having a central (neutral) way of doing it: OGF 11

  12. Reasons for Formal Group (3) • Most of us have a longer history in this area • Solving some firewall problems before, data formats, visualization tools, steering apis and libraries, distributed approaches, … • GOAL: Provide guidelines/best practices to the Grid community • Others that I might missed 12

  13. Charter Process 13

  14. Charter Process • Answers to certain questions for groups • Nature of group: Research vs community group • Milestones • Later discussion: Surveys, guidance, and/or visualization/steering standards (To Be discussed later) • Timelines • Discussions: Up to 3 co-chairs… • Morris would volunteer as one (FZJ/JSC: COVS) (if the group accept) • As interoperability group leader within the Distributed Systems and Grid Compting Division of SCJ it’s expected that I will attend the next OGFs.. • Morris proposes Ian Grimstead (OMII-UK:RAVE) as another • Ian is interested but a clear yes must be checked first with funding, etc. • Morris proposes Thomas Prokosch (GUP: gLogin,etc.) as another • Thomas? • Final agreement of co-chairs via emails to our community 14

  15. Possible Milestones 15

  16. Possible Milestones (1) • (1) Survey of available (nearly) production ready systems for scientific Grid visualization and computational steering • (2) Survey of contacts and projects dealing with Grid visualization and computational steering • Identify bi-lateral efforts like CompuSteer Network, etc. • (3) Gap analysis of steering apis/libraries and potentials for an open standard in that area • If identified, e.g. SAGA spin-off ?! Own standard?! 16

  17. Possible Milestones (2) • (4) Contribute working solution demonstrations to GIN, especially for Supercomputing 2007 demos • Use of open standards not necessary, but deployment within e-Infrastructures should exist… • (5) Host Steering workshops at OGF • Train e-Scientists to use our software in their scientific code(40% of attendees of OGF coming out of e-Science Function) • Better align Standards group/software providers/e-Scientists • Added value for e-Scientists: Visualization/Steering of their code • Other Achievements we can do? • Ideas? • TBD: Ask our community via email 17

  18. Ongoing: Firewall Challenges 18

  19. Ongoing: Firewall Challenges • Ian Grimstead, RAVE of OMII-UK, Mid 2008 release • RAVE (Resource Aware Visualization Environment) • http://users.cs.cf.ac.uk/I.J.Grimstead/RAVE/index.html • Firewall issues prevented a few potential user groups from accessing RAVE. • Currently considering the use of image push over the standard web port, to avoid these issues. • Any thoughts on standardising streaming of visualized data (and related interaction) with support for firewalls would be most useful. • There may already be a standard, but I last looked into this around a year ago, and gave up. • Morris Riedel, COVS of UNICORE, End 2007 release • COVS (Collaborative Online Visualization and Steering) • We have similar issues with firewalls • We solved this by using SSH tunnels that were accepted in the past • More recently, however, they unfortunately also shut down SSH ports at servers! 19

More Related