1 / 26

WP 5 - Activity

WP 5 - Activity. G.Taffoni, F.Pasian. Activity plan. Knowledge acquisition; Coordination; Suggestions and guidelines; Dissemination. A. Knowledge acquisition. Survey of European/national/campus GRID initiatives Middleware tools analysis; Production status Interactions with EGEE

gamada
Download Presentation

WP 5 - Activity

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. WP 5 - Activity G.Taffoni, F.Pasian

  2. VO DCA Board Meeting – Strasbourg, October 2006 Activity plan • Knowledge acquisition; • Coordination; • Suggestions and guidelines; • Dissemination

  3. VO DCA Board Meeting – Strasbourg, October 2006 A. Knowledge acquisition • Survey of European/national/campus GRID initiatives • Middleware tools analysis; • Production status • Interactions with EGEE • Relations with OGF (aka GGF) standards.

  4. VO DCA Board Meeting – Strasbourg, October 2006 “Wise” analysis • Grid => evolving standards • Grid => de facto standards • Not always a production environment follows the standards! • We shall be careful.

  5. VO DCA Board Meeting – Strasbourg, October 2006 Middleware tools • the “Four Pillars” of Grid: • Auth&auth • Information system • Data management • Job management

  6. VO DCA Board Meeting – Strasbourg, October 2006 Comparison of tools • Authentication and Authorization; • Grid data management: data access for/to DCs; • Grid job management and workflow tools: job access/exchange for DCs.

  7. VO DCA Board Meeting – Strasbourg, October 2006 B. Coordination • Coordination with other WPs in particular WP4: • Common startup in late November ? • Interactions every 3 months (?) • Coordination with VO-Tech • Inputs to / feedback from DS3 • Coordination with IVOA! • Mid-term meeting? Common docs?

  8. VO DCA Board Meeting – Strasbourg, October 2006 C. Suggestions and guidelines • HOWTOs • best practice procedures to access Grid facilities from DCs • Suggestions (e.g.): • Similar/compatible auth&auth procedures ? • Data sharing between DCs and Grid ? • Interoperable workload management systems ?

  9. VO DCA Board Meeting – Strasbourg, October 2006 D. Dissemination • Pervasive knowledge of Grid systems to DCs: • HOWTOs • Single knowledge repository: up-to-date pointers to documents on Grid Initiatives • Workshop • Schools (in coordination with Grid projects)

  10. VO DCA Board Meeting – Strasbourg, October 2006 Knowledge repository • Information on Grid is also distributed ... • Grid info for DCs: • Documentation; • API + CLI; • Examples • Grid info for users • Very complex and time-consuming

  11. VO DCA Board Meeting – Strasbourg, October 2006 Dissemination to Grid • Collections of VObs requirements; • Make Grid initiatives aware of the VObs requirements; • Interoperating is a two way interaction!!!

  12. VO DCA Board Meeting – Strasbourg, October 2006 Preliminary working plan KO Phase 0 Workshop Phase 1 Phase 2 Phase 3 Kick-Off (with WP4? End-Nov?) Phase 0: survey Phase 1: middleware analysis Phase 2: howtos and suggestions (WShop) Phase 3: dissemination

  13. VO DCA Board Meeting – Strasbourg, October 2006 Across phases ... • Ideally, partners should have their own pet application(s) to be integrated with their own campus/national Grid and/or EGEE • This would allow experience-based gathering of information and preparation of howtos and suggestions • WP4 (+ others!) could provide examples • EGEE should have maximum priority

  14. VO DCA Board Meeting – Strasbourg, October 2006 Preliminary working plan KO Integration of applications Phase 0 Workshop Phase 1 Phase 2 Phase 3 Kick-Off (with WP4? End-Nov?) Phase 0: survey Phase 1: middleware analysis (practical!) Phase 2: howtos and suggestions (WShop) Phase 3: dissemination

  15. VO DCA Board Meeting – Strasbourg, October 2006 instrument parameters Planck end-to-end simulations Add foregrounds Add foregrounds reference sky maps Add foregrounds Add foregrounds Generate CMB sky Add foregrounds “Observe” sky with LFI Time-Ordered Data cosmological parameters • Knowledge and detail increase over time, therefore the whole computational chain must be iterated many times Add foregrounds Add foregrounds Data reduction cosmological parameters frequency sky maps component maps Freq. merge Comp. sep. Parameter evaluation C(l) evaluation C(l)

  16. User defines simulation to be performed: parameters are sent to Grid nodes Ideal generated sky is generated and “observed” (TOD); some analysis and mapmaking is performed Maps (ideal, observed skies, map-making residuals) are sent back to user de-striped “observed” sky de-striping residuals map VO DCA Board Meeting – Strasbourg, October 2006 User Node maps maps params params CE CE Node 1 Node k ... WN WN maps, TOD maps, TOD

  17. Standard definition of an application-specific layer • Standard mechanism to run processing software and access data (input and results) VO DCA Board Meeting – Strasbourg, October 2006 (being used for other astro processing tasks, within the Grid.it and DRACO projects)

  18. Full mission simulated on Grid.it and EGEE, at full resolution for LFI (TOD ~ 1.3 TB) – plan to extend to HFI channels (74 total, 5.4 TB of TOD size) Given distribution of computing/storage resources, only limited amounts of storage can be exchanged across the network  TOD are not downloaded from host nodes Some applications (e.g. full-sky convolutions, LSQ map-making) have a memory footprint requiring large centralised RAM  not feasible within a standard Grid environment VO DCA Board Meeting – Strasbourg, October 2006 Planck simulations approved by EGAAP in Nov ’04

  19. VO DCA Board Meeting – Strasbourg, October 2006

  20. VO DCA Board Meeting – Strasbourg, October 2006

  21. VO DCA Board Meeting – Strasbourg, October 2006

  22. VO DCA Board Meeting – Strasbourg, October 2006

  23. VO DCA Board Meeting – Strasbourg, October 2006

  24. VO DCA Board Meeting – Strasbourg, October 2006

  25. VO DCA Board Meeting – Strasbourg, October 2006

  26. VO DCA Board Meeting – Strasbourg, October 2006

More Related