Introduction to the NEEShub

1. Introduction to the NEEShub Ellen M. Rathje University of Texas at Austin NEEScomm IT Development Team

2. Welcome to NEEShub! We’ve got a HUB for that!

3. NEEShub • Project Warehouse: data repository • Collaborate: group space, wish list • Tools and resources: tools, reports • Simulation: info on simulation

4. Contribution Competition

5. My NEEShub page Dashboard for your NEEShub activities Your Groups Your Projects in the Warehouse Your current tools sessions Your contributions to the NEEShub Your Wishes The tools you use most often Your Tickets Your Messages

6. Your NEEShub Spaces There are different levels of sharing and collaboration within NEEShub NEEShub Project Warehouse (private/ public) Group Spaces (restricted) Personal Workspace (private)

7. The Project Warehouse

8. The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data

9. The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data Drawings Mat’l Descriptions Data Descriptions Photos Publications

10. The Project Warehouse • Every project is created with the same structure • This provides consistency between projects and aids in the navigation of project information

11. The Data Model The model governing the organization of data within a project • Project Experiment Trial Repetition • A project represents an entire research project, which consists of a suite of tests and associated simulations • Each test is set up as an individual experiment • Within each experiment there are several trials or separate events for which data is measured • If the same trial is performed more than once, it may have multiple repetitions

12. Data Organization The model governing the organization of data within a project Project NEES-GC: Seismic Risk Mitigation for Port Systems Experiments Pile-Wharf Connection Test Sept 2007 Centrifuge Test of PV Drains Mar 2007 Crane Shake Table Test Nov 2009 Trials Sine1 Sine2 Sine3 Cyclic Load Shake1 Shake2 Repetitions Rep1 Rep1 Rep1 Rep1 Rep1 Rep1

13. Data Organization The model governing the organization of data within a project

14. The Project Warehouse A centralized data repository for managing, sharing, storing, and publishing research data

15. Types of Sensor Data Remember the data within the Project Warehouse is PUBLIC • For each repetition within a trial, there are four data folders that are automatically created • Unprocessed data (data collected by Equipment Site) • Raw voltages, channel names, potentially non-standard formats (e.g., binary files) • Converted data • Measurement units, instrument names • Corrected data • Filtering, baseline corrections, removal of bad data • Derived data • Corrected data plus values derived from measured data ASCII files recommended for all sensor data Put all channels into a single ASCII file

16. Data Requirements Data cannot be shared without proper documentation • Experiment Documentation • Metadata fields within the Project Display • Experimental Setup Report placed in Documentation folder • Sensor Measurement Data • Unprocessed • Converted • Corrected • Derived Uploaded by Researcher within 6 months of experiment Uploaded by Site within 1-month of experiment Uploaded by Researcher within 6 months of experiment Minimum data requirements: sensor data in engineering units!

17. Project Warehouse Tools The nuts and bolts • The Project Editor • Create, edit, and update projects • File uploads through web interface • The Project Explorer for NEES (PEN) • Efficient upload/download for bulk file management • Direct file upload (not a web interface) • Files organized offline and then uploaded • Recommended for large numbers of files • inDEED Data Viewer • Facilitates browsing/viewing/investigating data within Warehouse without download • Use inDEED data file format https://nees.org/tools/indeed/wiki/CSVFileFormat

18. The Project Editor Projects are created using the Project Editor

19. Project Explorer for NEES (PEN1.4) Enhancing bulk upload of files

20. inDEED Data Viewer Facilitating data queries

21. Visualization Tools Specimen Authoring Tool InDEED

22. Enhanced Projects Projects with Data Visualization

23. Enhanced Projects Projects with Data Visualization • Definition of Enhanced • Metadata fields in Project Display are complete (including drawings, material properties) • Project includes at least one visualization of data • inDEED is currently the only visualization tool that allows for viewing data within the NEEShub without download

24. Project Warehouse User Guide One-stop shop for documentation related to project warehouse

25. Group Spaces

26. Group Space An easy way to share content and conversation • Groups can be: • Public, restricted, or private • Purpose • To facilitate conversation, collaboration, and data sharing between group members • Discussions, wiki posts, and files are in one central location available to all group members • Generate a webpage for your project • Features • Wiki, messaging, discussion boards, and file sharing via the dropbox

27. Creating/Finding Groups

28. Project Groups • A group is automatically created for all projects created in the Project Warehouse • Group name has Project in title • Membership is controlled by project team members listed in the Project Editor

29. Group Space/Overview An easy way to share content and conversation About section can be expanded into a web page for your project

30. Group Space/Wiki An easy way to share content and conversation

31. Group Space/Discussion An easy way to share content and conversation

32. Group Space/Data Sharing An easy way to share content and conversation

33. Group Space Tools The nuts and bolts • SynchroNEES • A graphical user interface for transferring files • Local PC to/from NEES Group workspace • Local PC to/from NEES Personal workspace

34. How you can help NEEShub

35. Participate • Contribute tools and resources to share with the community • Submit tickets to get problems/issues resolved • Submit wishes about things you would like to see on the NEEShub • Participate in Usability Study: email e.rathje@mail.utexas.edu to volunteer

36. Participate

37. Contact Information • Cyberinfrastructure Release Committee (CRC) • Chair: Ellen Rathje (e.rathje@mail.utexas.edu) • Members: JoAnn Browning, Juan Caicedo, Shirley Dyke, Rudi Eigenmann, Tom Hacker, Ayhan Irfanoglu, Santiago Pujol • NEEScomm IT Director • Dawn Weisman (dweisman@purdue.edu) • Data Curator • Standa Pejsa (spejsa@purdue.edu)

38. Future NEEShub Boot Camps • Data Upload (January 2012) • Demonstrations of the Project Editor and PEN by graduate students using these tools • High Performance Computing (January 2012) • Demonstrations of accessing Teragrid, OpenScienceGrid for OpenSees and other tools • inDEED /Authoring Tool (February 2012) • Demonstrations of how to generate inDEED visualization files using your data • Getting the most from the hub (March 2012) • Demonstrations of Group Space, Tools, etc

39. Questions