Insight in six dimensions: An approach to visualizing data using Layerscape

1. Insight in six dimensions: An approach to visualizing data using Layerscape Rob Fatland Microsoft Research rob.fatland@microsoft.com Demo 1: http://www.layerscape.org/Content/Index/1024 Demo 2: http://www.layerscape.org/Content/Index/1025 Demo 3: http://www.layerscape.org/Content/Index/1026 This presentation: http://www.layerscape.org/Content/Index/1023

2. Insight in six dimensions: An approach to visualizing data using Layerscape Rob Fatland Microsoft Research rob.fatland@microsoft.com http://layerscape.org

3. AbstractData Deluge versus Visualization and Cyber-Infrastructure Data visualization and cyber-infrastructure (CI) are two important technology pillars in support of data-intensive science, i.e. they are two means of coping with our self-inflicted Data Deluge (DD). With remarks incorporated on the latter (cyber-infrastructure) we discuss here the former: A visualization engine (http://layerscape.org) that leverages consumer-driven graphics capabilities of Personal Computers. This visualization engine is presented from motivating principles as a working implementation that incorporates the following: • Support for time series data • Support for data in 3D, for raster overlays, for geometric rendering, and for marker rendering • Support for modestly large datasets (1,000,000 points) • Support for free-perspective inspection and choreographed storytelling • Cloud service support for data sharing and collaboration • Excel-embedded data preparation/injection into the visualization system • Emphasis on service-oriented data access • No cost to the researcher beyond time to learn: All software and services described are freely available as research tools Our objective is to share Microsoft technology in the context and community of serious earth system science research. We see tremendous value and importance in this field and consequently feel it is a win-win sociological proposition to contribute tools and technologies that could drastically reduce ‘time to insight’ from our increasingly complex and heterogeneous data harvest. The philosophical basis for this thematic work is further elaborated in the online-available book The Fourth Paradigm.

4. Metadata Impact Without adequate care to curate both data and errors we (preservationists) risk simply wasting years of effort. To paraphrase a colleague’s practical example: “I recently discovered a processing issue impacting the latitude and longitude values for [an important global dataset]. The issue impacts the precision in some, but not all cases; for example,  the original spreadsheet might have latitude 53.14301 but now reads 53.14300. The introduced errors are large enough to matter scientifically in some analytical uses of the data. More pressingly, errors arelarge enough to give the involved scientists considerable and justifiably severe angst/distress/heartburn.”

5. Demo 1 of 3 • Towards 6D visualization • Earthquake distributions have 5 dimensions • Data System Web Services and Confederation • MSR Cambridge providesFetchClimate (FC) • Layerscape Excel Add In binds FC to WWT • Navigate to some location • Click the FC Demo button

6. Adoption as Cost plus Benefit • CEES and WordPress-ization • Adoption • Four key exhortation verbs • Offend! • Gossip! • Steal! • Deceive!

7. Demo 2 of 3 • More to the topic of 6D visualization • Combine RS with bio lab with CTD with robots • This includes non-organic nutrient molecules • Can add the DOM grocery store • Part 1: Play the Mundie segment • Part 2: Isopycnal • Part 3: Lagrangian frame

8. CyberInfrastructure • Services • Confederation • Metadata • Executable paper concept • Nightmare of software revision • Research model • Exploratory • Perfunctory • Glass box / Sand box picture

9. Layerscape as Geoscience Vis Engine • Molecular cloud from Mass Spectrometer rendered in 3D • Individual dots represent molecular formulas • Tree with bright dots represents a cohort of related molecules • Time slider is used to draw (reveal) selected trees • Color represents presence of Sulfur, Phosphorous, Nitrogen • Alternative representations permit scientists to explore data in other ways

10. http://layerscape.org: Layerscape on the web

11. Layerscape as Excel Add In

12. Layerscape for Developers

13. Demo 3 of 3 • BGC Data System: Cyberinfrastructure for data longevity • MS vk diagrams and molecular cohorts • Carbon-based organic molecules • CH2 groups • CO2 groups and photodegredation

14. Microsoft (Research and other) Technologies of Interest • http://layerscape.org : Earth science visualization, collaboration, sharing, storytelling • “Worldwide Telescope” is the GPU-driven visualization engine (no cost) • DataUp • Microsoft Academic Search • ChronoZoom • SciScope: http://sciscope.org • Eye On Earth http://eyeonearth.eu • Computational Ecology: Microsoft Research Cambridge • Azure Cloud Services • More Broadly • The Great Game: Data Deluge meets Cyber Infrastructure • Call to action: Offend, gossip, steal, deceive… • We must push one another; acknowledge and address the DD, build CI • Develop opinions and share them: Blog, tweet, bark, trumpet, whatever it takes • Computer scientists want to save the world too; let’s bring them in • Exaggerate the cost/benefit of CI to scientists… some of them will listen and lead • I would like the un-anticipated thing to be the joy of discovery in research. Insight in six dimensions: An approach to visualizing data using Layerscape Rob Fatland Microsoft Research rob.fatland@microsoft.com