1 / 26

The Federal Big Data Initiative: Where it has been and where it is going

The Federal Big Data Initiative: Where it has been and where it is going. Dr. Brand Niemann Director and Senior Data Scientist Semantic Community http://semanticommunity.info/ http://www.meetup.com/Federal-Big-Data-Working-Group/

eilis
Download Presentation

The Federal Big Data Initiative: Where it has been and where it is going

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. The Federal Big Data Initiative: Where it has been and where it is going Dr. Brand Niemann Director and Senior Data Scientist Semantic Community http://semanticommunity.info/ http://www.meetup.com/Federal-Big-Data-Working-Group/ http://semanticommunity.info/Data_Science/Federal_Big_Data_Working_Group_Meetup August 4, 2014

  2. Keynote and Panel: COM.BigData 2014 http://www.com-geo.org/conferences/2014/prog_keynotes.htm

  3. Abstract • Since the White House announced the Big Data Initiative in 2012, there have been a series of activities for government agencies, academia, and industry to participate in to develop data scientists, perform research, and to develop applications, which this presentation will summarize. • The work of the Federal Big Data Senior Steering Work Group, the NSF Big Data Funding Opportunities, and the Federal Big Data Working Group Meetup will be described and specific examples will be shown. • The roles of the Presidential Digital Government Strategy and Open Data / Open Government Policy, the new Congressional Data Act, and the Open Research Data Policy will be described and specific examples of their implementation will be given. • Attendees should be able to see where they might participate in the Federal Big Data Initiative as a result of attending this presentation.

  4. President Obama Discovers Big Data in 2009 • United States President Barack Obama looks through a telescope during an Astronomy Night event on the South Lawn of the White House on Wednesday, 7 October 2009. • The President and First Lady, Michelle Obama, hosted the star party to mark the International Year of Astronomy (IYA2009), which celebrated the 400th anniversary of Galileo Galilei's first use of a telescope. • The President addressed a group of 150 local school students, and astronauts BuzzAldrin,  Mae Jemison,  John Grunsfeld, and Sally Ride also attended. • The President's science advisor JohnHoldren guided the President in viewing a double star in the constellation Lyra through an 8" diffraction limited Schmidt–Cassegraintelescope Source: http://commons.wikimedia.org/wiki/File:Barack_Obama_looks_through_a_telescope.jpg

  5. Prelude Announcement Semantic Community Source: The Federal Big Data Initiative: Where it has been and where it is going

  6. Semantic Community • The Semantic Community Semantic Data Science Team pioneered a government big data application for the Federal Big Data Senior Steering Work Group called Semantic Medline on the YarcData Graph Appliance in which a massive medical publication data base (PubMed) was converted to a Semantic Web Graph Data Format (RDF) consisting of about 25 billion triples whose complex graph relationships are instantaneously visualized for discovery of diseases and treatments by medical scientists and researchers. • For more details see: • Finding a Needle in a Digital haystack The Opinion Pages, • Gartner on YarcDataUrika, • MEDLINE Solutions Brief, and • Urika Product Brief. • This was one of the first Big Data Publication (PubMed) in a Data Browser (YarcData). • We had done hundreds before that in the Spotfire Web Player for the US EPA, Data.gov, etc. • The Presidential Digital Government Strategy and Open Data / Open Government Policy, the new Congressional Data Act, and the Open Research Data Policy, all essentially require Data Science Data Publications in Data Browsers.

  7. Three Examples in Paper and Examples for 10 Senior Government People Source: Conclusion

  8. You Can Participate • Federal Big Data Senior Steering Work Group: • The Big Data Senior Steering Group (BD SSG) works to facilitate and further the goals of the White House Big Data R&D Initiative. The BD SSG strategic priorities include: Core technologies, Big data infrastructure, Workforce development, and Competitions and challenges. • Primarily government with some non-government invited presentations like Semantic Community. • Faster Administration of Science and Technology Education and Research (FASTER): • FASTER’s goal is to enhance collaboration and accelerate agencies’ adoption of advanced IT capabilities developed by Government-sponsored IT research. FASTER hosts Expedition and Emerging Technology workshops as well as monthly meetings with invited guest speakers to achieve this goal. • Open to public. Get on email list. • NSF Funding for Big Data and Data Science: • Recent Program Solicitation: Critical Techniques and Technologies for Advancing Big Data Science & Engineering (BIGDATA). • The Semantic Community Data Science Team submitted a proposal you can see. • Federal Big Data Working Group Meetup: • Mission Statement, What We Are Doing, and How We Are Doing It. • About 240 members now (government and non-government) with diverse employment and interests. Open to public, just become a member at the web site.

  9. NITRD FASTER FASTER is responding to the Open Government Directive by using the technologies of the Social Data Web (e.g., Linked Open Data and the Semantic Web). Web Site

  10. NSF Funding for Big Data and Data Science Those looking to know more about the NSF BIG DATA Initiative and related programs can search the spreadsheets and Spotfire dashboard to identify projects they might want to partner with in their completions and/or new projects they might want to propose that do not duplicate existing projects. Knowledge Base: NSF Funding for BIG DATA and Data Science

  11. NSF BIG DATA Funding Dashboard Data Publication in Data Browser: Web Player

  12. NSF Grant Proposal Guide and Semantic Community Proposal The NSF Grant Proposal Guide PDF was Converted to MindTouch (Wiki) and Then Used as a Template for the Actual Proposal with Semantically Linked Data! Data Publication in Data Browser: NSF Grant Proposal Guide

  13. NSF FastLane Submittal Sheet https://www.fastlane.nsf.gov/jsp/homepage/proposals.jsp

  14. Federal Big Data Working Group Meetup http://www.meetup.com/Federal-Big-Data-Working-Group/events/186838842/

  15. Agenda:MIT Big Data Initiative: Sam Madden, & Current Elephants: Michael Stonebraker • MIT Big Data with Sam Madden and Tamr with Michael Stonebraker • Background: See ​Workshops on Extremely Large Databases • 6:30 pm Welcome and Introduction • 6:35 pm MIT Big Data Initiative: bigdata@CAIL and the new Intel Science and Technology Center for Big Data, Sam Madden • 7:10 pm Brief Member Introductions • 7:15 pm Alan Wagner, Tamr Demo • 7:3045 pm  Why the current "elephants" are good at nothing, Data Tamer, and data integration issues, Michael Stonebraker • 8:30 p.m. Open Discussion • 8:45 p.m. Networking • 9:00 p.m. Depart • July 7 and August 4: Once a month • Silver Line Spring Hill Metro Station Opens in July?

  16. Mission Statement • Federal: Supports the Federal Big Data Initiative, but not endorsed by the Federal Government or its Agencies; • Big Data: Supports the Federal Digital Government Strategy which is "treating all content as data", so big data = all your content; • Working Group: Data Science Teams composed of Federal Government and Non-Federal Government experts producing big data products (How was the data collected, Where is it stored, and What are the results?); and • Meetup: The world's largest network of local groups to revitalize local community and help people around the world self-organize like MOOCs (Massive Open On-line Classes) being considered by the White House. Co-organizers: Brand Niemann and Kate Goodier

  17. What Are We Doing? • Leadership of the Semantic Data Science Team that produced Semantic Medline running on the Yarc Data Graph Appliance. • Founding and co-organizing of the Federal Big Data Working Group Meetup. • A graduate class prepared for GMU entitled “Practical Data Science for Data Scientists”. • Using the Cross Industry Standard Process for Data Mining (CRISP-DM; Shearer, 2000) to build a Data Science Knowledge Base • Mining of the Data Science and Digital Earth scientific journals the CODATA International Workshop on Big Data for International Scientific Programmes, (June 8-9, in Beijing). • Participation in the Data FAIRport (Findable, Accessible, Interoperable, and Reusable) with “Data Publication in Data Browsers”. • Providing data stories that persuade and presentation materials for public education conferences like the COM.BigDataConference (August 4-6, in Washington, DC).

  18. How Are We Doing It? • Federating Uses Cases: Data Science (Brand Niemann); Environmental and Earth Science (Joan Aron); and Astronomy (Kirk Borne) • Federating Data Publications: Structured Scientific Content (Papers, journals, books, reports, etc.); Data FAIRports (Findable, Accessible, Interoperable); and Reusable Data Stories That Persuade (Claims and Evidence) • Federating Solutions & Technologies: Hand-Crafted by Individuals and Teams (Mary Galvin, STEM); Data Mining Standards and Products (Brand Niemann, Data Publications in Data Browsers); Machine Processing (Fredrik Salvesen, Semantic Data Publications on Yarc Data Graph Appliance); Reading and Reasoning (Kate Goodier and Chuck Rehberg (Semantic Insights on Elsevier Content Text Mining); and Data Curation at Scale (Michael Stonebraker, Tamr on 1000s of Spreadsheets)

  19. Data FAIRPort Final Report, Interview, and Joint Hackathons Started http://datafairport.org/ http://semanticommunity.info/Data_Science/Euretos_BRAIN

  20. Fourth Paradigm and Fourth Question • The Fourth Paradigm of Science (1): • First Paradigm. Observation, descriptions of natural phenomena, and experimentation. • Second Paradigm. Theoretical science such as Newton’s laws of motion and Maxwell’s equations. • Third Paradigm. Simulation and modelling, such as in astronomy. • Fourth Paradigm. Data-intensive science that exploits the large volumes of data in new ways for scientific exploration, such as the International Virtual Observatory Alliance in astronomy. • The Fourth Question of Big Data for Science (2): • How was the data collected? • Where is the data stored? • What are the data results? • Does the data story persuade? Bell G, Hey, T., & Szalay, A. (2009) Beyond the data deluge, Science 323, 6 March 2009, pp. 1297-1298. de Waard, Anita, (2014) About Stories, that Persuade With Data, Federal Big Data Working Group Meetup, 20 May,, 41 slides.

  21. Activities • Mentoring: • White House Energy Datapalooza, May 28 (In process with Alexandra Winkler, Knowledge Cities Graduate Student) • Health Datapalooza V, June 1-3, and HHS Fellowship: • Story and Application for HHS 12-month External Entrepreneur Fellowship for Innovative Design, Development and Linkages of Databases • Big Data for Government, June 16-17: • Keynote from Dr. George Strawn and Presentation by Dr. Tom Rindflesch and Semantic Medline/YarcData Team • Earth Cube All-Hands Meeting, June 24-26: • ESIP Earth Science Analytics (In process with Joan Aron, Global Environmental/Climate Change Scientist) • Keynote and Panel: COM.BigData2014, August 4-6: • You can participate and attend

  22. June 30thMeetup:Continue Data Science Tutorial • Practical Data Science for Data Scientists: • Reading Assignments: • Chapter 15: The Students Speak • We invited the students who took Introduction to Data Science version 1.0 to contribute a chapter to the book. They chose to use their chapter to reflect on the course and describe how they experienced it. • Chapters 16: Next-Generation Data Scientists, Hubris, and Ethics • The best minds of my generation are thinking about how to make people click ads… That sucks. — Jeff Hammerbacher • We’d like to encourage the next-gen data scientists to become problem solvers and question askers, to think deeply about appropriate design and process, and to use data responsibly and make the world better, not worse. • Resources: AmericasDataFestCompetition • Team Homework Exercise: • Study about Graph Databases, Graph Computing, and Semantic Medline • Review Wiki and View Videos: YarcDataVideos (Schizo-7 minutes, Cancer-21 minutes). • Ask Me Questions and Prepare to Ask Questions Next Week

  23. Practical Data Science for Data Scientists Providing On-Line Class With Private Tutoring Class 8 http://semanticommunity.info/Data_Science/Practical_Data_Science_for_Data_Scientists

  24. Follow Ben Shneiderman's 8 Golden Rules of Data Science • Preparation • Choose actionable problems & appropriate theories • Consult domain experts & generalists • Exploration • Examine data in isolation & contexually • Keep cleaning & add related data • Apply visualizations& statistical patterns, clusters, gaps, outliers, missing & uncertain data • Decision • Evaluate your efficacy, refine your theory • Take responsibility, own your failures • World is complex, proceed with humility Source: "8 Golden Rules of Data Science“ http://semanticommunity.info/Data_Science/Ben_Shneiderman

  25. Dr. George Strawn, Director, National Coordination Office/NITRD (USA) • Semantic Community was following the DataFAIRPortprinciple and Force11 Data Citation Preamble even before they existed and using Data Stories to "persuade" readers with the facts because of the influence of Dr. George Strawn, Director, National Coordination Office / NITRD (USA) who said recently at the Data FAIRPort(Findable, Accessible, Interoperable, and Reusable) Conference (see Interview Innovation International):

  26. Data FAIRPort Conference Interview Innovation International • I am an observer from the US federal government and especially interested in this conference given the recent requirement to provide open access to scientific results funded by the US federal government covering both scientific articles as well as the supporting data. • At the highest level, I am hoping that we will develop the technology and the social willingness to work on interoperability of heterogeneous datasets so that we can combine them in novel ways. If we can truly structure scientific data, we will be able to conduct new science. • I would just add that that not only are these technologies ultimately applicable to all science and other scholarly domains, their ultimate value will hopefully be to promote interdisciplinary research. If we can use electronic technology to help us articulate between and among these scientific fields, I think we will create entire new tiers of knowledge.

More Related