60 likes | 148 Views
BRIITE SEATTLE, 2003. SCIENTIFIC DATA MANAGEMENT WORKING GROUP. NEEDS. MASSIVE DISPARATE DATA SETS IMAGE DATA (CONFOCAL, ETC.) DNA/PROTEIN SEQUENCE GENE EXPRESSION PROTEOMICS (GELS, ICAT, MASS SPEC) STRUCTURE. PROBLEMS. RECAPITULATION OF BOB’S PRESENTATION
E N D
BRIITESEATTLE, 2003 SCIENTIFIC DATA MANAGEMENT WORKING GROUP
NEEDS • MASSIVE DISPARATE DATA SETS IMAGE DATA (CONFOCAL, ETC.) DNA/PROTEIN SEQUENCE GENE EXPRESSION PROTEOMICS (GELS, ICAT, MASS SPEC) STRUCTURE . . .
PROBLEMS RECAPITULATION OF BOB’S PRESENTATION BETTER GRAPH REPRESENTATIONS AND QUERIES RATE OF CHANGE (2 YR LIFESPAN) DO AS LITTLE AS POSSIBLE – NEVER OVERBUILD SAVE ALL BASIC DATA ERRORS UNAVOIDABLE HUMAN INTERPRETATION OF SEMATICS TRANSLATIONAL ERRORS PERVASIVE….. SEMANTICS LACK OF ACCEPTED VOCABULARIES NEVER BE ONE ONTOLOGY EXAMPLES OF ONTOLOGIES DATA INTEGRATION CHALLENGES TECHNICAL INTEGRATION VS. SCIENTIFIC INTEGRATION
WHAT WORKS BUILD AS SMALL, MODULAR AS POSSIBLE – EXPECT IT TO CHANGE USE ESTABLISHED DB DESIGN, DEVELOPMENT, AND QC PRACTICES TO FACILITATE CHANGE XML SCHEMA TO BUILD DB EASY TO MODIFY HANDLES DATA FORMAT CHANGES OVER TIME FACILITATES SHARING DATA BETWEEN INSTITUTION USE OPEN SOURCE
AVAILABLE TO SHARE WARREN KIBBE NOTIS SECURITY MODULES (JAVA, C, COLDFUSION USING ORACLE) SAMPLE TRACKING CORE FACILITY ORDERING SYSTEM TONY PAN DISTRIBUTED METADATA MGMT SYSTEM (WWW.PROJECTMOBIUS.ORG) DISTRIBUTED PROCESS EXECUTION – DATACUTTER (WWW..DATACUTTER.ORG) CLAYTON NAEVE HCNETDAT- A GENE ANNOTATION DATABASE (WWW.STJUDERESEARCH.ORG) SIMS (LIMS, DB, ONLINE ORDERING/TRACKING, ETC.) NAT GOODMAN SBEAMS (RELATIONAL SCHEMA FOR HT LAB DATA) (see WWW.SBEAMS.ORG)
AVAILBLE TO SHARE MICHAEL OCHS AUTOMATED ANNOTATION PIPELINE FUNCTIONAL GENOMICS DATA PIPELINE DISTRIBUTED BLAST (BEOBLAST) – A QUEUEING SYSTEM FLOWLIMS – FLOW CYTOMETRY DATA SYSTEM