1 / 14

Andrew Hanushevsky Stanford Linear Accelerator Center

Objectivity/DB 5.2 New Features http://www.slac.stanford.edu/~abh/RD45/ams52.html. Andrew Hanushevsky Stanford Linear Accelerator Center Produced under contract DE-AC03-76SF00515 between Stanford University and the Department of Energy. Active Schema™ Scalable Collections

darby
Download Presentation

Andrew Hanushevsky Stanford Linear Accelerator Center

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Objectivity/DB 5.2 New Featureshttp://www.slac.stanford.edu/~abh/RD45/ams52.html Andrew Hanushevsky Stanford Linear Accelerator Center Produced under contract DE-AC03-76SF00515 between Stanford University and the Department of Energy

  2. Active Schema™ Scalable Collections Event Notification Framework Hot Failover™ Purge Autonomous Partitions DB Version Checking Tool Support of Java JDK 1.2 Object Accessibility Java/C++ Release 5.2 - Contents • Multi-threaded AMS • Open File System (OFS) • 64-bit File Support • Security Framework

  3. Release 5.2 – Programming Enhancements • Active Schema™ • Schema read & evolution of existing classes • Creation of new classes • Fully supports the ODMG 2.0 standard for Schema Interface • Scalable Collections • Persistent language independent collections scalable to >108 of objects • Patterned on JDK 1.2 specifications • Event Notification Framework • Allows Objectivity/DB components to communicate events • Develop applications that provide trigger like semantics • Applications can be automatically notified of changes to specific objects • Built on Visibroker Event Services

  4. Release 5.2 – Manageability Enhancements • Hot Failover™ • Allows DRO to be used with only 2 machines for hot standby capability • Purge Autonomous Partitions • Remove permanently unavailable APs by purging them • DB Version Checking Tool • Enhanced oofile utility • File Type: Federated DB/ Database/Autonomous Partition • Attributes: identifier, system name, journal info, directory info, server info • Architecture: Platform and OS • Compatibility with Objectivity/DB releases • Which upgrade utility to use

  5. Release 5.2 – Java Related Enhancements • Support of Java JDK 1.2 • Objectivity 5.2 Java binding released on Windows/NT, Solaris 2.6, Solaris 7, Alpha, HP-UX 11.00 • Object Accessibility Java / C++ • Java-compatibility classes enable an Objectivity/C++ application to access objects of classes that were added to a federated-database schema by an Objectivity for Java application

  6. Master/Worker thread model Default of eight worker threads Minimum is 1 and maximum is 32 oostartams –numthreads value It really does multi-thread! Release 5.2 - Multi-threaded AMS

  7. Release 5.2 – Objectivity Open File System (OOFS) • Customizable interface between Objectivity/DB and storage • SLAC-Objectivity designed and developed • SLAC has reference version of the oofs • The oofs/ooss layer now dynamically linked via liboofs.so • Optional software application ooams Database Protocol Layer ams Filesystem Logical Layer oofs liboofs.so Filesystem Physical Layer ooss

  8. All components have been compiled with large file support Solaris: -D_LARGEFILE_SOURCE _D_FILE_OFFSET_BITS=64 Tested with up to 60GB files Works fine Release 5.2 – 64-bit File Support

  9. Release 5.2 – Security Framework • Customizable interface between Objectivity/DB and standard security solutions • Designed and developed by SLAC • SLAC will be providing reference solution • Optional software application libseccl.so security ooams Database Protocol Layer ams liboofs.so Filesystem Layer oofs/ooss libseccl.so Security Layer security

  10. Release 5.2 – Other Internal AMS Enhancements • Rewritten for OO multi-threading environment • Use of mutexes minimized • Ability to run multiple servers per host • Static or dynamic selection • Solaris only • Redundant fsync() bypass • Particularly useful with multiple writers • New AMS options for optimization and fewer restrictions • maxusers (number of users per open fd) • nodread now compatible with journal servers • MSS interfaces made non-specific • Any MSS can be explicitly used

  11. Release 5.2 –External AMS Enhancements • Dynamic file system selection for caching • Allows disk cache to be unlimited in size • Substantially improves performance • More heads, more I/O busses, more everything • On-demand migration and purge • Substantially improves disk cache utilization • Decreases time before a completed database is visible for analysis • Additional auto-recovery options • Automatic retry after lack of human intervention

  12. Release 5.2 –Manageability Enhancements • New disk cache management tool: ooss_Xeq • Single interface for disk cache management and administration • ac – audit cache mv – rename file • an – audit name space pf – pin file • cp – copy file rl – relocate file • cr – create file rm – remove file • New high speed secure copy utility: ooss_fget • Used for high speed disk cache population • Supports 3rd party copy and multiple parallel streams • Uses existing ssh infrastructure for authentication • No new infrastructure needed! • New file pinning functions: ooss_pin • Pin or unpin files in the disk cache • By target date or duration plus optional non-use time

  13. Future Enhancements • Interactive control interface to the AMS • Dynamic configuration • Database hyper-copy utility • Copies only modified pages since the last copy operation • Automatic load balancing • Internal file system balancing • External server balancing • Real-time monitoring • AMS, Lock Server, and application • Ability to see the complete picture • SSTP • The secure storage transfer protocol • The secure high performance server-less FTP replacement

  14. Conclusion • Objectivity/DB 5.2 significantly enhanced • AMS works as expected • SLAC has been using 5.2 since late December 1999 • Should be in full production with 5.2 by end of January • Some components are more CPU hungry • Working with Objectivity to identify hot spots and tame them • Lock server has not improved • Working with Objectivity to enhance lock server • Extensive monitoring tools • Scalable lock server • Static lock server partitioning

More Related