1 / 16

CopperEye Greenwich Overview

CopperEye Greenwich Overview. Company Snapshot. CopperEye Search™ introduced. DataBlade Announced with IBM. CopperEye Greenwich™ introduced. Company Founded. Technology SDK. OEM Agreement. 2000. 2001. 2002. 2003. 2004. 2005. 2006. 2007. Product Focus.

ike
Download Presentation

CopperEye Greenwich Overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CopperEye Greenwich Overview

  2. Company Snapshot CopperEye Search™ introduced DataBlade Announced with IBM CopperEye Greenwich™ introduced Company Founded Technology SDK OEM Agreement 2000 2001 2002 2003 2004 2005 2006 2007 Product Focus Technology Development Oracle Product DataBlade for Informix CopperEye Greenwich TM

  3. Live Archive Problem Domain Transactional Application Live Archive Data Warehouse write read write read write read Workload:mixture of write and read Workload:write intensive, read occasionally Workload: write in bulk, read-intensive • Design Point: • Fast, efficient write with good selective query response • Design Point: • Balanced write and query performance • Design Point: • Fast query performance • Problem Characteristics: • Enormous data volumes • Queries retrieve a small subset of total data • Data may be needed seconds after being written, or years • Easy scalability and low total cost of ownership dominate • Problem Characteristics: • “run the business” types of usage • Combination of active and inactive data • Application performance dominates, with platform and data volumes flexible • Problem Characteristics: • Large data volumes • Lengthy time history • Frequent data aggregation and summary queries • Query performance and platform cost dominate, with data volume a given • Examples: • Track and trace • EU Data Retention • Fraud detection • Lifetime healthcare record • Examples: • Customer relationship management • Enterprise resource planning • Financial systems • Examples: • Strategic planning • Data mining • Performance reporting

  4. CopperEye Indexing is 100x Faster CopperEye Indexing Conventional B-Tree Indexing index query operations index query operations little disk I/O required means good index query performance Index query performance every bit as good as the B-tree = = index maintenance operations index maintenance operations 99% less disk I/O than the B-tree means 100x faster data loading and transaction performance Heavy disk I/O means poor loading and transaction performance = = disk I/O for data operations disk I/O for indexing operations

  5. Live Archiving Value Proposition Database File System Fast Low Cost, Fast AccessCopperEye Patented IP High Cost,Fast Access Data Access Low Cost, Slow Access Slow Low Cost and Complexity High

  6. Architecture – Sun Components ZFS Circa 60% data compression Simple administration Dynamic Volume Growth Solaris 10 (As secure as it gets) Containers – Secure isolation Write-only access for Ingest process Read-only access for Data Retrieval X4500 Dense Storage (48 TB in 4U) 2 Socket AMD Server SQL Query Results Web Server Search Ingest Greenwich™ ZFS Solaris 10 Sun X4500

  7. Architecture – CopperEye Components Search Google-like search to query indexed data Greenwich™ Server 100x faster data ingestion than traditional technologies (e.g. B-Tree indexing) Optimised Selective Query Performance Incredible ingestion & query rates Request Disclosure Web Server Search Ingest Greenwich™ ZFS Solaris 10 Sun X4500

  8. CopperEye performance The X4500 configuration used: 2 x Dual core AMD Opteron processors, model 285 16 GB Memory 48 Hot swappable,3.5” SATA II disks

  9. Hot Standby Solution

  10. Hot Failover Configuration

  11. Customers & Partners

  12. CopperEye Greenwich GREENWICH SERVER Mediation Server Switch Data IP Log Files • Sees flat files as virtual tables • Does not load data • Builds indexes on selected fields • Indexes are also files • Built in ‘stripes’ • No need for maintenance • No reorganisation • No optimisation • Backup can be performed daily • Only new files need be backed up • That day’s data files • That day’s index stripe

  13. CopperEye File Handling ASCII ASN.1 Special Extract Mediation Server Switch Data IP Log Files • Greenwich reads data from • Flat ASCII files • Fixed Length • Delimited • Binary Switch formats • Multi-Record Logs • SMTP • POP3 • VOIP • CAR • Etc • Databases GREENWICH SERVER Cartridges RDBMS

  14. File Indexing process • Files are placed in a particular location • A scheduled process checks that location • If files are found • File is moved to final directory • File type is established (Duration, Event …..) • File is ‘discovered’ by Greenwich • Correct schedule is run to index file • At the end of each day • Index stripe is closed down and compressed GREENWICH SERVER Discovery Data SFTP Scheduled Process Permanent Storage Holding

  15. Information Retrieval ODBC Search IP Log Files Switch Data • Two Main retrieval tools • ODBC • ANSII standard SQL • CopperEye Search • Configurable Search tool GREENWICH SERVER Mediation Server

  16. ODBC Connectivity • Connects non Greenwich solutions to other applications such as • Excel • Business Intelligence Tools • MS Access • Oracle

More Related