DRS 2 Enhancements
Updates - See the October 28 DRS 2 update presentation.
In the fall of 2008, OIS started work on the first major upgrade of the DRS - "DRS 2". This is a multi-year project to enhance all DRS applications, services and documentation. In order to keep these enhancements at a manageable level of work and still keep pace with the ongoing priorities of the University Library Council (ULC), the Digital Content Systems Working Group (DCSWG) and other groups, the enhancements are being conducted a phased way. Each phase has a theme and is scoped to cover a fixed set of enhancements. In addition, each phase includes new or enhanced support for a file format or genre.
The theme of the first phase, DRS 2.1, is “Object Security and Integrity”. It began in October 2008 and is estimated to be completed by June 2010. For more information, please see DRS 2.1 Enhancements.
The theme of the second DRS 2 phase, DRS 2.2,is “Management and Monitoring”. It will focus on improving the search and editing capabilities of the DRS and will include an overhaul of the DRS Web Admin. These enhancements are the DCSWG's highest DRS priorities and are consistent with the DRS Customer Survey 2008 results. In addition, DRS 2.2 will provide improved support for audio in the DRS. For more information, please see DRS 2.2 Enhancements
If you have any questions or comments about DRS enhancements please contact Andrea at OIS: andrea_goethals@harvard.edu.
DRS 2.1 Enhancements
Theme: “Object Security and Integrity”
Start date: October 2008
Estimated end date: June 2010
Releases:
- DRS 2.1.1 (August 2009)
Description:
During 2007 and 2008, the DRS underwent a large-scale upgrade of its storage system. The DRS 2.1 enhancements build on the storage upgrade by shoring up the DRS foundation, especially in operational matters. It ensures that DRS data and metadata are as secure as possible before taking on higher-level enhancements of successive DRS2 phases. The enhancements include changes to the data model, a new approach to metadata and support for new formats.
Goals and enhancements:
- Goal 1: Richer object modeling in the DRS
- Enhancement 1.1 Add object support
- The DRS data model has been modified to include objects. Data model and object documentation will be made available when the new Digital Preservation section of the OIS website is published in August 2009.
- Objects will be supported by Batch Builder and the DRS Loader in a QA environment for testing by depositors in June 2010.
- Enhancement 1.1 Add object support
- Goal 2: Support additional formats in the DRS
- Enhancement 2.1 Add PDF support
- This will be rolled out in 2 phases:
- In August 2009, BatchBuilder was enhanced to support a new genre - PDF batches. See the DRS 2.1.1 release notes and the Batch Builder User Guide for more information.
- In June of 2010, a new Batch Builder that supports document objects composed of PDFs, will be available in a QA environrment for testing by depositors.
- PDF creation guidelines are available at: http://hul.harvard.edu/ois/digpres/docs/OIS_recs_for_pdf.pdf
- Enhancement 2.2: Add opaque object support
- This will be rolled out in 2 phases:
- In August 2009, Batch Builder's container batch genre was enhanced to support opaque containers (any files packaged in ZIP files). See the DRS 2.1.1 release notes and the Batch Builder User Guide for more information.
- In June of 2010, a new Batch Builder that supports opaque objects, will be available in a QA environrment for testing by depositors. These objects can include files in any format.
- Opaque Container creation guidelines are included in the Batch Builder User Guide.
- Goal 3: Reduce chance of data loss or corruption
- Enhancement 3.1: Add virus checking
- New metadata will be added to the DRS to flag files found to be virus-infected.
- OIS is still examining the feasibility and implications of adding virus checking to the DRS Loader.
- Enhancement 3.2: Modify and publish content deletion policy and process
- A new set of deletion requirements has been drafted by OIS and reviewed by the DCSWG and the DCWAG. Three types of deletions will be supported - (1) deletions, (2) suppression from public view and (3) expungements. There will be an automated process for notifying collection managers and library directors when large amounts of deletion acitivity occurred within their owner codes during the previous week.
- The new deletion requirements will be supported by the DRS Web Admin as part of DRS 2.2 work.
- Enhancement 3.1: Add virus checking
- Goal 4: Improve ability to preserve object, file and metadata integrity
- Enhancement 4.1: Modify file integrity monitoring policy and process
- New metadata will be added to the DRS to flag files found to be corrupt.
- OIS has added additional monitoring to the file integrity monitoring process and is currently developing data recovery documentation for use by OIS system administrators.
- Enhancement 4.2: Maintain redundant and recoverable object metadata
- Each object will be accompanied by an object descriptor. These are METS XML files that will store the complete history of the object within the DRS and all the metadata for the object and its files.
- In June of 2010, in a QA environment for developer testing, a new Batch Builder will have the ability to generate object descriptors, and a new DRS loader will be able to ingest them into the DRS.
- Enhancement 4.1: Modify file integrity monitoring policy and process
- Goal 5: Improve, document and publish ability to recover data, and reduce vendor dependence
- Enhancement 5.1: Develop and document file system and tape policy and procedures
- This is covered by enhancement 4.1.
- Enhancement 5.1: Develop and document file system and tape policy and procedures
DRS 2.2 Enhancements
Theme: “Management and Monitoring”
Estimated start date: Winter 2009 (requirements gathering will overlap with DRS 2.1 development)
Estimated end date: June 2011
At a minimum this phase will incorporate the following specific enhancements that have been requested by the DCSWG:
- DRS: Bug # 2 Develop a Batch Update Mechanism
- DRS: Bug # 2181 Expose more metadata for searching in WebAdmin
- DRS: Bug # 2098 Give user choice to rename files back to original names when user gets them from async or web admin
- Batch Builder: Bug #2082 Add Audio Genre to Batch Builder (replace DMART)
- Batch Builder: Bug # 1677 Accept invalid but well-formed MISC files
This phase will also include:
- Redesign of the DRS Web Admin to support better and faster search and editing capabilities, as requested by participants in the 2008 DRS Customer Survey. If you would like to participate in building the functional requirements for the new DRS Web Admin please contact Wendy Gogel at OIS: wendy_gogel@harvard.edu.
- Additional rights and access restriction metadata
- Migration of the DRS files to objects