Difference between revisions of "CONTENTdm"

From Archivematica
Jump to navigation Jump to search
(Created page with "Main Page > Documentation > User manual > User manual 0.10-beta > CONTENTdm <div class="clearfix"> == General description == Users can upload th...")
 
 
(33 intermediate revisions by 3 users not shown)
Line 1: Line 1:
[[Main Page]] > [[Documentation]] > [[User Manual|User manual]] > [[User manual 0.10-beta]] > CONTENTdm
+
[[Main Page]] > [[Documentation]] > [[User Manual|User manual]] > [[User manual 1.1]] > CONTENTdm
  
 
<div class="clearfix">
 
<div class="clearfix">
Line 5: Line 5:
 
== General description ==
 
== General description ==
  
Users can upload the DIP to CONTENTdm as the access system. Please note the user must create the description in CONTENTdm '''before''' uploading the DIP.  
+
Users can process digital content and then upload the DIP to CONTENTdm as the access system.
 +
To configure Archivematica to upload a DIP to CONTENTdm, see [[Administrator_manual_1.1#CONTENTdm_DIP_upload|Administrator manual - CONTENTdm upload]]. Please note the user must create the target collection in CONTENTdm '''before''' uploading the DIP.  
  
Should you run into an error during this process, please see [[UM error handling|Error handling]].
+
Should you run into an error during this process, please see [[UM error handling 1.1|Error handling]].
  
More information on Archivematica's CONTENTdm integration is available on the Archivematica wiki: see [[ ]].
+
== Transfer and Ingest of Single Items ==
  
== CONTENTdm upload ==
+
=== Controlling the file order and labels in compound items ===
  
An information management tool called AtoM is bundled with Archivematica as a default access system. AtoM supports standards-compliant hierarchical archival description and digital object management. A small amount of sample data has been added to AtoM, including the Vancouver City Clerk fonds ('''figure 1'''). [[Image:qubit-1g.png|600px|right|thumb|'''Figure 1'''   A series description in the Vancouver City Clerk fonds in Qubit]]
+
In order to allow users to display digital files in a specified order in CONTENTdm compound items such as newspapers issues, Archivematica provides the following options:
 +
*Order of files in the structMap will be determined by the alphabetical order of each file's original name
 +
**Numbers will be respected
 +
**Case will be ignored
 +
**If the objects directory has subdirectories, the structMap will sort alphabetically by directory and within each directory
 +
*Each file will be placed in its own div
 +
*If desired, div labels can be applied to files via a csv file entitled ''file_labels.csv'' included in the ''/metadata'' directory of the transfer
 +
**The csv file would consist of two columns: filename and label
 +
**The div labels would map to the title field in the access system
 +
**The div labels would be applied only to original versions of the files, not normalized versions
  
AtoM is the underlying management tool for the archival description tool ICA-AtoM. A user manual for ICA-AtoM which can also be used for AtoM is available at http://ica-atom.org/docs/index.php?title=User_manual.
+
[[File:structMap-09.png|680px|thumb|center|]]
 +
 
 +
</br>
 +
 
 +
=== User-supplied structMaps ===
 +
 
 +
If desired, the user can submit a structMap with a single-item transfer or SIP. This will be useful if the user desires an upload/display order based on logical divisions (for example, book chapters):
 +
*Archivematica will automatically detect the structMap file and use it as the structMap in the AIP METS file. This will be the only structMap in the AIP METS file
 +
*The name of the file must be ''mets_structmap.xml''
 +
*There must be no more than one ''mets_structmap.xml'' file per transfer or SIP
 +
*The structMap TYPE must be specified as either logical or physical
 +
*The structMap file must be placed in the ''/metadata'' folder of the transfer or SIP
 +
*The structMap must cover all the files in the ''/objects'' directory
 +
*All filenames in the ''/objects'' directory must be unique
 +
*If the structMap contains <fptr> elements Archivematica will generate a fileSec in order to create a valid METS file
 +
*Once the fileSec is added, Archivematica will validate the METS file using e.g. xmllint
 +
*Archivematica will apply file UUIDs to the filenames in the <fptr> elements of the structMap when the AIP METS file is generated
 +
*Div labels, if included, will be mapped to title field in CONTENTdm and ICA-AtoM
 +
</br>
 +
 
 +
Sample user-supplied structMap:
 +
 
 +
[[File:mets_structmap1.png|680px|thumb|center|]]
 +
[[File:mets_structmap2.png|680px|thumb|center|]]
 +
 
 +
</br>
 +
 
 +
 
 +
== Transfer and Ingest of Multiple Items ==
 +
 
 +
It is also possible to ingest multiple objects in a single transfer. Like a transfer package that contains a single object, a transfer package containing multiple objects has two directories, “objects” and “metadata”. In the case of simple objects (e.g., single-page items), the “objects” directory contains files, and each of the files corresponds to a simple object. In the case of compound objects (e.g., books consisting of multiple pages), the “objects” directory has a directory for each compound object where all files for the compound item (e.g., pages of a book) are placed. In both cases, the “metadata” directory contains a CSV file that meets the metadata import specifications: [[UM_Transfer_metadata_import_1.1|Metadata import]]. Note that this file must be named ''metadata.csv''. '''Figure 1''' shows the directory structure of a transfer package of compound objects "CDMtest02".
  
To configure Archivematica for uploading the DIP to AtoM, see the [[Administrator_manual_0.9#AtoM_DIP_upload|Administrator manual - AtoM DIP upload]]
 
 
</div>
 
</div>
  
Line 23: Line 62:
  
 
</div>
 
</div>
 +
[[Image:CONTENTdmTransferDirectory.png|600px|center|thumb|'''Figure 1'''  Transfer package directory structure]]
 +
 +
 +
</div>
 +
 +
<div class="clearfix">
 +
 +
</div>
 +
 +
Process the transfer in Archivematica using instructions in the Archivematica User Manual: [[User_manual_1.1|User manual]]. Note that to create a DIP you must select "Normalize for access" or "Normalize for preservation and access" at the normalization step (unless you have included your own access copies in the transfer - see [[UM_digitization_output_1.1|Digitization output]] in the user manual).
 +
 +
=== Metadata field mappings ===
 +
 +
If you are importing multiple items using a ''metadata.csv'' file, Archivematica will look for "custom" (non-Dublin Core) field names in this file that match field names in the target CONTENTdm collection and map the values for those fields to the corresponding fields in CONTENTdm. If there are no custom fields in your ''metadata.csv'' file (that is, all fields match Dublin Core elements), Archivematica will use whatever Dublin Core mappings have been defined in the target CONTENTdm collection to populate the corresponding fields in CONTENTdm.
  
 
== Upload DIP ==
 
== Upload DIP ==
'''Important note''': The user '''must''' create the target description in AtoM (or other access system) before uploading the DIP. The user will need to indicate part of the description's URL or a target collection in order to send the DIP to the appropriate place during DIP upload.
 
  
In this example, we will upload a DIP to the sample description shown in '''figure 1''', above. [[Image:access1g.png|600px|right|thumb|'''Figure 2'''  Select "Upload DIP" in the Actions drop-down menu]]
+
'''Important note''': The user '''must''' create the target collection in CONTENTdm before uploading the DIP. The user will need to indicate a target collection in order to send the DIP to the appropriate place during DIP upload. Also, target collections '''must''' have a field named "AIP UUID", which will be automatically populated with the UUID of the AIP containing the CONTENTdm item. If this field is absent, and the collection has a field mapped to dc.identifier, the AIP's UUID will be added to that field as a "repeated" value (that is, if there is already a value in the field, it will be kept).
  
#In the ingest tab, select "Upload DIP" in the upload DIP Actions drop-down menu ('''figure 2''').
+
To upload a DIP directly from Archivematica to your CONTENTdm collection:
#A dialogue box will appear ('''figure 3''').  
+
 
#*To upload the DIP to the level of description pictured in figure 1, enter the permalink of the description in the dialogue box: ''subject-files-including-council-supporting-documents''
+
# In the Archivematica dashboard at “Upload DIP”, choose the action “Upload DIP to CONTENTdm” from the drop-down menu.
#*Click on "Create intermediate level of description" to create an archival description from the Dublin Core metadata you entered during ingest.  
+
# At “Select target CONTENTdm server”, select your server.  
#**If you chose not to click this box, the digital objects would be uploaded as immediate child levels of the level of description to which the DIP is being uploaded. This might be useful for, for example, a collection of digitized images which was not hierarchically arranged into lower levels of description.
+
# At “Select destination collection”, select your CONTENTdm collection.
#Click the blue "Upload" button.
+
# At "Select upload type (Project Client or direct upload)", select “Direct upload”.
#When the DIP has finished uploading, open the Access tab in the dashboard. This tab shows the AIP and its uploaded DIP. Click on the DIP URL to go to the uploaded DIP in AtoM ('''figure 4''').
+
Also refer to the “CONTENTdm DIP upload” section of the Administrator Manual: [[Administrator_manual_1.0#CONTENTdm_DIP_upload|Administrator manual - CONTENTdm DIP upload]]
#If you are not already logged in to AtoM you will need to log in using the email ''demo@example.com'' and the password ''demo''.
+
 
#You will see an archival description with the metadata you added during ingest, displayed in the context of the level of archival description to which the DIP was uploaded ('''figure 5'''). To view an individual digital object, scroll through the thumbnails on the left of the screen and click on an image.
+
To send a DIP to the project client:
#'''Figure 6''' shows the digital object displayed in Qubit. Clicking on the image will open the uploaded object.
+
 
[[Image:access2g.png|600px|right|thumb|'''Figure 3'''  The Upload DIP dialogue box]]
+
# Follow steps 1-3 above, then at "Select upload type (Project Client or direct upload)", select “Project client".
[[Image:access3g.png|600px|right|thumb|'''Figure 4'''  The Access tab showing AIPs and their uploaded DIPs. Click on a DIP URL to go to the uploaded DIP in Qubit]]
+
# The DIP will be stored in /share/sharedDirectoryStructure/watchedDirectories/uploadedDIPs/CONTENTdm/. The user will need to move the DIP somewhere accessible to the CONTENTdm project client, then unzip it and process using normal CONTENTdm project client workflows.
[[Image:qubit2g.png|600px|right|thumb|'''Figure 5'''  The uploaded DIP: an archival description with digital objects attached as immediate child-level objects]]
 
[[Image:qubit3g.png|600px|right|thumb|'''Figure 6'''  The digital object displayed in Qubit. Clicking on the image will open the uploaded object]]
 
  
 
</div>
 
</div>
Line 49: Line 99:
  
 
</div>
 
</div>
 
== Upload DIP to CONTENTdm ==
 
To configure Archivematica to upload a DIP to CONTENTdm, see [[Administrator_manual_0.9#CONTENTdm_DIP_upload|Administrator manual - CONTENTdm upload]]
 

Latest revision as of 12:12, 2 April 2014

Main Page > Documentation > User manual > User manual 1.1 > CONTENTdm

General description[edit]

Users can process digital content and then upload the DIP to CONTENTdm as the access system. To configure Archivematica to upload a DIP to CONTENTdm, see Administrator manual - CONTENTdm upload. Please note the user must create the target collection in CONTENTdm before uploading the DIP.

Should you run into an error during this process, please see Error handling.

Transfer and Ingest of Single Items[edit]

Controlling the file order and labels in compound items[edit]

In order to allow users to display digital files in a specified order in CONTENTdm compound items such as newspapers issues, Archivematica provides the following options:

  • Order of files in the structMap will be determined by the alphabetical order of each file's original name
    • Numbers will be respected
    • Case will be ignored
    • If the objects directory has subdirectories, the structMap will sort alphabetically by directory and within each directory
  • Each file will be placed in its own div
  • If desired, div labels can be applied to files via a csv file entitled file_labels.csv included in the /metadata directory of the transfer
    • The csv file would consist of two columns: filename and label
    • The div labels would map to the title field in the access system
    • The div labels would be applied only to original versions of the files, not normalized versions
StructMap-09.png


User-supplied structMaps[edit]

If desired, the user can submit a structMap with a single-item transfer or SIP. This will be useful if the user desires an upload/display order based on logical divisions (for example, book chapters):

  • Archivematica will automatically detect the structMap file and use it as the structMap in the AIP METS file. This will be the only structMap in the AIP METS file
  • The name of the file must be mets_structmap.xml
  • There must be no more than one mets_structmap.xml file per transfer or SIP
  • The structMap TYPE must be specified as either logical or physical
  • The structMap file must be placed in the /metadata folder of the transfer or SIP
  • The structMap must cover all the files in the /objects directory
  • All filenames in the /objects directory must be unique
  • If the structMap contains <fptr> elements Archivematica will generate a fileSec in order to create a valid METS file
  • Once the fileSec is added, Archivematica will validate the METS file using e.g. xmllint
  • Archivematica will apply file UUIDs to the filenames in the <fptr> elements of the structMap when the AIP METS file is generated
  • Div labels, if included, will be mapped to title field in CONTENTdm and ICA-AtoM


Sample user-supplied structMap:

Mets structmap1.png
Mets structmap2.png



Transfer and Ingest of Multiple Items[edit]

It is also possible to ingest multiple objects in a single transfer. Like a transfer package that contains a single object, a transfer package containing multiple objects has two directories, “objects” and “metadata”. In the case of simple objects (e.g., single-page items), the “objects” directory contains files, and each of the files corresponds to a simple object. In the case of compound objects (e.g., books consisting of multiple pages), the “objects” directory has a directory for each compound object where all files for the compound item (e.g., pages of a book) are placed. In both cases, the “metadata” directory contains a CSV file that meets the metadata import specifications: Metadata import. Note that this file must be named metadata.csv. Figure 1 shows the directory structure of a transfer package of compound objects "CDMtest02".

Figure 1 Transfer package directory structure


Process the transfer in Archivematica using instructions in the Archivematica User Manual: User manual. Note that to create a DIP you must select "Normalize for access" or "Normalize for preservation and access" at the normalization step (unless you have included your own access copies in the transfer - see Digitization output in the user manual).

Metadata field mappings[edit]

If you are importing multiple items using a metadata.csv file, Archivematica will look for "custom" (non-Dublin Core) field names in this file that match field names in the target CONTENTdm collection and map the values for those fields to the corresponding fields in CONTENTdm. If there are no custom fields in your metadata.csv file (that is, all fields match Dublin Core elements), Archivematica will use whatever Dublin Core mappings have been defined in the target CONTENTdm collection to populate the corresponding fields in CONTENTdm.

Upload DIP[edit]

Important note: The user must create the target collection in CONTENTdm before uploading the DIP. The user will need to indicate a target collection in order to send the DIP to the appropriate place during DIP upload. Also, target collections must have a field named "AIP UUID", which will be automatically populated with the UUID of the AIP containing the CONTENTdm item. If this field is absent, and the collection has a field mapped to dc.identifier, the AIP's UUID will be added to that field as a "repeated" value (that is, if there is already a value in the field, it will be kept).

To upload a DIP directly from Archivematica to your CONTENTdm collection:

  1. In the Archivematica dashboard at “Upload DIP”, choose the action “Upload DIP to CONTENTdm” from the drop-down menu.
  2. At “Select target CONTENTdm server”, select your server.
  3. At “Select destination collection”, select your CONTENTdm collection.
  4. At "Select upload type (Project Client or direct upload)", select “Direct upload”.

Also refer to the “CONTENTdm DIP upload” section of the Administrator Manual: Administrator manual - CONTENTdm DIP upload

To send a DIP to the project client:

  1. Follow steps 1-3 above, then at "Select upload type (Project Client or direct upload)", select “Project client".
  2. The DIP will be stored in /share/sharedDirectoryStructure/watchedDirectories/uploadedDIPs/CONTENTdm/. The user will need to move the DIP somewhere accessible to the CONTENTdm project client, then unzip it and process using normal CONTENTdm project client workflows.