Difference between revisions of "UM ingest 1.1"
(Created page with "Main Page > Documentation > User manual > User manual 1.1 > Ingest <div class="clearfix"> == General description == During ingest, digital objec...") |
|||
(10 intermediate revisions by the same user not shown) | |||
Line 7: | Line 7: | ||
During ingest, digital objects are packaged into SIPs and run through several micro-services, including normalization, packaging into an AIP and generation of a DIP. | During ingest, digital objects are packaged into SIPs and run through several micro-services, including normalization, packaging into an AIP and generation of a DIP. | ||
− | If you would like to skip some of the default decision points or make preconfigured choices for your desired workflow, see [[UM_administration_1. | + | If you would like to skip some of the default decision points or make preconfigured choices for your desired workflow, see [[UM_administration_1.1#Processing_configuration|User administration - Processing configuration]] |
− | Should you run into an error during ingest, please see [[UM error handling 1. | + | Should you run into an error during ingest, please see [[UM error handling 1.1|Error handling]]. |
</br> | </br> | ||
Line 15: | Line 15: | ||
== Create SIP == | == Create SIP == | ||
− | #Process transfers as described in [[UM transfer 1. | + | #Process transfers as described in [[UM transfer 1.1|Transfer]]. |
#Click on the Ingest tab.You will get a pop-up warning you that if you wish to add metadata or PREMIS rights you must do it prior to normalization. Dismiss or wait until it disappears. | #Click on the Ingest tab.You will get a pop-up warning you that if you wish to add metadata or PREMIS rights you must do it prior to normalization. Dismiss or wait until it disappears. | ||
− | #The single SIP will move through a number of micro-services. If the user has preconfigured Archivematica to do so, processing will stop at a decision point that allows the user to choose a file identification method to base normalization upon or to choose to use pre-existing data gathered during identification at the transfer stage. Archivematica default is to use pre-existing data. For more about this option, see [[ | + | #The single SIP will move through a number of micro-services. If the user has preconfigured Archivematica to do so, processing will stop at a decision point that allows the user to choose a file identification method to base normalization upon or to choose to use pre-existing data gathered during identification at the transfer stage. Archivematica default is to use pre-existing data. For more about this option, see [[UM_administration_1.1#Processing_configuration|User Administration - Processing configuration]] |
− | # Wait until the SIP reaches "Normalize" and a bell icon appears ('''figure 5'''). [[Image:Normalize1.png|600px| | + | # Wait until the SIP reaches "Normalize" and a bell icon appears ('''figure 5'''). [[Image:Normalize1.png|600px|center|thumb|'''Figure 5''' Normalization micro-service]] |
#To add descriptive metadata, see Add metadata, below. | #To add descriptive metadata, see Add metadata, below. | ||
#To add PREMIS rights information, see Add PREMIS, below. | #To add PREMIS rights information, see Add PREMIS, below. | ||
Line 28: | Line 28: | ||
You must add metadata prior to the normalization step. Any metadata added after normalization will not be included in the AIP package. See [http://www.ica-atom.org/doc/Dublin_Core ICA-AtoM (Qubit) Dublin Core] for information about the Dublin Core elements available. See [http://ica-atom.org/doc/Glossary#Rights_record ICA-AtoM (Qubit) Rights Entity] for information about the rights elements available. | You must add metadata prior to the normalization step. Any metadata added after normalization will not be included in the AIP package. See [http://www.ica-atom.org/doc/Dublin_Core ICA-AtoM (Qubit) Dublin Core] for information about the Dublin Core elements available. See [http://ica-atom.org/doc/Glossary#Rights_record ICA-AtoM (Qubit) Rights Entity] for information about the rights elements available. | ||
− | *'''Remember''', if you are importing lower-level metadata (i.e. metadata to be attached to subdirectories and files within a SIP) see *[[UM Transfer metadata import 1. | + | *'''Remember''', if you are importing lower-level metadata (i.e. metadata to be attached to subdirectories and files within a SIP) see *[[UM Transfer metadata import 1.1|Metadata import]] in the [[UM transfer 1.1|Transfer]] section of this manual. |
− | #Click on the template icon. ('''figure 6''').[[Image:MetadataIcon1.png|600px| | + | #Click on the template icon. ('''figure 6''').[[Image:MetadataIcon1.png|600px|center|thumb|'''Figure 6''' To add metadata, click on the template icon]] |
#This will take you to the SIP detail panel. On the left-hand side, under metadata click Add ('''figure 7''').[[Image:SIPDetailPanel1.png|600px|right|thumb|'''Figure 7''' SIP detail panel]] | #This will take you to the SIP detail panel. On the left-hand side, under metadata click Add ('''figure 7''').[[Image:SIPDetailPanel1.png|600px|right|thumb|'''Figure 7''' SIP detail panel]] | ||
− | #Add metadata as desired ('''figure 8''') and save it by clicking the Create button at the bottom of the screen. Hovering in a field will activate tooltips that define the Dublin Core element and provide a link to [http://dublincore.org/documents/dces/ ISO 15836 Dublin Core Metadata Element Set]. Note that | + | #Add metadata as desired ('''figure 8''') and save it by clicking the Create button at the bottom of the screen. Hovering in a field will activate tooltips that define the Dublin Core element and provide a link to [http://dublincore.org/documents/dces/ ISO 15836 Dublin Core Metadata Element Set]. Note that you can only add metadata at the SIP level when using the template. If you would like to add metadata to a digital object, you will need to do that once the object has been uploaded to your access system. |
+ | #*If you would like to upload your DIP to AtoM as a child of an existing target description, you must add at least a Title in the Dublin Core template prior to normalization. | ||
+ | <br> | ||
+ | [[Image:Metadataform1.png|600px|center|thumb|'''Figure 8''' SIP metadata entry form]] | ||
+ | </br> | ||
#When you click Create, you will see the metadata entry in the list page ('''figure 9'''). To edit it further, click Edit on the right-hand side.To delete it, click Delete. To add more DC metadata, click the Add button below the list. | #When you click Create, you will see the metadata entry in the list page ('''figure 9'''). To edit it further, click Edit on the right-hand side.To delete it, click Delete. To add more DC metadata, click the Add button below the list. | ||
#Return to the ingest tab to continue processing the SIP. | #Return to the ingest tab to continue processing the SIP. | ||
− | [[Image:Metadatalist1.png|600px| | + | [[Image:Metadatalist1.png|600px|center|thumb|'''Figure 9''' SIP metadata list]] |
</br> | </br> | ||
== Add PREMIS rights == | == Add PREMIS rights == | ||
− | |||
− | |||
− | |||
You must add PREMIS rights prior to the normalization step. Any rights added after normalization will not be included in the AIP package or the DIP upload. See [http://www.ica-atom.org/doc/Dublin_Core ICA-AtoM (Qubit) Dublin Core] for information about the PREMIS rights bases and elements available. | You must add PREMIS rights prior to the normalization step. Any rights added after normalization will not be included in the AIP package or the DIP upload. See [http://www.ica-atom.org/doc/Dublin_Core ICA-AtoM (Qubit) Dublin Core] for information about the PREMIS rights bases and elements available. | ||
− | + | *Click on the template icon. ('''figure 6'''). | |
+ | *This will take you to the SIP detail panel. On the left-hand side, under Rights click Add ('''figure 7'''). | ||
+ | <br> | ||
+ | [[Image:CopyrightNext.png|600px|center|thumb|'''Figure 10''' SIP rights template - first page]] | ||
+ | [[Image:RightsPg2AddAct.png|600px|center|thumb|'''Figure 11''' SIP rights template - second page]] | ||
+ | </br> | ||
+ | *Add rights as desired ('''figure 10''') and save it by clicking the Save button at the bottom of the screen, or clicking Next if you are finished and ready to move on to the second page of data entry. Rights entries are made up of two pages of content. To get to the second page to complete data entry, click Next (figure 11). Note that in Archivematica 1.1 you can only add rights at the SIP level. If you would like to add rights to an individual digital object, you will need to do that once the object has been uploaded to your access system. | ||
+ | #When you click Save on the second page, you will be given the option to add another act with its associated grants and/or restrictions. ('''figure 12''') | ||
+ | |||
+ | [[Image:Createnewgrant.png|600px|right|thumb|'''Figure 12''' Repeatable acts in rights template]] | ||
+ | </br> | ||
+ | *If you have finished adding acts, click Done. You will see the rights entry in the list page . To edit it further, click Edit on the right-hand side.('''figure 13''') | ||
+ | <br> | ||
+ | [[Image:T16RightsPanelwRights.png|600px|right|thumb|'''Figure 13''' SIP detail panel with rights]] | ||
+ | </br> | ||
+ | *Return to the ingest tab to continue processing the SIP. | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
</br> | </br> | ||
Line 60: | Line 70: | ||
== Normalize == | == Normalize == | ||
− | Normalizing is the process of converting ingested digital objects to preservation and/or access formats. Note that the original objects are always kept along with their normalized versions. For more information about Archivematica's preservation strategy, go to the [[UM preservation planning 1. | + | Normalizing is the process of converting ingested digital objects to preservation and/or access formats. Note that the original objects are always kept along with their normalized versions. For more information about Archivematica's preservation strategy, go to the [[UM preservation planning 1.1|Preservation Planning]] section of the manual. |
− | [[Image:NormPresAccess1.png|600px| | + | [[Image:NormPresAccess1.png|600px|center|thumb|'''Figure 14''' Selecting a normalization option]] |
</br> | </br> | ||
Line 76: | Line 86: | ||
#You may review the normalization results in a new tab by clicking on Review. ('''figure 17''') If your browser has plug-ins to view a file, you may open it in another tab by clicking on it. If you click on a file and your browser cannot open it, it will download locally so you can view it using the appropriate software on your machine. | #You may review the normalization results in a new tab by clicking on Review. ('''figure 17''') If your browser has plug-ins to view a file, you may open it in another tab by clicking on it. If you click on a file and your browser cannot open it, it will download locally so you can view it using the appropriate software on your machine. | ||
#Approve normalization in the Actions drop-down menu to continue processing the SIP. You may also Reject the SIP or re-do normalization. | #Approve normalization in the Actions drop-down menu to continue processing the SIP. You may also Reject the SIP or re-do normalization. | ||
− | #*If you see errors in normalization, follow the instructions in [[UM_error_handling_1. | + | #*If you see errors in normalization, follow the instructions in [[UM_error_handling_1.1|Error handling]] to learn more about the problem. |
− | [[Image:ReportIcon1.png|600px| | + | <br> |
− | [[Image:ReviewNorm1.png|600px| | + | [[Image:ReportIcon1.png|600px|center|thumb|'''Figure 15''' Click on the report icon to open the normalization report]][[Image:NormReport1.png|600px|center|thumb|'''Figure 16 ''' The normalization report shows what was normalized and what was already in an acceptable preservation or access format]] |
+ | [[Image:ReviewNorm1.png|600px|center|thumb|'''Figure 17 ''' Review normalization results in new tab]] | ||
</br> | </br> | ||
Line 91: | Line 102: | ||
#From the Action dropdown menu, select "Store AIP" to move the AIP into archival storage. You can store an AIP in any number of preconfigured directories. For instructions to configure AIP storage locations, see [[Administrator_manual_1.0#Storage_service|Administrator manual - Storage Service]] | #From the Action dropdown menu, select "Store AIP" to move the AIP into archival storage. You can store an AIP in any number of preconfigured directories. For instructions to configure AIP storage locations, see [[Administrator_manual_1.0#Storage_service|Administrator manual - Storage Service]] | ||
#From the Action dropdown menu, select the AIP storage location from the pre-configured set of options. | #From the Action dropdown menu, select the AIP storage location from the pre-configured set of options. | ||
− | #For information on viewing and managing stored AIPs go to [[UM archival storage 1. | + | #For information on viewing and managing stored AIPs go to [[UM archival storage 1.1|Archival storage]] |
</br> | </br> | ||
== Upload DIP == | == Upload DIP == | ||
− | For information on uploading the DIP, go to [[UM access|Access]]. | + | For information on uploading the DIP, go to [[UM access 1.1|Access]]. |
Latest revision as of 13:24, 29 April 2014
Main Page > Documentation > User manual > User manual 1.1 > Ingest
General description[edit]
During ingest, digital objects are packaged into SIPs and run through several micro-services, including normalization, packaging into an AIP and generation of a DIP.
If you would like to skip some of the default decision points or make preconfigured choices for your desired workflow, see User administration - Processing configuration
Should you run into an error during ingest, please see Error handling.
Create SIP[edit]
- Process transfers as described in Transfer.
- Click on the Ingest tab.You will get a pop-up warning you that if you wish to add metadata or PREMIS rights you must do it prior to normalization. Dismiss or wait until it disappears.
- The single SIP will move through a number of micro-services. If the user has preconfigured Archivematica to do so, processing will stop at a decision point that allows the user to choose a file identification method to base normalization upon or to choose to use pre-existing data gathered during identification at the transfer stage. Archivematica default is to use pre-existing data. For more about this option, see User Administration - Processing configuration
- Wait until the SIP reaches "Normalize" and a bell icon appears (figure 5).
- To add descriptive metadata, see Add metadata, below.
- To add PREMIS rights information, see Add PREMIS, below.
- For selecting a normalization option, see Normalization, below.
Add metadata[edit]
You must add metadata prior to the normalization step. Any metadata added after normalization will not be included in the AIP package. See ICA-AtoM (Qubit) Dublin Core for information about the Dublin Core elements available. See ICA-AtoM (Qubit) Rights Entity for information about the rights elements available.
- Remember, if you are importing lower-level metadata (i.e. metadata to be attached to subdirectories and files within a SIP) see *Metadata import in the Transfer section of this manual.
- Click on the template icon. (figure 6).
- This will take you to the SIP detail panel. On the left-hand side, under metadata click Add (figure 7).
- Add metadata as desired (figure 8) and save it by clicking the Create button at the bottom of the screen. Hovering in a field will activate tooltips that define the Dublin Core element and provide a link to ISO 15836 Dublin Core Metadata Element Set. Note that you can only add metadata at the SIP level when using the template. If you would like to add metadata to a digital object, you will need to do that once the object has been uploaded to your access system.
- If you would like to upload your DIP to AtoM as a child of an existing target description, you must add at least a Title in the Dublin Core template prior to normalization.
- When you click Create, you will see the metadata entry in the list page (figure 9). To edit it further, click Edit on the right-hand side.To delete it, click Delete. To add more DC metadata, click the Add button below the list.
- Return to the ingest tab to continue processing the SIP.
Add PREMIS rights[edit]
You must add PREMIS rights prior to the normalization step. Any rights added after normalization will not be included in the AIP package or the DIP upload. See ICA-AtoM (Qubit) Dublin Core for information about the PREMIS rights bases and elements available.
- Click on the template icon. (figure 6).
- This will take you to the SIP detail panel. On the left-hand side, under Rights click Add (figure 7).
- Add rights as desired (figure 10) and save it by clicking the Save button at the bottom of the screen, or clicking Next if you are finished and ready to move on to the second page of data entry. Rights entries are made up of two pages of content. To get to the second page to complete data entry, click Next (figure 11). Note that in Archivematica 1.1 you can only add rights at the SIP level. If you would like to add rights to an individual digital object, you will need to do that once the object has been uploaded to your access system.
- When you click Save on the second page, you will be given the option to add another act with its associated grants and/or restrictions. (figure 12)
- If you have finished adding acts, click Done. You will see the rights entry in the list page . To edit it further, click Edit on the right-hand side.(figure 13)
- Return to the ingest tab to continue processing the SIP.
Normalize[edit]
Normalizing is the process of converting ingested digital objects to preservation and/or access formats. Note that the original objects are always kept along with their normalized versions. For more information about Archivematica's preservation strategy, go to the Preservation Planning section of the manual.
- At the normalization step, the SIP will appear in the dashboard with a bell icon next to it. Select one of the normalization options from the Actions drop-down menu (figure 14):
- Normalize for preservation and access: creates preservation copies of the objects plus access copies which will be used to generate the DIP.
- Normalize for access: no preservation copies are created. Creates access copies which will be used to generate the DIP.
- Normalize for preservation: creates preservation copies. No access copies are created and no DIP will be generated.
- Do not normalize: no preservation copies are created. No access copies are created and no DIP will be generated.
- You may also Reject SIP at this stage.
- Once normalization is completed you can review the results in the normalization report. Click on the report icon next to the Actions drop-down menu (figure 15).
- The report shows what has been normalized and what is already in an acceptable preservation and access format (figure 16).
- You may review the normalization results in a new tab by clicking on Review. (figure 17) If your browser has plug-ins to view a file, you may open it in another tab by clicking on it. If you click on a file and your browser cannot open it, it will download locally so you can view it using the appropriate software on your machine.
- Approve normalization in the Actions drop-down menu to continue processing the SIP. You may also Reject the SIP or re-do normalization.
- If you see errors in normalization, follow the instructions in Error handling to learn more about the problem.
Store AIP[edit]
- After normalization is approved, the SIP runs through a number of micro-services, including processing of the submission documentation, generation of the METS file, indexing, generation of the DIP and packaging of the AIP.
- When these micro-services are complete, the user can upload DIP and store AIP. (figure 18)
- If desired, review the contents of the AIP in another tab by clicking on Review. More information on Archivematica's AIP structure and the METS/PREMIS file is available on the Archivematica wiki: see AIP structure and METS. You can download the AIP at this stage, as well, by clicking on it.
- From the Action dropdown menu, select "Store AIP" to move the AIP into archival storage. You can store an AIP in any number of preconfigured directories. For instructions to configure AIP storage locations, see Administrator manual - Storage Service
- From the Action dropdown menu, select the AIP storage location from the pre-configured set of options.
- For information on viewing and managing stored AIPs go to Archival storage
Upload DIP[edit]
For information on uploading the DIP, go to Access.