Difference between revisions of "Transfer and SIP creation"

From Archivematica
Jump to navigation Jump to search
 
(29 intermediate revisions by 8 users not shown)
Line 1: Line 1:
 
[[Main Page]] > [[Development]] > [[:Category:Development documentation|Development documentation]] > Transfer and SIP creation
 
[[Main Page]] > [[Development]] > [[:Category:Development documentation|Development documentation]] > Transfer and SIP creation
 +
 +
<div style="padding: 10px 10px; border: 1px solid black; background-color: #F79086;">This page is no longer being maintained and may contain inaccurate information. Please see the [https://www.archivematica.org/docs/latest/ Archivematica documentation] for up-to-date information.</div><p>
 +
 +
[[Category:Feature requirements]]
  
 
= Use Cases =
 
= Use Cases =
* Generic (i.e. unstructured)
+
* Standard (i.e. unstructured)
* Bag
+
* Bag (zipped and unzipped)
 +
* Maildir
 
* TRIM export
 
* TRIM export
* Dspace exports
+
* [[Dspace exports]]
 +
 
 +
= Mockups =
  
= Workflow (Generic Transfer) =
+
1.0 Mockup for Create SIP
 +
 
 +
 
 +
[[File:1.0_CreateSIP.png|1000px|thumb|center|]]
 +
 
 +
= Workflow (Standard Transfer) =
 
In these workflow diagrams, the white ovals are manual steps and the grey ovals are automated steps.
 
In these workflow diagrams, the white ovals are manual steps and the grey ovals are automated steps.
===Transfer===
+
===Transfer and create SIPs===
 +
 
 +
'''0.9 Transfer workflow'''
 +
 
 +
[[File:transferWorkflow0.9.png|680px|thumb|center|]]
 +
[[File:transferWorkflow0.9pt2.png|680px|thumb|center|]]
 +
 
 +
[[Media:transferWorkflow0.9.pdf|transferWorkflow0.9.pdf]]
 +
 
 +
'''0.9 Create SIP workflow'''
 +
 
 +
[[File:createSIPWorkflow0.9.png|680px|thumb|center|]]
 +
[[File:createSIPWorkflow0.9pt2.png|680px|thumb|center|]]
 +
 
 +
[[Media:createSIPWorkflow0.9.pdf]]
 +
 
 +
'''0.8 Transfer workflow'''
 +
 
 
[[File:transfer1.png|680px|thumb|center|]]
 
[[File:transfer1.png|680px|thumb|center|]]
===Create SIPs===
 
[[File:CreateSIPs1.png|680px|thumb|center|]]
 
  
==indexing==
+
====Transfer indexing requirements 0.9 and beyond====
* keyword & pattern matching for privacy/security sensitive information (e.g. social insurance numbers, credit card numbers, 'private', 'confidential')
+
 
 +
* Full text content
 +
* File embedded metadata
 +
* Formats - by folder, by transfer
 +
* Keyword & pattern matching for privacy/security sensitive information (e.g. social insurance numbers/social security numbers, credit card numbers, email addresses security keywords like 'private', 'confidential' - find or generate list)
 +
* list of PDFs that have not been OCR'ed
 +
* list of password protected / encrypted files
 +
* duplicates with their file paths
 +
 
 +
Reports for these indexing requirements will be available via the Examine Contents windows, accessible from the Create SIP browser window in the Ingest tab
  
==file visualizations==
+
= Examine contents splash page =  
* (sub)directory size
 
* Should we move file format identification forward in the pipeline? To offer visualizations on:
 
**file extension
 
**(from FITS report): DROID identification, JHOVE identification, EXIF identification, etc
 
  
 +
[[File:1.0_ExamineContents.png|1000px|thumb|center|]]
 +
 +
** information about the transfer or selected file group (number of files, size, name, uuid, accession #, and?)
 +
** pie graph showing file type distribution overall and bargraph showing file type by folder and ordered by size)
 +
***clickable links: file type opens into new tab with file browser interface of all of specified format), folders opens into new tab with file browser interface of entire folder in context of rest of transfer)
 +
** search box to search index (opens in new tab)
 +
** Report options (each opens in new tab):
 +
*** See duplicates with locations
 +
*** See Security keywords, CC numbers, SIN/SS#s, Email addresses (with distribution graph)
 +
*** See password protected files with distribution (graph?)
  
 
===Ingest SIPs===
 
===Ingest SIPs===
 
[[File:ingest.png|680px|thumb|center|]]
 
[[File:ingest.png|680px|thumb|center|]]
 +
 +
= Workflow (DSpace export) =
 +
In these workflow diagrams, the white ovals are manual steps and the grey ovals are automated steps.
 +
 +
===Transfer and create SIPs===
 +
[[File:Dspace1.png|680px|thumb|center|]]
 +
[[File:DSpace2.png|680px|thumb|center|]]
 +
 +
===Ingest SIPs===
 +
[[File:DSpace3.png|680px|thumb|center|]]
  
 
= Dashboard design =
 
= Dashboard design =
Line 32: Line 84:
 
===Click the metadata icon to add transfer metadata===
 
===Click the metadata icon to add transfer metadata===
 
[[File:TransferDashboard2.png|680px|thumb|center|]]
 
[[File:TransferDashboard2.png|680px|thumb|center|]]
===Enter transfer metadata and click "Save"===
+
===Add transfer metadata===
 
[[File:TransferDashboard3.png|680px|thumb|center|]]
 
[[File:TransferDashboard3.png|680px|thumb|center|]]
===Transfer is finished after a virus scan shows no viruses===
+
 
 +
===A completed transfer===
 
[[File:TransferDashboard4.png|680px|thumb|center|]]
 
[[File:TransferDashboard4.png|680px|thumb|center|]]
 +
===File visualization reporting page===
 +
[[File:reports.png|680px|thumb|center|]]
  
 
= Create SIPs using file manager =
 
= Create SIPs using file manager =
Line 42: Line 97:
 
[[File:thunar.png|680px|thumb|center|]]
 
[[File:thunar.png|680px|thumb|center|]]
  
[[Category:Development documentation]]
+
= Add Dublin Core metadata to a SIP during ingest =
 +
*All fields are simple Dublin Core except for Relation: Is Part Of, which is designed to upload the SIP to a pre-existing archival description in the access system.
 +
*Multi-value entries are separated by a backward slash: \.
 +
 
 +
[[File:Ingest1a.png|680px|thumb|center|]]
 +
 
 +
= The dashboard showing a SIP that has completed the ingest process =
 +
 
 +
[[File:Ingest2.png|680px|thumb|center|]]

Latest revision as of 16:28, 11 February 2020

Main Page > Development > Development documentation > Transfer and SIP creation

This page is no longer being maintained and may contain inaccurate information. Please see the Archivematica documentation for up-to-date information.

Use Cases[edit]

  • Standard (i.e. unstructured)
  • Bag (zipped and unzipped)
  • Maildir
  • TRIM export
  • Dspace exports

Mockups[edit]

1.0 Mockup for Create SIP


1.0 CreateSIP.png

Workflow (Standard Transfer)[edit]

In these workflow diagrams, the white ovals are manual steps and the grey ovals are automated steps.

Transfer and create SIPs[edit]

0.9 Transfer workflow

TransferWorkflow0.9.png
TransferWorkflow0.9pt2.png

transferWorkflow0.9.pdf

0.9 Create SIP workflow

CreateSIPWorkflow0.9.png
CreateSIPWorkflow0.9pt2.png

Media:createSIPWorkflow0.9.pdf

0.8 Transfer workflow

Transfer1.png

Transfer indexing requirements 0.9 and beyond[edit]

  • Full text content
  • File embedded metadata
  • Formats - by folder, by transfer
  • Keyword & pattern matching for privacy/security sensitive information (e.g. social insurance numbers/social security numbers, credit card numbers, email addresses security keywords like 'private', 'confidential' - find or generate list)
  • list of PDFs that have not been OCR'ed
  • list of password protected / encrypted files
  • duplicates with their file paths

Reports for these indexing requirements will be available via the Examine Contents windows, accessible from the Create SIP browser window in the Ingest tab

Examine contents splash page[edit]

1.0 ExamineContents.png
    • information about the transfer or selected file group (number of files, size, name, uuid, accession #, and?)
    • pie graph showing file type distribution overall and bargraph showing file type by folder and ordered by size)
      • clickable links: file type opens into new tab with file browser interface of all of specified format), folders opens into new tab with file browser interface of entire folder in context of rest of transfer)
    • search box to search index (opens in new tab)
    • Report options (each opens in new tab):
      • See duplicates with locations
      • See Security keywords, CC numbers, SIN/SS#s, Email addresses (with distribution graph)
      • See password protected files with distribution (graph?)

Ingest SIPs[edit]

Ingest.png

Workflow (DSpace export)[edit]

In these workflow diagrams, the white ovals are manual steps and the grey ovals are automated steps.

Transfer and create SIPs[edit]

Dspace1.png
DSpace2.png

Ingest SIPs[edit]

DSpace3.png

Dashboard design[edit]

Dashboard showing list of transfers[edit]

TransferDashboard1.png

Click the metadata icon to add transfer metadata[edit]

TransferDashboard2.png

Add transfer metadata[edit]

TransferDashboard3.png

A completed transfer[edit]

TransferDashboard4.png

File visualization reporting page[edit]

Reports.png

Create SIPs using file manager[edit]

In this mockup, the user has completed a transfer, has created SIP folders in ingestSIP and is preparing to move objects from the completed transfer into the SIP folders.

Thunar.png

Add Dublin Core metadata to a SIP during ingest[edit]

  • All fields are simple Dublin Core except for Relation: Is Part Of, which is designed to upload the SIP to a pre-existing archival description in the access system.
  • Multi-value entries are separated by a backward slash: \.
Ingest1a.png

The dashboard showing a SIP that has completed the ingest process[edit]

Ingest2.png