[[Main Page]] > [[Development roadmap]] > Scalability testing

= Test File Sets =
[http://archivematica.org/downloads/docZips/ Test Documents]

= Test design =

Maximums to test for:
*Max number of SIPS - 10
*Max number of files in SIP - 10,000
*Max size of individual file - 30 GiB
*Max size of SIP - 100 GiB

Baseline amounts:
* number of SIPS - 1
* number of files in SIP - 10
* size of individual file - 1 MiB
* size of SIP - 100 MiB

{| class="wikitable"
|-
! Test
! No. of SIPs
! No. of files in SIP
! Max size of individual file
! Max size of SIP
|-
| 1. Baseline Test
| 1
| 10
| 1 MiB
| 100 MiB
|-
| 2. No. of SIPs
| '''10'''
| 10
| 1 MiB
| 100 MiB
|-
| 3. No. of files
| 1
| '''10,000'''
| 1 MiB
| 100 MiB
|-
| 4. Max file size
| 1
| 10
| '''30 GiB'''
| 100 MiB
|-
| 5. Max SIP size
| 1
| 10
| 1 MiB
| '''100 GiB'''
|-
| ...
|
|
|
|
|}

*Other tests: combination of maximums

= CVA tests =

System setup:

*Bare-metal install, 1 processor
*2 cores
*4GB ram 9 GB swap
*xubuntu

Note: excludes store AIP and upload DIP micro-services except where noted

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
!Test date
!No. transfers/SIPs
!No. files
!Total file size
!Largest file size
!AIP size
!Total time
!Comments
|-
|2011/11/10
|1/1
|1,000
|12.1 GB
|60 MB
|
|
|
*Failed at prepareAIP due to max Bag size: <strike>Issue 785</strike>
*Failed at uploadDIP due to max post size limit in ica-atom (8M).
|-
|2011/11/10
|1/1
|1
|2.7 GB
|2.7 GB
|
|
|Failed at prepareAIP due to max Bag size: <strike>Issue 785</strike>
|-
|2011/11/18
|1/1
|1,000
|12.1 GB
|60 MB
|7.2 GB
|4 hrs 30 mins
|Access normalization only
|-
|2011/12/02
|2/2
|1,998
|13 GB
|21 MB
|
|
|Access normalization only
|-
|2011/12/11
|1/1
|1,000
|6.51 GB
|21 MB
|3.5 GB
|
|Access normalization only
|-
|2011/12/11
|2/2
|1,996
|13.8 GB
|27 MB
|7.2 GB
|
|Access normalization only
|-
|2011/12/13
|3/3
|2,974
|18.6 GB
|20 MB
|10.3 GB
|3 hrs 19 mins
|Access normalization only
|-
|2011/12/14
|4/4
|3,993
|24.6 GB
|22 MB
|13.2 GB
|3 hrs 16 mins
|Access normalization only
|-
|2011/12/15
|4/4
|3,982
|43 GB
|12 MB
|15 GB
|3 hrs 30 mins
|Access normalization only
|-
|2011/12/15
|6/6
|5,113
|34.1 GB
|38 MB
|19.8 GB
|4 hrs 2 mins
|Access normalization only
|-
|2012/01/04
|6/6
|5,845
|42.4 GB
|33 MB
|24 GB
|3 hrs 52 mins
|Access normalization only
|-
|2012/01/05
|3/3
|2,957
|20.9 GB
|45 MB
|13.6 GB
|4 hrs
|Access normalization only
|-
|2012/01/05
|6/6
|'''5,947'''
|33 GB
|52 MB
|19.2 GB
|4 hrs 47 mins
|Access normalization only
|-
|2012/01/12
|6/6
|4,847
|38.5 GB
|58 MB
|23.2 GB
|4 hrs 43 mins
|Access normalization only
|-
|2012/01/13
|6/6
|5,912
|101.6 GB
|175 MB
|63.8 GB
|'''8 hrs 53 mins'''
|Access normalization only
|-
|2012/01/17
|1/1
|1
|1.4 GB
|1.4 GB
|0.6 GB
|25 mins
|Access normalization only
|-
|2012/01/17
|5/5
|23
|19.7 GB
|2.1 GB
|19 GB
|4 hrs 1 min
|Access normalization only
|-
|2012/01/18
|2/2
|2
|3.8 GB
|2.1 GB
|3.7 GB
|1 hr 11 mins
|Access normalization only
|-
|2012/01/20
|6/6
|14
|6.1 GB
|1.3 GB
|5.9 GB
|48 mins
|Access normalization only
|-
|2012/02/07
|5/5
|5
|56.7 GB
|'''25.4 GB'''
|55.5 GB
|4 hrs 51 mins
|No normalization
|-
|2012/02/08
|5/5
|10
|'''124.4 GB'''
|23.8 GB
|'''122.2 GB'''
|8 hrs 21 mins
|No normalization
|-
|2012/02/20
|1/1
|1,261
|11.9 GB
|largest file size
|AIP size
|total time
|
comments
|-
|}
</br>

= Old test findings =

Findings when running a 2,000 and 10,000 object sip through (May 2011):
* the dashboard would lose contact with the MCP intermittently this maybe fixed with more cores in a processor
* transcoder extract packages was producing ALOT of log, causing the logs to rotate every few seconds. Is a less verbose log possible, with option for debug mode?
* Sanitize (/usr/lib/sanitizeNames.py) names hung For a very long time, MCPServer and MCPClient seemed fine however. My 2,000 object sip contained ~1,000 objects with spaces in the name, the 10,000 object sip contained ~9,000 objects with spaces in the name. On both the 2,000 object sip and the 10,000 object SIP the processing failed to complete.

Transfer and SIP creation

2011-10-19T18:19:44Z

CCM:

Visual Basic Scripting file

2010-01-28T23:18:16Z

CCM: /* Format registry */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Visual Basic Scripting file

===Also known as===
* C Source Code
* Microsoft Active Scripting language
* VBScript

===File extension(s)===
.vbs

===Format registry===
Not part of PRONOM

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

__NOTOC__

Python script file

2010-01-28T23:17:38Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Python script file

===Also known as===

===File extension(s)===

*.py

===Format registry information===
Not part of PRONOM

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Perl script

2010-01-28T23:17:22Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Perl script

===Also known as===

===File extension(s)===

*.pl

===Format registry information===
Not part of PRONOM

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Command Source Code

2010-01-28T23:16:45Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Command source code

===Also known as===

===File extension(s)===

*.cmd

===Format registry information===
Not part of PRONOM

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Advanced Stream Redirector file

2010-01-28T23:16:01Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Advance Stream Redirector file

===Also known as===

Microsoft ASX Playlist

===File extension(s)===

*.asx

===Format registry information===
Not part of PRONOM

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

GNU zip file

2010-01-28T23:14:28Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > GNU Zip file

===Also known as===
*GZIP file

===File extension(s)===

*.gz

===Format registry information===[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=386 PRONOM]

===Significant properties===

===Preservation action plan===
*The archive is un-compressed and the resulting file is processed as normal using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Extensible Stylesheet Language

2010-01-28T23:13:52Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Extensible Stylesheet Language

===Also known as===

===File extension(s)===

*.xsl

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=430 PRONOM]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Extensible Markup Language

2010-01-28T23:13:12Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Extensible Markup Language

===Also known as===
*XML

===File extension(s)===

*.xml

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=638 PRONOM]

===Significant properties===

===Preservation action plan===
*Stored in native open XML format using [http://xena.sourceforge.net/ Xena]
===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Hypertext Markup Language

2010-01-28T23:11:52Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Hypertext Markup Language

===Also known as===
*HTML

===File extension(s)===

*.html
*.htm

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=642 PRONOM]

===Significant properties===

===Preservation action plan===
*Converted to XHTML using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Microsoft Icon file

2010-01-28T23:11:02Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Microsoft Icon file

===Also known as===
*Icon file format

===File extension(s)===

*.ico

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=805 PRONOM]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Microsoft Icon file

2010-01-28T23:10:49Z

CCM: /* Also known as */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Microsoft Icon file

===Also known as===
*Icon file format

===File extension(s)===

*.ico

===Format registry information===

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Java archive file

2010-01-28T23:09:40Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Java archive file

===Also known as===

===File extension(s)===

*.jar

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=777 PRONOM]

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Real Media Metafile

2010-01-28T23:06:40Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Real Media Metafile

===Also known as===
*Real Audio Metafile

===File extension(s)===

*.ram

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=256 PRONOM]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Real Media Metafile

2010-01-28T23:06:29Z

CCM: /* Also known as */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Real Media Metafile

===Also known as===
*Real Audio Metafile

===File extension(s)===

*.ram

===Format registry information===

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

SQL code

2010-01-28T23:01:12Z

CCM: /* Also known as */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > SQL Code

===Also known as===
*Structured Query Language data

===File extension(s)===

*.sql

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=932 PRONOM]

===Significant properties===

===Preservation action plan===
*Structured Query Language files are processed as plain text wrapped in XML using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

SQL code

2010-01-28T23:00:45Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > SQL Code

===Also known as===

===File extension(s)===

*.sql

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=932 PRONOM]

===Significant properties===

===Preservation action plan===
*Structured Query Language files are processed as plain text wrapped in XML using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Document type definition

2010-01-28T22:52:33Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Document type definition

===Also known as===

===File extension(s)===

*.dtd

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=474 PRONOM]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Comma Separated Values file

2010-01-28T22:51:17Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Comma Separated Values file

===Also known as===

===File extension(s)===

*.csv

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=45 PRONOM]

===Significant properties===

===Preservation action plan===
*Comma and Tab Separated Values-based files are stored as a special case of plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Cascading Stylesheet

2010-01-28T22:50:28Z

CCM: /* Format registry */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Cascading Stylesheet

===Also known as===
CSS

===File extension(s)===
.css

===Format registry===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=316 PRONOM]

===Significant properties===

===Preservation action plan===
*Stored as plain text wrapped in XML using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

__NOTOC__

Batch file

2010-01-28T22:34:39Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Batch file

===Also known as===

*MS-Dos Batch File
*MS-Windows Batch File

===File extension(s)===

*.bat

===Format registry information===
[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=800 PRONOM]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Batch file

2010-01-28T22:32:13Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Batch file

===Also known as===

*MS-Dos Batch File
*MS-Windows Batch File

===File extension(s)===

*.bat

===Format registry information===
[[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=800 Pronom]]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Batch file

2010-01-28T22:31:53Z

CCM: /* Format registry information */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Batch file

===Also known as===

*MS-Dos Batch File
*MS-Windows Batch File

===File extension(s)===

*.bat

===Format registry information===
[[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=800]]

===Significant properties===

===Preservation action plan===

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Python script file

2010-01-28T21:41:40Z

CCM: /* Preservation action plan */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Python script file

===Also known as===

===File extension(s)===

*.py

===Format registry information===

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Perl script

2010-01-28T21:41:20Z

CCM: /* Preservation action plan */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Perl script

===Also known as===

===File extension(s)===

*.pl

===Format registry information===

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Format policies

2010-01-28T21:39:34Z

CCM:

[[Main Page]] > [[Documentation]] > Format-specific preservation plans

Format-specific preservation planning for Archivematica is based on analyses of the [[Significant properties]] of the format.

Normalization is one preservation strategy that can be implemented using Archivematica. Archivematica uses the National Archives of Australia's Xena (XML Electronic Normalising for Archives) software to convert certain file formats to xml-based formats on ingest. A full list of the file types Xena can normalize is available at [http://xena.sourceforge.net/help.php?page=normformats.html http://xena.sourceforge.net/help.php?page=normformats.html].

However, some formats cannot be normalized by Xena. Also, it may be desirable to adopt format-specific preservation plans for certain types of files based on institutional requirements and preferences.

Follow the links below for further discussion of these issues for each file format.

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
|- style="background-color:#cccccc;"
!style="width:20%"|'''Format'''
!style="width:20%"|'''Also known as'''
!style="width:20%"|'''File extension(s)'''
!style="width:20%"|'''Normalization tool'''
|-
|[[Adobe Extensible Metadata Platform]]
|Adobe XMP
|.xmp
|
|-
|[[Adobe Illustrator drawing]]
|Adobe AI
|.ai
|
|-
|[[Advanced Stream Redirector file]]
|Microsoft ASX Playlist
|.asx
|
|-
|[[Batch file]]
|
*MS-DOS batch file
*MS-Windows batch file
|.bat
|
|-
|[[Microsoft Windows Bitmap Image file]]
|
|.bmp
|Xena
|-
|[[Cascading Stylesheet]]
|
|.css
|Xena
|-
|[[Comma Separated Values file]]
|
|.csv
|Xena
|-
|[[Command Source Code]]
|
|.cmd
|
|-
|[[Document type definition]]
|
|.dtd
|
|-
|[[Encapsulated PostScript]]
|
|.eps
|
|-
|[[Extensible Markup Language]]
|
|.xml
|Xena
|-
|[[Extensible Stylesheet Language]]
|
|.xsl
|
|-
|[[GNU zip file]]
|GZIP file
|.gz
|Xena
|-
|[[Graphics Interchange Format]]
|GIF
|.gif
|Xena
|-
|[[Hypertext Markup Language ]]
|
|
*.html
*.htm
|Xena
|-
|[[Microsoft Icon file]]
|
|.ico
|
|-
|[[JavaScript file]]
|
*JavaScript programming files
*JScript files
|.js
|Xena
|-
|[[Java archive file]]
|
|.jar
|Xena
|-
|[[Joint Photographic Experts Group]]
|JPEG
|.jpg
|Xena
|-
|[[Microsoft Excel Workbook]]
|
*Microsoft Excel
*Binary Interchange File Format (BIFF)
|.xls
|Xena
|-
|[[Microsoft Office Word]]
|MS-WORD
|.doc
|Xena
|-
|[[Moving Picture Experts Group file]]
|MPEG
|.mpg
|
|-
|[[Nikon Electronic Format]]
|
*Nikon Image Format
*Nikon Digital SLR Camera Raw Image File
|.nef
|
|-
|[[Perl script]]
|
|.pl
|Xena
|-
|[[Portable Document Format]]
|
|.pdf
|Xena
|-
|[[Portable Network Graphics]]
|
|.png
|Xena
|-
|[[Python script file]]
|
|.py
|Xena
|-
|[[Quicktime (video)]]
|
*MOV
*QT
|.mov
|
|-
|[[Real Media Metafile]]
|
|.ram
|
|-
|[[Rich Text Format]]
|
|.rtf
|Xena
|-
|[[Scalable Vector Graphics]]
|
|.svg
|Xena
|-
|[[Shockwave Flash file]]
|
|.swf
|
|-
|[[SQL code]]
|
|.sql
|Xena
|-
|[[Tagged Image File Format]]
|
|.tiff, .tif
|Xena
|-
|[[Windows Media Player file]]
|
|.wmv
|
|-
|[[Visual Basic Scripting file]]
|
*C Source Code
*Microsoft Active Scripting language
*VBScript
|.vbs
|Xena
|-
|[[ZIP file]]
|Zip archive file
|.zip
|Xena
|-
|}<br />

Format policies

2010-01-28T21:36:53Z

CCM:

[[Main Page]] > [[Documentation]] > Format-specific preservation plans

Format-specific preservation planning for Archivematica is based on analyses of the [[Significant properties]] of the format.

Normalization is one preservation strategy that can be implemented using Archivematica. Archivematica uses the National Archives of Australia's Xena (XML Electronic Normalising for Archives) software to convert certain file formats to xml-based formats on ingest. A full list of the file types Xena can normalize is available at [http://xena.sourceforge.net/help.php?page=normformats.html http://xena.sourceforge.net/help.php?page=normformats.html].

However, some formats cannot be normalized by Xena. Also, it may be desirable to adopt format-specific preservation plans for certain types of files based on institutional requirements and preferences.

Follow the links below for further discussion of these issues for each file format.

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
|- style="background-color:#cccccc;"
!style="width:20%"|'''Format'''
!style="width:20%"|'''Also known as'''
!style="width:20%"|'''File extension(s)'''
!style="width:20%"|'''Normalization tool'''
|-
|[[Adobe Extensible Metadata Platform]]
|Adobe XMP
|.xmp
|
|-
|[[Adobe Illustrator drawing]]
|Adobe AI
|.ai
|
|-
|[[Advanced Stream Redirector file]]
|Microsoft ASX Playlist
|.asx
|
|-
|[[Batch file]]
|
*MS-DOS batch file
*MS-Windows batch file
|.bat
|
|-
|[[Microsoft Windows Bitmap Image file]]
|
|.bmp
|Xena
|-
|[[Cascading Stylesheet]]
|
|.css
|Xena
|-
|[[Comma Separated Values file]]
|
|.csv
|Xena
|-
|[[Command Source Code]]
|
|.cmd
|
|-
|[[Document type definition]]
|
|.dtd
|
|-
|[[Encapsulated PostScript]]
|
|.eps
|
|-
|[[Extensible Markup Language]]
|
|.xml
|Xena
|-
|[[Extensible Stylesheet Language]]
|
|.xsl
|
|-
|[[GNU zip file]]
|GZIP file
|.gz
|Xena
|-
|[[Graphics Interchange Format]]
|GIF
|.gif
|Xena
|-
|[[Hypertext Markup Language ]]
|
|
*.html
*.htm
|Xena
|-
|[[Microsoft Icon file]]
|
|.ico
|
|-
|[[JavaScript file]]
|
*JavaScript programming files
*JScript files
|.js
|Xena
|-
|[[Java archive file]]
|
|.jar
|Xena
|-
|[[Joint Photographic Experts Group]]
|JPEG
|.jpg
|Xena
|-
|[[Microsoft Excel Workbook]]
|
*Microsoft Excel
*Binary Interchange File Format (BIFF)
|.xls
|Xena
|-
|[[Microsoft Office Word]]
|MS-WORD
|.doc
|Xena
|-
|[[Moving Picture Experts Group file]]
|MPEG
|.mpg
|
|-
|[[Nikon Electronic Format]]
|
*Nikon Image Format
*Nikon Digital SLR Camera Raw Image File
|.nef
|
|-
|[[Perl script]]
|
|.pl
|
|-
|[[Portable Document Format]]
|
|.pdf
|Xena
|-
|[[Portable Network Graphics]]
|
|.png
|Xena
|-
|[[Python script file]]
|
|.py
|
|-
|[[Quicktime (video)]]
|
*MOV
*QT
|.mov
|
|-
|[[Real Media Metafile]]
|
|.ram
|
|-
|[[Rich Text Format]]
|
|.rtf
|Xena
|-
|[[Scalable Vector Graphics]]
|
|.svg
|Xena
|-
|[[Shockwave Flash file]]
|
|.swf
|
|-
|[[SQL code]]
|
|.sql
|Xena
|-
|[[Tagged Image File Format]]
|
|.tiff, .tif
|Xena
|-
|[[Windows Media Player file]]
|
|.wmv
|
|-
|[[Visual Basic Scripting file]]
|
*C Source Code
*Microsoft Active Scripting language
*VBScript
|.vbs
|Xena
|-
|[[ZIP file]]
|Zip archive file
|.zip
|Xena
|-
|}<br />

SQL code

2010-01-28T21:36:29Z

CCM: /* Preservation action plan */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > SQL Code

===Also known as===

===File extension(s)===

*.sql

===Format registry information===

===Significant properties===

===Preservation action plan===
*Structured Query Language files are processed as plain text wrapped in XML using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

Format policies

2010-01-28T21:34:34Z

CCM:

[[Main Page]] > [[Documentation]] > Format-specific preservation plans

Format-specific preservation planning for Archivematica is based on analyses of the [[Significant properties]] of the format.

Normalization is one preservation strategy that can be implemented using Archivematica. Archivematica uses the National Archives of Australia's Xena (XML Electronic Normalising for Archives) software to convert certain file formats to xml-based formats on ingest. A full list of the file types Xena can normalize is available at [http://xena.sourceforge.net/help.php?page=normformats.html http://xena.sourceforge.net/help.php?page=normformats.html].

However, some formats cannot be normalized by Xena. Also, it may be desirable to adopt format-specific preservation plans for certain types of files based on institutional requirements and preferences.

Follow the links below for further discussion of these issues for each file format.

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
|- style="background-color:#cccccc;"
!style="width:20%"|'''Format'''
!style="width:20%"|'''Also known as'''
!style="width:20%"|'''File extension(s)'''
!style="width:20%"|'''Normalization tool'''
|-
|[[Adobe Extensible Metadata Platform]]
|Adobe XMP
|.xmp
|
|-
|[[Adobe Illustrator drawing]]
|Adobe AI
|.ai
|
|-
|[[Advanced Stream Redirector file]]
|Microsoft ASX Playlist
|.asx
|
|-
|[[Batch file]]
|
*MS-DOS batch file
*MS-Windows batch file
|.bat
|
|-
|[[Microsoft Windows Bitmap Image file]]
|
|.bmp
|Xena
|-
|[[Cascading Stylesheet]]
|
|.css
|Xena
|-
|[[Comma Separated Values file]]
|
|.csv
|Xena
|-
|[[Command Source Code]]
|
|.cmd
|
|-
|[[Document type definition]]
|
|.dtd
|
|-
|[[Encapsulated PostScript]]
|
|.eps
|
|-
|[[Extensible Markup Language]]
|
|.xml
|Xena
|-
|[[Extensible Stylesheet Language]]
|
|.xsl
|
|-
|[[GNU zip file]]
|GZIP file
|.gz
|Xena
|-
|[[Graphics Interchange Format]]
|GIF
|.gif
|Xena
|-
|[[Hypertext Markup Language ]]
|
|
*.html
*.htm
|Xena
|-
|[[Microsoft Icon file]]
|
|.ico
|
|-
|[[JavaScript file]]
|
*JavaScript programming files
*JScript files
|.js
|Xena
|-
|[[Java archive file]]
|
|.jar
|Xena
|-
|[[Joint Photographic Experts Group]]
|JPEG
|.jpg
|Xena
|-
|[[Microsoft Excel Workbook]]
|
*Microsoft Excel
*Binary Interchange File Format (BIFF)
|.xls
|Xena
|-
|[[Microsoft Office Word]]
|MS-WORD
|.doc
|Xena
|-
|[[Moving Picture Experts Group file]]
|MPEG
|.mpg
|
|-
|[[Nikon Electronic Format]]
|
*Nikon Image Format
*Nikon Digital SLR Camera Raw Image File
|.nef
|
|-
|[[Perl script]]
|
|.pl
|
|-
|[[Portable Document Format]]
|
|.pdf
|Xena
|-
|[[Portable Network Graphics]]
|
|.png
|Xena
|-
|[[Python script file]]
|
|.py
|
|-
|[[Quicktime (video)]]
|
*MOV
*QT
|.mov
|
|-
|[[Real Media Metafile]]
|
|.ram
|
|-
|[[Rich Text Format]]
|
|.rtf
|Xena
|-
|[[Scalable Vector Graphics]]
|
|.svg
|Xena
|-
|[[Shockwave Flash file]]
|
|.swf
|
|-
|[[SQL code]]
|
|.sql
|
|-
|[[Tagged Image File Format]]
|
|.tiff, .tif
|Xena
|-
|[[Windows Media Player file]]
|
|.wmv
|
|-
|[[Visual Basic Scripting file]]
|
*C Source Code
*Microsoft Active Scripting language
*VBScript
|.vbs
|Xena
|-
|[[ZIP file]]
|Zip archive file
|.zip
|Xena
|-
|}<br />

Visual Basic Scripting file

2010-01-28T21:34:11Z

CCM: /* Preservation action plan */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Visual Basic Scripting file

===Also known as===
* C Source Code
* Microsoft Active Scripting language
* VBScript

===File extension(s)===
.vbs

===Format registry===

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===

__NOTOC__

Format policies

2010-01-28T21:28:58Z

CCM:

[[Main Page]] > [[Documentation]] > Format-specific preservation plans

Format-specific preservation planning for Archivematica is based on analyses of the [[Significant properties]] of the format.

Normalization is one preservation strategy that can be implemented using Archivematica. Archivematica uses the National Archives of Australia's Xena (XML Electronic Normalising for Archives) software to convert certain file formats to xml-based formats on ingest. A full list of the file types Xena can normalize is available at [http://xena.sourceforge.net/help.php?page=normformats.html http://xena.sourceforge.net/help.php?page=normformats.html].

However, some formats cannot be normalized by Xena. Also, it may be desirable to adopt format-specific preservation plans for certain types of files based on institutional requirements and preferences.

Follow the links below for further discussion of these issues for each file format.

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
|- style="background-color:#cccccc;"
!style="width:20%"|'''Format'''
!style="width:20%"|'''Also known as'''
!style="width:20%"|'''File extension(s)'''
!style="width:20%"|'''Normalization tool'''
|-
|[[Adobe Extensible Metadata Platform]]
|Adobe XMP
|.xmp
|
|-
|[[Adobe Illustrator drawing]]
|Adobe AI
|.ai
|
|-
|[[Advanced Stream Redirector file]]
|Microsoft ASX Playlist
|.asx
|
|-
|[[Batch file]]
|
*MS-DOS batch file
*MS-Windows batch file
|.bat
|
|-
|[[Microsoft Windows Bitmap Image file]]
|
|.bmp
|Xena
|-
|[[Cascading Stylesheet]]
|
|.css
|Xena
|-
|[[Comma Separated Values file]]
|
|.csv
|Xena
|-
|[[Command Source Code]]
|
|.cmd
|
|-
|[[Document type definition]]
|
|.dtd
|
|-
|[[Encapsulated PostScript]]
|
|.eps
|
|-
|[[Extensible Markup Language]]
|
|.xml
|Xena
|-
|[[Extensible Stylesheet Language]]
|
|.xsl
|
|-
|[[GNU zip file]]
|GZIP file
|.gz
|Xena
|-
|[[Graphics Interchange Format]]
|GIF
|.gif
|Xena
|-
|[[Hypertext Markup Language ]]
|
|
*.html
*.htm
|Xena
|-
|[[Microsoft Icon file]]
|
|.ico
|
|-
|[[JavaScript file]]
|
*JavaScript programming files
*JScript files
|.js
|Xena
|-
|[[Java archive file]]
|
|.jar
|Xena
|-
|[[Joint Photographic Experts Group]]
|JPEG
|.jpg
|Xena
|-
|[[Microsoft Excel Workbook]]
|
*Microsoft Excel
*Binary Interchange File Format (BIFF)
|.xls
|Xena
|-
|[[Microsoft Office Word]]
|MS-WORD
|.doc
|Xena
|-
|[[Moving Picture Experts Group file]]
|MPEG
|.mpg
|
|-
|[[Nikon Electronic Format]]
|
*Nikon Image Format
*Nikon Digital SLR Camera Raw Image File
|.nef
|
|-
|[[Perl script]]
|
|.pl
|
|-
|[[Portable Document Format]]
|
|.pdf
|Xena
|-
|[[Portable Network Graphics]]
|
|.png
|Xena
|-
|[[Python script file]]
|
|.py
|
|-
|[[Quicktime (video)]]
|
*MOV
*QT
|.mov
|
|-
|[[Real Media Metafile]]
|
|.ram
|
|-
|[[Rich Text Format]]
|
|.rtf
|Xena
|-
|[[Scalable Vector Graphics]]
|
|.svg
|Xena
|-
|[[Shockwave Flash file]]
|
|.swf
|
|-
|[[SQL code]]
|
|.sql
|
|-
|[[Tagged Image File Format]]
|
|.tiff, .tif
|Xena
|-
|[[Windows Media Player file]]
|
|.wmv
|
|-
|[[Visual Basic Scripting file]]
|
*C Source Code
*Microsoft Active Scripting language
*VBScript
|.vbs
|
|-
|[[ZIP file]]
|Zip archive file
|.zip
|Xena
|-
|}<br />

Format policies

2010-01-28T21:18:38Z

CCM:

[[Main Page]] > [[Documentation]] > Format-specific preservation plans

Format-specific preservation planning for Archivematica is based on analyses of the [[Significant properties]] of the format.

Normalization is one preservation strategy that can be implemented using Archivematica. Archivematica uses the National Archives of Australia's Xena (XML Electronic Normalising for Archives) software to convert certain file formats to xml-based formats on ingest. A full list of the file types Xena can normalize is available at [http://xena.sourceforge.net/help.php?page=normformats.html http://xena.sourceforge.net/help.php?page=normformats.html].

However, some formats cannot be normalized by Xena. Also, it may be desirable to adopt format-specific preservation plans for certain types of files based on institutional requirements and preferences.

Follow the links below for further discussion of these issues for each file format.

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
|- style="background-color:#cccccc;"
!style="width:20%"|'''Format'''
!style="width:20%"|'''Also known as'''
!style="width:20%"|'''File extension(s)'''
!style="width:20%"|'''Normalization tool'''
|-
|[[Adobe Extensible Metadata Platform]]
|Adobe XMP
|.xmp
|
|-
|[[Adobe Illustrator drawing]]
|Adobe AI
|.ai
|
|-
|[[Advanced Stream Redirector file]]
|Microsoft ASX Playlist
|.asx
|
|-
|[[Batch file]]
|
*MS-DOS batch file
*MS-Windows batch file
|.bat
|
|-
|[[Microsoft Windows Bitmap Image file]]
|
|.bmp
|Xena
|-
|[[Cascading Stylesheet]]
|
|.css
|Xena
|-
|[[Comma Separated Values file]]
|
|.csv
|Xena
|-
|[[Command Source Code]]
|
|.cmd
|
|-
|[[Document type definition]]
|
|.dtd
|
|-
|[[Encapsulated PostScript]]
|
|.eps
|
|-
|[[Extensible Markup Language]]
|
|.xml
|Xena
|-
|[[Extensible Stylesheet Language]]
|
|.xsl
|
|-
|[[GNU zip file]]
|GZIP file
|.gz
|Xena
|-
|[[Graphics Interchange Format]]
|GIF
|.gif
|Xena
|-
|[[Hypertext Markup Language ]]
|
|
*.html
*.htm
|Xena
|-
|[[Microsoft Icon file]]
|
|.ico
|
|-
|[[JavaScript file]]
|
*JavaScript programming files
*JScript files
|.js
|Xena
|-
|[[Java archive file]]
|
|.jar
|Xena
|-
|[[Joint Photographic Experts Group]]
|JPEG
|.jpg
|Xena
|-
|[[Microsoft Excel Workbook]]
|
*Microsoft Excel
*Binary Interchange File Format (BIFF)
|.xls
|Xena
|-
|[[Microsoft Office Word]]
|MS-WORD
|.doc
|Xena
|-
|[[Moving Picture Experts Group file]]
|MPEG
|.mpg
|
|-
|[[Nikon Electronic Format]]
|
*Nikon Image Format
*Nikon Digital SLR Camera Raw Image File
|.nef
|
|-
|[[Perl script]]
|
|.pl
|
|-
|[[Portable Document Format]]
|
|.pdf
|Xena
|-
|[[Portable Network Graphics]]
|
|.png
|Xena
|-
|[[Python script file]]
|
|.py
|
|-
|[[Quicktime (video)]]
|
*MOV
*QT
|.mov
|
|-
|[[Real Media Metafile]]
|
|.ram
|
|-
|[[Rich Text Format]]
|
|.rtf
|Xena
|-
|[[Scalable Vector Graphics]]
|
|.svg
|Xena
|-
|[[Shockwave Flash file]]
|
|.swf
|
|-
|[[SQL code]]
|
|.sql
|
|-
|[[Tagged Image File Format]]
|
|.tiff, .tif
|Xena
|-
|[[Windows Media Player file]]
|
|.wmv
|
|-
|[[Visual Basic Scripting file]]
|
*C Source Code
*Microsoft Active Scripting language
*VBScript
|.vbs
|
|-
|[[ZIP file]]
|Zip archive file
|.zip
|
|-
|}<br />

Format policies

2010-01-28T21:17:20Z

CCM:

[[Main Page]] > [[Documentation]] > Format-specific preservation plans

Format-specific preservation planning for Archivematica is based on analyses of the [[Significant properties]] of the format.

Normalization is one preservation strategy that can be implemented using Archivematica. Archivematica uses the National Archives of Australia's Xena (XML Electronic Normalising for Archives) software to convert certain file formats to xml-based formats on ingest. A full list of the file types Xena can normalize is available at [http://xena.sourceforge.net/help.php?page=normformats.html http://xena.sourceforge.net/help.php?page=normformats.html].

However, some formats cannot be normalized by Xena. Also, it may be desirable to adopt format-specific preservation plans for certain types of files based on institutional requirements and preferences.

Follow the links below for further discussion of these issues for each file format.

{| border="1" cellpadding="10" cellspacing="0" width=90%
|-
|- style="background-color:#cccccc;"
!style="width:20%"|'''Format'''
!style="width:20%"|'''Also known as'''
!style="width:20%"|'''File extension(s)'''
!style="width:20%"|'''Normalization tool'''
|-
|[[Adobe Extensible Metadata Platform]]
|Adobe XMP
|.xmp
|
|-
|[[Adobe Illustrator drawing]]
|Adobe AI
|.ai
|
|-
|[[Advanced Stream Redirector file]]
|Microsoft ASX Playlist
|.asx
|
|-
|[[Batch file]]
|
*MS-DOS batch file
*MS-Windows batch file
|.bat
|
|-
|[[Microsoft Windows Bitmap Image file]]
|
|.bmp
|Xena
|-
|[[Cascading Stylesheet]]
|
|.css
|Xena
|-
|[[Comma Separated Values file]]
|
|.csv
|Xena
|-
|[[Command Source Code]]
|
|.cmd
|
|-
|[[Document type definition]]
|
|.dtd
|
|-
|[[Encapsulated PostScript]]
|
|.eps
|
|-
|[[Extensible Markup Language]]
|
|.xml
|Xena
|-
|[[Extensible Stylesheet Language]]
|
|.xsl
|
|-
|[[GNU zip file]]
|GZIP file
|.gz
|Xena
|-
|[[Graphics Interchange Format]]
|GIF
|.gif
|Xena
|-
|[[Hypertext Markup Language ]]
|
|
*.html
*.htm
|Xena
|-
|[[Microsoft Icon file]]
|
|.ico
|
|-
|[[JavaScript file]]
|
*JavaScript programming files
*JScript files
|.js
|Xena
|-
|[[Java archive file]]
|
|.jar
|Xena
|-
|[[Joint Photographic Experts Group]]
|JPEG
|.jpg
|
|-
|[[Microsoft Excel Workbook]]
|
*Microsoft Excel
*Binary Interchange File Format (BIFF)
|.xls
|Xena
|-
|[[Microsoft Office Word]]
|MS-WORD
|.doc
|Xena
|-
|[[Moving Picture Experts Group file]]
|MPEG
|.mpg
|
|-
|[[Nikon Electronic Format]]
|
*Nikon Image Format
*Nikon Digital SLR Camera Raw Image File
|.nef
|
|-
|[[Perl script]]
|
|.pl
|
|-
|[[Portable Document Format]]
|
|.pdf
|Xena
|-
|[[Portable Network Graphics]]
|
|.png
|Xena
|-
|[[Python script file]]
|
|.py
|
|-
|[[Quicktime (video)]]
|
*MOV
*QT
|.mov
|
|-
|[[Real Media Metafile]]
|
|.ram
|
|-
|[[Rich Text Format]]
|
|.rtf
|Xena
|-
|[[Scalable Vector Graphics]]
|
|.svg
|Xena
|-
|[[Shockwave Flash file]]
|
|.swf
|
|-
|[[SQL code]]
|
|.sql
|
|-
|[[Tagged Image File Format]]
|
|.tiff, .tif
|Xena
|-
|[[Windows Media Player file]]
|
|.wmv
|
|-
|[[Visual Basic Scripting file]]
|
*C Source Code
*Microsoft Active Scripting language
*VBScript
|.vbs
|
|-
|[[ZIP file]]
|Zip archive file
|.zip
|
|-
|}<br />

Java archive file

2010-01-28T21:16:33Z

CCM: /* Preservation action plan */

[[Main Page]] > [[Documentation]] > [[Format-specific preservation plans]] > Java archive file

===Also known as===

===File extension(s)===

*.jar

===Format registry information===

===Significant properties===

===Preservation action plan===
*All scripting files are stored as plain text using [http://xena.sourceforge.net/ Xena]

===Preservation issues===

===Conversion test results===

===Access format===

===More information===