Development roadmap: Archivematica

Main Page > Development > Development roadmap

Archivematica development roadmap

This roadmap describes what Artefactual is working on for the Archivematica system. Sponsored work, that is development of features and enhancements which is funded by our development partners, is prioritized. On our wishlist, we have also included enhancements and features that we would like to see or that the community has shown interest in; however, without development resources allocated to us or contributions from developers outside of Artefactual, we cannot guarantee their inclusion.

Reflecting the bounty business model for open source development, each feature is developed in partnership with an institution or group of institutions with unique workflow needs. Despite our best efforts to keep features as generic as possible, some extra development may be necessary for a feature to function well in your own environment. Please see the Archivematica services offered on Artefactual's website to find out more about how to become a development partner, get training and support, or take advantage of installation services.

We will issue public releases incrementally upon completion and testing of the sponsored features and enhancements listed below. All features are subject to code review and QA, the results of which may result in any feature being pushed to a future release.

Features by release number

Storage Service 0.3.0

Includes backend enhancements and API-level changes only, with no direct user facing changes

• Sponsored (University of Alberta) Dataset preservation
  • Sponsored Add support for AIC's https://github.com/artefactual/archivematica-storage-service/pull/2
• Improved unicode support https://github.com/artefactual/archivematica-storage-service/pull/3
• v2 of internal REST API (the API used by the Dashboard) and update documentation
• Storage Service now supports updating - no longer necessary to reinstall to upgrade https://github.com/artefactual/archivematica-storage-service/pull/6

Archivematica 1.1

• Sponsored (University of Alberta) Dataset preservation
  • Sponsored creation and management of AICs #5802
  • Sponsored AIP pointer file #5159
  • Sponsored pointer file tracks multi-AIP relationships
• Sponsored (University of Alberta) Enhancements to manual normalization workflow
  • Sponsored ability to add PREMIS event detail information for manually normalized files via the dashboard #5216
• Backend/Not user-facing:
  • Improved unicode support https://github.com/artefactual/archivematica/pull/17
  • Better handling of preconfigured choices (processingMCP.xml)
  • More choices in processing archive file formats (extra preconfigured choices)
  • Improved handling of unit variables (passing parameters between micro-services)
  • Update to FITS 0.8.0 (or newer if available)
  • Update to ElasticSearch 0.90.13
  • Security fix (avoid invoking subshell when running micro-services) https://github.com/artefactual/archivematica/pull/16
  • Bug fix (file identification in mets is now from file id tool and not FITS) https://github.com/artefactual/archivematica/pull/15

Storage Service 0.4.0

• Sponsored (University of Saskatchewan) Islandora integration. See also: Sword_API, #5796 #5837
  • v1 of Sword API (the API used by external applications like Islandora)
• Sponsored (SFU Library) LOCKSS available as an AIP storage location using PLN Manager "LOCKSS-o-MATIC" (AIP storage / API plugin)
• Bug fixes and GUI changes depending on resources available
• View pointer files from Archival Storage and SS #5716
• Sponsored (COPPUL) Any changes required for COPPUL hosting
• Sponsored (SFU) Ability to configure transfer backlog locations via the Storage Service
• Sponsored (University of Saskatchewan) Add post store AIP micro-service to let Islandora know that an object has been moved into storage and can be deleted from Islandora

Archivematica 1.2

• Sponsored (University of Alberta) Dataset preservation
  • Sponsored pointer file includes compression information and other metadata required to find and process (e.g. open) AIP
• Sponsored (Yale University Libraries) Forensic disk image ingest #5037, #5356, #5900
  • Sponsored includes identification and flagging of personal information in transfers, as well as other bulk extractor reporting functions
• Sponsored (COPPUL) For COPPUL hosting functionality at Bronze level, ability to process through to Transfer backlog only
• Add ability to configure Characterization commands via FPR https://github.com/artefactual/archivematica/pull/6
• Add verification command micro-service (verify frame-level fixity and lossless compression)
• Improvements to transfer start #6220
• Add nailgun (improve performance of java tools like FITS)
• may include changes to packaging
• Bug fixes
• Improvements to file identification metadata in METS #
• Include TIKA #5027 and DROID in packages so FPR can be configured to use them as identification tools
• Include MediaInfo, Exiftool and framemd5 (maybe ffprobe) for characterization and metadata extraction instead of FITS #5034
• Support Dublin Core metadata in JSON (as well as csv, which was already supported) https://github.com/artefactual/archivematica/pull/14

Storage Service 0.5.0

• Backend/Not user-facing:
  • Sponsored (SFU Archives) Changes to support SIP creation panel (see below, Archivematica 1.3)

Archivematica 1.3

• Sponsored (SFU Archives) SIP Arrangement - Create one or more SIPs from one or more transfers in the Ingest tab Transfer and SIP creation - #1726, #1571, #1713, #1035, #6022
  • does not support taking content out of a SIP once it's been moved to the SIP arrangement panel
• METS refactoring and METS generation improvements
  • develop standalone Python METS writer application and distribute separately from and integrated with Archivematica

Storage Service 0.6.0

• Backend/Not user-facing:
  • Supported (Zuse Institut) Changes to support AIP re-ingest (See below, Archivematica 1.4)

Archivematica 1.4

• Sponsored (Zuse Institute) AIP Re-ingest
  • Sponsored supports AIP versioning (METS file updates) #1564
  • Sponsored generate DIP from AIP after processing is complete - Issue #1843
  • does not support re-normalization
• Sponsored (Harvard Business School Library) Directory printer - See requirements Directory printer for recording original order
• Sponsored (Harvard Business School Library) OCR - See requirements OCR text in DIP
• Sponsored (Harvard Business School Library) Store DIP - See requirements Store DIP

Wish list

Also see unsponsored features/tasks/bugs without assigned releases: unsponsored and unscheduled fixes, features and tasks

1. Improvements to e-mail ingest workflow (maildir)
2. DIP generation/upload info logged to pointer file
3. Re-index AIPs and DIPs (storage service)
4. Persistent data about stored AIPs and DIPs
5. Upload submission documentation during transfer upload #1910
6. Ability to upgrade rather than re-install
7. SAMBA plugin for Storage API
8. ElasticSearch in SS
9. Format Policy Registry (FPR) public site UI
10. Ability to send local format policy changes to the FPR public site #5074
11. Visualization of transfer contents - #1578, Transfer and SIP creation#File visualization reporting page
12. Field validation in rights templates - #1519
13. Hydra (AIP storage / API plugin)
14. Fedora (AIP storage / API plugin)
15. Dspace (DIP upload)
16. BitCurator integration: how much functionality/data can be integrated/re-used prior to Archivematica ingest. - #1869
17. Develop ability and end-user documentation to add other identification tools as selections from the drop-down menu in the Ingest tab of the dashboard to base normalization workflows on #5077 #5078
18. Administrative dashboard interface for system monitoring, including status and restart services
19. Status indicator to show current status of transfer/job
20. Better documentation