Development roadmap: Archivematica

From Archivematica
Jump to navigation Jump to search

Main Page > Development > Development roadmap

Archivematica development roadmap

This roadmap describes what Artefactual is working on for the Archivematica system. Sponsored work, that is development of features and enhancements which is funded by our development partners, is prioritized. On our wishlist, we have also included enhancements and features that we would like to see or that the community has shown interest in; however, without development resources allocated to us or contributions from developers outside of Artefactual, we cannot guarantee their inclusion.

Reflecting the bounty business model for open source development, each feature is developed in partnership with an institution or group of institutions with unique workflow needs. Despite our best efforts to keep features as generic as possible, some extra development may be necessary for a feature to function well in your own environment. Please see the Archivematica services offered on Artefactual's website to find out more about how to become a development partner, get training and support, or take advantage of installation services.

We will issue public releases incrementally upon completion and testing of the sponsored features and enhancements listed below. All features are subject to code review and QA, the results of which may result in any feature being pushed to a future release.

Features by release number

===Storage Service 0.4.0=== (June 2014)

  • Sponsored (SFU Library) LOCKSS available as an AIP storage location using PLN Manager "LOCKSS-o-MATIC" (AIP storage / API plugin) #5425 PR#8
  • Sponsored (SFU) Ability to configure transfer backlog locations via the Storage Service #6131 PR#9
  • Sponsored (Harvard Business School Library) Manage DIP storage PR#11
  • Sponsored (Museum of Modern Art) Fixity checking app #6597 PR#13
  • View pointer files from Archival Storage and SS #5716 PR#5
  • Enhancements
    • optimizations in moving files between Locations #6248 PR#4
    • streamlined creation of new endpoints with decorators PR#14
    • new dependency added unar (and lsar) used to add support for AIP's with multiple extensions (e.g., aip.tar.gz) #6764 PR#15
  • Bugfixes
    • setting Location path from gui #5608 PR#10
    • allow email address to be used as username #6674 PR#12

Archivematica 1.2

  • Sponsored (Yale University Libraries) Forensic disk image ingest #5037, #5356, #5900
    • Sponsored includes identification and flagging of personal information in transfers, as well as other bulk extractor reporting functions
  • Sponsored (COPPUL) For COPPUL hosting functionality at Bronze level, ability to process through to Transfer backlog only
  • Add ability to configure Characterization commands via FPR https://github.com/artefactual/archivematica/pull/6
  • Add verification command micro-service (verify frame-level fixity and lossless compression) #6501
  • Improvements to transfer start #6220
    • updates to manual documentation
  • Scalability: Add nailgun (improve performance of java tools like FITS)
    • may include changes to packaging
  • View pointer files from Archival Storage and SS
  • Bug fixes
  • Improvements to file identification metadata in METS #
  • Include TIKA #5027 and DROID in packages so FPR can be configured to use them as identification tools
  • Include MediaInfo, Exiftool and framemd5 (maybe ffprobe) for characterization and metadata extraction instead of FITS #5034
  • Support Dublin Core metadata in JSON (as well as csv, which was already supported) https://github.com/artefactual/archivematica/pull/14

Storage Service 0.5.0

  • Sponsored (University of Saskatchewan) Islandora integration. See also: Sword_API, #5796 #5837
    • v1 of Sword API (the API used by external applications like Islandora)

Archivematica 1.3

  • Sponsored (University of Saskatchewan) Add post store AIP micro-service to let Islandora know that an object has been moved into storage and can be deleted from Islandora
  • Sponsored (SFU Archives) SIP Arrangement - Create one or more SIPs from one or more transfers in the Ingest tab Transfer and SIP creation - #1726, #1571, #1713, #1035, #6022
    • does not support taking content out of a SIP once it's been moved to the SIP arrangement panel
  • Sponsored (Harvard Business School Library) Directory printer - See requirements Directory printer for recording original order
  • Sponsored (Harvard Business School Library) OCR - See requirements OCR text in DIP
  • Sponsored (Harvard Business School Library) Store DIP - See requirements Store DIP
  • METS refactoring and METS generation improvements
    • develop standalone Python METS writer application and distribute separately from and integrated with Archivematica

Storage Service 0.6.0

  • Backend/Not user-facing:
    • Supported (Zuse Institut) Changes to support AIP re-ingest (See below, Archivematica 1.4)

Archivematica 1.4

  • Sponsored (Zuse Institute) AIP DC and Rights MD Re-ingest Full AIP re-ingest requirements
    • Sponsored supports AIP versioning (METS file updates) #1564
    • Sponsored generate DIP from AIP after processing is complete - Issue #1843
    • does not support re-normalization
    • note that this work is only part of the entire AIP re-ingest feature, the rest is not yet sponsored

Storage Service 0.7.0

Archivematica 1.5

  • Sponsored (National Library of Wales)
    • Sponsored Add levels of description to Submission Information Packages using AtoM REST endpoint to enforce controlled vocabulary
    • Sponsored Generate hierarchical structMap in Archival Information Package METS file
    • This development is concurrent with AtoM development including the following: generate hierarchical arrangement based on METS structMap, map levels of description in hierarchical METS structMap to Level of description element in AtoM information object, and display hierarchical arrangement in AtoM treeview

Wish list

Also see unsponsored features/tasks/bugs without assigned releases: unsponsored and unscheduled fixes, features and tasks

  1. Improvements to e-mail ingest workflow (maildir)
  2. DIP generation/upload info logged to pointer file
  3. Re-index AIPs and DIPs (storage service)
  4. Persistent data about stored AIPs and DIPs
  5. Upload submission documentation during transfer upload #1910
  6. Ability to upgrade rather than re-install
  7. SAMBA plugin for Storage API
  8. ElasticSearch in SS
  9. Format Policy Registry (FPR) public site UI
  10. Ability to send local format policy changes to the FPR public site #5074
  11. Visualization of transfer contents - #1578, Transfer and SIP creation#File visualization reporting page
  12. Field validation in rights templates - #1519
  13. Hydra (AIP storage / API plugin)
  14. Fedora (AIP storage / API plugin)
  15. Dspace (DIP upload)
  16. BitCurator integration: how much functionality/data can be integrated/re-used prior to Archivematica ingest. - #1869
  17. Develop ability and end-user documentation to add other identification tools as selections from the drop-down menu in the Ingest tab of the dashboard to base normalization workflows on #5077 #5078
  18. Administrative dashboard interface for system monitoring, including status and restart services
  19. Status indicator to show current status of transfer/job
  20. Better documentation