Difference between revisions of "Archivematica 1.16.0 and Storage Service 0.22.0 release notes"

From Archivematica
Jump to navigation Jump to search
(Add PRONOM update)
(Update API links)
 
(6 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
[[Main_Page|Home]] > [[Release_Notes|Release Notes]] > Archivematica 1.16.0 and Storage Service 0.22.0
 
[[Main_Page|Home]] > [[Release_Notes|Release Notes]] > Archivematica 1.16.0 and Storage Service 0.22.0
  
−
'''Release date: TBD'''
+
'''Release date: May 16, 2024'''
  
 
== Environments ==
 
== Environments ==
Line 15: Line 15:
  
 
== Added ==
 
== Added ==
 +
 +
=== List jobs API endpoint returns detailed output ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1641
 +
 +
A <code>detailed</code> parameter was added to the [https://www.archivematica.org/en/docs/archivematica-1.16/dev-manual/api/api-reference-archivematica/#list-jobs List jobs] API endpoint. When the parameter is sent in the request, the endpoint will return all the task properties returned by the [https://www.archivematica.org/en/docs/archivematica-1.16/dev-manual/api/api-reference-archivematica/#task Task] endpoint.
  
 
== Changed ==
 
== Changed ==
Line 23: Line 29:
  
 
[https://github.com/archivematica/Issues/issues/1653 GitHub issue 1653]
 
[https://github.com/archivematica/Issues/issues/1653 GitHub issue 1653]
 +
 +
=== Python versions ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1632
 +
 +
Archivematica 1.16 works with all the current [https://devguide.python.org/versions/#supported-versions Python supported versions]: 3.8 - 3.12.
 +
 +
=== Django 4.2 ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1624
 +
 +
Archivematica 1.16 dropped support for Django 3.2.
  
 
== Fixed ==
 
== Fixed ==
 +
 +
=== Update MCPClient forking model ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1482
 +
 +
Archivematica 1.16.0 introduces a new prefork execution model in MCPClient based on a process pool. MCPClient workers are automatically restarted to free resources and will reuse database connections when possible.
 +
 +
The following new settings were added to the MCPClient service:
 +
 +
* <code>ARCHIVEMATICA_MCPCLIENT_WORKERS</code> defines the number of MCPClient workers. If undefined, it defaults to the number of CPUs available on the machine. Only client modules that define <code>concurrent_instances</code> will perform concurrent execution of tasks (e.g. identify_file_format).
 +
 +
* <code>ARCHIVEMATICA_MCPCLIENT_MAX_TASKS_PER_CHILD</code> defines the maximum number of tasks a worker can execute before it's replaced by a new process in order to free resources.
 +
 +
* <code>ARCHIVEMATICA_MCPCLIENT_MCPCLIENT_PROMETHEUS_DETAILED_METRICS</code> indicates that detailed metrics should be sent to Prometheus. With large transfers this might affect performance of the local storage in Prometheus and slow down its threads in Archivematica.
 +
 +
See the [https://github.com/artefactual/archivematica/blob/48004c5bd798ccb54196720103b462654bf9b08d/src/MCPClient/install/README.md MCPClient Configuration] page.
 +
 +
=== DIPs are cleaned from watched directories ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1665
 +
 +
=== Duracloud spaces retry chunk downloads ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1607
 +
 +
Thank you [https://github.com/carlosmcgregor Carlos Mc Gregor] for contributing this fix!
 +
 +
=== Partial reingest works with non-core DC properties ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1620
 +
 +
=== Improve paths handling in the Storage Service ===
 +
 +
* Issue: https://github.com/archivematica/Issues/issues/1622
 +
 +
Thank you [https://github.com/klavman Fco. Javier Clavero] for starting this work!
  
 
Please see the 1.16.0 milestone in GitHub for all issues addressed in this release: https://github.com/archivematica/Issues/milestone/24?closed=1.
 
Please see the 1.16.0 milestone in GitHub for all issues addressed in this release: https://github.com/archivematica/Issues/milestone/24?closed=1.

Latest revision as of 11:19, 12 June 2024

Home > Release Notes > Archivematica 1.16.0 and Storage Service 0.22.0

Release date: May 16, 2024

Environments[edit]

Please see the installation instructions.

Archivematica 1.16.0 and Storage Service 0.22.0 have been tested in the following environments:

  • Ubuntu 22.04 64-bit Server Edition
  • Rocky Linux 9 x86_64

For development purposes, most of our developers prefer to use Docker containers. These and all above environments are linked from the installation instructions above.

Added[edit]

List jobs API endpoint returns detailed output[edit]

A detailed parameter was added to the List jobs API endpoint. When the parameter is sent in the request, the endpoint will return all the task properties returned by the Task endpoint.

Changed[edit]

PRONOM v.116[edit]

As of this Archivematica release, we are up to date to PRONOM v. 116.

GitHub issue 1653

Python versions[edit]

Archivematica 1.16 works with all the current Python supported versions: 3.8 - 3.12.

Django 4.2[edit]

Archivematica 1.16 dropped support for Django 3.2.

Fixed[edit]

Update MCPClient forking model[edit]

Archivematica 1.16.0 introduces a new prefork execution model in MCPClient based on a process pool. MCPClient workers are automatically restarted to free resources and will reuse database connections when possible.

The following new settings were added to the MCPClient service:

  • ARCHIVEMATICA_MCPCLIENT_WORKERS defines the number of MCPClient workers. If undefined, it defaults to the number of CPUs available on the machine. Only client modules that define concurrent_instances will perform concurrent execution of tasks (e.g. identify_file_format).
  • ARCHIVEMATICA_MCPCLIENT_MAX_TASKS_PER_CHILD defines the maximum number of tasks a worker can execute before it's replaced by a new process in order to free resources.
  • ARCHIVEMATICA_MCPCLIENT_MCPCLIENT_PROMETHEUS_DETAILED_METRICS indicates that detailed metrics should be sent to Prometheus. With large transfers this might affect performance of the local storage in Prometheus and slow down its threads in Archivematica.

See the MCPClient Configuration page.

DIPs are cleaned from watched directories[edit]

Duracloud spaces retry chunk downloads[edit]

Thank you Carlos Mc Gregor for contributing this fix!

Partial reingest works with non-core DC properties[edit]

Improve paths handling in the Storage Service[edit]

Thank you Fco. Javier Clavero for starting this work!

Please see the 1.16.0 milestone in GitHub for all issues addressed in this release: https://github.com/archivematica/Issues/milestone/24?closed=1.

Retrieved from "https://wiki.archivematica.org/index.php?title=Archivematica_1.16.0_and_Storage_Service_0.22.0_release_notes&oldid=13721"