Bottlenecks - Revision history

Sallain at 21:41, 11 February 2020

2020-02-11T21:41:30Z

Joseph at 16:55, 21 July 2011

2011-07-21T16:55:11Z

Joseph at 16:51, 21 July 2011

2011-07-21T16:51:18Z

Joseph at 22:13, 20 July 2011

2011-07-20T22:13:57Z

Joseph: Created page with 'Category:Development documentation A bottleneck refers to a point of congestion in a system, typically a place of limited resources, where workflow is prone to slow. * For mo...'

2011-07-20T19:46:23Z

Created page with 'Category:Development documentation A bottleneck refers to a point of congestion in a system, typically a place of limited resources, where workflow is prone to slow. * For mo...'

New page

[[Category:Development documentation]]
A bottleneck refers to a point of congestion in a system, typically a place of limited resources, where workflow is prone to slow.
* For more information on bottlenecks see [http://en.wikipedia.org/wiki/Bottleneck wikipedia.]

= Processing Power =
Archivematica uses it's distributed, multi processing MCP system to mitigate the traditional problems of a processing system. However, this places higher importance on two other bottlenecks: Network and Disk activity.

= Network =
In Archivematica processing, networking comes into play for two key reasons:
* distributing tasks
* central file store access

= Disk/Hard drive =

== RAID ==

== Distributed File System ==

← Older revision		Revision as of 16:55, 21 July 2011
Line 16:		Line 16:

	= Disk/Hard drive =		= Disk/Hard drive =
		+	Hard drive access is one of the key bottlenecks in the Archivematica system. All of the operations performed on the objects require reading of the objects from the drive. There are a number of ways to improve disk read performance in a system.

	== RAID ==		== RAID ==

← Older revision		Revision as of 22:13, 20 July 2011
Line 14:		Line 14:

	== RAID ==		== RAID ==
		+	RAID (redundant array of inexpensive disks) is a way of distributing the load of a file system on a set of drives. There are various forms of RAID, with different levels of redundancy.
		+	* For more information on RAIDs see [http://en.wikipedia.org/wiki/RAID wikipedia.]

	== Distributed File System ==		== Distributed File System ==
		+	Distributed file systems are arguably a sub-set of RAIDs. They are distributed over multiple machines, to form a single file system. This has the potential to lighten the Network load for processing.
		+
		+	We are looking at using a distributed file system with archivematica. See [http://code.google.com/p/archivematica/issues/detail?id=669 Issue 669.]
		+
		+	=== Ceph ===
		+	Ceph is a distributed file system, which is currently (July 2011) under alpha development. They have a beta 1.0 release scheduled for release 08/21/2011 see their [http://tracker.newdream.net/projects/ceph/roadmap roadmap.]

@@ Line 1: / Line 1: @@
 [[Category:Development documentation]]
 A bottleneck refers to a point of congestion in a system, typically a place of limited resources, where workflow is prone to slow.
 * For more information on bottlenecks see [http://en.wikipedia.org/wiki/Bottleneck wikipedia.]

@@ Line 9: / Line 9: @@
 In Archivematica processing, networking comes into play for two key reasons:
 * distributing tasks
-* central file store access
+* central file store accessed over the network
 = Disk/Hard drive =