Difference between revisions of "Meeting 20120411"
Jump to navigation
Jump to search
Line 10: | Line 10: | ||
= Documentation = | = Documentation = | ||
− | + | *Austin will be responsible for documenting multi-node processor testing | |
= Testing = | = Testing = | ||
Line 17: | Line 17: | ||
**There's a limit to how much can be tested in the office; the limit is the disk, so we will have to upgrade | **There's a limit to how much can be tested in the office; the limit is the disk, so we will have to upgrade | ||
**however, it sounds like our ciaus test environment is confirming thus far that our multi-node mysql drops problem has dissappeared after full 12.04 upgrades | **however, it sounds like our ciaus test environment is confirming thus far that our multi-node mysql drops problem has dissappeared after full 12.04 upgrades | ||
+ | **for testing, we should probably be comparing results for individual micro-services as well as total ingest-to-aip/dip creation times | ||
+ | **Austin will create the test net on openhosting, maybe in an afternoon/evening | ||
+ | *Austin will take over the testing process & docs, he will speak to Joseph about all the variations to test for, e.g. specific micro-services vs total pipeline time, bulk set of sample data vs testing for specific format types | ||
+ | **All of the testing needs to be ordered in a systematic way, e.g. separate tests that keep everything the same except a change in one factor, ie. sample data, microservice, number of nodes | ||
+ | **After we have all those stats (hopefully with positive results, ie. adding more processors boosts performance) we can add distributed FS as a new test variable, eg CEPH | ||
= Chat log = | = Chat log = |
Revision as of 12:57, 11 April 2012
Development
- Joseph tarted working on the office normalization not working, handed off to Austin: http://code.google.com/p/archivematica/issues/detail?id=961
- Issue 961:12.04 + DocumentConverter.py normalization failures. Joseph would like to give this high priority. There have been some major changes to unoconv, and he'd like to give it a shot again. It would be nice to fix
Issue 304: Transcoding with Open Office fails periodically.
- Austin is trying to track some similar issue down.. but will post issues to libre office and launchpad as well
Deployment
Documentation
- Austin will be responsible for documenting multi-node processor testing
Testing
- Multi-node processor testing: Joseph is not seeing database drops/disconnects in archivematica 0.9 dev on precise.
- He's holding back on testing till we get a better idea of what metrics we want to keep.
- There's a limit to how much can be tested in the office; the limit is the disk, so we will have to upgrade
- however, it sounds like our ciaus test environment is confirming thus far that our multi-node mysql drops problem has dissappeared after full 12.04 upgrades
- for testing, we should probably be comparing results for individual micro-services as well as total ingest-to-aip/dip creation times
- Austin will create the test net on openhosting, maybe in an afternoon/evening
- Austin will take over the testing process & docs, he will speak to Joseph about all the variations to test for, e.g. specific micro-services vs total pipeline time, bulk set of sample data vs testing for specific format types
- All of the testing needs to be ordered in a systematic way, e.g. separate tests that keep everything the same except a change in one factor, ie. sample data, microservice, number of nodes
- After we have all those stats (hopefully with positive results, ie. adding more processors boosts performance) we can add distributed FS as a new test variable, eg CEPH