Meeting 20120530 - Revision history

Evelyn: /* Development */

2012-05-30T18:12:03Z

Development

Evelyn at 18:10, 30 May 2012

2012-05-30T18:10:41Z

Evelyn: /* Testing */

2012-05-30T18:03:13Z

Testing

Evelyn at 18:02, 30 May 2012

2012-05-30T18:02:58Z

Show changes

Evelyn: Created page with "== Development == * Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directo..."

2012-05-30T17:55:36Z

Created page with "== Development == * Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directo..."

New page

== Development ==

* Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.

== Deployment ==

* Courtney has been working with UBC Library on procedures for all three external media situations: 5.25" floppies, opt disks, and hard drives. We'll have lots of different workflows for many different situations... for instance, at cov, she want to do some testing on their optical disk issues.
** Three different types of fails:
*** disk won't show up at all
*** disk won't mount
*** disk won't image (some kinds of audio disks have been failing to image)

== Documentation ==

* Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
* lots of installation tech support on the forums this week and other architecture discussions; great support from Artefactual. got lots of compliments about our fast, friendly responses on the discussion list. It makes a big impression.

== Chat log ==

<pre>
(1:29:53 PM) vangarderen.peter: copy chat log to qubit wiki
(1:30:09 PM) vangarderen.peter: then start new chat log and notes for Archivematica meeting and post to Archivematica meetings wiki page
(1:30:50 PM) MJ Suhonos: i'd be grateful if someone can create a stub page so i know where to put the minutes (while i'm cleaning them up from my notes)
(1:31:06 PM) vangarderen.peter: MJ Suhonos: for qubit, archivematica or both?
(1:31:06 PM) david.juhasz: I can do that MJ Suhonos
(1:31:11 PM) vangarderen.peter: david.juhasz: thanks
(1:31:15 PM) MJ Suhonos: thanks david
(1:31:24 PM) MJ Suhonos: vangarderen.peter: for qubit, presumably. whatever david comes up with
(1:31:57 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
(1:31:59 PM) vangarderen.peter: david.juhasz: can you do one for archivematica then too please? I've got a meeting page up already with a list for 2011 meetings
(1:32:29 PM) vangarderen.peter: okay, in the meanwhile on to Archivematica dev
(1:32:30 PM) MJ Suhonos: should i just put the notes undera heading for "qubit" ?
(1:32:56 PM) berwin22: I've been working on the shared folder problems, haven't gotten much, if any dev done
(1:33:13 PM) david.juhasz: MJ Suhonos: three headings, dev, docs and deployment
(1:33:15 PM) david.juhasz: I can create them
(1:33:30 PM) vangarderen.peter: and then a copy of the chat log underneath that
(1:33:45 PM) MJ Suhonos: vangarderen.peter: don't know how to get that, but i'll figure it out
(1:33:52 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
(1:33:59 PM) vangarderen.peter: hopefully it was on in your IM client
(1:34:06 PM) vangarderen.peter: david.juhasz: you have a log?
(1:34:09 PM) david.juhasz: MJ Suhonos: I can post the chat log for now
(1:34:10 PM) Rachel: cheers all - I'm heading out. See you next week!
(1:34:10 PM) Jessica Bushey: MJ - are you using ADIUM?
(1:34:15 PM) Jessica Bushey: Bye Rachel
(Rachel left the room. (1:34:20 PM)
(1:34:24 PM) vangarderen.peter: bye rachel. thanks for checking in!
(1:34:28 PM) berwin22: http://groups.google.com/group/archivematica/browse_thread/thread/345f63b118995711?hl=en <- shared folder problem with virtualbox
(1:31:15 PM) MJ Suhonos: thanks david
(1:31:24 PM) MJ Suhonos: vangarderen.peter: for qubit, presumably. whatever david comes up with
(1:31:57 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
(1:31:59 PM) vangarderen.peter: david.juhasz: can you do one for archivematica then too please? I've got a meeting page up already with a list for 2011 meetings
(1:32:29 PM) vangarderen.peter: okay, in the meanwhile on to Archivematica dev
(1:32:30 PM) MJ Suhonos: should i just put the notes undera heading for "qubit" ?
(1:32:56 PM) berwin22: I've been working on the shared folder problems, haven't gotten much, if any dev done
(1:33:12 PM) david.juhasz: MJ Suhonos: three headings, dev, docs and deployment
(1:33:15 PM) david.juhasz: I can create them
(1:33:29 PM) vangarderen.peter: and then a copy of the chat log underneath that
(1:33:45 PM) MJ Suhonos: vangarderen.peter: don't know how to get that, but i'll figure it out
(1:33:52 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
(1:33:58 PM) vangarderen.peter: hopefully it was on in your IM client
(1:34:05 PM) vangarderen.peter: david.juhasz: you have a log?
(1:34:09 PM) david.juhasz: MJ Suhonos: I can post the chat log for now
(1:34:10 PM) Rachel: cheers all - I'm heading out. See you next week!
(1:34:10 PM) Jessica Bushey: MJ - are you using ADIUM?
(1:34:14 PM) Jessica Bushey: Bye Rachel
(1:34:24 PM) vangarderen.peter: bye rachel. thanks for checking in!
(1:34:27 PM) berwin22: http://groups.google.com/group/archivematica/browse_thread/thread/345f63b118995711?hl=en <- shared folder problem with virtualbox
(1:34:43 PM) MJ Suhonos: Jessica Bushey: yup, think i've got it
(1:35:00 PM) vangarderen.peter: berwin22: then Austin made call to switch to sftp
(1:35:09 PM) vangarderen.peter: as officially supported method
(1:35:29 PM) vangarderen.peter: it sounds like a good move
(1:35:35 PM) berwin22: yes, I agree
(1:35:54 PM) vangarderen.peter: great tech support on the forums this week guys.
(1:36:04 PM) berwin22: I'd rather have one method, than one for each of our distrobutions
(1:36:11 PM) vangarderen.peter: there is definitely a little spike of Archivematica interest right now
(1:36:18 PM) vangarderen.peter: a lot of people kicking the tires
(1:36:23 PM) berwin22: I can upload my r3 that has the virtualbox fix
(1:36:56 PM) Austin: berwin22: after this release maybe we can just release a vmdk.. which worrks in both vmware and virtualbox
(1:37:12 PM) Austin: no sharedfolders.. no need to release a separate version
(1:37:17 PM) berwin22: Austin, I like the sounds of that
(1:37:22 PM) vangarderen.peter: me too
(1:37:32 PM) vangarderen.peter: let's do it
(1:37:42 PM) vangarderen.peter: deployment
(1:38:01 PM) Austin: rockafella and imf have gone well
(1:38:04 PM) vangarderen.peter: Austin: rock it out with Fernando and Roberto at RAC last week
(1:38:22 PM) Austin: install has mostly been done on the first days
(1:38:37 PM) Austin: run into a few issues.. looks like mcpsqllogger dies on apostrophies
(1:38:47 PM) vangarderen.peter: had brand new server room. 20TB NetApps appliance just for us. ESX servers for archivematica ready to go. Networking green light.
(1:39:13 PM) Austin: yeah was great working with them
(1:35:08 PM) vangarderen.peter: as officially supported method
(1:35:29 PM) vangarderen.peter: it sounds like a good move
(1:35:35 PM) berwin22: yes, I agree
(1:35:54 PM) vangarderen.peter: great tech support on the forums this week guys.
(1:36:04 PM) berwin22: I'd rather have one method, than one for each of our distrobutions
(1:36:11 PM) vangarderen.peter: there is definitely a little spike of Archivematica interest right now
(1:36:18 PM) vangarderen.peter: a lot of people kicking the tires
(1:36:23 PM) berwin22: I can upload my r3 that has the virtualbox fix
(1:36:56 PM) Austin: berwin22: after this release maybe we can just release a vmdk.. which worrks in both vmware and virtualbox
(1:37:12 PM) Austin: no sharedfolders.. no need to release a separate version
(1:37:17 PM) berwin22: Austin, I like the sounds of that
(1:37:22 PM) vangarderen.peter: me too
(1:37:31 PM) vangarderen.peter: let's do it
(1:37:41 PM) vangarderen.peter: deployment
(1:38:00 PM) Austin: rockafella and imf have gone well
(1:38:03 PM) vangarderen.peter: Austin: rock it out with Fernando and Roberto at RAC last week
(1:38:22 PM) Austin: install has mostly been done on the first days
(1:38:37 PM) Austin: run into a few issues.. looks like mcpsqllogger dies on apostrophies
(1:38:47 PM) vangarderen.peter: had brand new server room. 20TB NetApps appliance just for us. ESX servers for archivematica ready to go. Networking green light.
(1:39:12 PM) Austin: yeah was great working with them
(1:39:47 PM) berwin22: so... which revision of the virtual box image should be available for download?
(r1 - doesn't support the shared folder stuff.
(r2 - problem with the nic being set to bridge to eth0 (bad)
(r3 - I can upload, but has a preset folder of /home/joseph - I'm fairly confident this wouldn't break anything
(r4 - I make the change to r3 and upload it - would take about 4 hours.
(1:39:55 PM) vangarderen.peter: only hickup was when at the last hour we juggled system between two images to get our server to a 3.5TB size server. But the boys made it 3.5GB
(1:40:39 PM) Austin: joseph that does break stuff here
(1:40:44 PM) Austin: /home/joseph^
(1:40:56 PM) Austin: *did
(1:40:57 PM) berwin22: K leaving as r1.
(1:41:10 PM) Austin: ?
(1:41:24 PM) Austin: I think I deleted r1 already
(1:41:26 PM) Austin:
(1:41:37 PM) Austin: current one up there is r2
(1:41:38 PM) berwin22: http://archivematica.org/wiki/index.php?title=Virtual_appliance_instructions
(We need to update this wiki with the sftp instructions
(1:41:45 PM) berwin22: I never deleted it.
(1:41:48 PM) Austin: yeah, havnt had time
(1:41:51 PM) berwin22: or updated the wiki to point to it
(1:41:56 PM) Austin: (10:41:23 AM) Austin: I think I deleted r1 already *
(1:42:03 PM) vangarderen.peter: who's gonna have time to update those docs first?
(1:42:25 PM) Austin: Im looking forward to taking a break tomorrow.. maybe if I have network in the airport today
(1:42:45 PM) vangarderen.peter: berwin22: what are you working on?
(1:43:23 PM) vangarderen.peter: it might save us some more forum questions the sooner we get that updated. requires some screenshots eh?
(1:43:57 PM) berwin22: ... at this point I think I should create r4 of the virtual box stuff, cause r1 is missing
(1:44:02 PM) berwin22: well deleted
(1:44:04 PM) Austin: yeah
(1:44:07 PM) Austin: and r2 dosnt work
(1:44:10 PM) Austin: or..
(1:44:15 PM) Austin: just explain howto use the vmdk
(1:40:57 PM) berwin22: K leaving as r1.
(1:41:10 PM) Austin: ?
(1:41:23 PM) Austin: I think I deleted r1 already
(1:41:25 PM) Austin:
(1:41:37 PM) Austin: current one up there is r2
(1:41:38 PM) berwin22: http://archivematica.org/wiki/index.php?title=Virtual_appliance_instructions
(We need to update this wiki with the sftp instructions
(1:41:45 PM) berwin22: I never deleted it.
(1:41:48 PM) Austin: yeah, havnt had time
(1:41:51 PM) berwin22: or updated the wiki to point to it
(1:41:56 PM) Austin: (10:41:23 AM) Austin: I think I deleted r1 already *
(1:42:02 PM) vangarderen.peter: who's gonna have time to update those docs first?
(1:42:24 PM) Austin: Im looking forward to taking a break tomorrow.. maybe if I have network in the airport today
(1:42:45 PM) vangarderen.peter: berwin22: what are you working on?
(1:43:22 PM) vangarderen.peter: it might save us some more forum questions the sooner we get that updated. requires some screenshots eh?
(1:43:56 PM) berwin22: ... at this point I think I should create r4 of the virtual box stuff, cause r1 is missing
(1:44:01 PM) berwin22: well deleted
(1:44:04 PM) Austin: yeah
(1:44:07 PM) Austin: and r2 dosnt work
(1:44:10 PM) Austin: or..
(1:44:15 PM) Austin: just explain howto use the vmdk
(1:44:38 PM) Austin: and we rename archivematica-0.7alpha-vmware to archivematica-0.7alpha-vmdk
(1:45:04 PM) david.juhasz: has the vmdk been tested with virtualbox?
(1:45:16 PM) berwin22: they'd both take about the same amount of time. and I know what I'm doing on the first.
(1:45:18 PM) Austin: we use the vmdk to create the virtualbox image
(1:45:27 PM) Austin: least I do
(1:45:51 PM) Austin: virtualbox image is the vmdk imported, and with the guest additions added(which are broken)
(1:46:12 PM) david.juhasz: Austin: so the answer is no?
(1:46:21 PM) Austin: ?
(1:46:23 PM) vangarderen.peter: *confused too*
(1:46:32 PM) Austin: no.. its yes, they are the same thing
(1:46:39 PM) vangarderen.peter: we're only going to create/support one vm format?
(1:46:46 PM) Austin: just the virtualbox image has the guest additions added and exported as ovf
(1:46:53 PM) berwin22: Austin, are you wanting the updated sources list in r4?
(1:46:58 PM) vangarderen.peter: which should work equally well with VMware and VirtualBox players?
(1:47:00 PM) Austin: sure
(1:47:10 PM) david.juhasz: Austin: right, I just think somebody should load up the vmdk in virtualbox to make sure it really, really works
(1:47:14 PM) Austin: berwin22: sure*
(1:47:22 PM) Austin: agreed
(1:47:24 PM) vangarderen.peter: david.juhasz: i agree, it needs evelyn blessing
(1:47:39 PM) berwin22: Just to confirm: no anticipated problems with version clashes or anything with that sources list.
(1:48:06 PM) Austin: ?
(1:48:26 PM) Austin: not really sure what your talking about
(1:48:33 PM) vangarderen.peter: me neither
(1:48:48 PM) Austin: your talking about switching your sources.list that you use to build off a mirror to a working one?
(1:48:49 PM) berwin22: http://archivematica.org/downloads/sources.list
(1:48:49 PM) Austin: sure
(1:49:10 PM) berwin22: that sources list is different than the one currently in the vm
(1:49:18 PM) Austin: in your vm?
(1:49:25 PM) Austin: my vm?
(1:49:34 PM) Austin: I know the ones I uploaded have my mirror
(1:46:39 PM) vangarderen.peter: we're only going to create/support one vm format?
(1:46:46 PM) Austin: just the virtualbox image has the guest additions added and exported as ovf
(1:46:52 PM) berwin22: Austin, are you wanting the updated sources list in r4?
(1:46:58 PM) vangarderen.peter: which should work equally well with VMware and VirtualBox players?
(1:47:00 PM) Austin: sure
(1:47:10 PM) david.juhasz: Austin: right, I just think somebody should load up the vmdk in virtualbox to make sure it really, really works
(1:47:14 PM) Austin: berwin22: sure*
(1:47:22 PM) Austin: agreed
(1:47:23 PM) vangarderen.peter: david.juhasz: i agree, it needs evelyn blessing
(1:47:38 PM) berwin22: Just to confirm: no anticipated problems with version clashes or anything with that sources list.
(1:48:06 PM) Austin: ?
(1:48:25 PM) Austin: not really sure what your talking about
(1:48:33 PM) vangarderen.peter: me neither
(1:48:48 PM) Austin: your talking about switching your sources.list that you use to build off a mirror to a working one?
(1:48:49 PM) berwin22: http://archivematica.org/downloads/sources.list
(1:48:49 PM) Austin: sure
(1:49:10 PM) berwin22: that sources list is different than the one currently in the vm
(1:49:18 PM) Austin: in your vm?
(1:49:24 PM) Austin: my vm?
(1:49:34 PM) Austin: I know the ones I uploaded have my mirror
(1:50:26 PM) berwin22: yeah. are we wanting to use the sources list, with your mirror in it, to prevent *bad* updates, or the http://archivematica.org/downloads/sources.list file?
(1:50:45 PM) Austin: thats why I left it in.. to prevent bad updates..
(1:50:49 PM) vangarderen.peter: okay, can discuss further after meeting
(1:50:49 PM) Austin: but useful if people want ssh
(1:50:52 PM) vangarderen.peter: okay, any more dev or deployment to report on?
(1:51:18 PM) vangarderen.peter: Austin: ingested a 1GB .pst file at IMF today?
(1:51:57 PM) Austin: yeah
(1:52:02 PM) Austin: worked great
(1:52:18 PM) vangarderen.peter: that's great
(1:52:23 PM) vangarderen.peter: 4GB vms eh?
(1:52:25 PM) Austin: noticed readpst is threaded.. so the more available CPUs the better
(1:52:27 PM) Austin: yeah..
(1:52:35 PM) Austin: but maxed out around 600mb of ram
(1:53:03 PM) vangarderen.peter: each vm would max out at 600mb but you could add more vm processors and it would thread them?
(1:53:29 PM) Austin: nah.. just the running vm was at 600mb of ram..
(1:53:37 PM) Austin: also had firefox and thunar etc etc open
(1:53:39 PM) vangarderen.peter: ah k
(1:53:41 PM) vangarderen.peter: docs?
(1:53:43 PM) vangarderen.peter: Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
(1:49:34 PM) Austin: I know the ones I uploaded have my mirror
(1:50:25 PM) berwin22: yeah. are we wanting to use the sources list, with your mirror in it, to prevent *bad* updates, or the http://archivematica.org/downloads/sources.list file?
(1:50:45 PM) Austin: thats why I left it in.. to prevent bad updates..
(1:50:49 PM) vangarderen.peter: okay, can discuss further after meeting
(1:50:49 PM) Austin: but useful if people want ssh
(1:50:52 PM) vangarderen.peter: okay, any more dev or deployment to report on?
(1:51:17 PM) vangarderen.peter: Austin: ingested a 1GB .pst file at IMF today?
(1:51:57 PM) Austin: yeah
(1:52:02 PM) Austin: worked great
(1:52:18 PM) vangarderen.peter: that's great
(1:52:23 PM) vangarderen.peter: 4GB vms eh?
(1:52:25 PM) Austin: noticed readpst is threaded.. so the more available CPUs the better
(1:52:27 PM) Austin: yeah..
(1:52:34 PM) Austin: but maxed out around 600mb of ram
(1:53:03 PM) vangarderen.peter: each vm would max out at 600mb but you could add more vm processors and it would thread them?
(1:53:29 PM) Austin: nah.. just the running vm was at 600mb of ram..
(1:53:36 PM) Austin: also had firefox and thunar etc etc open
(1:53:38 PM) vangarderen.peter: ah k
(1:53:41 PM) vangarderen.peter: docs?
(1:53:42 PM) vangarderen.peter: Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
(1:55:00 PM) vangarderen.peter: lots of installation tech support on the forums this week and other architecture discussions
(1:55:43 PM) vangarderen.peter: great support from Artefactual. got lots of compliments about our fast, friendly responses on the discussion list. It makes a big impression.
(1:56:30 PM) MJ Suhonos: nice to hear
(1:56:36 PM) Jessica Bushey: Awesome!
(ford35229 entered the room. (1:57:10 PM)
(1:57:20 PM) vangarderen.peter: okay, i'm gonna run if there's nothing else guys
</pre>

@@ Line 2: / Line 2: @@
 * 0.9 Feature freeze is today, a meeting yesterday clarified the roadmap
-* Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
+* Re maildir processing: Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
 * PREMIS 2.2 has been approved, so update of rights module is now on 0.9 roadmap: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9.
 == Deployment ==

@@ Line 18: / Line 18: @@
 * Evelyn made a table for Austin to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
 == Documentation ==
-* Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
+* Courtney updated the [[Development roadmap]]
-* lots of installation tech support on the forums this week and other architecture discussions; great support from Artefactual. got lots of compliments about our fast, friendly responses on the discussion list. It makes a big impression.
+* Evelyn updated maildir processing requirements at https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
 == Chat log ==
 <pre>
+(10:39:40 AM) peterVG: had good archivematica dev mtg yesterday, got a lot sorted out
 </pre>

@@ Line 17: / Line 17: @@
 == Testing ==
-* Evelyn made a table for ARTi to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
+* Evelyn made a table for Austin to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
 == Documentation ==