Difference between revisions of "Meeting 20120530"

From Archivematica
Jump to navigation Jump to search
(Created page with "== Development == * Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directo...")
 
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
== Development ==
 
== Development ==
  
−
* Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
+
* 0.9 Feature freeze is today, a meeting yesterday clarified the roadmap
 +
* Re maildir processing: Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
 +
* PREMIS 2.2 has been approved, so update of rights module is now on 0.9 roadmap: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9.
  
 
== Deployment ==
 
== Deployment ==
Line 10: Line 12:
 
*** disk won't mount
 
*** disk won't mount
 
*** disk won't image (some kinds of audio disks have been failing to image)
 
*** disk won't image (some kinds of audio disks have been failing to image)
 +
 +
 +
== Testing ==
 +
 +
* Evelyn made a table for Austin to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
  
  
 
== Documentation ==
 
== Documentation ==
  
−
* Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
+
* Courtney updated the [[Development roadmap]]
−
* lots of installation tech support on the forums this week and other architecture discussions; great support from Artefactual. got lots of compliments about our fast, friendly responses on the discussion list. It makes a big impression.
+
* Evelyn updated maildir processing requirements at https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
 +
* Courtney created a packaging and compression at https://www.archivematica.org/wiki/AIP_packaging_and_compression
 +
 
  
 
== Chat log ==
 
== Chat log ==
  
 
<pre>
 
<pre>
−
(1:29:53 PM) vangarderen.peter: copy chat log to qubit wiki
+
(10:39:40 AM) peterVG: had good archivematica dev mtg yesterday, got a lot sorted out
−
(1:30:09 PM) vangarderen.peter: then start new chat log and notes for Archivematica meeting and post to Archivematica meetings wiki page
+
(10:39:50 AM) courtney: roadmap is sorted on wiki
−
(1:30:50 PM) MJ Suhonos: i'd be grateful if someone can create a stub page so i know where to put the minutes (while i'm cleaning them up from my notes)
+
(10:39:58 AM) peterVG: oh great, thx
−
(1:31:06 PM) vangarderen.peter: MJ Suhonos: for qubit, archivematica or both?
+
(10:40:03 AM) peterVG: http://archivematica.org/roadmap
−
(1:31:06 PM) david.juhasz: I can do that MJ Suhonos
+
(10:40:06 AM) epmclellan: I updated some issues and the email preservation wiki page
−
(1:31:11 PM) vangarderen.peter: david.juhasz: thanks
+
(10:40:07 AM) courtney: notes about requirements for compression/packaging got a page
−
(1:31:15 PM) MJ Suhonos: thanks david
+
(10:40:49 AM) epmclellan: https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
−
(1:31:24 PM) MJ Suhonos: vangarderen.peter:  for qubit, presumably.  whatever david comes up with
+
(10:41:04 AM) courtney: https://www.archivematica.org/wiki/AIP_packaging_and_compression
−
(1:31:57 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
+
(10:41:29 AM) peterVG: nice cleanup on roadmap page courtney thx
−
(1:31:59 PM) vangarderen.peter: david.juhasz: can you do one for archivematica then too please? I've got a meeting page up already with a list for 2011 meetings
+
(10:41:33 AM) epmclellan: I made a table for ARTi to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
−
(1:32:29 PM) vangarderen.peter: okay, in the meanwhile on to Archivematica dev
+
(10:41:41 AM) berwin221: been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
−
(1:32:30 PM) MJ Suhonos: should i just put the notes undera heading for "qubit" ?
+
(10:41:45 AM) epmclellan: ARTi: feel free to change the table structure if needed
−
(1:32:56 PM) berwin22: I've been working on the shared folder problems, haven't gotten much, if any dev done
+
(10:41:54 AM) ARTi: thanks epmclellan
−
(1:33:13 PM) david.juhasz: MJ Suhonos: three headings, dev, docs and deployment
+
(10:41:57 AM) peterVG: berwin221 nice
−
(1:33:15 PM) david.juhasz: I can create them
+
(10:42:03 AM) peterVG: thx epmclellan and ARTi!
−
(1:33:30 PM) vangarderen.peter: and then a copy of the chat log underneath that
+
berwin22 berwin221
−
(1:33:45 PM) MJ Suhonos: vangarderen.peter: don't know how to get that, but i'll figure it out
+
(10:42:15 AM) epmclellan: berwin221 wow
−
(1:33:52 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
+
(10:42:28 AM) peterVG: just updated roadmap page to indicate dec 1 as official 1.0 release date
−
(1:33:59 PM) vangarderen.peter: hopefully it was on in your IM client
+
(10:42:29 AM) courtney: wking on basic access tab search mockup this am
−
(1:34:06 PM) vangarderen.peter: david.juhasz: you have a log?
+
(10:42:55 AM) courtney: awesome berwin22
−
(1:34:09 PM) david.juhasz: MJ Suhonos: I can post the chat log for now
+
(10:43:02 AM) peterVG: oh wait, that's a saturday....dec 3
−
(1:34:10 PM) Rachel: cheers all - I'm heading out.  See you next week!
+
(10:44:06 AM) peterVG: btw, this link was getting passed around the twitterverse this week: http://www.archives.gov/applied-research/events/archivematica-transcript.pdf
−
(1:34:10 PM) Jessica  Bushey: MJ - are you using ADIUM?
+
(10:44:20 AM) peterVG: transcript of my NARA talk on Archivematica two years ago now. Was demoing 0.6
−
(1:34:15 PM) Jessica  Bushey: Bye Rachel
+
(10:44:43 AM) peterVG: if you can stand the literal transcription, including some uhms, is pretty interesting to see how far we've come
−
(Rachel left the room. (1:34:20 PM)
+
(10:44:53 AM) epmclellan: cool
−
(1:34:24 PM) vangarderen.peter: bye rachel. thanks for checking in!
+
(10:44:54 AM) mcantelon: Nice
−
(1:34:28 PM) berwin22: http://groups.google.com/group/archivematica/browse_thread/thread/345f63b118995711?hl=en <- shared folder problem with virtualbox
+
(10:45:03 AM) courtney: yeah, saw that...  
−
(1:31:15 PM) MJ Suhonos: thanks david
+
(10:45:13 AM) epmclellan: love it when our software and eg "NARA" get in the same sentence
−
(1:31:24 PM) MJ Suhonos: vangarderen.peter:  for qubit, presumably.  whatever david comes up with
+
(10:45:34 AM) peterVG: and, in spite of the usual stress and craziness of our release schedule, I think provides a pretty good rationale of how we are going about our dev cycles and the organizing principle behind Archivematica
−
(1:31:57 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
+
(10:45:51 AM) peterVG: ^ what some comp sci academics would call an "emergent" system
−
(1:31:59 PM) vangarderen.peter: david.juhasz: can you do one for archivematica then too please? I've got a meeting page up already with a list for 2011 meetings
+
(10:46:24 AM) epmclellan: what's the next phase, "dominant"?
−
(1:32:29 PM) vangarderen.peter: okay, in the meanwhile on to Archivematica dev
+
(10:46:25 AM) epmclellan: :)
−
(1:32:30 PM) MJ Suhonos: should i just put the notes undera heading for "qubit" ?
+
(10:47:04 AM) peterVG: "Each iteration in an agile development method leads to improved requirements,
−
(1:32:56 PM) berwin22: I've been working on the shared folder problems, haven't gotten much, if any dev done
+
(10:47:04 AM) peterVG: obviously improved software, as well as updates to documentation, improving the
−
(1:33:12 PM) david.juhasz: MJ Suhonos: three headings, dev, docs and deployment
+
(10:47:04 AM) peterVG: scope, depth and breadth of all of those, as well as development resources – the  
−
(1:33:15 PM) david.juhasz: I can create them
+
(10:47:04 AM) peterVG: resources that are available to developers and people working with the software.
−
(1:33:29 PM) vangarderen.peter: and then a copy of the chat log underneath that
+
(10:47:04 AM) peterVG: So the big part of that is that we’re not going to get it right the first time; we just
−
(1:33:45 PM) MJ Suhonos: vangarderen.peter:  don't know how to get that, but i'll figure it out
+
(10:47:05 AM) peterVG: pretty much assume that. "
−
(1:33:52 PM) david.juhasz: http://qubit-toolkit.org/wiki/index.php?title=Meeting_20110302
+
(10:47:30 AM) peterVG: we're also probably not gonna get it right the second or third time either ;-)
−
(1:33:58 PM) vangarderen.peter: hopefully it was on in your IM client
+
(10:47:59 AM) epmclellan: there's more latitude for us to say things like that than commercial software vendors, I think
−
(1:34:05 PM) vangarderen.peter: david.juhasz: you have a log?
+
(10:48:05 AM) peterVG: "So, the agile development methodology really is very well suited to the digital preservation field, where for all intents and purposes we’re never actually going to finish making our system because the technology we’re trying to preserve is constantly changing and the technology we have available to preserve digital objects is constantly changing so we try to just accept that right from the start as a principle."
−
(1:34:09 PM) david.juhasz: MJ Suhonos: I can post the chat log for now
+
(10:48:31 AM) courtney: the problem is that commercial vendors have the same limitations but don't admit it
−
(1:34:10 PM) Rachel: cheers all - I'm heading out.  See you next week!
+
(10:48:40 AM) peterVG: ^ exactly
−
(1:34:10 PM) Jessica  Bushey: MJ - are you using ADIUM?
+
(10:48:44 AM) courtney: makes upgrading and migration very difficult
−
(1:34:14 PM) Jessica  Bushey: Bye Rachel
+
(10:48:54 AM) epmclellan: yes, it's hard for them to say they don't have it exactly right but it costs a million dollars
−
(1:34:24 PM) vangarderen.peter: bye rachel. thanks for checking in!
+
(10:49:41 AM) epmclellan: so any more deployment, docs, testing?
−
(1:34:27 PM) berwin22: http://groups.google.com/group/archivematica/browse_thread/thread/345f63b118995711?hl=en <- shared folder problem with virtualbox
+
(10:49:44 AM) courtney: btw... for meeting notes: ran through a lot of my QA
−
(1:34:43 PM) MJ Suhonos: Jessica  Bushey: yup, think i've got it
+
(10:49:50 AM) epmclellan: courtney: you've been doing quite a bit of work at UBC too
−
(1:35:00 PM) vangarderen.peter: berwin22: then Austin made call to switch to sftp
+
(10:49:53 AM) courtney: taking a pause on it until next week
−
(1:35:09 PM) vangarderen.peter: as officially supported method
+
(10:50:02 AM) courtney: working with sarah/lisa/edwin
−
(1:35:29 PM) vangarderen.peter: it sounds like a good move
+
(10:50:24 AM) JessicaB: erwin
−
(1:35:35 PM) berwin22: yes, I agree
+
(10:50:40 AM) courtney: i think we have a good procedure in place for all three situations: 5.5" floppies, opt disks, and hard drivews
−
(1:35:54 PM) vangarderen.peter: great tech support on the forums this week guys.
+
(10:50:45 AM) courtney: yes, erwin - sorry, typo
−
(1:36:04 PM) berwin22: I'd rather have one method, than one for each of our distrobutions
+
(10:50:55 AM) epmclellan: courtney: I'm pretty excited about that
−
(1:36:11 PM) vangarderen.peter: there is definitely a little spike of Archivematica interest right now
+
(10:51:14 AM) epmclellan: a lot of clients need that stuff
−
(1:36:18 PM) vangarderen.peter: a lot of people kicking the tires
+
(10:51:18 AM) peterVG: nice!
−
(1:36:23 PM) berwin22: I can upload my r3 that has the virtualbox fix
+
(10:51:31 AM) djjuhasz: no 3.5" floppies?
−
(1:36:56 PM) Austin: berwin22: after this release maybe we can just release a vmdk.. which worrks in both vmware and virtualbox
+
(10:51:53 AM) courtney: yes, we'll have lots of different workflows for many different situations... for instance, at cov, i want to do some testing on their optical disk issues
−
(1:37:12 PM) Austin: no sharedfolders.. no need to release a separate version
+
(10:52:05 AM) courtney: there are currently three different fails we need to solve
−
(1:37:17 PM) berwin22: Austin, I like the sounds of that
+
(10:52:22 AM) courtney: where disks won't image or copy using the default workflow (dd)
−
(1:37:22 PM) vangarderen.peter: me too
+
(10:53:09 AM) JessicaB: great!
−
(1:37:32 PM) vangarderen.peter: let's do it
+
(10:54:22 AM) peterVG: what's the other 2?
−
(1:37:42 PM) vangarderen.peter: deployment
+
(10:54:38 AM) courtney: that wasn't one
−
(1:38:01 PM) Austin: rockafella and imf have gone well
+
(10:54:43 AM) courtney: 1. disk won't show up at all
−
(1:38:04 PM) vangarderen.peter: Austin: rock it out with Fernando and Roberto at RAC last week
+
(10:54:46 AM) courtney: 2. disk won't mount
−
(1:38:22 PM) Austin: install has mostly been done on the first days
+
(10:55:02 AM) courtney: 3. audio disks won't image
−
(1:38:37 PM) Austin: run into a few issues.. looks like mcpsqllogger dies on apostrophies
+
(10:55:28 AM) peterVG: k
−
(1:38:47 PM) vangarderen.peter: had brand new server room. 20TB NetApps appliance just for us. ESX servers for archivematica ready to go. Networking green light.
+
(10:55:32 AM) epmclellan: just audio disks?
−
(1:39:13 PM) Austin: yeah was great working with them
+
(10:55:38 AM) courtney: 2. is solved and duplicated at ubc
−
(1:35:08 PM) vangarderen.peter: as officially supported method
+
(10:55:41 AM) courtney: only some kinds of audio disk
−
(1:35:29 PM) vangarderen.peter: it sounds like a good move
+
(10:55:49 AM) courtney: sue suggested it could be drm issues
−
(1:35:35 PM) berwin22: yes, I agree
+
(10:55:52 AM) peterVG: dvds are okay?
−
(1:35:54 PM) vangarderen.peter: great tech support on the forums this week guys.
+
(10:55:55 AM) courtney: need to investigate
−
(1:36:04 PM) berwin22: I'd rather have one method, than one for each of our distrobutions
+
(10:56:05 AM) courtney: these are probs with dvds and cds
−
(1:36:11 PM) vangarderen.peter: there is definitely a little spike of Archivematica interest right now
+
(10:56:10 AM) peterVG: sorry, i meant video on dvd
−
(1:36:18 PM) vangarderen.peter: a lot of people kicking the tires
+
(10:56:23 AM) peterVG: like Barney & Friends
−
(1:36:23 PM) berwin22: I can upload my r3 that has the virtualbox fix
+
(10:56:27 AM) courtney: so far they've been fine, but we could run into something
−
(1:36:56 PM) Austin: berwin22: after this release maybe we can just release a vmdk.. which worrks in both vmware and virtualbox
+
(10:56:43 AM) courtney: there are soooo many problems with Barney & Frien ds
−
(1:37:12 PM) Austin: no sharedfolders.. no need to release a separate version
+
(10:56:55 AM) peterVG: but he loves you
−
(1:37:17 PM) berwin22: Austin, I like the sounds of that
+
(10:57:01 AM) courtney: JessicaB: at dev meeting yesterday, we talked about PREMIS 2.2 implementation
−
(1:37:22 PM) vangarderen.peter: me too
+
(10:57:09 AM) courtney: JessicaB: also applies to ica-atom
−
(1:37:31 PM) vangarderen.peter: let's do it
+
(10:57:38 AM) epmclellan: JessicaB: requirements haven't changed since we talked about this a few weeks ago
−
(1:37:41 PM) vangarderen.peter: deployment
+
(10:57:48 AM) epmclellan: but draft 2.2 of PREMIS has now been approved
−
(1:38:00 PM) Austin: rockafella and imf have gone well
+
(10:57:59 AM) JessicaB: good to know.  
−
(1:38:03 PM) vangarderen.peter: Austin: rock it out with Fernando and Roberto at RAC last week
+
(10:58:00 AM) peterVG: we need to figure out where to put it on Qubit roadmap
−
(1:38:22 PM) Austin: install has mostly been done on the first days
+
(10:58:09 AM) epmclellan: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9
−
(1:38:37 PM) Austin: run into a few issues.. looks like mcpsqllogger dies on apostrophies
+
(10:58:22 AM) peterVG: i.e. between 2.0 RC1 (Sept 4) and 2.0 (Dec 3) or post 2.0
−
(1:38:47 PM) vangarderen.peter: had brand new server room. 20TB NetApps appliance just for us. ESX servers for archivematica ready to go. Networking green light.
+
(10:58:36 AM) peterVG: i think the strategy, as before, is to mirror the implementations exactly
−
(1:39:12 PM) Austin: yeah was great working with them
+
(10:58:41 AM) JessicaB: please keep the qubit team informed.  
−
(1:39:47 PM) berwin22: so... which revision of the virtual box image should be available for download?
+
(10:58:55 AM) JessicaB: epmclellan: thanks for the link
−
(r1 - doesn't support the shared folder stuff.
+
(10:59:00 AM) epmclellan: np
−
(r2 - problem with the nic being set to bridge to eth0 (bad)
+
(10:59:01 AM) peterVG: qubit migration script can take care of migration pre2.0 rights records
−
(r3 - I can upload, but has a preset folder of /home/joseph - I'm fairly confident this wouldn't break anything
+
(10:59:09 AM) peterVG: JessicaB: is it on issue list?
−
(r4 - I make the change to r3 and upload it - would take about 4 hours.
+
(10:59:36 AM) JessicaB: peterVG: i'm afraid i don't know what you are asking.
−
(1:39:55 PM) vangarderen.peter: only hickup was when at the last hour we juggled system between two images to get our server to a 3.5TB size server. But the boys made it 3.5GB
+
(10:59:56 AM) JessicaB: what would you like the issue to be?
−
(1:40:39 PM) Austin: joseph that does break stuff here
+
(10:59:57 AM) peterVG: e.g. "upgrade PREMIS implementation to make it 2.2 compliant. Notes: mirror Archivematica 0.9 implementation. include pre2.0 migration in upgrade script"
−
(1:40:44 PM) Austin: /home/joseph^
+
(11:00:09 AM) JessicaB: ok. i will create it.
−
(1:40:56 PM) Austin: *did
+
(11:00:27 AM) epmclellan: related archivematica issue: http://code.google.com/p/archivematica/issues/detail?id=982
−
(1:40:57 PM) berwin22: K leaving as r1.
+
(11:00:31 AM) peterVG: assign it to 2.0 for now as a high. may get bumped to post 2.0 depending on availability in fall
−
(1:41:10 PM) Austin: ?
+
(11:00:42 AM) JessicaB: is this issue on the roadmap for 2.0 release?
−
(1:41:24 PM) Austin: I think I deleted r1 already
+
(11:01:03 AM) peterVG: i guess it wasn't until now
−
(1:41:26 PM) Austin:  
+
(11:01:32 AM) peterVG: we won't get to it for 2.0 RC1 by Sept 4 but maybe 2.0 Dec.3.
−
(1:41:37 PM) Austin: current one up there is r2
+
(11:01:43 AM) peterVG: will need to discuss at our roadmap checkin tomorrow
−
(1:41:38 PM) berwin22: http://archivematica.org/wiki/index.php?title=Virtual_appliance_instructions
+
(11:02:22 AM) peterVG: unfortunately got dropped on us by PREMIS committee. would have been nice if they had just been really late with updates like every other standard committee :-)
−
(We need to update this wiki with the sftp instructions
+
(11:02:26 AM) JessicaB: communication between Archivematica and Qubit could be improved now that the two projects are working in tandem. i'm not sure how you want to address that.
−
(1:41:45 PM) berwin22: I never deleted it.
+
(11:02:40 AM) courtney: JessicaB: seconded
−
(1:41:48 PM) Austin: yeah, havnt had time
+
(11:02:40 AM) epmclellan: JessicaB: good subject for ArtefactualCon
−
(1:41:51 PM) berwin22: or updated the wiki to point to it
+
(11:02:47 AM) peterVG: good thing to discuss at ArtefactualCon
−
(1:41:56 PM) Austin: (10:41:23 AM) Austin: I think I deleted r1 already *
+
(11:02:54 AM) courtney: ..haha great minds
−
(1:42:03 PM) vangarderen.peter: who's gonna have time to update those docs first?
+
(11:03:01 AM) peterVG: we have time to discuss these types of improvements
−
(1:42:25 PM) Austin: Im looking forward to taking a break tomorrow.. maybe if I have network in the airport today
+
(11:03:17 AM) JessicaB: great. i for one - would love to be more up to speed with archivematica functions and features.
−
(1:42:45 PM) vangarderen.peter: berwin22: what are you working on?
+
(11:03:19 AM) peterVG: actually, most of ArtefactualCon is meant to discuss these types of improvements
−
(1:43:23 PM) vangarderen.peter: it might save us some more forum questions the sooner we get that updated. requires some screenshots eh?
+
(11:03:27 AM) peterVG: ^ hold those thoughts
−
(1:43:57 PM) berwin22: ... at this point I think I should create r4 of the virtual box stuff, cause r1 is missing
+
(11:03:46 AM) JessicaB: it's hard to simply lurk in the meetings on IRS and grasp everything that is going on.
−
(1:44:02 PM) berwin22: well deleted
+
(11:04:58 AM) epmclellan: agreed
−
(1:44:04 PM) Austin: yeah
+
(11:05:53 AM) courtney: mtg adjourned?
−
(1:44:07 PM) Austin: and r2 dosnt work
+
(11:05:59 AM) epmclellan: think so
−
(1:44:10 PM) Austin: or..
 
−
(1:44:15 PM) Austin: just explain howto use the vmdk
 
−
(1:40:57 PM) berwin22: K leaving as r1.
 
−
(1:41:10 PM) Austin: ?
 
−
(1:41:23 PM) Austin: I think I deleted r1 already
 
−
(1:41:25 PM) Austin:
 
−
(1:41:37 PM) Austin: current one up there is r2
 
−
(1:41:38 PM) berwin22: http://archivematica.org/wiki/index.php?title=Virtual_appliance_instructions
 
−
(We need to update this wiki with the sftp instructions
 
−
(1:41:45 PM) berwin22: I never deleted it.
 
−
(1:41:48 PM) Austin: yeah, havnt had time
 
−
(1:41:51 PM) berwin22: or updated the wiki to point to it
 
−
(1:41:56 PM) Austin: (10:41:23 AM) Austin: I think I deleted r1 already *
 
−
(1:42:02 PM) vangarderen.peter: who's gonna have time to update those docs first?
 
−
(1:42:24 PM) Austin: Im looking forward to taking a break tomorrow.. maybe if I have network in the airport today
 
−
(1:42:45 PM) vangarderen.peter: berwin22: what are you working on?
 
−
(1:43:22 PM) vangarderen.peter: it might save us some more forum questions the sooner we get that updated. requires some screenshots eh?
 
−
(1:43:56 PM) berwin22: ... at this point I think I should create r4 of the virtual box stuff, cause r1 is missing
 
−
(1:44:01 PM) berwin22: well deleted
 
−
(1:44:04 PM) Austin: yeah
 
−
(1:44:07 PM) Austin: and r2 dosnt work
 
−
(1:44:10 PM) Austin: or..
 
−
(1:44:15 PM) Austin: just explain howto use the vmdk
 
−
(1:44:38 PM) Austin: and we rename  archivematica-0.7alpha-vmware  to archivematica-0.7alpha-vmdk
 
−
(1:45:04 PM) david.juhasz: has the vmdk been tested with virtualbox?
 
−
(1:45:16 PM) berwin22: they'd both take about the same amount of time. and I know what I'm doing on the first.
 
−
(1:45:18 PM) Austin: we use the vmdk to create the virtualbox image
 
−
(1:45:27 PM) Austin: least I do
 
−
(1:45:51 PM) Austin: virtualbox image is the vmdk imported, and with the guest additions added(which are broken)
 
−
(1:46:12 PM) david.juhasz: Austin: so the answer is no?
 
−
(1:46:21 PM) Austin: ?
 
−
(1:46:23 PM) vangarderen.peter: *confused too*
 
−
(1:46:32 PM) Austin: no.. its yes,  they are the same thing
 
−
(1:46:39 PM) vangarderen.peter: we're only going to create/support one vm format?
 
−
(1:46:46 PM) Austin: just the virtualbox image has the guest additions added and exported as ovf
 
−
(1:46:53 PM) berwin22: Austin, are you wanting the updated sources list in r4?
 
−
(1:46:58 PM) vangarderen.peter: which should work equally well with VMware and VirtualBox players?
 
−
(1:47:00 PM) Austin: sure
 
−
(1:47:10 PM) david.juhasz: Austin: right, I just think somebody should load up the vmdk in virtualbox to make sure it really, really works
 
−
(1:47:14 PM) Austin: berwin22: sure*
 
−
(1:47:22 PM) Austin: agreed
 
−
(1:47:24 PM) vangarderen.peter: david.juhasz: i agree, it needs evelyn blessing
 
−
(1:47:39 PM) berwin22: Just to confirm: no anticipated problems with version clashes or anything with that sources list.
 
−
(1:48:06 PM) Austin: ?
 
−
(1:48:26 PM) Austin: not really sure what your talking about
 
−
(1:48:33 PM) vangarderen.peter: me neither
 
−
(1:48:48 PM) Austin: your talking about switching your sources.list that you use to build off a mirror to a working one?
 
−
(1:48:49 PM) berwin22: http://archivematica.org/downloads/sources.list
 
−
(1:48:49 PM) Austin: sure
 
−
(1:49:10 PM) berwin22: that sources list is different than the one currently in the vm
 
−
(1:49:18 PM) Austin: in your vm?
 
−
(1:49:25 PM) Austin: my vm?
 
−
(1:49:34 PM) Austin: I know the ones I uploaded have my mirror
 
−
(1:46:39 PM) vangarderen.peter: we're only going to create/support one vm format?
 
−
(1:46:46 PM) Austin: just the virtualbox image has the guest additions added and exported as ovf
 
−
(1:46:52 PM) berwin22: Austin, are you wanting the updated sources list in r4?
 
−
(1:46:58 PM) vangarderen.peter: which should work equally well with VMware and VirtualBox players?
 
−
(1:47:00 PM) Austin: sure
 
−
(1:47:10 PM) david.juhasz: Austin: right, I just think somebody should load up the vmdk in virtualbox to make sure it really, really works
 
−
(1:47:14 PM) Austin: berwin22: sure*
 
−
(1:47:22 PM) Austin: agreed
 
−
(1:47:23 PM) vangarderen.peter: david.juhasz: i agree, it needs evelyn blessing
 
−
(1:47:38 PM) berwin22: Just to confirm: no anticipated problems with version clashes or anything with that sources list.
 
−
(1:48:06 PM) Austin: ?
 
−
(1:48:25 PM) Austin: not really sure what your talking about
 
−
(1:48:33 PM) vangarderen.peter: me neither
 
−
(1:48:48 PM) Austin: your talking about switching your sources.list that you use to build off a mirror to a working one?
 
−
(1:48:49 PM) berwin22: http://archivematica.org/downloads/sources.list
 
−
(1:48:49 PM) Austin: sure
 
−
(1:49:10 PM) berwin22: that sources list is different than the one currently in the vm
 
−
(1:49:18 PM) Austin: in your vm?
 
−
(1:49:24 PM) Austin: my vm?
 
−
(1:49:34 PM) Austin: I know the ones I uploaded have my mirror
 
−
(1:50:26 PM) berwin22: yeah. are we wanting to use the sources list, with your mirror in it, to prevent *bad* updates, or the http://archivematica.org/downloads/sources.list file?
 
−
(1:50:45 PM) Austin: thats why I left it in.. to prevent bad updates..
 
−
(1:50:49 PM) vangarderen.peter: okay, can discuss further after meeting
 
−
(1:50:49 PM) Austin: but useful if people want ssh
 
−
(1:50:52 PM) vangarderen.peter: okay, any more dev or deployment to report on?
 
−
(1:51:18 PM) vangarderen.peter: Austin: ingested a 1GB .pst file at IMF today?
 
−
(1:51:57 PM) Austin: yeah
 
−
(1:52:02 PM) Austin: worked great
 
−
(1:52:18 PM) vangarderen.peter: that's great
 
−
(1:52:23 PM) vangarderen.peter: 4GB vms eh?
 
−
(1:52:25 PM) Austin: noticed readpst is threaded.. so the more available CPUs the better
 
−
(1:52:27 PM) Austin: yeah..
 
−
(1:52:35 PM) Austin: but maxed out around 600mb of ram
 
−
(1:53:03 PM) vangarderen.peter: each vm would max out at 600mb but you could add more vm processors and it would thread them?
 
−
(1:53:29 PM) Austin: nah.. just the running vm was at 600mb of ram..
 
−
(1:53:37 PM) Austin: also had firefox and thunar etc etc open
 
−
(1:53:39 PM) vangarderen.peter: ah k
 
−
(1:53:41 PM) vangarderen.peter: docs?
 
−
(1:53:43 PM) vangarderen.peter: Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
 
−
(1:49:34 PM) Austin: I know the ones I uploaded have my mirror
 
−
(1:50:25 PM) berwin22: yeah. are we wanting to use the sources list, with your mirror in it, to prevent *bad* updates, or the http://archivematica.org/downloads/sources.list file?
 
−
(1:50:45 PM) Austin: thats why I left it in.. to prevent bad updates..
 
−
(1:50:49 PM) vangarderen.peter: okay, can discuss further after meeting
 
−
(1:50:49 PM) Austin: but useful if people want ssh
 
−
(1:50:52 PM) vangarderen.peter: okay, any more dev or deployment to report on?
 
−
(1:51:17 PM) vangarderen.peter: Austin: ingested a 1GB .pst file at IMF today?
 
−
(1:51:57 PM) Austin: yeah
 
−
(1:52:02 PM) Austin: worked great
 
−
(1:52:18 PM) vangarderen.peter: that's great
 
−
(1:52:23 PM) vangarderen.peter: 4GB vms eh?
 
−
(1:52:25 PM) Austin: noticed readpst is threaded.. so the more available CPUs the better
 
−
(1:52:27 PM) Austin: yeah..
 
−
(1:52:34 PM) Austin: but maxed out around 600mb of ram
 
−
(1:53:03 PM) vangarderen.peter: each vm would max out at 600mb but you could add more vm processors and it would thread them?
 
−
(1:53:29 PM) Austin: nah.. just the running vm was at 600mb of ram..
 
−
(1:53:36 PM) Austin: also had firefox and thunar etc etc open
 
−
(1:53:38 PM) vangarderen.peter: ah k
 
−
(1:53:41 PM) vangarderen.peter: docs?
 
−
(1:53:42 PM) vangarderen.peter: Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
 
−
(1:55:00 PM) vangarderen.peter: lots of installation tech support on the forums this week and other architecture discussions
 
−
(1:55:43 PM) vangarderen.peter: great support from Artefactual. got lots of compliments about our fast, friendly responses on the discussion list. It makes a big impression.
 
−
(1:56:30 PM) MJ Suhonos: nice to hear
 
−
(1:56:36 PM) Jessica  Bushey: Awesome!
 
−
(ford35229 entered the room. (1:57:10 PM)
 
−
(1:57:20 PM) vangarderen.peter: okay, i'm gonna run if there's nothing else guys
 
 
</pre>
 
</pre>

Latest revision as of 13:12, 30 May 2012

Development[edit]

  • 0.9 Feature freeze is today, a meeting yesterday clarified the roadmap
  • Re maildir processing: Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
  • PREMIS 2.2 has been approved, so update of rights module is now on 0.9 roadmap: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9.

Deployment[edit]

  • Courtney has been working with UBC Library on procedures for all three external media situations: 5.25" floppies, opt disks, and hard drives. We'll have lots of different workflows for many different situations... for instance, at cov, she want to do some testing on their optical disk issues.
    • Three different types of fails:
      • disk won't show up at all
      • disk won't mount
      • disk won't image (some kinds of audio disks have been failing to image)


Testing[edit]


Documentation[edit]


Chat log[edit]

(10:39:40 AM) peterVG: had good archivematica dev mtg yesterday, got a lot sorted out
(10:39:50 AM) courtney: roadmap is sorted on wiki
(10:39:58 AM) peterVG: oh great, thx
(10:40:03 AM) peterVG: http://archivematica.org/roadmap
(10:40:06 AM) epmclellan: I updated some issues and the email preservation wiki page
(10:40:07 AM) courtney: notes about requirements for compression/packaging got a page
(10:40:49 AM) epmclellan: https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
(10:41:04 AM) courtney: https://www.archivematica.org/wiki/AIP_packaging_and_compression
(10:41:29 AM) peterVG: nice cleanup on roadmap page courtney thx
(10:41:33 AM) epmclellan: I made a table for ARTi to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
(10:41:41 AM) berwin221: been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
(10:41:45 AM) epmclellan: ARTi: feel free to change the table structure if needed
(10:41:54 AM) ARTi: thanks epmclellan
(10:41:57 AM) peterVG: berwin221 nice
(10:42:03 AM) peterVG: thx epmclellan and ARTi!
berwin22 berwin221 
(10:42:15 AM) epmclellan: berwin221 wow
(10:42:28 AM) peterVG: just updated roadmap page to indicate dec 1 as official 1.0 release date
(10:42:29 AM) courtney: wking on basic access tab search mockup this am
(10:42:55 AM) courtney: awesome berwin22
(10:43:02 AM) peterVG: oh wait, that's a saturday....dec 3
(10:44:06 AM) peterVG: btw, this link was getting passed around the twitterverse this week: http://www.archives.gov/applied-research/events/archivematica-transcript.pdf
(10:44:20 AM) peterVG: transcript of my NARA talk on Archivematica two years ago now. Was demoing 0.6
(10:44:43 AM) peterVG: if you can stand the literal transcription, including some uhms, is pretty interesting to see how far we've come
(10:44:53 AM) epmclellan: cool
(10:44:54 AM) mcantelon: Nice
(10:45:03 AM) courtney: yeah, saw that... 
(10:45:13 AM) epmclellan: love it when our software and eg "NARA" get in the same sentence
(10:45:34 AM) peterVG: and, in spite of the usual stress and craziness of our release schedule, I think provides a pretty good rationale of how we are going about our dev cycles and the organizing principle behind Archivematica
(10:45:51 AM) peterVG: ^ what some comp sci academics would call an "emergent" system
(10:46:24 AM) epmclellan: what's the next phase, "dominant"?
(10:46:25 AM) epmclellan: :)
(10:47:04 AM) peterVG: "Each iteration in an agile development method leads to improved requirements, 
(10:47:04 AM) peterVG: obviously improved software, as well as updates to documentation, improving the 
(10:47:04 AM) peterVG: scope, depth and breadth of all of those, as well as development resources – the 
(10:47:04 AM) peterVG: resources that are available to developers and people working with the software. 
(10:47:04 AM) peterVG: So the big part of that is that we’re not going to get it right the first time; we just 
(10:47:05 AM) peterVG: pretty much assume that. "
(10:47:30 AM) peterVG: we're also probably not gonna get it right the second or third time either ;-)
(10:47:59 AM) epmclellan: there's more latitude for us to say things like that than commercial software vendors, I think
(10:48:05 AM) peterVG: "So, the agile development methodology really is very well suited to the digital preservation field, where for all intents and purposes we’re never actually going to finish making our system because the technology we’re trying to preserve is constantly changing and the technology we have available to preserve digital objects is constantly changing so we try to just accept that right from the start as a principle." 
(10:48:31 AM) courtney: the problem is that commercial vendors have the same limitations but don't admit it
(10:48:40 AM) peterVG: ^ exactly
(10:48:44 AM) courtney: makes upgrading and migration very difficult
(10:48:54 AM) epmclellan: yes, it's hard for them to say they don't have it exactly right but it costs a million dollars
(10:49:41 AM) epmclellan: so any more deployment, docs, testing?
(10:49:44 AM) courtney: btw... for meeting notes: ran through a lot of my QA 
(10:49:50 AM) epmclellan: courtney: you've been doing quite a bit of work at UBC too
(10:49:53 AM) courtney: taking a pause on it until next week
(10:50:02 AM) courtney: working with sarah/lisa/edwin
(10:50:24 AM) JessicaB: erwin
(10:50:40 AM) courtney: i think we have a good procedure in place for all three situations: 5.5" floppies, opt disks, and hard drivews
(10:50:45 AM) courtney: yes, erwin - sorry, typo
(10:50:55 AM) epmclellan: courtney: I'm pretty excited about that
(10:51:14 AM) epmclellan: a lot of clients need that stuff
(10:51:18 AM) peterVG: nice!
(10:51:31 AM) djjuhasz: no 3.5" floppies?
(10:51:53 AM) courtney: yes, we'll have lots of different workflows for many different situations... for instance, at cov, i want to do some testing on their optical disk issues
(10:52:05 AM) courtney: there are currently three different fails we need to solve
(10:52:22 AM) courtney: where disks won't image or copy using the default workflow (dd)
(10:53:09 AM) JessicaB: great!
(10:54:22 AM) peterVG: what's the other 2?
(10:54:38 AM) courtney: that wasn't one
(10:54:43 AM) courtney: 1. disk won't show up at all
(10:54:46 AM) courtney: 2. disk won't mount
(10:55:02 AM) courtney: 3. audio disks won't image
(10:55:28 AM) peterVG: k
(10:55:32 AM) epmclellan: just audio disks?
(10:55:38 AM) courtney: 2. is solved and duplicated at ubc
(10:55:41 AM) courtney: only some kinds of audio disk
(10:55:49 AM) courtney: sue suggested it could be drm issues
(10:55:52 AM) peterVG: dvds are okay?
(10:55:55 AM) courtney: need to investigate
(10:56:05 AM) courtney: these are probs with dvds and cds
(10:56:10 AM) peterVG: sorry, i meant video on dvd
(10:56:23 AM) peterVG: like Barney & Friends
(10:56:27 AM) courtney: so far they've been fine, but we could run into something
(10:56:43 AM) courtney: there are soooo many problems with Barney & Frien ds
(10:56:55 AM) peterVG: but he loves you
(10:57:01 AM) courtney: JessicaB: at dev meeting yesterday, we talked about PREMIS 2.2 implementation
(10:57:09 AM) courtney: JessicaB: also applies to ica-atom
(10:57:38 AM) epmclellan: JessicaB: requirements haven't changed since we talked about this a few weeks ago
(10:57:48 AM) epmclellan: but draft 2.2 of PREMIS has now been approved
(10:57:59 AM) JessicaB: good to know. 
(10:58:00 AM) peterVG: we need to figure out where to put it on Qubit roadmap
(10:58:09 AM) epmclellan: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9
(10:58:22 AM) peterVG: i.e. between 2.0 RC1 (Sept 4) and 2.0 (Dec 3) or post 2.0
(10:58:36 AM) peterVG: i think the strategy, as before, is to mirror the implementations exactly
(10:58:41 AM) JessicaB: please keep the qubit team informed. 
(10:58:55 AM) JessicaB: epmclellan: thanks for the link
(10:59:00 AM) epmclellan: np
(10:59:01 AM) peterVG: qubit migration script can take care of migration pre2.0 rights records
(10:59:09 AM) peterVG: JessicaB: is it on issue list?
(10:59:36 AM) JessicaB: peterVG: i'm afraid i don't know what you are asking.
(10:59:56 AM) JessicaB: what would you like the issue to be?
(10:59:57 AM) peterVG: e.g. "upgrade PREMIS implementation to make it 2.2 compliant. Notes: mirror Archivematica 0.9 implementation. include pre2.0 migration in upgrade script"
(11:00:09 AM) JessicaB: ok. i will create it.
(11:00:27 AM) epmclellan: related archivematica issue: http://code.google.com/p/archivematica/issues/detail?id=982
(11:00:31 AM) peterVG: assign it to 2.0 for now as a high. may get bumped to post 2.0 depending on availability in fall
(11:00:42 AM) JessicaB: is this issue on the roadmap for 2.0 release?
(11:01:03 AM) peterVG: i guess it wasn't until now
(11:01:32 AM) peterVG: we won't get to it for 2.0 RC1 by Sept 4 but maybe 2.0 Dec.3.
(11:01:43 AM) peterVG: will need to discuss at our roadmap checkin tomorrow
(11:02:22 AM) peterVG: unfortunately got dropped on us by PREMIS committee. would have been nice if they had just been really late with updates like every other standard committee :-)
(11:02:26 AM) JessicaB: communication between Archivematica and Qubit could be improved now that the two projects are working in tandem. i'm not sure how you want to address that. 
(11:02:40 AM) courtney: JessicaB: seconded
(11:02:40 AM) epmclellan: JessicaB: good subject for ArtefactualCon
(11:02:47 AM) peterVG: good thing to discuss at ArtefactualCon
(11:02:54 AM) courtney: ..haha great minds
(11:03:01 AM) peterVG: we have time to discuss these types of improvements
(11:03:17 AM) JessicaB: great. i for one - would love to be more up to speed with archivematica functions and features.
(11:03:19 AM) peterVG: actually, most of ArtefactualCon is meant to discuss these types of improvements
(11:03:27 AM) peterVG: ^ hold those thoughts
(11:03:46 AM) JessicaB: it's hard to simply lurk in the meetings on IRS and grasp everything that is going on.
(11:04:58 AM) epmclellan: agreed
(11:05:53 AM) courtney: mtg adjourned? 
(11:05:59 AM) epmclellan: think so
Retrieved from "https://wiki.archivematica.org/index.php?title=Meeting_20120530&oldid=5969"