Difference between revisions of "Meeting 20120530"

From Archivematica
Jump to navigation Jump to search
Line 18: Line 18:
  
 
* Evelyn made a table for Austin to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
 
* Evelyn made a table for Austin to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
 +
  
 
== Documentation ==
 
== Documentation ==
  
−
* Evelyn has being doing lots of project documentation work for RAC and IMF on-site work these past two weeks.
+
* Courtney updated the [[Development roadmap]]
−
* lots of installation tech support on the forums this week and other architecture discussions; great support from Artefactual. got lots of compliments about our fast, friendly responses on the discussion list. It makes a big impression.
+
* Evelyn updated maildir processing requirements at https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
 +
* Courtney created a packaging and compression at https://www.archivematica.org/wiki/AIP_packaging_and_compression
 +
 
  
 
== Chat log ==
 
== Chat log ==
  
 
<pre>
 
<pre>
−
 
+
(10:39:40 AM) peterVG: had good archivematica dev mtg yesterday, got a lot sorted out
 +
(10:39:50 AM) courtney: roadmap is sorted on wiki
 +
(10:39:58 AM) peterVG: oh great, thx
 +
(10:40:03 AM) peterVG: http://archivematica.org/roadmap
 +
(10:40:06 AM) epmclellan: I updated some issues and the email preservation wiki page
 +
(10:40:07 AM) courtney: notes about requirements for compression/packaging got a page
 +
(10:40:49 AM) epmclellan: https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
 +
(10:41:04 AM) courtney: https://www.archivematica.org/wiki/AIP_packaging_and_compression
 +
(10:41:29 AM) peterVG: nice cleanup on roadmap page courtney thx
 +
(10:41:33 AM) epmclellan: I made a table for ARTi to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
 +
(10:41:41 AM) berwin221: been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
 +
(10:41:45 AM) epmclellan: ARTi: feel free to change the table structure if needed
 +
(10:41:54 AM) ARTi: thanks epmclellan
 +
(10:41:57 AM) peterVG: berwin221 nice
 +
(10:42:03 AM) peterVG: thx epmclellan and ARTi!
 +
berwin22 berwin221
 +
(10:42:15 AM) epmclellan: berwin221 wow
 +
(10:42:28 AM) peterVG: just updated roadmap page to indicate dec 1 as official 1.0 release date
 +
(10:42:29 AM) courtney: wking on basic access tab search mockup this am
 +
(10:42:55 AM) courtney: awesome berwin22
 +
(10:43:02 AM) peterVG: oh wait, that's a saturday....dec 3
 +
(10:44:06 AM) peterVG: btw, this link was getting passed around the twitterverse this week: http://www.archives.gov/applied-research/events/archivematica-transcript.pdf
 +
(10:44:20 AM) peterVG: transcript of my NARA talk on Archivematica two years ago now. Was demoing 0.6
 +
(10:44:43 AM) peterVG: if you can stand the literal transcription, including some uhms, is pretty interesting to see how far we've come
 +
(10:44:53 AM) epmclellan: cool
 +
(10:44:54 AM) mcantelon: Nice
 +
(10:45:03 AM) courtney: yeah, saw that...
 +
(10:45:13 AM) epmclellan: love it when our software and eg "NARA" get in the same sentence
 +
(10:45:34 AM) peterVG: and, in spite of the usual stress and craziness of our release schedule, I think provides a pretty good rationale of how we are going about our dev cycles and the organizing principle behind Archivematica
 +
(10:45:51 AM) peterVG: ^ what some comp sci academics would call an "emergent" system
 +
(10:46:24 AM) epmclellan: what's the next phase, "dominant"?
 +
(10:46:25 AM) epmclellan: :)
 +
(10:47:04 AM) peterVG: "Each iteration in an agile development method leads to improved requirements,
 +
(10:47:04 AM) peterVG: obviously improved software, as well as updates to documentation, improving the
 +
(10:47:04 AM) peterVG: scope, depth and breadth of all of those, as well as development resources – the
 +
(10:47:04 AM) peterVG: resources that are available to developers and people working with the software.
 +
(10:47:04 AM) peterVG: So the big part of that is that we’re not going to get it right the first time; we just
 +
(10:47:05 AM) peterVG: pretty much assume that. "
 +
(10:47:30 AM) peterVG: we're also probably not gonna get it right the second or third time either ;-)
 +
(10:47:59 AM) epmclellan: there's more latitude for us to say things like that than commercial software vendors, I think
 +
(10:48:05 AM) peterVG: "So, the agile development methodology really is very well suited to the digital preservation field, where for all intents and purposes we’re never actually going to finish making our system because the technology we’re trying to preserve is constantly changing and the technology we have available to preserve digital objects is constantly changing so we try to just accept that right from the start as a principle."
 +
(10:48:31 AM) courtney: the problem is that commercial vendors have the same limitations but don't admit it
 +
(10:48:40 AM) peterVG: ^ exactly
 +
(10:48:44 AM) courtney: makes upgrading and migration very difficult
 +
(10:48:54 AM) epmclellan: yes, it's hard for them to say they don't have it exactly right but it costs a million dollars
 +
(10:49:41 AM) epmclellan: so any more deployment, docs, testing?
 +
(10:49:44 AM) courtney: btw... for meeting notes: ran through a lot of my QA
 +
(10:49:50 AM) epmclellan: courtney: you've been doing quite a bit of work at UBC too
 +
(10:49:53 AM) courtney: taking a pause on it until next week
 +
(10:50:02 AM) courtney: working with sarah/lisa/edwin
 +
(10:50:24 AM) JessicaB: erwin
 +
(10:50:40 AM) courtney: i think we have a good procedure in place for all three situations: 5.5" floppies, opt disks, and hard drivews
 +
(10:50:45 AM) courtney: yes, erwin - sorry, typo
 +
(10:50:55 AM) epmclellan: courtney: I'm pretty excited about that
 +
(10:51:14 AM) epmclellan: a lot of clients need that stuff
 +
(10:51:18 AM) peterVG: nice!
 +
(10:51:31 AM) djjuhasz: no 3.5" floppies?
 +
(10:51:53 AM) courtney: yes, we'll have lots of different workflows for many different situations... for instance, at cov, i want to do some testing on their optical disk issues
 +
(10:52:05 AM) courtney: there are currently three different fails we need to solve
 +
(10:52:22 AM) courtney: where disks won't image or copy using the default workflow (dd)
 +
(10:53:09 AM) JessicaB: great!
 +
(10:54:22 AM) peterVG: what's the other 2?
 +
(10:54:38 AM) courtney: that wasn't one
 +
(10:54:43 AM) courtney: 1. disk won't show up at all
 +
(10:54:46 AM) courtney: 2. disk won't mount
 +
(10:55:02 AM) courtney: 3. audio disks won't image
 +
(10:55:28 AM) peterVG: k
 +
(10:55:32 AM) epmclellan: just audio disks?
 +
(10:55:38 AM) courtney: 2. is solved and duplicated at ubc
 +
(10:55:41 AM) courtney: only some kinds of audio disk
 +
(10:55:49 AM) courtney: sue suggested it could be drm issues
 +
(10:55:52 AM) peterVG: dvds are okay?
 +
(10:55:55 AM) courtney: need to investigate
 +
(10:56:05 AM) courtney: these are probs with dvds and cds
 +
(10:56:10 AM) peterVG: sorry, i meant video on dvd
 +
(10:56:23 AM) peterVG: like Barney & Friends
 +
(10:56:27 AM) courtney: so far they've been fine, but we could run into something
 +
(10:56:43 AM) courtney: there are soooo many problems with Barney & Frien ds
 +
(10:56:55 AM) peterVG: but he loves you
 +
(10:57:01 AM) courtney: JessicaB: at dev meeting yesterday, we talked about PREMIS 2.2 implementation
 +
(10:57:09 AM) courtney: JessicaB: also applies to ica-atom
 +
(10:57:38 AM) epmclellan: JessicaB: requirements haven't changed since we talked about this a few weeks ago
 +
(10:57:48 AM) epmclellan: but draft 2.2 of PREMIS has now been approved
 +
(10:57:59 AM) JessicaB: good to know.
 +
(10:58:00 AM) peterVG: we need to figure out where to put it on Qubit roadmap
 +
(10:58:09 AM) epmclellan: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9
 +
(10:58:22 AM) peterVG: i.e. between 2.0 RC1 (Sept 4) and 2.0 (Dec 3) or post 2.0
 +
(10:58:36 AM) peterVG: i think the strategy, as before, is to mirror the implementations exactly
 +
(10:58:41 AM) JessicaB: please keep the qubit team informed.
 +
(10:58:55 AM) JessicaB: epmclellan: thanks for the link
 +
(10:59:00 AM) epmclellan: np
 +
(10:59:01 AM) peterVG: qubit migration script can take care of migration pre2.0 rights records
 +
(10:59:09 AM) peterVG: JessicaB: is it on issue list?
 +
(10:59:36 AM) JessicaB: peterVG: i'm afraid i don't know what you are asking.
 +
(10:59:56 AM) JessicaB: what would you like the issue to be?
 +
(10:59:57 AM) peterVG: e.g. "upgrade PREMIS implementation to make it 2.2 compliant. Notes: mirror Archivematica 0.9 implementation. include pre2.0 migration in upgrade script"
 +
(11:00:09 AM) JessicaB: ok. i will create it.
 +
(11:00:27 AM) epmclellan: related archivematica issue: http://code.google.com/p/archivematica/issues/detail?id=982
 +
(11:00:31 AM) peterVG: assign it to 2.0 for now as a high. may get bumped to post 2.0 depending on availability in fall
 +
(11:00:42 AM) JessicaB: is this issue on the roadmap for 2.0 release?
 +
(11:01:03 AM) peterVG: i guess it wasn't until now
 +
(11:01:32 AM) peterVG: we won't get to it for 2.0 RC1 by Sept 4 but maybe 2.0 Dec.3.
 +
(11:01:43 AM) peterVG: will need to discuss at our roadmap checkin tomorrow
 +
(11:02:22 AM) peterVG: unfortunately got dropped on us by PREMIS committee. would have been nice if they had just been really late with updates like every other standard committee :-)
 +
(11:02:26 AM) JessicaB: communication between Archivematica and Qubit could be improved now that the two projects are working in tandem. i'm not sure how you want to address that.
 +
(11:02:40 AM) courtney: JessicaB: seconded
 +
(11:02:40 AM) epmclellan: JessicaB: good subject for ArtefactualCon
 +
(11:02:47 AM) peterVG: good thing to discuss at ArtefactualCon
 +
(11:02:54 AM) courtney: ..haha great minds
 +
(11:03:01 AM) peterVG: we have time to discuss these types of improvements
 +
(11:03:17 AM) JessicaB: great. i for one - would love to be more up to speed with archivematica functions and features.
 +
(11:03:19 AM) peterVG: actually, most of ArtefactualCon is meant to discuss these types of improvements
 +
(11:03:27 AM) peterVG: ^ hold those thoughts
 +
(11:03:46 AM) JessicaB: it's hard to simply lurk in the meetings on IRS and grasp everything that is going on.
 +
(11:04:58 AM) epmclellan: agreed
 +
(11:05:53 AM) courtney: mtg adjourned?
 +
(11:05:59 AM) epmclellan: think so
 
</pre>
 
</pre>

Revision as of 12:10, 30 May 2012

Development

  • 0.9 Feature freeze is today, a meeting yesterday clarified the roadmap
  • Joseph has been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
  • PREMIS 2.2 has been approved, so update of rights module is now on 0.9 roadmap: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9.


Deployment

  • Courtney has been working with UBC Library on procedures for all three external media situations: 5.25" floppies, opt disks, and hard drives. We'll have lots of different workflows for many different situations... for instance, at cov, she want to do some testing on their optical disk issues.
    • Three different types of fails:
      • disk won't show up at all
      • disk won't mount
      • disk won't image (some kinds of audio disks have been failing to image)


Testing


Documentation


Chat log

(10:39:40 AM) peterVG: had good archivematica dev mtg yesterday, got a lot sorted out
(10:39:50 AM) courtney: roadmap is sorted on wiki
(10:39:58 AM) peterVG: oh great, thx
(10:40:03 AM) peterVG: http://archivematica.org/roadmap
(10:40:06 AM) epmclellan: I updated some issues and the email preservation wiki page
(10:40:07 AM) courtney: notes about requirements for compression/packaging got a page
(10:40:49 AM) epmclellan: https://www.archivematica.org/wiki/Email_preservation#Archivematica_0.9_maildir_ingest_requirements
(10:41:04 AM) courtney: https://www.archivematica.org/wiki/AIP_packaging_and_compression
(10:41:29 AM) peterVG: nice cleanup on roadmap page courtney thx
(10:41:33 AM) epmclellan: I made a table for ARTi to use for scalability test results at https://www.archivematica.org/wiki/Scalability_testing#Test_results
(10:41:41 AM) berwin221: been working on normalization of maildir to access formats... adding files to transfer to represent the directories. Will normalize the directories, identified by these files. (sound complicated and obscure.. it is, but should work well for our needs) in theory, rights can be applied to these files, which will extend to the DIP.
(10:41:45 AM) epmclellan: ARTi: feel free to change the table structure if needed
(10:41:54 AM) ARTi: thanks epmclellan
(10:41:57 AM) peterVG: berwin221 nice
(10:42:03 AM) peterVG: thx epmclellan and ARTi!
berwin22 berwin221 
(10:42:15 AM) epmclellan: berwin221 wow
(10:42:28 AM) peterVG: just updated roadmap page to indicate dec 1 as official 1.0 release date
(10:42:29 AM) courtney: wking on basic access tab search mockup this am
(10:42:55 AM) courtney: awesome berwin22
(10:43:02 AM) peterVG: oh wait, that's a saturday....dec 3
(10:44:06 AM) peterVG: btw, this link was getting passed around the twitterverse this week: http://www.archives.gov/applied-research/events/archivematica-transcript.pdf
(10:44:20 AM) peterVG: transcript of my NARA talk on Archivematica two years ago now. Was demoing 0.6
(10:44:43 AM) peterVG: if you can stand the literal transcription, including some uhms, is pretty interesting to see how far we've come
(10:44:53 AM) epmclellan: cool
(10:44:54 AM) mcantelon: Nice
(10:45:03 AM) courtney: yeah, saw that... 
(10:45:13 AM) epmclellan: love it when our software and eg "NARA" get in the same sentence
(10:45:34 AM) peterVG: and, in spite of the usual stress and craziness of our release schedule, I think provides a pretty good rationale of how we are going about our dev cycles and the organizing principle behind Archivematica
(10:45:51 AM) peterVG: ^ what some comp sci academics would call an "emergent" system
(10:46:24 AM) epmclellan: what's the next phase, "dominant"?
(10:46:25 AM) epmclellan: :)
(10:47:04 AM) peterVG: "Each iteration in an agile development method leads to improved requirements, 
(10:47:04 AM) peterVG: obviously improved software, as well as updates to documentation, improving the 
(10:47:04 AM) peterVG: scope, depth and breadth of all of those, as well as development resources – the 
(10:47:04 AM) peterVG: resources that are available to developers and people working with the software. 
(10:47:04 AM) peterVG: So the big part of that is that we’re not going to get it right the first time; we just 
(10:47:05 AM) peterVG: pretty much assume that. "
(10:47:30 AM) peterVG: we're also probably not gonna get it right the second or third time either ;-)
(10:47:59 AM) epmclellan: there's more latitude for us to say things like that than commercial software vendors, I think
(10:48:05 AM) peterVG: "So, the agile development methodology really is very well suited to the digital preservation field, where for all intents and purposes we’re never actually going to finish making our system because the technology we’re trying to preserve is constantly changing and the technology we have available to preserve digital objects is constantly changing so we try to just accept that right from the start as a principle." 
(10:48:31 AM) courtney: the problem is that commercial vendors have the same limitations but don't admit it
(10:48:40 AM) peterVG: ^ exactly
(10:48:44 AM) courtney: makes upgrading and migration very difficult
(10:48:54 AM) epmclellan: yes, it's hard for them to say they don't have it exactly right but it costs a million dollars
(10:49:41 AM) epmclellan: so any more deployment, docs, testing?
(10:49:44 AM) courtney: btw... for meeting notes: ran through a lot of my QA 
(10:49:50 AM) epmclellan: courtney: you've been doing quite a bit of work at UBC too
(10:49:53 AM) courtney: taking a pause on it until next week
(10:50:02 AM) courtney: working with sarah/lisa/edwin
(10:50:24 AM) JessicaB: erwin
(10:50:40 AM) courtney: i think we have a good procedure in place for all three situations: 5.5" floppies, opt disks, and hard drivews
(10:50:45 AM) courtney: yes, erwin - sorry, typo
(10:50:55 AM) epmclellan: courtney: I'm pretty excited about that
(10:51:14 AM) epmclellan: a lot of clients need that stuff
(10:51:18 AM) peterVG: nice!
(10:51:31 AM) djjuhasz: no 3.5" floppies?
(10:51:53 AM) courtney: yes, we'll have lots of different workflows for many different situations... for instance, at cov, i want to do some testing on their optical disk issues
(10:52:05 AM) courtney: there are currently three different fails we need to solve
(10:52:22 AM) courtney: where disks won't image or copy using the default workflow (dd)
(10:53:09 AM) JessicaB: great!
(10:54:22 AM) peterVG: what's the other 2?
(10:54:38 AM) courtney: that wasn't one
(10:54:43 AM) courtney: 1. disk won't show up at all
(10:54:46 AM) courtney: 2. disk won't mount
(10:55:02 AM) courtney: 3. audio disks won't image
(10:55:28 AM) peterVG: k
(10:55:32 AM) epmclellan: just audio disks?
(10:55:38 AM) courtney: 2. is solved and duplicated at ubc
(10:55:41 AM) courtney: only some kinds of audio disk
(10:55:49 AM) courtney: sue suggested it could be drm issues
(10:55:52 AM) peterVG: dvds are okay?
(10:55:55 AM) courtney: need to investigate
(10:56:05 AM) courtney: these are probs with dvds and cds
(10:56:10 AM) peterVG: sorry, i meant video on dvd
(10:56:23 AM) peterVG: like Barney & Friends
(10:56:27 AM) courtney: so far they've been fine, but we could run into something
(10:56:43 AM) courtney: there are soooo many problems with Barney & Frien ds
(10:56:55 AM) peterVG: but he loves you
(10:57:01 AM) courtney: JessicaB: at dev meeting yesterday, we talked about PREMIS 2.2 implementation
(10:57:09 AM) courtney: JessicaB: also applies to ica-atom
(10:57:38 AM) epmclellan: JessicaB: requirements haven't changed since we talked about this a few weeks ago
(10:57:48 AM) epmclellan: but draft 2.2 of PREMIS has now been approved
(10:57:59 AM) JessicaB: good to know. 
(10:58:00 AM) peterVG: we need to figure out where to put it on Qubit roadmap
(10:58:09 AM) epmclellan: https://www.archivematica.org/wiki/PREMIS_metadata:_rights_-_0.9
(10:58:22 AM) peterVG: i.e. between 2.0 RC1 (Sept 4) and 2.0 (Dec 3) or post 2.0
(10:58:36 AM) peterVG: i think the strategy, as before, is to mirror the implementations exactly
(10:58:41 AM) JessicaB: please keep the qubit team informed. 
(10:58:55 AM) JessicaB: epmclellan: thanks for the link
(10:59:00 AM) epmclellan: np
(10:59:01 AM) peterVG: qubit migration script can take care of migration pre2.0 rights records
(10:59:09 AM) peterVG: JessicaB: is it on issue list?
(10:59:36 AM) JessicaB: peterVG: i'm afraid i don't know what you are asking.
(10:59:56 AM) JessicaB: what would you like the issue to be?
(10:59:57 AM) peterVG: e.g. "upgrade PREMIS implementation to make it 2.2 compliant. Notes: mirror Archivematica 0.9 implementation. include pre2.0 migration in upgrade script"
(11:00:09 AM) JessicaB: ok. i will create it.
(11:00:27 AM) epmclellan: related archivematica issue: http://code.google.com/p/archivematica/issues/detail?id=982
(11:00:31 AM) peterVG: assign it to 2.0 for now as a high. may get bumped to post 2.0 depending on availability in fall
(11:00:42 AM) JessicaB: is this issue on the roadmap for 2.0 release?
(11:01:03 AM) peterVG: i guess it wasn't until now
(11:01:32 AM) peterVG: we won't get to it for 2.0 RC1 by Sept 4 but maybe 2.0 Dec.3.
(11:01:43 AM) peterVG: will need to discuss at our roadmap checkin tomorrow
(11:02:22 AM) peterVG: unfortunately got dropped on us by PREMIS committee. would have been nice if they had just been really late with updates like every other standard committee :-)
(11:02:26 AM) JessicaB: communication between Archivematica and Qubit could be improved now that the two projects are working in tandem. i'm not sure how you want to address that. 
(11:02:40 AM) courtney: JessicaB: seconded
(11:02:40 AM) epmclellan: JessicaB: good subject for ArtefactualCon
(11:02:47 AM) peterVG: good thing to discuss at ArtefactualCon
(11:02:54 AM) courtney: ..haha great minds
(11:03:01 AM) peterVG: we have time to discuss these types of improvements
(11:03:17 AM) JessicaB: great. i for one - would love to be more up to speed with archivematica functions and features.
(11:03:19 AM) peterVG: actually, most of ArtefactualCon is meant to discuss these types of improvements
(11:03:27 AM) peterVG: ^ hold those thoughts
(11:03:46 AM) JessicaB: it's hard to simply lurk in the meetings on IRS and grasp everything that is going on.
(11:04:58 AM) epmclellan: agreed
(11:05:53 AM) courtney: mtg adjourned? 
(11:05:59 AM) epmclellan: think so
Retrieved from "https://wiki.archivematica.org/index.php?title=Meeting_20120530&oldid=5968"