Difference between revisions of "Meeting 20121031"

From Archivematica
Jump to navigation Jump to search
(Created page with "Artefactual Systems, Internal Archivematica Dev Mtg, 2012-10-31 = Development = * Courtney mocked up Advanced AIP Search: Advanced_AIP_index_search * Joseph has been wor...")
 
 
(7 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
= Development =
 
= Development =
  
−
* Courtney mocked up Advanced AIP Search: [[Advanced_AIP_index_search]]
+
* Joseph has been working away on using PUIDs for normalization
−
* Joseph has been working on implementing the normalization based on file identification tool workflows
+
* Evelyn supplied a list of PUIDs from PRONOM that link to existing normalization rules in Archivematica
−
* Courtney completed [[Transfer_backlog_requirements]]
+
* Mike C changed the Archivematica dev scripts to pull AtoM from Git
−
* Evelyn has been working on requirements for [[TRIM_exports]]
+
* Mike G has been working on the FPR. He got it displaying the tables and such, basic search was working but there's a minor bug in it he just noticed this morning. He hasn't gotten the individual fields/boolean combinations stuff done yet
 +
* Courtney updated a lot of mockups and made sure that there were issues for all of the requirements for transfer backlog, create sip
 +
* Courtney and Mike C worked on updating tooltips in the rights metadata entry template
  
 
= Deployment =
 
= Deployment =
  
−
* Austin has been working on multiple VM deployment for distributed processing
+
* Austin has been working on multi-node install on Windows VM for a client
  
 
= Testing =
 
= Testing =
 +
 +
* Dan tested AM metadata mapping on export to AtoM, and created issue 1268 and issue 1269 in response to some issues encountered with language and date fields
 +
* Courtney has been testing DIP upload and doing QA on outstanding issues
  
 
= Documentation =
 
= Documentation =
  
 +
* Courtney made a DIP structure page on the wiki: https://www.archivematica.org/wiki/DIP_structure
  
 
=chat log=
 
=chat log=
  
 
<pre>
 
<pre>
−
<courtney> and created associated issues
+
(10:34:41 AM) djjuhasz: Archivematica, you have the floor
−
<berwin22> I have been making great headway on implementing the normalization based on file identification tool workflows.
+
(10:34:46 AM) epmclellan: I'll take notes
−
<courtney> hooooray
+
(10:35:29 AM) djjuhasz: (Thanks for taking notes fiver) :)
−
<courtney> maybe not the having the meeting was a good thing?
+
(10:35:32 AM) epmclellan: Joseph has been working away on using PUIDs for normalization
−
<berwin22> I'll be away next week.
+
(10:35:54 AM) epmclellan: epmclellan: supplied a list of PUIDs from PRONOM that link to existing normalization rules
−
<peterVG> berwin22: okay, glad to hear it. re: progress
+
(10:36:06 AM) courtney [~courtney@184.69.130.182] entered the room.
−
<courtney> i've completed Transfer backlog requirements with mockups as well: https://www.archivematica.org/wiki/Transfer_backlog_requirements
+
(10:36:12 AM) epmclellan: hi courtney
−
<peterVG> berwin22: we can discuss outstanding issues and options tomorrow or Fri
+
(10:36:18 AM) courtney: hi
−
<epmclellan1> I've been working with CVA on TRIM export requirements: https://www.archivematica.org/wiki/TRIM_exports
+
(10:36:21 AM) peterVG: fiver: thx, I'm assuming you'll touch base with jessica on this
−
<epmclellan1> which I think will have to be VanDocs export requirements, they're not really generic
+
(10:36:24 AM) epmclellan: just talking about Joseph's work on using PUIDs for normalization
−
<berwin22> Friday may be better, tomorrow I may be away.
+
(10:36:32 AM) courtney: ok
−
<peterVG> okay, great. so for sure on Fri.
+
(10:36:51 AM) epmclellan: one of the key issues is figuring out how to test, right?
−
<courtney> that means I'll work from home tomorrow, come in fri
+
(10:36:58 AM) mcantelon: I changed the Archivematica dev scripts to pull AtoM from Git
−
<berwin22> thanks courtney
+
(10:37:49 AM) fiver: (meeting notes for AtoM: https://www.qubit-toolkit.org/wiki/Meeting_20121031 )
−
<epmclellan1> I'll be at home on Friday, hope that's ok
+
(10:38:15 AM) fiver: peterVG: yes, I will follow up with JessicaB
−
<peterVG> i'll get debrief from you and we'll plan next steps for when you get back in Nov
+
(10:38:18 AM) ARTi1:  mcantelon cool!
−
<epmclellan1> it's in the calendar
+
(10:38:44 AM) epmclellan: MikeG: you've been working on the FPR, right?
−
<courtney> i'll need to update the create sip mockup a bit and sort of "reactivate" those issues so we have time to qa when mike's got something for us
+
(10:39:25 AM) MikeG: yes
−
<peterVG> epmclellan1: np, joseph and I can chat. I can always follow-up with you and courtney the week after or when berwin22 gets back
+
(10:39:39 AM) courtney: how far along?
−
<epmclellan1> sounds good
+
(10:40:20 AM) MikeG: I got it displaying the tables and such, basic search was working but there's a minor bug in it I just noticed this morning. I didn't get the individual fields/boolean combinations stuff done yet
−
<courtney> peterVG: i'll be here for it
+
(10:40:32 AM) MikeG: for the more advanced searches
−
<epmclellan1> thanks
+
(10:40:34 AM) epmclellan: great, thx
−
<peterVG> courtney: okay, good
+
(10:40:47 AM) mcantelon: Nice!
−
<courtney> peterVG: i may have to do a lot of the dirty work
+
(10:40:53 AM) courtney: i'll take a look after you get the bug fixed, k?
−
<peterVG> okay, looking forward to all file mucking details
+
(10:40:58 AM) MikeG: sure, sounds good
−
<courtney> peterVG, epmclellan1 it may be a good idea for us to quickly sit down tomorrow for maybe 1/2 hour about AM dev
+
(10:41:29 AM) courtney: i updated a lot of mockups
−
<epmclellan1> sure
+
(10:41:48 AM) courtney: and made sure that there were issues for all of the requirements for transfer backlog, create sip
−
<peterVG> okay, np
+
(10:42:18 AM) courtney: also made a DIP structure page on the wiki: https://www.archivematica.org/wiki/DIP_structure
−
<courtney> any more dev? mcantelon?
+
(10:42:41 AM) epmclellan: ok, I'll put that under docs
−
<courtney> oh, actually, wondering if i can hand an issue to fiver
+
(10:43:01 AM) epmclellan: any more dev?
−
<mcantelon> I was tied up last with with UBC DIP support and CVA stuff, so no, alas.
+
(10:43:06 AM) courtney: we should put next big dev mtg on the books
−
<fiver> courtney: what's the issue?
+
(10:43:06 AM) fiver: fiver tested AM metadata mapping on export to AtoM, and created issues 1268 and 1269 in response to some issues encountered with language and date fields
−
<courtney> http://code.google.com/p/archivematica/issues/detail?id=1122
+
(10:43:16 AM) courtney: fiver: yes, great reporting
−
<courtney> fiver: might give you some practice with AM
+
(10:43:17 AM) epmclellan: right, thanks fiver
−
<fiver> hm, relates a lot to the current roundtrip work. sure.  
+
(10:43:24 AM) fiver: not sure if testing goes in dev or elsewhere, btw
−
<courtney> anyone opposed to this idea? peterVG, epmclellan1, JessicaB
+
(10:43:33 AM) fiver: re: meetings
−
<epmclellan1> sounds like a good idea to me
+
(10:43:37 AM) courtney: mcantelon: can you update your issues sometime in the next week?
−
<JessicaB> no i think that was Peter's plan.
+
(10:43:46 AM) epmclellan: fiver: no worries, I put it under testing
−
<courtney> hm, can't assign it to him in AM issues list
+
(10:44:02 AM) courtney: mcantelon: i think some of them are actually fixed or moved to 1.0 or beyond
−
<peterVG> issue 1122 not loading for me
+
(10:44:08 AM) mcantelon: courtney: Sure... on the Google Code?
−
<peterVG> but yes, plan was to include Dan in Archivematica QA as well
+
(10:44:56 AM) courtney: mcantelon: yeah
−
<JessicaB> not loading for me either
+
(10:45:00 AM) mcantelon: cool
−
<peterVG> so if that is a good transition issue, please go ahead
+
(10:45:26 AM) epmclellan: deployment?
−
<courtney> it's mapping md from am to atom
+
(10:45:38 AM) courtney: epmclellan: for deployment - can we have a brief talk post-meeting about requirements for that trac-like audit template
−
<peterVG> perfect
+
(10:45:47 AM) epmclellan: courtney: sure
−
<peterVG> googlecode not loading for me
+
(10:46:09 AM) epmclellan: ARTi1: how goes the deployment you're working on?
−
<epmclellan1> me neither
+
(10:47:01 AM) ARTi1: I didn't have luck with installing/running windows :X, going to try and get the Sevein's vm from the office today
−
<mcantelon> Weird, works for me.
+
(10:47:19 AM) ARTi1: I think it hates me
−
<peterVG> i believe evelyn is an admin, she can add dan@artefactual.com to group?
+
(10:47:24 AM) epmclellan: oh dear
−
<peterVG> when its back up?
+
(10:47:42 AM) epmclellan: 1.0-dev install at UBC delayed
−
<courtney> cool, i added fiver to the list of owners in the AM issues list
+
(10:47:51 AM) ARTi1: for upload dip?
−
<courtney> peterVG: i already did
+
(10:47:58 AM) epmclellan: while Mark Jordan completes CONTENTdm work
−
<peterVG> there you go!
+
(10:48:04 AM) ARTi1: right
−
<fiver> creating asana task now - should i put this under AM dev or AM community support in Asana?
+
(10:48:07 AM) epmclellan: but we do have a number of DIP upload issues
−
<courtney> AM dev
+
(10:48:25 AM) epmclellan: I'm going to make a list of what needs to be fixed before UBC can go into production
−
<courtney> mcantelon: will you have time to go over some of the new mockups/issues today?
+
(10:48:39 AM) epmclellan: for example, DIP upload breaks access tab
−
<fiver> thx - task made - added epmclellan1 as follower...
+
(10:48:48 AM) epmclellan: http://code.google.com/p/archivematica/issues/detail?id=1273
−
<mcantelon> courtney: Sure... only thing I have scheduled is a 1 PM meeting with CVA.
+
(10:48:55 AM) mcantelon: ARTi: The Windows VM is, I think, 8GB so it'll take awhile to DL... but I'll put it online somewhere
−
<mcantelon> (phone meeting)
+
(10:49:18 AM) peterVG: ARTi1: working with Jill to upgrade UBC vm aipstore to 3.5 TB
−
<courtney> cool
+
(10:49:38 AM) mcantelon: epmclellan: weird
−
<JessicaB> fiver: can you add me to the followers on your Asana task, so that I can stay in the loop over this critical component between the two systesm
+
(10:49:50 AM) epmclellan: mcantelon: yeah
−
<courtney> me too, por favor
+
(10:49:51 AM) ARTi1: mcantelon: maybe lzma it?
−
<fiver> JessicaB: courtney: done
+
(10:50:01 AM) epmclellan: not that the DIP upload that broke the access tab actually worked
−
<JessicaB> thnx
+
(10:50:05 AM) mcantelon: ARTi1: Cool... I'll try that
−
<courtney> moving on from dev?
+
(10:50:09 AM) ARTi1: think ubuntu comes with lzip or lz or something
−
<epmclellan1> ARTi: how is CVA vm deployment coming along?
+
(10:50:15 AM) mcantelon: nice
−
<epmclellan1> hmm, nm
+
(10:50:27 AM) ARTi1: bzip is good too.. but lzip should get more compression
−
<ARTi> epmclellan1: good, touched base with tuan yesturday about configuration.. just waiting for network info back
+
(10:51:20 AM) ARTi1: peterVG: cheers Ive been following the convo.. should be a easy install
−
<epmclellan1> ah, thanks
+
(10:51:56 AM) epmclellan: any more meeting stuff?
−
<ARTi> Ive mostly been working on deployment
+
(10:52:12 AM) courtney: epmclellan: i've been doing a lot of testing
−
<ARTi> sfu/ubc/cvan all want the new stuff ^_^
+
(10:52:19 AM) courtney: clearing out my qa
−
<epmclellan1> they want the hottest new Archivematica vms
+
(10:52:28 AM) djjuhasz: mcantelon: ARTi1: can you do transfer the Windows VM tonight after office hours?
−
<peterVG> so idea there is to get MCP server with 3 processing client VMs configured and we pump through previous CVA SIPs and try to gauge how much throughput speed improvements we see
+
(10:52:34 AM) epmclellan: focusing on anything in particular, courtney?
−
<ARTi> peterVG: yep, thats the plan
+
(10:52:49 AM) djjuhasz: So we don't saturate the upload bandwidth here.
−
<peterVG> So epmclellan1 can you follow-up and line-up test SIPs
+
(10:52:49 AM) mcantelon: courtney and i worked on updating the tooltips in rights
−
<courtney> ALL of the SIPs?
+
(10:52:54 AM) courtney: DIP upload and clearing out issues
−
<epmclellan1> using CVA's stuff?
+
(10:53:06 AM) epmclellan: k, thanks mcantelon and courtney
−
<peterVG> no, we're just testing for performance improvement right now
+
(10:53:11 AM) courtney: oh yeah, tooltips... but some of them didn't work, so mcantelon has to fix them
−
<epmclellan1> ah, ok
+
(10:53:13 AM) ARTi1: djjuhasz: sure
−
<peterVG> but we do want the same data to compare against
+
(10:53:25 AM) courtney: mcantelon: because of something about the code for some of the fields, right?
−
<peterVG> so a subset of already ingested SIPs
+
(10:53:35 AM) mcantelon: Yeah... AJAX stuff
−
<epmclellan1> ok, I'll talk to Sue
+
(10:53:38 AM) ARTi1: mcantelon: if you want to put it on bion, Ill move it tonight
−
<courtney> testing?
+
(10:53:43 AM) mcantelon: Cool
−
<courtney> i've been doing qa catchup, just a few outstanding that i'll need clarification from the folks who assigned them to me
+
(10:53:51 AM) MikeG- [~MikeG@184.69.130.182] entered the room.
−
<epmclellan1> nothing from me this week
+
(10:54:18 AM) MikeG left the room (quit: Quit: irc2go).
−
<courtney> i'll send direct msgs to those involved.
+
(10:55:02 AM) mcantelon: ARTi: Out of curiosity, is there a way to transfer big files that's fast but can recover after network issues?  
−
<epmclellan1> on to docs?
+
(10:55:13 AM) mcantelon: ARTi: I guess Bittorrent
−
<courtney> i got nuthin'
+
(10:55:27 AM) djjuhasz: mcantelon: rsync
−
<epmclellan1> likewise
+
(10:55:31 AM) mcantelon: Oh right
−
<berwin22> nothing
+
(10:55:50 AM) mcantelon: The magical steed
−
<fiver> niet....
+
(10:56:09 AM) djjuhasz: :)
−
<fiver> Non-sequitur: not sure exactly how, but we should aim for AM to be on this list next year, after 1.x release... http://www.dpconline.org/newsroom/latest-news/934-dpc-member-vote-for-digital-preservation-awards-2012 
+
(10:56:49 AM) epmclellan: meeting done?
−
<courtney> i have an issue to document dip structure, do we think that's necessary still?
+
(10:57:00 AM) mcantelon: aye
−
<courtney> fiver: i like the idea, but i think it's hard when you're a "vendor"
 
−
<courtney> i think they like to give prizes to projects
 
−
<berwin22> I would say yes, if people plan to create DIPS for different systems by altering the archivematica dip
 
−
<mcantelon> fiver: Nice!
 
−
<courtney> even though we consider ourselves, in a lot of ways, a project
 
−
<epmclellan1> courtney: it would be a good idea to have DIP structure documented on the wiki
 
 
</pre>
 
</pre>
  
 
[[Category:meetings]]
 
[[Category:meetings]]

Latest revision as of 12:58, 31 October 2012

Artefactual Systems, Internal Archivematica Dev Mtg, 2012-10-31

Development[edit]

  • Joseph has been working away on using PUIDs for normalization
  • Evelyn supplied a list of PUIDs from PRONOM that link to existing normalization rules in Archivematica
  • Mike C changed the Archivematica dev scripts to pull AtoM from Git
  • Mike G has been working on the FPR. He got it displaying the tables and such, basic search was working but there's a minor bug in it he just noticed this morning. He hasn't gotten the individual fields/boolean combinations stuff done yet
  • Courtney updated a lot of mockups and made sure that there were issues for all of the requirements for transfer backlog, create sip
  • Courtney and Mike C worked on updating tooltips in the rights metadata entry template

Deployment[edit]

  • Austin has been working on multi-node install on Windows VM for a client

Testing[edit]

  • Dan tested AM metadata mapping on export to AtoM, and created issue 1268 and issue 1269 in response to some issues encountered with language and date fields
  • Courtney has been testing DIP upload and doing QA on outstanding issues

Documentation[edit]

chat log[edit]

(10:34:41 AM) djjuhasz: Archivematica, you have the floor
(10:34:46 AM) epmclellan: I'll take notes
(10:35:29 AM) djjuhasz: (Thanks for taking notes fiver) :)
(10:35:32 AM) epmclellan: Joseph has been working away on using PUIDs for normalization
(10:35:54 AM) epmclellan: epmclellan: supplied a list of PUIDs from PRONOM that link to existing normalization rules
(10:36:06 AM) courtney [~courtney@184.69.130.182] entered the room.
(10:36:12 AM) epmclellan: hi courtney
(10:36:18 AM) courtney: hi 
(10:36:21 AM) peterVG: fiver: thx, I'm assuming you'll touch base with jessica on this
(10:36:24 AM) epmclellan: just talking about Joseph's work on using PUIDs for normalization
(10:36:32 AM) courtney: ok
(10:36:51 AM) epmclellan: one of the key issues is figuring out how to test, right?
(10:36:58 AM) mcantelon: I changed the Archivematica dev scripts to pull AtoM from Git
(10:37:49 AM) fiver: (meeting notes for AtoM: https://www.qubit-toolkit.org/wiki/Meeting_20121031 )
(10:38:15 AM) fiver: peterVG: yes, I will follow up with JessicaB
(10:38:18 AM) ARTi1:  mcantelon cool!
(10:38:44 AM) epmclellan: MikeG: you've been working on the FPR, right?
(10:39:25 AM) MikeG: yes
(10:39:39 AM) courtney: how far along?
(10:40:20 AM) MikeG: I got it displaying the tables and such, basic search was working but there's a minor bug in it I just noticed this morning. I didn't get the individual fields/boolean combinations stuff done yet
(10:40:32 AM) MikeG: for the more advanced searches
(10:40:34 AM) epmclellan: great, thx
(10:40:47 AM) mcantelon: Nice!
(10:40:53 AM) courtney: i'll take a look after you get the bug fixed, k?
(10:40:58 AM) MikeG: sure, sounds good
(10:41:29 AM) courtney: i updated a lot of mockups 
(10:41:48 AM) courtney: and made sure that there were issues for all of the requirements for transfer backlog, create sip
(10:42:18 AM) courtney: also made a DIP structure page on the wiki: https://www.archivematica.org/wiki/DIP_structure
(10:42:41 AM) epmclellan: ok, I'll put that under docs
(10:43:01 AM) epmclellan: any more dev?
(10:43:06 AM) courtney: we should put next big dev mtg on the books
(10:43:06 AM) fiver: fiver tested AM metadata mapping on export to AtoM, and created issues 1268 and 1269 in response to some issues encountered with language and date fields
(10:43:16 AM) courtney: fiver: yes, great reporting
(10:43:17 AM) epmclellan: right, thanks fiver
(10:43:24 AM) fiver: not sure if testing goes in dev or elsewhere, btw
(10:43:33 AM) fiver: re: meetings
(10:43:37 AM) courtney: mcantelon: can you update your issues sometime in the next week?
(10:43:46 AM) epmclellan: fiver: no worries, I put it under testing
(10:44:02 AM) courtney: mcantelon: i think some of them are actually fixed or moved to 1.0 or beyond
(10:44:08 AM) mcantelon: courtney: Sure... on the Google Code?
(10:44:56 AM) courtney: mcantelon: yeah
(10:45:00 AM) mcantelon: cool
(10:45:26 AM) epmclellan: deployment?
(10:45:38 AM) courtney: epmclellan: for deployment - can we have a brief talk post-meeting about requirements for that trac-like audit template
(10:45:47 AM) epmclellan: courtney: sure
(10:46:09 AM) epmclellan: ARTi1: how goes the deployment you're working on?
(10:47:01 AM) ARTi1: I didn't have luck with installing/running windows :X, going to try and get the Sevein's vm from the office today
(10:47:19 AM) ARTi1: I think it hates me
(10:47:24 AM) epmclellan: oh dear
(10:47:42 AM) epmclellan: 1.0-dev install at UBC delayed
(10:47:51 AM) ARTi1: for upload dip?
(10:47:58 AM) epmclellan: while Mark Jordan completes CONTENTdm work
(10:48:04 AM) ARTi1: right
(10:48:07 AM) epmclellan: but we do have a number of DIP upload issues
(10:48:25 AM) epmclellan: I'm going to make a list of what needs to be fixed before UBC can go into production
(10:48:39 AM) epmclellan: for example, DIP upload breaks access tab
(10:48:48 AM) epmclellan: http://code.google.com/p/archivematica/issues/detail?id=1273
(10:48:55 AM) mcantelon: ARTi: The Windows VM is, I think, 8GB so it'll take awhile to DL... but I'll put it online somewhere
(10:49:18 AM) peterVG: ARTi1: working with Jill to upgrade UBC vm aipstore to 3.5 TB
(10:49:38 AM) mcantelon: epmclellan: weird
(10:49:50 AM) epmclellan: mcantelon: yeah
(10:49:51 AM) ARTi1: mcantelon: maybe lzma it?
(10:50:01 AM) epmclellan: not that the DIP upload that broke the access tab actually worked
(10:50:05 AM) mcantelon: ARTi1: Cool... I'll try that
(10:50:09 AM) ARTi1: think ubuntu comes with lzip or lz or something
(10:50:15 AM) mcantelon: nice
(10:50:27 AM) ARTi1: bzip is good too.. but lzip should get more compression
(10:51:20 AM) ARTi1: peterVG: cheers Ive been following the convo.. should be a easy install
(10:51:56 AM) epmclellan: any more meeting stuff?
(10:52:12 AM) courtney: epmclellan: i've been doing a lot of testing
(10:52:19 AM) courtney: clearing out my qa
(10:52:28 AM) djjuhasz: mcantelon: ARTi1: can you do transfer the Windows VM tonight after office hours?
(10:52:34 AM) epmclellan: focusing on anything in particular, courtney?
(10:52:49 AM) djjuhasz: So we don't saturate the upload bandwidth here.
(10:52:49 AM) mcantelon: courtney and i worked on updating the tooltips in rights
(10:52:54 AM) courtney: DIP upload and clearing out issues
(10:53:06 AM) epmclellan: k, thanks mcantelon and courtney
(10:53:11 AM) courtney: oh yeah, tooltips... but some of them didn't work, so mcantelon has to fix them
(10:53:13 AM) ARTi1: djjuhasz: sure
(10:53:25 AM) courtney: mcantelon: because of something about the code for some of the fields, right?
(10:53:35 AM) mcantelon: Yeah... AJAX stuff
(10:53:38 AM) ARTi1: mcantelon: if you want to put it on bion, Ill move it tonight
(10:53:43 AM) mcantelon: Cool
(10:53:51 AM) MikeG- [~MikeG@184.69.130.182] entered the room.
(10:54:18 AM) MikeG left the room (quit: Quit: irc2go).
(10:55:02 AM) mcantelon: ARTi: Out of curiosity, is there a way to transfer big files that's fast but can recover after network issues? 
(10:55:13 AM) mcantelon: ARTi: I guess Bittorrent
(10:55:27 AM) djjuhasz: mcantelon: rsync
(10:55:31 AM) mcantelon: Oh right
(10:55:50 AM) mcantelon: The magical steed
(10:56:09 AM) djjuhasz: :)
(10:56:49 AM) epmclellan: meeting done?
(10:57:00 AM) mcantelon: aye
Retrieved from "https://wiki.archivematica.org/index.php?title=Meeting_20121031&oldid=7128"