Meeting 20120215

Deployment

• Austin worked on sfu last week, helped them with webdav access, and accessed their current email backups
  • their IT sent them a Zimbra backup, we're trying to figure out what to do with it
• Joseph is trying to test large CVA transfers at Artefactual but we need to re-create the hardware environment; Joseph set something up locally on his machine, but doesn't have enough ram/hard drive space to do this properly. The system drive was full, so mysql wasn't logging anything else.
  • this test is less about speed/scalability however and more about verifying that our distrubited processor setup is working for physical network scenarios
  • Joseph set up a virtual network to mimic CVA's network. He tried running the sample sips through, but appear to have encountered some problems. he needs to sift through the logs.
• Joseph tried to process the PST file from RAC on his laptop, and eventually cancelled the process, but it looked like it was continuing to go. Will need to take another stab at it when my desktop is free.

Documentation

• Evelyn filled out CVA scalability testing data at http://archivematica.org/wiki/index.php?title=Scalability_testing#CVA_tests
• Evelyn added http://archivematica.org/wiki/index.php?title=Archivematica_0.8_Micro-services
• Courtney added http://archivematica.org/wiki/index.php?title=AIP_structure

Chat log

(10:35:20 AM) epmclellan: I can take notes
(10:35:23 AM) peterVG: thx
(10:35:56 AM) epmclellan: dev news?
(10:36:38 AM) epmclellan: berwin22: ^
(10:37:26 AM) berwin22: no dev
(10:37:42 AM) epmclellan: how is CVA testing going?
(10:38:15 AM) courtney: epmclellan: are you asking me or berwin22?
(10:38:23 AM) epmclellan: berwin22: 
(10:38:30 AM) peterVG: and ARTi?
(10:38:35 AM) epmclellan: re the large transfers that Sue gave us
(10:38:39 AM) peterVG: did you guys setup a test network last week?
(10:39:06 AM) ARTi: we discussed, but only had a hour or so
(10:39:06 AM) epmclellan: Joesph's machine is not frozen
(10:39:11 AM) epmclellan: IS frozen
(10:39:33 AM) peterVG: k
(10:39:45 AM) ARTi: I worked on sfu last week,  helped them with webdav access, and accessed their current email backups
(10:39:45 AM) peterVG: is this dealt with in an email thread I need to catch up on?
(10:39:49 AM) peterVG: cool
(10:39:58 AM) epmclellan: thanks ARTi
(10:40:08 AM) epmclellan: we're working on their email issues
(10:40:25 AM) epmclellan: their IT sent them a Zimbra backup, we're trying to figure out what to do with it
(10:40:28 AM) epmclellan: ingest-wise
(10:40:38 AM) peterVG: okay, cool
(10:40:50 AM) epmclellan: I think ARTiand I will go back again next week
(10:41:54 AM) epmclellan: courtney: do you have any deployment news from CVA?
(10:42:02 AM) epmclellan: Sue is still processing, yes?
(10:42:24 AM) courtney: sorry, i don't start ingesting VANOC until tmrw, Sue is processing away with gusto
(10:42:32 AM) epmclellan: excellent!
(10:42:54 AM) epmclellan: no error reports in the last few days, silence is golden
(10:42:54 AM) berwin22 left the room (quit: Read error: Connection reset by peer).
(10:42:57 AM) peterVG: anything to report on CVA network test setup? Deal with after Archivematica dev mtg scheduled in office for next Tue?
(10:43:17 AM) peterVG: epmclellan: cool, but that's on a single processor right?
(10:43:18 AM) berwin22 [~joseph@70.71.0.109] entered the room.
(10:43:24 AM) epmclellan: yes
(10:43:27 AM) peterVG: k
(10:43:32 AM) courtney: no updates from HG
(10:43:43 AM) berwin22: back. had to force a restart
(10:43:58 AM) peterVG: i've got to telecon with them tomorrow to update on CoV IT security reqs
(10:44:06 AM) epmclellan: peterVG: scalability testing info at http://archivematica.org/wiki/index.php?title=Scalability_testing#CVA_tests
(10:44:11 AM) peterVG: will discuss with Sevein this aft
(10:44:15 AM) epmclellan: not bad considering only one processor
(10:44:39 AM) Sevein: o/
(10:45:26 AM) djjuhasz: \o
(10:45:30 AM) epmclellan: so berwin22 were you able to test Sue's large transfers here in the office?
(10:45:36 AM) peterVG: berwin22:  ARTi anything to report on CVA network test setup? Deal with after Archivematica dev mtg scheduled in office for next Tue?
(10:46:13 AM) ARTi: peterVG: berwin22 was unable to find the same dropping connections from the mysql databases
(10:46:20 AM) peterVG: argh!
(10:46:24 AM) berwin22: I was going to set it up on caius, but caius only had 20Gb of free space.
(10:46:24 AM) berwin22: The test files are 80 GB
(10:46:26 AM) peterVG: well, actually, i take that back
(10:46:37 AM) epmclellan: er, does that make it more likely to be a hardware problem at CVA?
(10:46:42 AM) ARTi: we discussed many options and routes to test
(10:46:58 AM) peterVG: epmclellan: yes
(10:47:01 AM) ARTi: some, like using a current version of mysql involve lots of upgrades
(10:47:15 AM) courtney: CVA hardware diag is actually a good thing, better argument for VM
(10:47:20 AM) epmclellan: peterVG: that sounds like a good thing
(10:47:31 AM) peterVG: epmclellan: yes, that's why i took back argh!
(10:47:35 AM) epmclellan: blame the client, I always say...
(10:47:35 AM) berwin22: So I set something up locally on my machine, I don't think I have enough ram/hard drive space to do this properly. The system drive was full, so mysql wasn't logging anything else.
(10:47:35 AM) peterVG: :-)
(10:47:59 AM) peterVG: well, until we actually do a physical network setup of our own its impossible to verify
(10:48:18 AM) epmclellan: or we could move them over to VM and see if it fixes the problem?
(10:48:25 AM) ARTi: yeah,  also I have those p3
(10:48:31 AM) peterVG: ARTi: we still have those cheapo boxes sitting in VHS basement/interrogation room/vault?
(10:48:38 AM) ARTi: 's  but that wont give us a good comparison
(10:48:45 AM) peterVG: k
(10:49:01 AM) berwin22: from what I've been seeing from my testing thus far... I think we should try to setup a physical network, rather than a virtual one
(10:49:25 AM) ARTi: really old hardware (disks, processor, eth)
(10:50:11 AM) peterVG: i guess this test is less about speed/scalability however and more about verifying that our distrubited processor setup is working for physical network scenarios?
(10:50:55 AM) peterVG: okay, well. how about we revisit in detail on Tue?
(10:53:13 AM) epmclellan: sounds fine to me
(10:53:24 AM) ARTi: oO, is this a online meeting?
(10:54:05 AM) epmclellan: face-to-face
(10:54:22 AM) epmclellan: i put it in the calendar
(10:54:33 AM) ARTi: ok, post sfu?
(10:54:36 AM) peterVG: archivematica 0.9 dev/roadmap mtg
(10:54:52 AM) epmclellan: hmm, we'll have to work around SFU I guess
(10:55:02 AM) peterVG: i don't see sfu in calendar
(10:55:11 AM) epmclellan: we've only just decided to go there
(10:55:16 AM) epmclellan: based on emails this morning
(10:55:19 AM) courtney: would it be useful for me to go to sfu to observe?
(10:55:30 AM) epmclellan: yes
(10:55:31 AM) peterVG: okay, we scheduled the 0.9 dev mtg a couple of weeks ago right?
(10:55:39 AM) epmclellan: yup
(10:55:44 AM) peterVG: will be too much to try and squeeze into one day
(10:55:56 AM) epmclellan: agreed
(10:56:06 AM) ARTi: sfu probably wont take very long in the morning..
(10:56:30 AM) epmclellan: Is technical meeting first on Tuesday?
(10:56:37 AM) epmclellan: or roadmap meeting?
(10:56:54 AM) epmclellan: if technical meeting, Austin and I can go to SFU at 9:00 then he can come back to the office for 11:00
(10:56:56 AM) peterVG: why did you pick tue for sfu?
(10:57:00 AM) epmclellan: we didn't
(10:57:16 AM) epmclellan: we're just trying to figure out when to go
(10:57:19 AM) peterVG: k
(10:57:20 AM) ARTi: peterVG: it was better then monday for me, sorry lost track of dev meeting
(10:57:36 AM) peterVG: okay, I think its best to keep Tue for our in office mtg
(10:57:40 AM) epmclellan: ok
(10:57:48 AM) peterVG: david & jessica aren't here that day, can focus on Archivematica
(10:57:56 AM) epmclellan: ARTi: Wednesday or Friday for SFU?
(10:58:11 AM) courtney: If i'm going, wednesday's my day
(10:58:16 AM) epmclellan: right
(10:58:38 AM) epmclellan: let's talk after this meeting to sort out the time
(10:58:40 AM) courtney: would like to familiarize myself with current projects where possible
(10:58:41 AM) peterVG: yes
(10:58:42 AM) courtney: ok
(10:58:45 AM) ARTi: ok
(10:58:47 AM) peterVG: courtney: let's discuss
(10:58:51 AM) courtney: ok
(10:59:01 AM) peterVG: ARTi: what's your availability then?
(10:59:04 AM) epmclellan: docs news?
(10:59:06 AM) peterVG: wed better?
(10:59:11 AM) peterVG: than monday?
(10:59:12 AM) ARTi: weds works
(10:59:15 AM) ARTi: yep
(10:59:15 AM) peterVG: k
(10:59:16 AM) epmclellan: I'm flexible
(10:59:22 AM) peterVG: okay docs?
(10:59:38 AM) epmclellan: I filled out CVA scalability table as mentioned above
(10:59:49 AM) epmclellan: Also http://archivematica.org/wiki/index.php?title=Archivematica_0.8_Micro-services
(11:00:18 AM) epmclellan: that's all, I was mostly on vacation
(11:00:36 AM) courtney: also: http://archivematica.org/wiki/index.php?title=AIP_structure
(11:00:42 AM) epmclellan: nice
(11:00:51 AM) courtney: :-D
(11:01:07 AM) peterVG: great!
(11:01:13 AM) epmclellan: glad we have a wiki manager, it was really getting away from us!
(11:02:03 AM) courtney: i supplemented some of internal documentation for releases, as well
(11:02:10 AM) berwin22: I setup a virtual network to mimic CVA's network. I tried running the sample sips through, but appear to have encountered some problems. Need to sift logs.
(11:02:11 AM) epmclellan: plus Courtney's killing herself trying to get screencast done, let's not forget that
(11:02:47 AM) courtney: by midnight tonight, come hell or high water
(11:02:56 AM) mcantelon: Nice.
(11:02:57 AM) peterVG: cool
(11:03:09 AM) epmclellan: thank god, thank god you're here
(11:03:14 AM) peterVG: got to accept less-than-perfection
(11:03:27 AM) berwin22: I tried that PST epmclellan gave me on my laptop, and I eventually cancelled the process, but it looked like it was continuing to go. Will need to take another stab at it when my desktop is free.
(11:03:32 AM) peterVG: will always be a few stray 'uhms'
(11:03:51 AM) epmclellan: and the f***ing dog barking, and pop-up messages from your brother
(11:03:57 AM) courtney: steam clock
(11:03:58 AM) epmclellan: the phone ringing, knocking the chair over
(11:03:59 AM) mcantelon: Haha... totally.
(11:04:15 AM) peterVG: "ACTION!"
(11:04:25 AM) peterVG: "QUIET ON THE SET!!"
(11:04:30 AM) berwin22: I like the one where the cat comes and sits on the laptop
(11:04:34 AM) epmclellan: gaaah... CUT!
(11:04:40 AM) epmclellan: lol
(11:04:50 AM) peterVG: okay, we done...for now?
(11:04:55 AM) courtney: yup
(11:04:58 AM) epmclellan: looks like we're starting to degenerate, yes
(11:05:14 AM) epmclellan: I mean yes, all our agenda items are done!