Meeting 20120404

Artefactual Systems, Internal Archivematica Dev Mtg, 2012-03-21

Development

• Mike C simplified icon selection logic (issue 935)
• Mike C fixed issue 950 (increasing the size of action selectors)
• Mike C worked on issue 839 (on hold as METS might change)
• Mike C did a bunch of refactoring of the dashboard JavaScript
• Evelyn has been filing issues for recommendations for enhancements and new features based on SFU report
• Joseph made the transcoder use the archivematica common database interface
• Joseph worked on an option to restructure for compliance, if compliance fails
• Joseph worked on auto approve of the first step - transfer completed
• Mark Jordan is worked on CONTENTdm integration
• Joseph added a field to the Jobs table, which links to the MicroserviceChainLink the job is an instance of (toward helping with reporting usage statistics)
• Joseph worked on some Mysql views for distributed processing

Deployment

• Joseph wrote a script to delete a client's hidden files so they don't get accidentally archived

Testing

• Auston's been working with AWS EC2, trying to set up an Archivematica cluster for our scalability/multi-node testing, but we've now decided that EC2 isn't suitable and will try o on openhosting.com (which is fully kvm compatible)

chat log

<mcantelon> Mike C fixed issue 950 (increasing the size of action selectors)
<mcantelon> Mike C worked on issue 839 (on hold as METS might change)
<mcantelon> Mike C did a bunch of refactoring of the dashboard JavaScript
<epmclellan> I've been going over SFU report, they made a bunch of recommendations for enhancements and new features
<epmclellan> I've started filing them
<epmclellan> will be doing more later today
<peterVG> austin couldn't make it but submitted his notes yesterday via email. Unfortunately, he has been spending all his time battling AWS EC2 trying to get and persist an Archivematica cluster going there for our scalability/multi-node testing. We decided that EC2 is really no use to us, cut our losses and give it another go on openhosting.com which is fully kvm compatible
<berwin22> I made the transcoder use the archivematica common database interface
<berwin22> work on option to restructure for compliance, if compliance fails
<berwin22> work on auto approve of the first step - transfer completed
<epmclellan> Mark Jordan is plowing through CONTENTdm integration work
<peterVG> epmclellan: do we have a wiki page up for that?
<epmclellan> I have been editing the METS page
<berwin22> added a field to the Jobs table, which links to the MicroserviceChainLink the job is an instance of. I think this may help down the line with reporting usage statistics.
<epmclellan> but everything else has been via email
<epmclellan> I can do the wiki page
<mcantelon> (Oops... noticed I'm not an admin on Archivematica wiki. Can someone flag me as an admin?)
<berwin22> work on some mysql views for the distributed processing.
<peterVG> epmclellan: great just start it with the project task breakdown and then email to MarkJ and ask him to fill in blanks
<epmclellan> ok
<peterVG> mcantelon: one sec
<peterVG> berwin22: saw those views yesterday cool
<mcantelon> peterVG: Thanks!
<peterVG> so that's querying columns that were already in the MCP db?
<berwin22> it's extrapolating info from them
<peterVG> yup, cool. 
<peterVG> mcantelon: you should be good
<mcantelon> peterVG: Ah, danke.
<courtney> peterVG: you mentioned mtg with mark j about dip upload next week, but i don't see a meeting - should i email to set that up?
<peterVG> courtney: yes pls
<courtney> will do
<peterVG> i guess wed aft would be best
<peterVG> i'm out next mon & tue
<courtney> ok. phone?
<peterVG> you mean mtg on phone?
<courtney> yes
<peterVG> mark mentioned that he'd be able to come down to office
<peterVG> so I guess we need to check with him first whether that's possible for next wed
<courtney> great - i will set it up - emailing now
<peterVG> we'll want to include joseph & mike & evelyn
<epmclellan> in person would be great
<epmclellan> phone meetings are kind of awkward
<berwin22> I'm away next thurs-fri-sat
<courtney> agreed. no whiteboard 
<berwin22> or at least not in the office
<djjuhasz> epmclellan: phone meetings rule!! no chance of spreading contagion...
<epmclellan> right, contagion, I forgot
<djjuhasz> well, unless the phone handset is unclean
<berwin22> I like these meetings... you can't tell I'm just rolling out of bed, and pulling a shirt on
<mcantelon> hehe
<djjuhasz> we should get one of those telepresence suites set up, when Google buys us
<epmclellan> agreed
<djjuhasz> maybe berwin22 can turn off the camera while he's getting dressed... :P
<djjuhasz> ahem, is that all for archivematica?
<berwin22> so... archivematica...
<epmclellan> any documentation etc?
<courtney> mcantelon: so, mike i'm way behind because of sick last week and also Canada rejecting me - so I'm home today with the goal of having all of the finished mockups up by end of day 
<berwin22> there were some interesting discussion list questions
<epmclellan> Canada rejected you?
<djjuhasz> oh no, courtney!
<courtney> no worries - peter's on it
<djjuhasz> We love you, don't listen to Canada
<mcantelon> courtney: No worries... *shakes fist at Canada*
<courtney> anywho - I just got caught up on the discussion list questions this morning
<courtney> many over my head, but i trust they make sense to joseph
<peterVG> "Blame Canada!"
<Sevein> courtney: you applied for the permanent residence?
<epmclellan> seriously, they can't eject you, we need you
<courtney> Sevein: not yet - need a temp work permit extension first, then permanent takes about 18 mos
<peterVG> actually, we're just moving operations to a panel van where I'll keep Jesus and Courtney working for minimum wage and room & board
<epmclellan> that sounds great, but we could also consider a Hawaii campus for Artefactual
<Sevein> hehe
<courtney> like Pump Up the Volume! with Christian Slater!
<mcantelon> Beyond open concept offices!
<JessicaB> aloha!
<peterVG> ie. air matress and bucket
<JessicaB> ew...
<courtney> ewwww... too far, peter. too far
<epmclellan> aaagh
<JessicaB> *shakes her head
<peterVG> yes, sorry /undo disgusting visual
<mjsuhonos> lol
<courtney> any more archivematica?
<mcantelon> peterVG: The glamourous technomad lifestyle.
<epmclellan> chokes on latte
<mcantelon> Any Archivematica deployment news? I put Austin's stuff under testing, although could be deployment.
<courtney> the hidden files script that joseph wrote for COV works great
<epmclellan> that's good to hear!
<epmclellan> thanks berwin22
<berwin22> great!
<berwin22> but I think I forgot about files ending in ~ in that revision
<peterVG> yay!
<mcantelon> What does that script do? Finds the hidden files?
<berwin22> not sure if it's an issue
<courtney> deletes all hidden files
<epmclellan> I think mainly the issue is files starting with a "."
<berwin22> find and remove files/directories starting with .
<mcantelon> Oh... nice.
<courtney> stinkin hfs + makes them and we don't need them
<djjuhasz> hidden files script? It sounds so cloak and dagger... <|B-o>
<epmclellan> that screwed up SFU during testing too
<Sevein> mcantelon: thank you for the work in getIcon, shamed of my dirty code hehe can't remember why I ended up doing that hehe
<djjuhasz> hehe
<djjuhasz> man in a room syndrome
<mcantelon> Sevein: Hehe.... the code is largely super clean... nice to work in. :D
<berwin22> 1 second while I have you all here... an issue with archivematica...
<berwin22> Do any of the techs know much about the Mac Icon^M files? 
<mcantelon> Not I.
<berwin22> I think I just have to remove them... bloody mac and it's crazy ideas some times.
<Sevein> it's an old method I think
<berwin22> it is, but some clients are getting files from those old systems
<epmclellan> yep, SFU
<Sevein> berwin22: is there any specific problem in removing them?
<Sevein> berwin22: like you did with Thumbs.db?
<berwin22> The sample I got only came out as "Icon" I think the ^M character didn't make it through zipping
<epmclellan> When I saw them at SFU I think they sere just Icon
<berwin22> so the question is, is the name Icon, or Icon^M that needs to be removed, or both?
<djjuhasz> this like a Mac OS9 thing?
<berwin22> yes
<Sevein> berwin22: what about .DS_Store, are you removing that one?
<berwin22> yes
<epmclellan> that's a hidden file
<epmclellan> so it gets removed with other hidden files
<berwin22> that gets removed by the remove hidden files microservice
<Sevein> what do you do with ntfs hidden files? (these that don't start with a dot but has internal attributes?)
<berwin22> they become unhidden in a linux file system
<berwin22> not sure if we can check for them
<courtney> right now i think they end up part of the AIP - but at some point we should consider that archivists will want to remove them
<berwin22> maybe if it's still on an ntfs partition
<courtney> might be more part of the arr/des functionality