An introduction

This is a semi-public place to dump text too flimsy to even become a blog post. I wouldn't recommend reading it unless you have a lot of time to waste. You'd be better off at my livejournal. I also have another blog, and write most of the French journal summaries at the Eurozine Review.

Why do I clutter up the internet with this stuff at all? Mainly because I'm trying to get into the habit of displaying as much as possible of what I'm doing in public. Also, Blogger is a decent interface for a notebook

Saturday, July 31, 2010

Horror Comics

Looking through the treatment of comics in the UK parliament, I find (unsurprisingly) that MPs care little and know less. But go back to 1955, and you find this brilliant rant from a young Labour MP, making a (successful) attempt to ban "horror comics":

it is the glorification of violence, the educating of children in the detail of every conceivable crime, the playing on sadism, the morbid stimulation of sex, the cultivation of race hatred, the cultivation of contempt for work, the family and authority, and, probably most unhealthy, the cultivation of the idea of the superman and a sort of incipient Fascism.


Turns out, this was just a pale reflection of all-out hysteria in the US aroudn the same time, complete with burnings of comics.

"Superheroes now are basically about the unfair fight"

Alan Moore:
I’m interested in the superhero in real life, but not the comic book version. I’ve had some distancing thoughts about them recently. I’ve come to the conclusion that what superheroes might be — in their current incarnation, at least — is a symbol of American reluctance to involve themselves in any kind of conflict without massive tactical superiority. I think this is the same whether you have the advantage of carpet bombing from altitude or if you come from the planet Krypton as a baby and have increased powers in Earth’s lower gravity. That’s not what superheroes meant to me when I was a kid. To me, they represented a wellspring of the imagination. Superman had a dog in a cape! He had a city in a bottle! It was wonderful stuff for a seven-year-old boy to think about. But I suspect that a lot of superheroes now are basically about the unfair fight. You know: people wouldn’t bully me if I could turn into the Hulk.

Thursday, July 29, 2010

More books

In a chart of changes over the last decade, this must be the most impressive:

Books published in 2000 in the US: 282,000
Books published in 2010 in the US: 1,053,000

Wednesday, July 28, 2010

yeahconsole

Xmonad is my window manager. I've had it configured to use dmenu as an ersatz command-line, but have been fairly unimpressed by its slowness, and by the difficulty of getting any notification of errors.



So I'm turning to yeahconsole. This is a drop-down terminal, something similar to yakuake, and hearking back ultimately to the headsup terminal in quake. To use: Ctrl-Alt-y to bring it up, type/run your command, M-A-y again to hide it.



I leave outstanding two jobs, one easy and one hard. Easy one is integrating it with xmonad, to launch on M-p. Hard one is making it vanish after executing a command; from a glance at the docs it seems this will only be possible by futzing with the source directly

Monday, July 26, 2010

chmod from within vim

as simple as

:! chmod u+x %

Sunday, July 25, 2010

Saving firefox

further to earlier grumbling about firefox, it seems the main culprit is the restore-session facility. This is something I hated anyway, even without realising that it was shutting down my hdd every 10 seconds to churn through all my tabs. Solution: go to about:config. browser.sessionstore.interval controls how often firefox stores its tab data. The default is 10 seconds; setting it to a long string of nines has sped up my computer no end.

and so, firefox is saved for another day.

also of note: the vimkeys plugin, providing j/k scrolling.
JSFiddle is a useful tool for editing javascript in a browser window. Raphael puts pretty pictures there. together, they make for a pretty decent learning interface.
I doubt very much _why is a Randian, but something in his self-annihilation reminds me of The Fountainhead. There's something scary about the vigorous assertion that your creations are yours to destroy -- something that's uncomfortably on the border of right and wrong, in an intense and personal way.

Firefox: TINA

Becoming increasingly infuriated by firefox eating up a disproportionate amount of my computer's time. Alternatives, though, seem limited:
- Chromium: best of the alternatives, but has largely-dysfunctional text searching.
- Opera: still around, still not very good on a small screen
- flock: built on firefox, but with more stuff on top of it
- galeon: not even installable in ubuntu, for some reason
- uzbl: nice idea, gaping usability/discoverability problems

..and so I return grudgingly to firefox :(

Monday, July 19, 2010

Webmontag 19.7.10

At Web Monday. Presentations:


  • First Trimester, blogging for doctors. Apparently while there are a lot of web projects targetting patients, there aren't many blogs aimed at providing professional information for doctors.
  • Yourcent, a micropayments system
  • Feed Magazine a free german-language (paper) magazine about the online world. Now at issue 0


Thursday, July 15, 2010

Kyrgz miltias

Not a good sign:




Amid the early April tumult that brought down former President Kurmanbek Bakiyev’s administration, young men in Bishkek and other cities began forming druzhiniki groups to patrol the streets and restore order. These groups were originally envisioned as a temporary solution to security challenges. But in the ongoing unrest that has plagued Kyrgyzstan since April, militia groups have kept on amassing influence. [Eurasianet



Wednesday, July 14, 2010

Temperature and clothing: a little project I'll never find time for

I hate hot weather passionately. Or more accurately, lethargically: when the temperature goes above 25, I find myself unable to concentrate on anything.

But now I find myself wondering: what makes people dress down in the heat? Do they choose their clothing based on today's weather, yesterday's weather, or some combination of the two?

Fortunately, we have the data and technology to answer this. I'm not going to implement it (see: lethargy). But here's what I would do, if I had the time/energy -- and perhaps I will when autumn comes and I start to wake up.

Skin-detection algorithms already exist. This is the only freely-available code I could find for the purpose; I haven't tested it.

You'd also need a source of images, tagged by date and location. Flickr will probably give you that, if you choose the right tags to narrow it down to full-body portraits of people. You can get weather information from The US National Weather Service, although it's not clear what historical data is available. Failing that, you could limit photos to a particular group of dates/locations, for which you manually look up the historical weather. Then just assemble the data, and run some regressions.

Sunday, July 11, 2010

Oxford comma

"For my parents, God and Damien Katz."
-- Noah Slater's dedicaiton, in the O'Reilly couchdb book


Saturday, July 10, 2010

git pull --rebase

Useful post on git by Yehuda Katz. inter alia, strongly suggests using the --rebase flag when merging


Friday, July 9, 2010

Kyrgyz political biographies

Ran into this who's who of Kyrgyz politics looking up the new Interior Minister, but it seems generally pretty worth paying attention to.


Kyrgyzstan: new interior minister

Kyrgyzstan has a new interior minister. Probably no bad thing, given that the accomplishments of previous acting interior minister Bolot Sher consisted of:
* pursuing Bakiyev's relatives
* Making the supremely reassuring statement that "I am in command of 80 percent of the Ministry of Interior...The other 20 percent is still waffling."



On the other hand his replacement, Kubat Baibolov, is coming straight from an oh-so-successful stint running things in Jalal-Abad


Kyrgyzstan: NYT beats WaPo

I've been shamefully ignoring Kyrgyzstan. Well, I've been ignoring politics in general, busy on vodo and other techncial work. But it's particularly hideous to start ignoring an area you care about, just as a great many things (good and bad) start happening. Not reading about what's happening over there makes me feel complicit in the near-total lack of attention in the Western media.



And Kyrgyzstan really is being overlooked to an incredible extent. Washington Post: nothing worth mentioning. New York Times is doing noticeably better, though -- in fact, their coverage is pretty decent considering the distance, and the lack of much domestic political significance within the US.


Open Data

We're in the midst of a data explosion. Then again, we're always in the midst of a daa explosion. It's been developing, wave by wave, since the first Sumerian scribe pushed his wedge into clay. Maybe it feels different this time; maybe it's always felt different.



The past two centuries saw the gradual triumph of ordered data collection: the regimented and expensive process of the census, the time-motion study, the economic indicator. The province of powerful behemoths -- government, military, corporate or the omnipresent RAND corporation -- such projects were rigorously plannedat the top, then executed by a small army of functionaries.



In the last 15 years, something has changed. Quantitative change, initially: more data, faster computers, easier transmission of information. But also a change in quality. Now we've moved into the era of data as by-product. Our clicks and our purchases are tracked because watching us is cheap and easy, not as part of a pre-planned technocratic project. Such cheapness brings us into the age of data abundance, and we're only beginning to appreciate the consequences and the possibilities.



Enter the Open Data movement. Bubbling with geekish idealism, this is a loose grouping of campaigners trying to prize large datasets out of government and corporate hands, bringing them into the agora. Knowledge here may be measured in SQL dumps, linked data and gigabytes of official transcripts, but the idealism fits into the standard pattern: the Truth will set you free.


Freebase

getting country population data from freebase:




from freebase.api import HTTPMetawebSession, MetawebError
mss = HTTPMetawebSession('www.freebase.com')
list(mss.mqlread([{'name': None, 'type': '/location/country', '/location/country/iso31661alpha2' : None, '/location/statistical_region/population' : [{'number': None}] }]))


Thursday, July 8, 2010

GANTT

Embedded in a project that's floundering a little as it expands beyond the size that the devs can keep in their heads. So, looking for some relatively lightweight, way of visualizing the moving parts and the work that needs to be done. And, as every other time I've looked in this area, finding most solutions to be too feature-light, too complicated, or sometimes both.



First are the project scheduling systems. Whatever they focus on, it's hard to think of them except as tools for generating GANTT charts. I can imagine these being useful for, say, a big construction project with complex interdependencies of people and machines. For coding, not so much. Particularly not Taskjuggler, which seems to delight in being non-user-friendly. That is , it is is complicated and does a bad job of explaining itself -- but then tries to use this as evidence of how sophisticated it is. I ran away before finding out; complexity is not what I want!



Gnome planner is quite possibly much inferior for large projects, but at least lets me add a task without hours grepping through the docs. If I ever need a gantt chart, I'll certainly head there rather than taskjuggler. I honestly believe that coding extra features into planner as required would be easier than making sense of taskjuggler



So, I think I'll do without!


MongoDB

MongoDB (and nosql generally) is an appealing idea. The words written about it, though, are problematic: too much hype, too little documentation. That'll change soon; we're over the peak of the nosql hype cycle, into the trough. People are looking at the nosql systems they've eagerly implemented in recent months, noticing that they won't solve every problem imaginable. For now, though, every blogpost with mongodb instructions is prefaced with grumbles about the lack of information.



So, i spend a ridiculous amount of time figuring out how to do grouping. Have a bunch of download logs, want to break them down by country.
The simplest way I could find of doing this is:



db.loglines.group({ 'cond' : {}, initial: {count: 0}, reduce: function(doc, out){out.count++;if(out[doc.country] == undefined){out[doc.country] = 0;};out[doc.country] += 1;}});



Or, the version in pymongo:




> reduce_func = """function(doc, out){
out.total++;
if(out[doc.country] == undefined){
out[doc.country] = 0;};
out[doc.country] += 1;};
"""

> l.group(key = {},
condition = {},
initial = {'total':0},
reduce = reduce_func)
[{
u'AE': 215.0,
u'AG': 23.0,
u'AM': 140.0,
u'AN': 58.0,
u'AO': 56.0,
...
u'total' : 87901;
}]


[apologies for formatting; I've not really figured out how to edit js within a python repl]

BP oil spill

I often avoid certain news stories: not because they're unimportant, but because I doubt I'll learn much by discovering them in the day-by-day dribble of the daily press.



The BP Oil Spill is one: I'm not going to bother with short articles on it, but I'd really love to follow the long ones. I've idly watched the speculation ramp up to biblical proportions, but have no idea how to interpret it.



[no content here, as you can see, just a stick in the ground to note how shameful it is that I know nothing about this]


Tuesday, July 6, 2010

more gaga

More on Alejandro:
- Bad Romance may have been similarly intricate
- The dreamscape reminds me strongly of Gaiman, although that probably means no more than that Gaiman's been on my mind lately
- Everybody seems to have seen the religious elements as a homaget to Madonna, with "like a prayer". Fair enough, but it surely also has some connection to Derek Jarman's video for the pet shop boys' It's a Sins


GaGa

It's taken a long while, but I'm now, finally, a convert to the church of gaga. It's all Alejandro's fault, and more particularly in the video. It's another epic 8-minute piece, which means there's plenty of time to develop a good many themes. She's doing what I like best: not making a syllogism with her music, but layering loosely-connected themes so that, if you clap your hands and try to believe, you'll be able to weave your own meaning out of it.



It's somehow very European, but drawn from disparate sources within that; Gaga surely deserves some EU subsidy for semiotic integration. The setting is mystical and unspecific, but in a cold and German fashion. Gaga appears as Dream or an Ice Queen, or maybe as Narnia's White Witch. But this isn't Narnia, with children and a christ-like lion. It's Weimar, a collapsing world where introspectively melodramatic romance must take the place of morality. It's intense and fearful, slightly frigid, physicality replaced by power. Even the male dance troupe are desexualised; after entering with a haka-like swagger, they retreat into stylised weirdness.



So far, we're in a familiar aesthetic, one which runs from Rammstein to Bauhaus through the entire spectrum of goth. The equivocation between sex and violence is likewise familiar, though rebel chic rarely gets as far as a semi-automatic bra. It's the hispanic eurodisco elements that take us away. Our tragic ice queen seems about to start singing 'numa numa ey'. Teutonic tragic Romance meets the Romance culture -- in accent, if not in much else.


Monday, July 5, 2010

debugging python regexes

Neat trick from stackoverflow: the re.DEBUG flag for python regexes:


> re.compile('a(b+)a', re.DEBUG)
literal 97
subpattern 1
max_repeat 1 65535
literal 98
literal 97

documentaries

Spent a chunk of the weekend with a clique of Australian travellers and party animals -- who turned out to have a sweet and counter-intuitive affection for watching documentaries. Also, chess. On the documentaries, they turned me onto this giant list of of documentaries to watch online.


Saturday, July 3, 2010

Patch: vi-style scrolling for the comix image viewer

Comix is my favourite no-bloat viewer for collections of images: not just for comics, but also for paging through a directory full of graphs or photographs. But needing to slip to the arrow keys for navigation is an irritation: hence this quick little patch to enable h,j,k,l scrolling. [I later realise that the h conflicts with another keyboard shortcut. So it goes]. This is in lieu of a large patch, which I'll probably never write, allowing shortcut keys to be set from a config file.

Here on github -- the first time I've used github in this way, and an impressively painless experience. I'm now itching to hack on other code that's hosted there. [also, there's probably a way of getting automatic github updates posted here, or to facebook, or something]

Patch: blogger post from stdin for googlecl

Going to start hijacking this blog, to record/link to patches I submit to various open-source projects. As with everything else on here, it's mainly to ensure I can find these little snippets a few months later.

So, to start, something intended for this blog itself. A patch to the google commandline tools enabling the "google blogger post" command to post content read from stdin (adding to the current options of supplying a string or a filename). Usage is the traditional '-' in place of a filename.

This enables two pieces of functionality I'd find very useful:
A) filter content through other programs. e.g. using markdown to HTMLify my content:
$ markdown post.txt | google blogger post -
B) make a blogpost from within vim, by selecting my post content and piping it to googlecl

tail wagging the dog

AP, via Wired:
"This year, the Pentagon will employ 27,000 people just for recruitment, advertising and public relations — almost as many as the total 30,000-person work force in the
State Department."

LSE Podcasts

:The LSE seem to have had an unusually interesting speakers lately. Not sure if it's an end-of-term twist away from serious economics towards the more accessible stuff. Žižek, Clay Shirky and Andrew Ross Sorkin, all in the space of a day; what a treat!


Friday, July 2, 2010

New post

what is the ø in infinite thøught? Merely the philosophical counterpart to the Heavy Metal Umlaut? Or are we in the equally-depressing land of subtle and pointless theoretical in-jokes?


New post

mysql file output is efficient -- but needs the FILE permission, which mysql turns off by default for most users:

mysql> select foo into outfile '/tmp/bar.txt' from sometable group by foo;


New post

While loving both The Parallax View and All the President's Men, I'd somehow never realised that they had a forgotten sibling. Klute is the first member of what came to be known as director Alan Pakula's political paranoia trilogy. One to watch.


New post

While loving both _The Parallax View_ and _All the President's Men_, I'd somehow never realised that they had a forgotten sibling. Klute is the first member of what came to be known as director Alan Pakula's _political paranoia trilogy_. One to watch.

Thursday, July 1, 2010

finding and editing

Search for files containing some text, open them in vim (one per tab)

 grep -l foo ./* | xargs vim -p


Alternatively, to get a single-line list that can be edited and then copy-pasted to a command-line:

grep -l foo ./* | xargs echo


There are more heavy-duty ways of removing lines in output listed here, but I see little reason for using them.t