Archive for ‘Data’

Patrick Ball on the Perils of Misusing Human Rights Data

By , 17 February, 2011, No Comment

Belated post at Foreign Exchange on a talk I attended last week about problems in human rights data collection. A snippet:

In his lecture, Ball presented a number of cases like this, from Kosovo, Guatemala, Sierre Leone and Timor-Leste, where sound and verifiable data was used effectively to answer a small question, then stretched to answer a broader question for which it was not suited. The researchers in each case, Ball argued, had confused ‘what was observable’ with ‘what was true,’ failing to acknowledge the existence of all the data they hadn’t collected or hadn’t thought to ask for.

The second half of Ball’s talk focused on ways to work around this, starting with some quick math. A short, 7th grade example: Two NGO projects in a country report widely differing figures for killings over the same period, call then result-set A and result-set B. They have some overlap in the list of names, call that subset M. What’s a rough estimate for the total number of killings, N? [Solution at the bottom of the post.]

More on Ball, and the solution, in the post.

Covering the Wikileaks

By , 29 November, 2010, No Comment

The latest at Foreign Exchange on the way news organizations are handling the Wikileaks:

as we come to see Wikileaks as just a source, news organizations are having to decide whether to cover them at all, and–as we often do with delicate subject matter–how to balance the scoop against the risk to those implicated. I have very minimal sympathy with Wikileaks’ overall agenda, which seems increasingly to be about embarrassing the US government for the sake of it rather than to advance any particular cause, but I do think that news organizations have an obligation to cover these leaks in some fashion once they’ve occurred. They can pick and choose what to include on the basis of what’s really significant, and they can avoid reprinting the actual documents if they see a risk to someone’s life, but they can’t just choose to ignore the whole development.  That’s why I think it’s deplorable that two major news organizations–the Wall Street Journal and CNN–chose to turn down access to the documents altogether, because, in essence, they were afraid of being compromised. National security reporting is inevitably compromised and risky, and to run from that challenge is unjournalistic, and wrong.

Go read the whole thing.

Too Little Too Late

By , 19 November, 2010, No Comment

Regulators in the US, UK, Spain, Italy, Germany, Canada and the European Commission are finally getting serious about privacy. First, there’s the bevy of cases and crackdowns recently introduced against Google’s Street View. Secondly, there’s the EC’s new privacy proposal, mandating that in the future companies ask such consent for all the data they take, and (more radically) make it possible for users to have it deleted at any time. They’re calling this the ‘right to be forgotten.’ [A direct response to Eben Moglen, perhaps?]

This is comforting news for those of us who have been talking about data and digital rights for some time, to be sure. But I am wondering it’s ultimately too little too late.

See, most of the major holders of user data online are–or are close to becoming–monopolies within their niche: Google in search and advertising, Facebook in social, etc. And it seems to me that the history of monopolies is that once they get in place, it’s very difficult, legally, to break them up and almost impossible to muster the political will for radically restricting their business practices when a massive majority of the populace are their customers. [Can you see I've been reading Tim Wu?] That’s one reason that I’ve been arguing for two years that the way to best Google on privacy was to take it to task on antitrust issues early on, before it became unbeatable.

But given we haven’t done that, it now seems to me that the best possible scenario is [and I can't believe I'm saying this] NOT to sue Google’s more offensive services out of existence, or to try and take it apart, but to essentially acknowledge it as a legitimate monopoly, and then slap it with a huge list of monopolist’s burdens: forbid it from further M&A activity, say, forbid them from collecting things like payload data, and mandate that all data-collecting services become voluntary, not at the individual level, because that’s now untenable, but at the municipal level. If the majority of a town’s population votes to be mapped, Google can photograph in the town. I think the municipal level is basically the smallest level that is still feasible, and the largest level that is still democratic. Is this a crazy idea?

As for the right to be forgotten, I regard it as pretty sound when I think of individuals and companies like Google or Facebook, but I am less convinced about how it might extend to other types of websites. Jeff Jarvis has correctly pointed out that a very broad reading of such a clause could lead to the idea that people can demand takedowns of news stories about them. Which is something that doesn’t make any sense to me, not least because news coverage is NOT something you consent to have written about you. It is not data YOU give away (and therefore own) but data which we as a society have decided can be collected involuntarily so long as you have the right to correct the record, and to extract a pound of flesh when the journalist is wrong. I’m inclined to say that the right to be forgotten should apply to everything except IRS and other federally mandated disclosures, and stories about you in the press. But I must admit that my sense of surety about these issues has declined the more I learn about them, so, please, sound off.

I Fixed the Deficit

By , 14 November, 2010, No Comment

What do econo-wonks do for fun on the weekends? We play interactive deficit-fixing games online. Really. Felix Salmon has a good post explaining why some of the options the game provides–especially the Medicare cap–are unrealistic and why many of them are regressive. But the solution Salmon proposes (gutting the Pentagon budget completely) seems just as unlikely. My version is harsher, in that I take a scalpel to entitlements. But it gives a 60-40 tax increases-spending cuts balance that I’m more comfortable with the 70-30 Salmon has going. You can see my version, and make your own, here.

Updated 11/15 5:20PM: Also worth playing is the CEPR budget deficit calculator. A very different–ie more left-wing–set of choices are in place there. It’s pretty hard to get far on that calculator, for example, without a complete re-do of health care reform and two energy taxes–both at the producer and the consumer levels. That seems ridiculously implausible to me, but still fun to play with.

More About Grizzlies

By , 3 November, 2010, 15 Comments

I’ve got a post about GOP women up at Forbes right now: basically, I took a look at how GOP candidates fared with women voters. And interestingly, in this so-called year of the GOP woman, it was GOP men who got the women’s vote, while GOP women were successful with a more traditional Republican base of white men. I’m not sure why that is, but I’m inviting theories from you, so please, go read the data and comment.

The Stiff Upper Lip and Its Discontents

By , 22 October, 2010, 1 Comment

I’ve just written the longest blog post ever at Foreign Exchange. It filled about 6 pages in Microsoft Word as I was working on it. I don’t think bloggers are actually allowed to be so verbose, but I couldn’t help myself, as the subjects touched on in the post triggered too many of my wonkish fetishes:

On Wednesday, the Tory-Lib Dem coalition in the U.K. unveiled its mammoth austerity program, aiming to take £81 billion off the deficit over four years. There are a few major sources of cuts: a reorientation of British foreign policy that should take 24% out of the Foreign Office and 8% out of the Ministry of Defense; a welfare reform program  that should yield close to £20 billion in savings; a push towards privatization and localism on everything from low-income housing to law enforcement; and across the board cuts–mostly efficiency savings and staff reductions–in all departments with a few notable exceptions: education, health and foreign aid spending will all keep growing.

The plan has taken a heavy beating in the first 48 hours. First, there are criticisms of the way the Spending Review plays fast and loose with data: leaving off half the cuts in order to claim that the overall effect is more progressive than it really is, conflating real and nominal figures or cash figures and percentages or departments’ capital ceilings and their actual expenditures. I can’t tell if that kind of fuzzy math is intentional obfuscation or just economic incompetence, but it’s a problem with the Review and one reason it took me a long time to develop a solid analysis of my own. Second, there are criticisms of the policies on the merits, in particular of the changes in taxes, disability and child benefits and housing. The most aggressive critique has come from the Institute for Fiscal Studies in a series of Power Point presentations that are getting a lot of positive play in the British press, but of which I’m a bit skeptical.

The rest of the post is a detailed analysis of the review, followed by an assessment of just how regressive it is. The figures I ended up with show that the Review is regressive in the broad sense (worse for the bottom half than the top half) but when it comes down to specifics, is actually going to squeeze the middle more than the absolute poor.

For more scintillating details, read the whole thing.

Introducing Public Business

By , 8 October, 2010, No Comment

As I mentioned yesterday, I’ve been swamped with a very exciting new project, and it’s now ready to introduce to you. Along with a Columbia classmate and BBC journalist, Damian Kahya, I’m launching a nonprofit dedicated to filling in a key gap in the emerging media model: in-depth, original, public interest reporting about business. That means reporting about how the decisions made at companies affect the rest of us: about the wider economic, environmental, and social implications of business activity. Once upon a time, this kind of journalism was a core part of every business newsroom, and indeed in some high profile examples, like Fortune’s big Enron scoop or the BBC’s documentary about Nike sweatshops, it has helped change the course of events and sparked public debate about important issues. There are still great reporters doing this work, but they are fewer in number and have less resources at their disposal. Our goal is to partner with news organizations to put more funds and more people behind this kind of reporting. To do that, we need support. We’re looking for donations large and small and we’re hoping to build a membership community around our work. To learn more about what kind of work we support, how we intend to do it, and what it will mean to be a member, visit our website.

There, you’ll find a blog post I wrote about the troubles in journalism and why we’re doing this. Here’s what it says:

Some Thoughts on the Wikileaks

By , 18 August, 2010, 5 Comments

When the massive data dump that was the Wikileaks Afghan War Logs showed up on my screen three weeks ago, I did what–apparently–no one else had yet done: read the whole thing. At the time, this seemed like Journalism 101. But by the time I finished [at the end of the week], I was more bored and overwhelmed than stimulated or enlightened. Because, as others had concluded by then, there really isn’t that much that’s earth-shattering in the logs. And I’ve been pondering what to say ever since .

Sex and the City, revisited

By , 14 July, 2010, 6 Comments

I recently came across some poll data about gender. Gender equality, in the abstract, is a widely supported goal, especially in the developed world and among women, but nearly half the respondents “believed men had more right than women to obtain jobs in a down economy.”

Unpack that. Firstly, it suggests that men are supporting families while women are working for kicks. Secondly, it suggests that because women are working for kicks, they will be the ones taking time to worry about raising families. If you’re an employer, the argument goes, a woman who wants to make her kids’ doctors appointments is a less reliable employee. And when you have limited funds, you want the reliable bang for your buck.

The first point is false: the majority of women, like the majority of men, work because they have to. If they are lucky, they will enjoy it, but that’s not why they do it. But women do take the lion’s share of responsibility for the house and the kids. The answer to that should be a reorganization of family life that makes it easier to achieve equality in the workplace. But the truth is that the notion of workplace equality is, on its own, fairly appealing to people, while the notion of shared domestic responsibilities still scares us.

Getting Serious for a Moment

By , 3 February, 2010, No Comment

Latest blog post, on the trillion-dollar question of Indo-Pak peace:

‘…These days, optimists are focused on a new effort by two leading newspapers—the Times of India and The News in Pakistan—to promote “Aman ki Asha,” or “Hope for Peace.” In Delhi, the campaign is ubiquitous: billboards, posters, and television advertisements, some featuring major Bollywood lights. But the simple one below, where Pakistanis are trying to request a song on Indian radio, is my favorite.

The goal, says the News, is “mobilising popular pressure for peace on the establishment of both countries.” The mechanism, says the Times, is “a series of cross-border cultural interactions, business seminars, music and literary festivals and citizen meets that will give the bonds of humanity a chance to survive outside the battlefield of politics, terrorism and fundamentalism.”

Looking back on the last year, and speaking to politicians here in Delhi, I am skeptical…’

Here’s the video I reference. But read the whole post, and comment, at Untold Stories.