US Gov: Most digital piracy estimates are bullshit

[General Zod]

Who knew!

We've all seen the studies trumpeting massive losses to the US economy from piracy. One famous figure, used literally for decades by rightsholders and the government, said that 750,000 jobs and up to $250 billion a year could be lost in the US economy thanks to IP infringement. A couple years ago, we thoroughly debunked that figure. For years, Business Software Alliance reports on software piracy assumed that each illicit copy was a lost sale. And the MPAA's own commissioned study on movie piracy turned out to overstate collegiate downloading by a factor of three.

Can we trust any of these claims about piracy?

The US doesn't think so. In a new report out yesterday, the government's own internal watchdog took a close look at "efforts to quantify the economic effects of counterfeit and pirated goods." After examining all the data and consulting with numerous experts inside and outside of government, the Government Accountability Office concluded (PDF) that it is "difficult, if not impossible, to quantify the economy-wide impacts."

More specific studies that focus only on single industries don't fare much better because "the illicit nature of counterfeiting and piracy makes estimating the economic impact of IP infringements extremely difficult." And when it comes time to choose a substitution rate (how much of the infringing activity should be counted as a lost sale), we're left only with "assumptions... which can have enormous impacts on the resulting estimates."

The GAO then went on to slam three particular reports often linked to the government. They're all commonly cited, they're all bogus, and at least one is still being used officially.

Three commonly cited estimates of U.S. industry losses due to counterfeiting have been sourced to U.S. agencies, but cannot be substantiated or traced back to an underlying data source or methodology.

First, a number of industry, media, and government publications have cited an FBI estimate that U.S. businesses lose $200-$250 billion to counterfeiting on an annual basis. This estimate was contained in a 2002 FBI press release, but FBI officials told us that it has no record of source data or methodology for generating the estimate and that it cannot be corroborated.

Second, a 2002 CBP press release contained an estimate that U.S. businesses and industries lose $200 billion a year in revenue and 750,000 jobs due to counterfeits of merchandise. However, a CBP official stated that these figures are of uncertain origin, have been discredited, and are no longer used by CBP. A March 2009 CBP internal memo was circulated to inform staff not to use the figures. However, another entity within DHS continues to use them.

Third, the Motor and Equipment Manufacturers Association reported an estimate that the U.S. automotive parts industry has lost $3 billion in sales due to counterfeit goods and attributed the figure to the Federal Trade Commission (FTC). The OECD has also referenced this estimate in its report on counterfeiting and piracy, citing the association report that is sourced to the FTC. However, when we contacted FTC officials to substantiate the estimate, they were unable to locate any record or source of this estimate within its reports or archives, and officials could not recall the agency ever developing or using this estimate. These estimates attributed to FBI, CBP, and FTC continue to be referenced by various industry and government sources as evidence of the significance of the counterfeiting and piracy problem to the U.S. economy.

The GAO then sets its sights on several private industry reports. The Business Software Alliance claimed a loss of $9 billion to piracy in 2008, but its study "uses assumptions that have raised concerns among experts we interviewed, including the assumption of a one-to-one rate of substitution and questions on how the results from the surveyed countries are extrapolated to non-surveyed countries."

Next up was the MPAA, which has already publicly taken its lumps for that flawed 2005 survey we mentioned above. But even when you set aside the mistaken initial conclusion about collegiate downloading, the study still shouldn't be used by lawmakers; it's a black box.

"It is difficult, based on the information provided in the study, to determine how the authors handled key assumptions such as substitution rates and extrapolation from the survey sample to the broader population," says the GAO.
More than they bargained for

Why is the government even looking into this issue? It's all due to the PRO-IP Act, which passed under President Bush and has led President Obama to appoint an Intellectual Property Enforcement Coordinator within the White House. Part of the IPEC's duties include gathering data on piracy and counterfeiting, and current IPEC Victoria Espinel is now rounding up that data. The GAO report is part of this process, and it certainly doesn't make industry estimates look compelling.

This is ironic for a bill that was backed by the big rightsholders; even its acronym, the PRO-IP Act, shows what it was supposed to do. But, by hauling the black art of "piracy surveys" into the light, the PRO-IP Act is forcing rightsholders to tone down some of their more specific and alarmist rhetoric.

The RIAA, MPAA and others have already asked Espinel to make Internet piracy her principal focus in order to "push back the tide of copyright theft."

What about all that data Espinel asked for, including detailed methodologies? The content industries basically punted, pointing to three surveys done by a single guy, Stephen Siwek of the Institute for Policy Innovation. GAO looked specifically at Siwek's work, all of which seeks to model effects of piracy on the entire US economy.

The government concluded that "most of the experts we interviewed" were reluctant to embrace Siwek's methodology; his approach comes from the Commerce Department, but it simply wasn't designed to measure what's being measured here. For instance, these studies ignore the obvious points that pirating goods leaves consumers with more disposable income, which is likely spent elsewhere in the economy. Effects on the economy as a whole, then, are terribly speculative and seem more likely to be simply redistributive.

None of this is to say that piracy and counterfeiting aren't real problems. The GAO accepts that the problem is "sizeable," but it also points out just how much bad data is used to produce these studies. Actual dollar figures and job loss numbers should be handled with extreme care and a good bit of skepticism; the GAO also noted that numerous experts told it that "there were positive effects [from piracy on the economy] and they should be assessed as well."

This is a helpful, level-headed review from the GAO, one that (hopefully) brings some of the debates over digital infringement into saner territory.

Salient bits highlighted for extra hilarity.

[White Haven]

Hah! What makes this so very, very sweet is that it's all fallout from their own bought-and-paid-for legislation that's bringing this all into...not the light, because none of it is really news, but into brighter and more public light.

[Darmalus]

So, if I understand this, is that all the estimates of piracy and counterfeiting were sourced to various government organizations, and when the government went asking the organizations for documents, they all responded "We never made any such estimates."

Wow. It's not even estimates made by bad math and assumptions, it's nothing but hot air at all!

[Solauren]

No shit the estimates were total bullshit.

Hell, half the stuff I've 'seen' pirated, was stuff the person that pirated couldn't be bothered to buy in the first place. It was a case of 'you know what, it's free, and there is nothing on TV.'

Otherwise, in most cases, they'd have not purchased it. i.e Just cause Microsoft Office 2007 is out, doesn't mean I'm upgrading. (I hated the demo/free version with a passion). Not worth my $100 dollars.

On the flip side, within the same group of people, pirating has actually encouraged them to purchase the movie or software.

i.e Several of the movies I own a legal copy of, I first watched as a pirate copy under the "I'm bored, and there is nothing on TV. Oh, this should only take about 45 minutes to download, enough time to walk the dog".

[Admiral Valdemar]

That's the same argument used against DRM in computer games. The people who were going to pirate it were never going to pay for it in the first place, and ironically, the pressure is being put on the legitimate buyers like myself to just say "fuck it" and do like the pirates do. At the end of the day, I'm getting a bit sick of being treated guilty until proven innocent, or like a second class citizen when there is no foundation to the belief that I'm some super pirate unless scared shitless by PR stunts or bad anti-piracy gimmicks.

Now we see that it wasn't just inflated numbers about this threat, it was a totally unsubstantiated threat to industry in the first place. If piracy was costing hundreds of billions in lost revenue from the US alone, do you think that may just show up somewhere in reality too? Either the industry makes more than enough cash as it does, or the drain is nowhere near such grandiose claims.

[Alphawolf55]

I think the moment someone claimed "Yeah if US piracy didn't exist people would be spending almost a 1000 dollarsp er capita on entertainment or almost 10% of the average US family income" it should've been known to be bullshit just for the mere fact that most people don't have the money to spare on such ridiculous things.

[Uraniun235]

Hahahaha, this is beautiful. There's got to be a load of paid shills and glory-seekers in the government that just had their blood pressure spike. How long before the whores in Congress and the White House set their sights on the GAO for not falsifying all their data like most of the rest of the agencies have learned to do by now?

[phred]

Hell, half the stuff I've 'seen' pirated, was stuff the person that pirated couldn't be bothered to buy in the first place. It was a case of 'you know what, it's free, and there is nothing on TV.'

i.e Several of the movies I own a legal copy of, I first watched as a pirate copy under the "I'm bored, and there is nothing on TV. Oh, this should only take about 45 minutes to download, enough time to walk the dog".

I'm sort of the same. A lot of the music I've downloaded I would never have given a chance to normally, but since I've heard a couple songs off the CD I'm more willing to shell out 13 bucks for it.

[Archaic`]

The real interest to me is how much of the research into piracy by Academics is now going to be called into question. A lot of research had quoted those figures along with other industry estimates. If we were able to identify which research was paid for by grants from groups like the RIAA/MPAA, I wonder just how big the divide we'd see between those papers and the others.