Collect-it-All

Yard Dart · Jan 26, 2015

In the summer of 2008, Gen. Keith Alexander, the recently resigned director of the National Security Agency, posed an audacious question to intelligence analysts at the Menwith Hill eavesdropping station in North Yorkshire, in the United Kingdom: “Why can’t we collect all the signals all the time?”

Since Edward Snowden’s revelations began, that quote has gone a long way to color the NSA’s seemingly insatiable appetite for data. Former administration officials who worked for Alexander have similarly described the cowboy-like regime of intelligence-gathering that defined his tenure, calling his strategy “the same as Google’s: I need to get all of the data.”

Amusingly, it wasn’t until a recent interview with comedian and former Daily Show correspondent John Oliver that the general got grilled on this point. “You do understand that ‘collect everything’ is also the motto of a hoarder,” he told Alexander during the premiere of his new talk show. “That’s the fundamental principle which ends up with someone living alongside 1,500 copies of newspapers from the 1950s and six mummified cats.”

Alexander smoothly responded that his “collect-it-all” quip was taken out of context, and only relevant to “specific problems”—in this particular case, the dramatic rise of U.S. troop casualties in Iraq. But additional Snowden documents released in Glenn Greenwald’s new book, No Place to Hide, seem to further illustrate the “collect-it-all” mentality as a recurring mantra within the NSA and its allied intelligence agencies. Indeed, much to Oliver’s humorous point, some of the material reads like dispatches from a Hoarders Anonymous convention.

Chief among them is a graphic presented at a secret meeting of the “Five Eyes” surveillance alliance in 2011 describing a “New Collection Posture” with incredibly explicit goals: “Collect it All; Process it All; Exploit it All; Partner it All; Sniff it All,” and, most chillingly, “Know it All.” Another document, from British spy agency Government Communications Headquarters, names a program that intercepts satellite communications, dubbed “Asphalt,” describing it as a “‘Collect it All’ proof-of-concept system.” A 2009 memo from the NSA operations center in Misawa, Japan, similarly touts its newly improved interception capabilities as “bringing our enterprise one step closer to collecting it all.”

“They don’t need a reason to collect information. That’s a mischaracterization of what the NSA does,” said Greenwald on Tuesday, during an event for his new book at Cooper Union in New York. “The reason they are collecting things is because those are communications that exist on the earth, and because they can.

A point commonly made by NSA critics is that these dragnets collect not enough signal and too much noise. Several internal documents give that credence, including one that admits the NSA “collects far more content than is routinely useful to analysts.” A top-secret chart in Greenwald’s book displaying “Current Volumes and Limits” for data storage shows that the agency collected upwards of 20 billion “communications events” per day in 2012, the vast majority of which were stored in various databases. In December of the same year, a program called “Shelltrumpet” processed its 1 trillionth metadata record; almost half that amount was processed in 2012 alone.

Such statistics seem to be cause for both celebration and headache within the NSA. Another classified slide, titled “The Challenge,” states that “Collection is outpacing our ability to ingest, process, and store the ‘norms’ to which we have been accustomed.” This overcollection is such a widely acknowledged problem that the agency has a separate line in its budget devoted to “coping with information overload.”

Often left out of the discussion, however, is how intelligence agencies like the NSA might one day turn all this noise back into signal.

In many ways, it’s already happening. Government contractors like Palantir, a company valued at $9 billion and backed by an alphabet soup of three-letter agencies, have built the success of their pattern-analysis software upon the growing need to make sense of the U.S. government’s ever-expanding Library of Babel. These systems work by adding metadata tags to communications as they pass through digital sensors at various choke points throughout the Internet and then running complex algorithms to find patterns in the noise. Once patterns are established, an intelligence analyst need only input the “selectors,” or search terms, into a user interface like the NSA’s “X-Keyscore” to find whatever it is they want to find.

German hacker Thomas Dullien, aka Halvar Flake, has a name for this unholy fusion of Big Data and Big Brother: “Full-packet-capture society.” He describes a possible future where the rapidly falling cost of electronic storage, pattern-detecting algorithms, and ubiquitous networks of sensors conspire to create a world “where every word ever spoken and every action ever taken is recorded somewhere.”

That may seem like far-off dystopian science fiction, but the spirit of “collect-it-all” is already visible outside the NSA as systems like automated license-plate readers and facial-recognition spring up around the world. California-based Vigilant Solutions maintains the largest private database of license-plate images, holding more than 550 million records of vehicle movements and grants unfettered access to police departments around the country. And the pilot program for the FBI’s national facial-recognition database is expected to hold 52 million face images by next year—including photos of individuals not suspected of a crime.

The NSA and its allies are staunch defenders of these “haystacks,” even though multiple studies concluded the database containing millions of Americans’ phone records played little or no role in preventing terrorist attacks. They’ve countered that it’s foolish to assume all terrorists hang out in one isolated section of the Internet, therefore mass-collection becomes a necessary obsession to find that ever-elusive needle.

But the recent passage of the amended USA Freedom Act through the House seems to suggest there is an alternative. The NSA reform bill, in its current form, would leave the agency’s hugely controversial database of Americans’ phone records in the hands of telecommunications companies, and would require the NSA to prove that there is “reasonable suspicion” to collect individual records. It’s a step down from a probable-cause warrant, but still starkly contrasts a rival bill written by NSA defenders that would allow the agency unfettered access without a judge’s approval.

It would be prudent to reach some kind of consensus soon, because when you collect-it-all, the next step is to automate-it-all. After that, who knows how many innocent straws of hay will start to look like needles under the gaze of unseen algorithms.
Click to expand...

NSA Can ‘Collect-it-All.’ But Then What? - Yahoo News
At what point do they just mail you a fine/fee for breaking a rule or law...or just crash in your door and drag you away. I was listening to the radio today (Bob Rivers) and they were discussing all the cameras everywhere in our society.... and how you will just get a fine at some point in the not so distant future for every little rule you break, because you will be under the continuous gaze of big brother. There are so many laws that it is almost to the point that you can be cited for "something" almost everyday. What happens when the insurance company is jacked into your car and sends you an extra bill each month for every mile over the speed limit you go. When is it to much, when has your right to privacy been violated..... I suggest we have passed far beyond that line in the sand.

Tracy · May 16, 2014

Does anyone here have those insurance things that plug into their car?? I'd love to know what you were told about them.

I asked, and was told (by an agent), that you plug them in - but are not to unplug them until they tell you that you can do so. That they gather boatloads of information about your driving habits. Currently; the agencies are only supposed to collect certain things, but their capabilities are more. He highly recommended that I did not get it. That the savings weren't quite worth the invasion. I assured him I had no intention of getting it, but that my curiosity made me ask.

kellory · May 16, 2014

I have had one before. It is supposed to be randomized info with no personal info allowed at all.
It is to see the populations driving habits as a whole, and there are waivers that state that it CAN NOT be used in any way against you. My wife signed us up for it twice (IIRC) and it plugs into the port beneath the steering column, and stays there for 3 or 6 months. Then gets mailed in.
The envelopes have no personal markings, and they state they collect none.
It knocked maybe $100. Off my insurance bill to participate. I would not have done so on general principle, but it was already installed by the time I knew of it. (Her car only).

Byte · May 16, 2014

Let's see...it has GPS, check! They absolutely know exactly who sends each one in. And it will be used against you and every other insured driver. If there was ever an invention I wish I had been around to be the first to dream up it would be 'insurance'. What a racket! Al Capone had nuthin' on the real racketeers.

kellory · May 16, 2014

Byte said: ↑

Let's see...it has GPS, check! They absolutely know exactly who sends each one in. And it will be used against you and every other insured driver. If there was ever an invention I wish I had been around to be the first to dream up it would be 'insurance'. What a racket! Al Capone had nuthin' on the real racketeers.
Click to expand...

It doesn't have GPS. It gathers the same type of info your computer gives your mechanic every time it is hooked up to a diagnostic machine. It looks at things like miles. Rpms, emission controls (I think). It looks at HOW you drive, not WHERE you drive.

Motomom34 · May 17, 2014

My boss was talking about these the other day. He said they really track your speed. You will get penalized if you go 80.

kellory · May 17, 2014

Motomom34 said: ↑

My boss was talking about these the other day. He said they really track your speed. You will get penalized if you go 80.
Click to expand...

.....and your boss would know this how?

Motomom34 · May 17, 2014

His agent told him. The discouraged him from getting one. Very odd.

kellory · May 17, 2014

Motomom34 said: ↑

His agent told him. The discouraged him from getting one. Very odd.
Click to expand...

think of it as a money maker. if they have committed fraud they will pay me.

ghrit · May 17, 2014

The boss is a trucker? Big rigs do have GPS for that reason. Unlikely they would use a cell or other personal device for the purpose, and if they are installed in a car at the factory, who is monitoring them for any purpose?

Yard Dart · May 17, 2014

In the logistics tracking system they use the truckers GPS either rig mounted or their cell phone to track high value loads. This is required by most shippers of these type of loads nationally They can also be used as Ghrit said to track average miles per day (speed) as well as identify issues with routing. My daughter pushes freight for a "large" national outfit and I have to put up with her chewing out a dispatcher on the weekends or evenings, because she can see that a truck is loitering somewhere rather than moving down the road..... She gets mad when the truckers stop answering her phone calls...... it is funny to watch for about 5 minutes... and then it is time for me to go elsewhere..

BTPost · May 17, 2014

This is EXACTLY why I will NEVER OWN a Vehicle with OnStar, or any similar Device Installed. I would suggest that anyone who does, should Cut the Antenna Connection, at the BlackBox, to disable the Comms Function. No Cellular Comms, No Tracking, or Remote Operation of your vehicle, from the outside, Period....Big Brother doesn't need to Control My Vehicles..... .... YMMV.....

Log in or Sign up

Collect-it-All

Yard Dart Vigilant Monkey Moderator

Tracy Insatiably Curious Moderator Founding Member

kellory An unemployed Jester, is nobody's fool. Banned

Byte Monkey+++

kellory An unemployed Jester, is nobody's fool. Banned

Motomom34 Monkey+++

kellory An unemployed Jester, is nobody's fool. Banned

Motomom34 Monkey+++

kellory An unemployed Jester, is nobody's fool. Banned

ghrit Bad company Administrator Founding Member

Yard Dart Vigilant Monkey Moderator

BTPost Stumpy Old Fart,Deadman Walking, Snow Monkey Moderator

Snowden’s Privacy Tips: “Get Rid Of Dropbox,” Avoid Facebook And Google

NSA Spying: Now It's Personal

How to Protect Your Privacy in the Age of NSA Surveillance

Reset The Net - SM is fully compliant SSL TLS HTTPS HSTS PFS

Push Back Against The Surveillance State

Edward Snowden, A Truth Unveiled (Documentary)

A Thought Provoking Editorial on Snowden

Collect-it-All

Yard Dart Vigilant Monkey Moderator

Tracy Insatiably Curious Moderator Founding Member

kellory An unemployed Jester, is nobody's fool. Banned

Byte Monkey+++

kellory An unemployed Jester, is nobody's fool. Banned

Motomom34 Monkey+++

kellory An unemployed Jester, is nobody's fool. Banned

Motomom34 Monkey+++

kellory An unemployed Jester, is nobody's fool. Banned

ghrit Bad company Administrator Founding Member

Yard Dart Vigilant Monkey Moderator

BTPost Stumpy Old Fart,Deadman Walking, Snow Monkey Moderator

Useful Searches