Big Data and Hacking

After a six year investigation, Mandiant, an American security company, claims that the US is in a cyber war with China’s stealth cyber war division, the People’s Liberation Army Unit 61398, from a 12-story building in Shanghai. Sen. Dianne Feinstein, chairwoman of the Senate Intelligence Committee, has said that classified intelligence documents support Mandiant’s claim.

Chinese hackers has acquired data from at least 141 companies across 20 major sectors, 115 being from the US.  The article explains that sometimes automate their hacking efforts by using programs, located across the globe, which will cycle through known exploits until one works. Once one works, the program will plant the code within the computer to allow for spreading across networks, usually without the computer operator aware.

“Less than one percent of the world’s data is analyzed and less than 20 percent is protected.”

It is estimated that global data will amount to 40 zettabytes (over 40 billion terabytes) by 2020.

Companies have realized the opportunity cost of not collecting data. So, even if companies aren’t exactly data mining, they are still collecting it. This is where the problem lies. Coupled with the fact that this type of data science usually relies on Quants, quantitative analysts with Ph.D.’s in math/physics and extensive computer programming skills, it makes it more difficult for everyone to usefully utilize their data. This creates ridiculous amounts of storage.

With companies not effectively protecting and securing peoples’ data and the masses of stagnant data, it becomes a field day for competent hackers.

The article finishes with the suggestion of more advocacy groups to protect consumer rights. Though I agree, I just see this being a ‘corporate’ version media piracy. Good luck.