Peer-to-Peer Technology to Trump Traditional Cloud Storage

On a lovely Thursday afternoon in June, I sat down with Sarah Koo, a data scientist with BitTorrent. I grew up in a time and place where Peer-to-Peer (P2P) transfer was almost commonplace, and I was fortunate enough to have the opportunity to learn more about this unique technology.

 

When Peer-to-Peer transfer is mentioned, the subject of copyright protection is the first thing to come to mind. Though P2P transfer is used, at times, to download Game of Thrones, the technology itself is an innovative protocol designed to efficiently transfer large files. I want to make an explicit statement that neither I, Sarah, nor BitTorrent, condones any forms of illegal file transfers. I am advocating the technology itself, which is commonly used in both academia and business. 

 

Bram Cohen created the Peer-to-Peer transfer protocol about a decade ago. This genius literally coded the program by himself in his bedroom, like many of our city’s tech entrepreneurs. Traditional file transfer protocols connected downloaders to a single server for direct file transfers. If there were 100 users downloading the same file, all these users would connect to the same server. Such traditional methods resulted in significant speed reductions and heavy server strain as demand for the file increased. Cohen's application created a distinct virtual network per file that allowed any invited users to help with distribution.

a protocol that created a virtual network based on the file itself, thus anyone within the network can help distribute the file

Lets say UC Berkeley is working on a massive database, and it needs to distribute it to 10,000 researchers across the country. If each of these 10,000 researchers downloads the file directly from the Cal server, the strain on the single server is intense and extremely inefficient. P2P transfer creates a network that links all invited researchers together, and once any researcher finishes downloading the database, he can act as a file distributor for other researchers within the network. Thus, the strain of distributing the database is crowd sourced to all its participants. 

BitTorrent, the most popular P2P transfer application, breaks down large files into small segments for even more efficient distribution. If the database described above is 20-gigabytes; BitTorrent could break down the file into 20 equal sized 1-gigabyte files. “If I request the file from peers, I can be getting it from 20 different people at the same time.” Thus, each peer only needs to distribute 1/20th of the overall load.

breaks down large files into small segments for more efficient distribution

Because BitTorrent breaks down files into many individual segments, peers can act as distributors the moment they finish downloading any piece of the overall file. Once all the segments are downloaded, BitTorrent reassembles the original file as whole. The ability to deconstruct files and then reassemble the segments after the transfer protocol is complete is groundbreaking, especially in the field of cloud storage.

BitTorrent has utilized this technology to build sync applications that are commonly used in industries such as video editing. In Hollywood, uncut video files run in the hundreds of gigabytes. If multiple video editors are working on the same film, it’s inefficient to retransfer the whole video anytime a minute change is made. Many editors utilize this segmentation technology to transfer and sync only the portions that were altered. Instead of retransferring the whole 100gb video, Hollywood only transfers the 1gb scene that was actually edited. Now that’s efficiency.

 

In our current age of NSA surveillance and CISPA interrogation, privacy and security has become a major concern. BitTorrent is unique among cloud storage applications, because it’s only a protocol, and not a storage system. “There’s no copy of (your files) on our cloud.” “If the government would be to subpoena our records, we wouldn’t have anything to turn over.”

“If the government would be to subpoena our records, we wouldn’t have anything to turn over.”

The lack of centralized storage acts as both a blessing and a curse. On one hand, your files never leave your possession; on the other hand, there’s no backup other than your own. Obviously, there are ways to alleviate this issue, but it’s something to keep in mind. I want to emphasis again that BitTorrent is only a protocol, not a storage service. 

Finally, I want to mention another firm that utilizes a similar technology, or at least one that I found to be of some interest. Bitcasa acts as a traditional cloud storage service, but it’s developing a technology called Infinite Drive: When a duplicate file is uploaded, the protocol searches its database for preexisting files, and earmarks the original without uploading the duplicate. 

If two teenage girls upload the same Justin Bieber album, only one copy is actually stored on Bitcasa's servers. When the album is downloaded, both users access the same file. The technology is interesting, but there are significant areas of concern. If one user alters the album, how would it affect related users who share the same download address. I don’t think this technology is ready for widespread use, but it’s something to look out for in the future.

the word “traditional” to describe cloud storage

It’s funny; it seems like it was only yesterday that Dropbox launched, but this Generation Y technology has already become old news. Earlier in this article, I, inadvertently, used the word “traditional” to describe cloud storage; might as well get out the cane and monocle while at it. The future of file storage will take advantage of Peer-to-Peer transfer protocol. It’s an ingenious method that enables crowd sourcing to distribute large files, and it's capabilities are greatly magnified by BitTorrent’s segmentation technology.

Peer-to-Peer file transfer is secure; but more importantly, it’s efficient.

  • Thread, The U.K. Online Personal Styling Service For Men, Scores $8M Series A

    Aug 28, 2015 | 07:40 am

    Thread, The U.K. Online Personal Styling Service For Men, Scores $8M Series A  Using a mixture of algorithms and human stylists, London-based Thread works on the premise that a lot of men hate clothes shopping, however much they like stylish attire. The online styling service claims 200,000 customers since it was founded in 2012 and has this week hit a significant funding milestone with the the closure of an $8 million Series A round led by Balderton Capital. Read More

  • Vive VR Headset Full Consumer Launch Slips To Q1 2016

    Aug 28, 2015 | 07:22 am

    Vive VR Headset Full Consumer Launch Slips To Q1 2016  You wait years and years for virtual reality to become a thing, and then suddenly a truck load of VR headsets pile into the tech hype cycle almost at once (thanks Oculus). But if you’re a consumer wanting to get eyes into this next-gen VR hardware you’re likely still waiting to live the daydream. Read More

  • Foxconn-backed Piq teams with France’s Babolat to roll out tennis wearable

    Aug 28, 2015 | 07:00 am

    In the latest step toward expanding its sports wearable strategy, Paris-based Piq announced today that it has partnered with Babolat, a major brand in the tennis world. France’s Babolat will start selling a version of Piq’s wearable multi-sport sensor that is customized for tennis players, and will display the Babolat brand. The deal is part of Piq’s long-term […]

  • Nokia agrees on China joint venture with Huaxin

    Aug 28, 2015 | 06:26 am

    HELSINKI (Reuters) – Finnish telecom equipment maker Nokia <NOKIA.HE> on Friday said it has agreed to create a joint venture in China with state-owned Huaxin, following Nokia’s proposed takeover of Alcatel-Lucent. Alcatel-Lucent and Huaxin currently share a similar joint venture. According to a memorandum of understanding, Nokia said it expects to hold 50 percent plus […]

  • ReBoard Is An iOS Keyboard With Third Party App Shortcuts

    Aug 28, 2015 | 05:33 am

    ReBoard Is An iOS Keyboard With Third Party App Shortcuts  ReBoard is a just launched iOS keyboard app from an indie dev team in India that’s targeting productivity-focused folk, by adding the ability to reach out to other apps right from the keyboard. So instead of having to double tap out of whatever messaging app you’re using to go hunt for that YouTube link, for instance, you can do a look up right from the keyboard. Read More

  • Google's Chrome to start auto-pausing Flash ads on Sept. 1

    Aug 28, 2015 | 05:20 am

    Google's Chrome to start auto-pausing Flash ads on Sept. 1 Flash, it was nice knowing you The demise of the once ever-present multimedia platform draws nearer with Google's decision to automatically pause "many" Flash ads in its web browser Chrome Chrome won't pause all Flash content — for example, a Flash video you're trying to watch will not be paused, but the surrounding Flash content (usually ads) will. If you want to look at a piece of Flash content that was paused, you can click on it and start it manually See also: Chrome update lets you disable annoying Flash videos from autoplaying The change, originally announced in June and enabled for beta users, goes into effect for everyone Sept. 1, Google announced Thursday. Read more...More about Google, Flash, Chrome, Tech, and Apps Software

  • Uber confirms China police investigating driver over alleged robbery and sexual assault

    Aug 28, 2015 | 05:10 am

    Police in China have opened an investigation after an Uber driver reportedly robbed and sexually assaulted a female passenger in the city of Chengdu on August 5, the company has confirmed to VentureBeat. Reports first surfaced Wednesday (link in Chinese) on local state media that a 42-year-old female passenger had hailed an Uber at 2 a.m., August 5, […]

  • Obama administration announces $171M manufacturing innovation hub in Silicon Valley

    Aug 28, 2015 | 05:00 am

    The Obama Administration will make an announcement later today that will establish a new flexible hybrid electronics manufacturing innovation hub in Silicon Valley. More than $171 million will be invested into this “manufacturing innovation institute” and marks the first time such an organization is headquartered in the West Coast. This institution is another extension of the […]

  • Aging2.0 #30in30in30 World Tour Wants To Find The Best Startups For Seniors

    Aug 28, 2015 | 04:54 am

    Aging2.0 #30in30in30 World Tour Wants To Find The Best Startups For Seniors  Consumers in their twenties to early fifties are usually considered the most attractive age demographic because of their spending power. Unfortunately, this means that older people are often underserved by companies even though they make up more than 16 percent of the world’s population. Aging2.0 wants to change that. Read More

  • Cheetah Mobile Will Launch Its Online Advertising Platform In India

    Aug 28, 2015 | 03:14 am

    Cheetah Mobile Will Launch Its Online Advertising Platform In India  Best known as an Android utility app maker, Cheetah Mobile is now focused on global growth for its mobile advertising business. The Beijing-based company announced today that it will launch its advertising platform in India next month. Read More

  • Remembering the Windows 95 launch and overreacting to Apple's event invites

    Aug 28, 2015 | 03:08 am

    Remembering the Windows 95 launch and overreacting to Apple's event invites This past Monday marked the 20th anniversary of the historic launch of Windows 95. See also: The hysteria over Windows 95 launch, 20 years ago To commemorate the occasion, we share our memories of the launch and play a fun round of Guess That Windows Startup Sound on the latest episode of MashTalk. Plus, we overreact to Apple's invitations to its upcoming iPhone event and discuss Instagram's decision to abandon the square crop Listen to the episode on Libsyn, above, or on iTunes. You can also subscribe to MashTalk on iTunes, and get our latest episodes instantly. Have something to add to this story? Share it in the comments. Read more...More about Microsoft, Iphone, Apple, Windows, and Instagram

  • DeNA’s Mirrativ App Livestreams Any Game Or App On Your Android Device

    Aug 28, 2015 | 03:06 am

    DeNA’s Mirrativ App Livestreams Any Game Or App On Your Android Device  YouTube isn’t the only one to introduce a live-streaming app this week. Just days after YouTube Gaming was outed, Japan’s DeNA — a prolific producer of games itself — has entered the scene with its own take, called Mirrativ. Read More