Peer-to-Peer Technology to Trump Traditional Cloud Storage

On a lovely Thursday afternoon in June, I sat down with Sarah Koo, a data scientist with BitTorrent. I grew up in a time and place where Peer-to-Peer (P2P) transfer was almost commonplace, and I was fortunate enough to have the opportunity to learn more about this unique technology.


When Peer-to-Peer transfer is mentioned, the subject of copyright protection is the first thing to come to mind. Though P2P transfer is used, at times, to download Game of Thrones, the technology itself is an innovative protocol designed to efficiently transfer large files. I want to make an explicit statement that neither I, Sarah, nor BitTorrent, condones any forms of illegal file transfers. I am advocating the technology itself, which is commonly used in both academia and business. 


Bram Cohen created the Peer-to-Peer transfer protocol about a decade ago. This genius literally coded the program by himself in his bedroom, like many of our city’s tech entrepreneurs. Traditional file transfer protocols connected downloaders to a single server for direct file transfers. If there were 100 users downloading the same file, all these users would connect to the same server. Such traditional methods resulted in significant speed reductions and heavy server strain as demand for the file increased. Cohen's application created a distinct virtual network per file that allowed any invited users to help with distribution.

a protocol that created a virtual network based on the file itself, thus anyone within the network can help distribute the file

Lets say UC Berkeley is working on a massive database, and it needs to distribute it to 10,000 researchers across the country. If each of these 10,000 researchers downloads the file directly from the Cal server, the strain on the single server is intense and extremely inefficient. P2P transfer creates a network that links all invited researchers together, and once any researcher finishes downloading the database, he can act as a file distributor for other researchers within the network. Thus, the strain of distributing the database is crowd sourced to all its participants. 

BitTorrent, the most popular P2P transfer application, breaks down large files into small segments for even more efficient distribution. If the database described above is 20-gigabytes; BitTorrent could break down the file into 20 equal sized 1-gigabyte files. “If I request the file from peers, I can be getting it from 20 different people at the same time.” Thus, each peer only needs to distribute 1/20th of the overall load.

breaks down large files into small segments for more efficient distribution

Because BitTorrent breaks down files into many individual segments, peers can act as distributors the moment they finish downloading any piece of the overall file. Once all the segments are downloaded, BitTorrent reassembles the original file as whole. The ability to deconstruct files and then reassemble the segments after the transfer protocol is complete is groundbreaking, especially in the field of cloud storage.

BitTorrent has utilized this technology to build sync applications that are commonly used in industries such as video editing. In Hollywood, uncut video files run in the hundreds of gigabytes. If multiple video editors are working on the same film, it’s inefficient to retransfer the whole video anytime a minute change is made. Many editors utilize this segmentation technology to transfer and sync only the portions that were altered. Instead of retransferring the whole 100gb video, Hollywood only transfers the 1gb scene that was actually edited. Now that’s efficiency.


In our current age of NSA surveillance and CISPA interrogation, privacy and security has become a major concern. BitTorrent is unique among cloud storage applications, because it’s only a protocol, and not a storage system. “There’s no copy of (your files) on our cloud.” “If the government would be to subpoena our records, we wouldn’t have anything to turn over.”

“If the government would be to subpoena our records, we wouldn’t have anything to turn over.”

The lack of centralized storage acts as both a blessing and a curse. On one hand, your files never leave your possession; on the other hand, there’s no backup other than your own. Obviously, there are ways to alleviate this issue, but it’s something to keep in mind. I want to emphasis again that BitTorrent is only a protocol, not a storage service. 

Finally, I want to mention another firm that utilizes a similar technology, or at least one that I found to be of some interest. Bitcasa acts as a traditional cloud storage service, but it’s developing a technology called Infinite Drive: When a duplicate file is uploaded, the protocol searches its database for preexisting files, and earmarks the original without uploading the duplicate. 

If two teenage girls upload the same Justin Bieber album, only one copy is actually stored on Bitcasa's servers. When the album is downloaded, both users access the same file. The technology is interesting, but there are significant areas of concern. If one user alters the album, how would it affect related users who share the same download address. I don’t think this technology is ready for widespread use, but it’s something to look out for in the future.

the word “traditional” to describe cloud storage

It’s funny; it seems like it was only yesterday that Dropbox launched, but this Generation Y technology has already become old news. Earlier in this article, I, inadvertently, used the word “traditional” to describe cloud storage; might as well get out the cane and monocle while at it. The future of file storage will take advantage of Peer-to-Peer transfer protocol. It’s an ingenious method that enables crowd sourcing to distribute large files, and it's capabilities are greatly magnified by BitTorrent’s segmentation technology.

Peer-to-Peer file transfer is secure; but more importantly, it’s efficient.

  • Google Snags Former Tesla Autopilot Engineering Manager Robert Rose

    Nov 30, 2015 | 22:28 pm

    Google Snags Former Tesla Autopilot Engineering Manager Robert Rose  The battle to make elite autonomous vehicles is on, and a major part of that is assembling teams that will carry out your plans. Today, it was reported that Google snagged Tesla’s former Autopilot software engineering manager, Robert Rose. Rose also spent five years at SpaceX according to his LinkedIn profile. Rose’s gig for “Google Robots” is listed as… Read More

  • Ad Exec Bob Lord To Leave AOL

    Nov 30, 2015 | 22:22 pm

    Ad Exec Bob Lord To Leave AOL  Bob Lord will soon leave his role as president of AOL. In an interview with The Wall Street Journal, AOL CEO Tim Armstrong said he’d seen Lord as his eventual successor, but that plan was sidetracked by Verizon’s acquisition of the company (which owns TechCrunch) — as part of the deal, Armstrong committed to remain on-board for several more years. Lord joined AOL two… Read More

  • Oculus Founder Palmer Luckey To Make “Special Announcement” This Week

    Nov 30, 2015 | 22:12 pm

    Oculus Founder Palmer Luckey To Make “Special Announcement” This Week  At this week’s “Game Awards” in Los Angeles, Oculus founder Palmer Luckey is scheduled to attend and make an announcement of some sort, its host announced today on Twitter. Read More

  • New Samsung patent shows off a phone that unfolds into a tablet (with bonus Apple cameo)

    Nov 30, 2015 | 22:06 pm

    The U.S. Patent and Trademark Office has just published an application from Samsung (via 9to5Mac) that attempts to patent a foldable electronic device. It’s likely that one of the examples depicted in the application represents the company’s upcoming foldable smartphone, dubbed Project Valley. First revealed by SamMobile, the so-called Project V (thus named to reflect the shape […]

  • NASA Initiative Puts Space Age Technologies At Entrepreneurs’ Fingertips

    Nov 30, 2015 | 22:00 pm

    NASA Initiative Puts Space Age Technologies At Entrepreneurs’ Fingertips  The space administration recently announced its Startup initiative by opening up around 1200 patented technologies to US startups to commercialize at no upfront costs. Soon, the space-age technologies that appear ripped from the pages of science fiction, and initially intended for deep space exploration, could make their way into our living rooms, reshaping our daily lives. Read More

  • This is what a National Security Letter looks like

    Nov 30, 2015 | 21:58 pm

    In 2004, the Federal Bureau of Investigation issued a National Security Letter (NSL) to a New York Internet service provider called Calyx. It’s a type of governmental information request that became much more common as a result of the passing of the USA Patriot Act in 2001, just after September 11. All this time, this […]

  • Hands-On With Facebook’s Haphazard Shopping Feed

    Nov 30, 2015 | 21:53 pm

    Hands-On With Facebook’s Haphazard Shopping Feed  Random is the right way to describe Facebook’s attempted invasion of Amazon’s turf. With skimpy product selection, no reviews and limited browsing options, Facebook’s dedicated feed of products is not a great way to shop. At least not yet. But this is only Facebook’s first attempt. It brings with it a ton of knowledge about you and its position as where people spend… Read More

  • Oculus VR will have a ‘special announcement’ at ‘The Game Awards’

    Nov 30, 2015 | 21:45 pm

    We may learn a little bit more about the Oculus Rift later this week. Oculus VR is going to make a “special announcement” this Thursday during The Game Awards, which is an annual livestreaming show that attempts to recognize excellence in game development. Imaging the MTV Video Music Awards but with more polygons and digital punching. […]

  • YouTube Enters The App Store’s Top Grossing Charts, Thanks To YouTube Red Subscriptions

    Nov 30, 2015 | 21:44 pm

    YouTube Enters The App Store’s Top Grossing Charts, Thanks To YouTube Red Subscriptions  YouTube’s plans to convert a portion of its user base to a subscription-based, ad-free service known as YouTube Red appears to be gaining traction. The company’s iOS application is now ranked as one of the App Store’s Top 10 Grossing apps on iPhone, following the launch of YouTube Red in late October. This indicates that a number of users who initially signed up for the… Read More

  • Apple Music Is Coming To Sonos On December 15

    Nov 30, 2015 | 21:36 pm

    Apple Music Is Coming To Sonos On December 15  Sonos users, rejoice! The speaker company just announced that an update adding Apple Music is coming on December 15 in beta. All the flagship Apple Music features will be available directly from the Sonos app. Read More

  • 50% of adults shop on smartphones while browsing a store

    Nov 30, 2015 | 21:29 pm

    Half of all adult shoppers conduct product research on mobile devices while shopping in physical stores, according to the results of a new study by the Interactive Advertising Bureau (IAB). The practice is called “showrooming,” and it’s especially popular among younger consumers. The IAB defines showrooming as “comparing prices on a mobile device while in […]

  • Effortlessly Cleanse And Monitor The Air In Your Home With Blueair’s Sense+ And Aware

    Nov 30, 2015 | 21:13 pm

    Effortlessly Cleanse And Monitor The Air In Your Home With Blueair’s Sense+ And Aware  Air shouldn’t really be something you have to spend too much time thinking about. You breathe it in, then breathe out. All good. Unfortunately, sometimes air quality sucks and you have to invest in an air purifier, which you then generally have to spend too much time thinking about how to operate. Read More