Peer-to-Peer Technology to Trump Traditional Cloud Storage

On a lovely Thursday afternoon in June, I sat down with Sarah Koo, a data scientist with BitTorrent. I grew up in a time and place where Peer-to-Peer (P2P) transfer was almost commonplace, and I was fortunate enough to have the opportunity to learn more about this unique technology.

 

When Peer-to-Peer transfer is mentioned, the subject of copyright protection is the first thing to come to mind. Though P2P transfer is used, at times, to download Game of Thrones, the technology itself is an innovative protocol designed to efficiently transfer large files. I want to make an explicit statement that neither I, Sarah, nor BitTorrent, condones any forms of illegal file transfers. I am advocating the technology itself, which is commonly used in both academia and business. 

 

Bram Cohen created the Peer-to-Peer transfer protocol about a decade ago. This genius literally coded the program by himself in his bedroom, like many of our city’s tech entrepreneurs. Traditional file transfer protocols connected downloaders to a single server for direct file transfers. If there were 100 users downloading the same file, all these users would connect to the same server. Such traditional methods resulted in significant speed reductions and heavy server strain as demand for the file increased. Cohen's application created a distinct virtual network per file that allowed any invited users to help with distribution.

a protocol that created a virtual network based on the file itself, thus anyone within the network can help distribute the file

Lets say UC Berkeley is working on a massive database, and it needs to distribute it to 10,000 researchers across the country. If each of these 10,000 researchers downloads the file directly from the Cal server, the strain on the single server is intense and extremely inefficient. P2P transfer creates a network that links all invited researchers together, and once any researcher finishes downloading the database, he can act as a file distributor for other researchers within the network. Thus, the strain of distributing the database is crowd sourced to all its participants. 

BitTorrent, the most popular P2P transfer application, breaks down large files into small segments for even more efficient distribution. If the database described above is 20-gigabytes; BitTorrent could break down the file into 20 equal sized 1-gigabyte files. “If I request the file from peers, I can be getting it from 20 different people at the same time.” Thus, each peer only needs to distribute 1/20th of the overall load.

breaks down large files into small segments for more efficient distribution

Because BitTorrent breaks down files into many individual segments, peers can act as distributors the moment they finish downloading any piece of the overall file. Once all the segments are downloaded, BitTorrent reassembles the original file as whole. The ability to deconstruct files and then reassemble the segments after the transfer protocol is complete is groundbreaking, especially in the field of cloud storage.

BitTorrent has utilized this technology to build sync applications that are commonly used in industries such as video editing. In Hollywood, uncut video files run in the hundreds of gigabytes. If multiple video editors are working on the same film, it’s inefficient to retransfer the whole video anytime a minute change is made. Many editors utilize this segmentation technology to transfer and sync only the portions that were altered. Instead of retransferring the whole 100gb video, Hollywood only transfers the 1gb scene that was actually edited. Now that’s efficiency.

 

In our current age of NSA surveillance and CISPA interrogation, privacy and security has become a major concern. BitTorrent is unique among cloud storage applications, because it’s only a protocol, and not a storage system. “There’s no copy of (your files) on our cloud.” “If the government would be to subpoena our records, we wouldn’t have anything to turn over.”

“If the government would be to subpoena our records, we wouldn’t have anything to turn over.”

The lack of centralized storage acts as both a blessing and a curse. On one hand, your files never leave your possession; on the other hand, there’s no backup other than your own. Obviously, there are ways to alleviate this issue, but it’s something to keep in mind. I want to emphasis again that BitTorrent is only a protocol, not a storage service. 

Finally, I want to mention another firm that utilizes a similar technology, or at least one that I found to be of some interest. Bitcasa acts as a traditional cloud storage service, but it’s developing a technology called Infinite Drive: When a duplicate file is uploaded, the protocol searches its database for preexisting files, and earmarks the original without uploading the duplicate. 

If two teenage girls upload the same Justin Bieber album, only one copy is actually stored on Bitcasa's servers. When the album is downloaded, both users access the same file. The technology is interesting, but there are significant areas of concern. If one user alters the album, how would it affect related users who share the same download address. I don’t think this technology is ready for widespread use, but it’s something to look out for in the future.

the word “traditional” to describe cloud storage

It’s funny; it seems like it was only yesterday that Dropbox launched, but this Generation Y technology has already become old news. Earlier in this article, I, inadvertently, used the word “traditional” to describe cloud storage; might as well get out the cane and monocle while at it. The future of file storage will take advantage of Peer-to-Peer transfer protocol. It’s an ingenious method that enables crowd sourcing to distribute large files, and it's capabilities are greatly magnified by BitTorrent’s segmentation technology.

Peer-to-Peer file transfer is secure; but more importantly, it’s efficient.

  • Instagram's new business profiles spotted in the wild

    May 4, 2016 | 22:58 pm

    Instagram's new business profiles spotted in the wild If you use Instagram to promote your business, you may soon have more ways to connect with potential customers.Instagram is testing new profile pages for businesses that feature large "contact" buttons, which make it easier to connect directly with the companies running the account.SEE ALSO: Instagram is launching new video slideshow adsThe profiles, first spotted by later.com, contain "contact" buttons that link to email and location information. The profiles also have general information about the type of business it is (e.g. "Health/Wellness Website.")An Instagram spokesperson confirmed the tests to Mashable, adding that only a small group of users are part of the experiment for now. Read more...More about Facebook, Instagram, Tech, and Apps Software

  • Sci-fi master John Carpenter dives into virtual reality in new music video

    May 4, 2016 | 22:48 pm

    Sci-fi master John Carpenter dives into virtual reality in new music video John Carpenter is the one of the masters of cinematic science fiction and horror (The Thing, Escape From New York, Halloween), but he's also a long time electronic musician, and his latest album, Lost Themes II, is just as gripping as his films. But what really stands out is the music video for one song from the album called "Night" (video above). The entire narrative is based on the director donning virtual reality goggles to remotely control an android. Sure, that kind of stuff is pretty common fare for music videos, but when one of the most famous film directors in Hollywood slaps on a VR headset, you have to wonder if there might be an epic VR sci-fi/horror film coming down the line from the iconic director. Hardcore Carpenter fans will also remember that he was one of the first directors to depict a version of augmented reality on the big screen Read more...More about John Carpenter, Movies, Film, Music, and Virtual Reality

  • Microgravity contest takes students and experiments on the vomit comet

    May 4, 2016 | 22:37 pm

    Microgravity contest takes students and experiments on the vomit comet  FOX’s “Xploration Outer Space” show is teaming up with Arlington, Va.-based ZERO-G Corporation, which operates weightless flights from U.S. airports. The reason they’re collaborating: to create the ultimate consolation prize for college students who were just too young to apply to NASA’s latest astronaut class. The show, a part of FOX’s… Read More

  • GoPro camera takes us into space on back of a test rocket, and it’s beautiful

    May 4, 2016 | 21:17 pm

    GoPro camera takes us into space on back of a test rocket, and it’s beautiful Thanks to NASA and companies like SpaceX, amazing footage of rockets traveling into space have become fairly common. However, a new video shot with the GoPro Hero 4 emerged Wednesday that is particularly stunning, no matter how much space footage you've seenThe crystal clear, high definition video, recorded from the perspective of the GoPro strapped to the side of the rocket, shows the 20-foot tall SL-10 rocket's take off and flight into near space, traveling at 3,800 miles per hour and reaching an altitude of about 75 miles. It's then that the most beautiful footage is revealed as the rocket floats in space with the Earth in the background. Shortly thereafter, we travel back down to the planet as a parachute brings the remaining rocket component softly back to terra firma. Read more...More about Gopro, Space, and Tech

  • Periscope mimics Fb Live by letting you permanently #Save replays

    May 4, 2016 | 21:16 pm

    Periscope mimics Fb Live by letting you permanently #Save replays  Periscope added its biggest missing feature today in a move that could make it more palatable to brands and social stars, and help it compete with Facebook Live. You can now permanently save replays of your broadcasts by including #Save in their title. You still can delete them later if you want. Previously, broadcasts disappeared after 24 hours.Periscope’s CEO Kayvon Beykpour took… Read More

  • No one organizes any crime on Slack, apparently

    May 4, 2016 | 21:12 pm

    No one organizes any crime on Slack, apparently  Slack released its second annual transparency report today, revealing that it has received a grand total of one government request for user data. Just one. The number is somewhat remarkable when compared with the rest of the industry. Facebook recently announced that it received 19,235 requests from U.S. agencies over a six-month period. Read More

  • How consolidations will play out in the transportation, food and entertainment industries

    May 4, 2016 | 21:00 pm

    How consolidations will play out in the transportation, food and entertainment industries  There has been no shortage of thoughtful articles exploring a bubble in technology. I would argue that the world has already been transformed, and there is no bubble in the purest sense. Instead of massive flameouts that leave everyone burned, I think we are going to see a wave of beneficial consolidation and rationalization in industries that appropriately have seen exceptional venture… Read More

  • Millions of email names, passwords hacked in giant data breach, report says

    May 4, 2016 | 20:07 pm

    Millions of email names, passwords hacked in giant data breach, report says More than 250 million email usernames and passwords have been breached and are being used by "Russia's criminal underworld," according to a Reuters report. SEE ALSO: Biggest-ever U.S. data breach hits 100 million people with bank accountsHold Security's Alex Holden, who reported the data breach, told Reuters that the breach affects many of the email addresses on Russia's popular Mail.ru service, as well as addresses from Google, Yahoo and Microsoft.Holden said his firm came across a Russian hacker who claimed to have more than 1 billion hacked addresses for sale. In total, after eliminating duplicates, the list included 57 million Mail.ru addresses, 40 million Yahoo addresses, 33 million Hotmail addresses and 24 million Gmail addresses. Read more...More about Russian Crime, Mail.Ru, Gmail, Hack, and Data Breach

  • Free Code Camp survey reveals demographics of self-taught coders

    May 4, 2016 | 18:20 pm

    Free Code Camp survey reveals demographics of self-taught coders  If you’ve ever wondered who exactly is signing up for all these free learn-at-home coding classes and tutorial websites, Free Code Camp (which is one of them) has kindly surveyed 15,624 users with regard to various basic demographics and some more code-centric items. Read More

  • Oculus snags Fitbit exec Hans Hartmann as new COO

    May 4, 2016 | 18:17 pm

    Oculus snags Fitbit exec Hans Hartmann as new COO  Oculus is bringing a new COO aboard as it perhaps looks to double down on tightening things up logistics-wise. Fitbit COO Hans Hartmann will be jumping ship and joining the virtual reality company owned by Facebook, according to a tweet from Oculus CEO Brendan Iribe. Hartmann, who was with Fitbit since 2011, will be replacing founding COO Laird Malamed, who Iribe says will be “taking… Read More

  • Tesla sets July 1, 2017 production date for Model 3, but there's a catch

    May 4, 2016 | 18:04 pm

    Tesla sets July 1, 2017 production date for Model 3, but there's a catch Tesla has set a Model 3 production date of July 1, 2017. Of course, there's a caveat.SEE ALSO: Ahead of Model 3, Tesla leases new warehouses, loses 2 product chiefsElon Musk revealed during the Tesla first quarter earnings call Wednesday afternoon that Tesla has told its third-party parts suppliers that Model 3 production will start on July 1. However, he admitted it was an "impossible" date. There's no way production will actually start then, as suppliers will be late to deliver.Musk explained that the July date had to be set in order for real production to begin several months later. Without that date, Tesla wouldn't be able to hold suppliers' feet to the fire, if they miss the deadline. Read more...More about Tesla, Transportation, Cars, and Tech

  • Fitbit shares tank after reporting a weak outlook amid rising competition

    May 4, 2016 | 17:29 pm

    Fitbit shares tank after reporting a weak outlook amid rising competition  Fitbit is not having a good day, with the stock crashing more than 11 percent after reporting its first-quarter results.Here’s the rub: its guidance for the second quarter came in light. Very light. Industry watchers were expecting the company to report earnings around 26 cents per share, while the company put its outlook at earnings between 8 cents per share and 11 cents per share. Read More

Loading ...