(Translated by https://www.hiragana.jp/)
Julian Assange as Couch Surfer

COLLECTED BY

Organization: Internet Archive

The Internet Archive discovers and captures web pages through many different web crawls. At any given time several distinct crawls are running, some for months, and some every day or longer. View the web archive through the Wayback Machine.

Collection: Wide Crawl started March 2011

Web wide crawl with initial seedlist and crawler configuration from March 2011. This uses the new HQ software for distributed crawling by Kenji Nagahashi.

What’s in the data set:

Crawl start date: 09 March, 2011
Crawl end date: 23 December, 2011
Number of captures: 2,713,676,341
Number of unique URLs: 2,273,840,159
Number of hosts: 29,032,069

The seed list for this crawl was a list of Alexa’s top 1 million web sites, retrieved close to the crawl start date. We used Heritrix (3.1.1-SNAPSHOT) crawler software and respected robots.txt directives. The scope of the crawl was not limited except for a few manually excluded sites.

However this was a somewhat experimental crawl for us, as we were using newly minted software to feed URLs to the crawlers, and we know there were some operational issues with it. For example, in many cases we may not have crawled all of the embedded and linked objects in a page since the URLs for these resources were added into queues that quickly grew bigger than the intended size of the crawl (and therefore we never got to them). We also included repeated crawls of some Argentinian government sites, so looking at results by country will be somewhat skewed.

We have made many changes to how we do these wide crawls since this particular example, but we wanted to make the data available “warts and all” for people to experiment with. We have also done some further analysis of the content.

If you would like access to this set of crawl data, please contact us at info at archive dot org and let us know who you are and what you’re hoping to do with it. We may not be able to say “yes” to all requests, since we’re just figuring out whether this is a good idea, but everyone will be considered.

TIMESTAMPS

The Wayback Machine - https://web.archive.org/web/20110430163326/http://www.switched.com/2011/03/22/julian-assange-houseguest-allison-silverman/

Switched has a new home! Huffpost Tech.

Click here to visit the new home of Switched!

Hot on HuffPost Tech:

See More Stories

AOL Tech

AOL
MAIL

Switched

Julian Assange as Couch Surfer

by Amar Toor on March 22, 2011 at 09:15 AM

The notoriously nomadic Julian Assange has never sought refuge on our couches, but if he ever did, we wouldn't be terribly surprised if he acted the way he does in this clip, which is allegedly based on an "absolutely true story." Directed and written by Allison Silverman (the former head writer of 'The Colbert Report'), the short features David Rees in a Warhol-esque wig, playing the WikiLeaks founder. He eats leftovers, he doesn't talk, he hacks into his host's laptop. And the only thing he leaves behind is rotten fruit.

Tags: AllisonSilverman, comedy, DavidRees, HouseGuests, julian assange, julian+assange, JulianAssange, lolz, parody, shorts, top, video, Web, Wikileaks

source: HuffPo

From Switched

From Our Partners

Microsoft patent application shows custom Kinect gestures, roaming user profiles
Engadget–7 days ago
Weekly Podcast Roundup: April 11-17, 2011
WoW Insider–11 days ago
TUAW Giveaway: Scrivener 2.0
The Unofficial Apple Weblog–22 days ago

Comments

hiMar 23rd 2011 12:03AM

Neutral

Oh come on, more ad hominin attacks on Julian? Is this supposed to make me value WikiLeaks/other leaking sites/the truth less? Why is it that people keep focusing on Julian instead of the cables or stuff that WL has released before but never got much media attention?

I get it, Julian is probably a jerk, but the point's been hammered again and again by NYT, Guardian, DDB, and everybody else, and guess what? NO ONE CARES. Stop focusing on Assange and start focusing on stuff that actually matters, like, oh I don't know, the CABLES.

Dislike

Report

Add your comments

Your comments:

Remember me

E-Mail me when someone replies to this comment

Please keep your comments relevant to this blog entry. Email addresses are never displayed, but they are required to confirm your comments.

When you enter your name and email address, you'll be sent a link to confirm your comment, and a password. To leave another comment, just use that password.

To create a live link, simply type the URL (including http://) or email address and we will make it a live link for you. You can put up to 3 URLs in your comments. Line breaks and paragraphs are automatically converted — no need to use <p> or <br /> tags.