These crawls are part of an effort to archive pages as they are created and archive the pages that they refer to. That way, as the pages that are referenced are changed or taken from the web, a link to the version that was live when the page was written will be preserved.
Then the Internet Archive hopes that references to these archived pages will be put in place of a link that would be otherwise be broken, or a companion link to allow people to see what was originally intended by a page's authors.
This is a collection of web page captures from links added to, or changed on, Wikipedia pages. The idea is to bring a reliability to Wikipedia outlinks so that if the pages referenced by Wikipedia articles are changed, or go away, a reader can permanently find what was originally referred to.
Barcelona was far from a happy place when Johan Cruyff walked back through the door as coach in 1988. More than 25 years on, his legacy is keenly felt at the Nou Camp and beyond, writes Andrew Murray...
Sixty years on from his first appearance in the pages of Tiger (11 September 1954), the legendary Roy 'Racey' Race selects the seven games that shaped his career and forged his reputation...
Arsenal's terror from Tocopilla has got Premier League fans hot under the collar this summer, but as Richard Edwards recalls, the 25-year-old has a tough job emulating the brothers who braved English football after the Second World War...
It almost never happened. But off the back of one man's mortgage, the USA put on a record-breaking World Cup that changed football forever. Jamie Trecker tells the inside story...