https://github.com/n0tan3rd/cnnreplayservice
https://github.com/n0tan3rd/cnnreplayservice
oduwsdl web web-archival webscidl
Last synced: over 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/n0tan3rd/cnnreplayservice
- Owner: N0taN3rd
- Created: 2017-03-19T06:21:10.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-03-24T19:11:21.000Z (over 9 years ago)
- Last Synced: 2025-01-23T05:28:32.903Z (over 1 year ago)
- Topics: oduwsdl, web, web-archival, webscidl
- Language: JavaScript
- Homepage: https://github.com/oduwsdl
- Size: 56.6 KB
- Stars: 0
- Watchers: 3
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# CNN Homepage Replay Service
Replay mementos of the [CNN](http://cnn.com) homepage from the [Internet Archives](https://archive.org/) locally without failure.
[](https://github.com/feross/standard)
## Usage
This project will run on node >= 6.x and to run `(npm|yarn) install && ./run.sh`.
Be sure to execute `chmod +x run.sh` if you have not already.
If your on windows (or do not want to use the bash file) simply substitute `./run.sh`
with `node --harmony index.js`.
If you wonder if your current node install can run this project consult [node.green](http://node.green/).
There are is only one optional argument that can be supplied to program which is
--port="new port" defaults to 3000.
Or if Docker is your thing `docker pull jberlin/cnn-replay-service`
and `docker run -p 3000:3000 jberlin/cnn-replay-service`
Once started simply navigate to `http://localhost:3000` and happy replaying :tada:
## The Secret Sauce
There is none. All this project does is proxy the Internet Archives Wayback Machine
for the following URIs `http://web.archive.org/web/*/http://www.cnn.com/` and `http://web.archive.org/web/`.
And two slight modifications to the replayed Memento :suspect:
The modifications made are described in the section `Modifications Made To The Replayed Memento`
## Why Is This Necessary
For a detailed explaination as to why this is necessary see the blog post from the
Web Science And Digital Libraries Research Group:
[2017-01-20: CNN.com has been unarchivable since November 1st, 2016](http://ws-dl.blogspot.com/2017/01/2017-01-20-cnncom-has-been-unarchivable.html)
#### TL;DR
CNN has made changes to how the contents of their homepage is loaded. One of the
methods used to accommodate these changes is to set the `document.domain` property
of the global `window` object to `cnn.com`.
This is not allowed when replayed via
the Internet Archives [Wayback Machine](https://archive.org/web/) due to the
[Same Origin Policy](https://developer.mozilla.org/en-US/docs/Web/Security/Same-origin_policy)
of web browsers. Subsequently causing information about how to load the contents of
the page to not be made available to the JavaScript responsible for the
loading and rendering of it.
Due to this, replaying mementos of the homepage after [2016-11-01T13:15:40](http://web.archive.org/web/20161101131540/http://www.cnn.com/) appear
to be an archived `about:blank` page.
But we can replay these mementos. We have the technology.
We can replay these mementos as archived. With a few modifications :godmode:
## Modifications Made To The Replayed Memento
This project intelligently removes the offending line of JavaScript code
```js
window.document.domain = "cnn.com";
```
from the second inline `script` tag in the `head` of the mementos HTML
if it is present at replay time.
The project also dynamically rewrites specific URI-Rs that the Internet Archives own
rewrite mechanisms missed to a URI-M corressponding to the datetime of the Memento
currently beging replayed.
For example if you were to view a Memento of http://www.cnn.com on 2017-03-10T06:03:34
via this project the archived pages JavaScript would request
`/data/ocs/section/_homepage-zone-injection/index.html:homepage-injection-zone-2/views/zones/common/zone-manager.izl`
Which this project would rewrite to `/web/20170310060334/http://www.cnn.com/data/ocs/section/_homepage-zone-injection/index.html:homepage-injection-zone-2/views/zones/common/zone-manager.izl`
Without these rewrites the page content on 2017-03-10T06:03:34 would not be viewable as
these URI-Rs are included in the information made available to the archived pages JavaScript
by the previous modification made by this project.