https://github.com/wikisource/ia-upload

Tool to import files from the Internet Archive to Wikimedia Commons.
https://github.com/wikisource/ia-upload

djvu internet-archive pdf wikimedia-commons wikisource

Last synced: 4 months ago
JSON representation

Tool to import files from the Internet Archive to Wikimedia Commons.

• Host: GitHub
• URL: https://github.com/wikisource/ia-upload
• Owner: wikisource
• Created: 2013-11-28T17:32:53.000Z (over 12 years ago)
• Default Branch: main
• Last Pushed: 2026-01-01T12:31:06.000Z (5 months ago)
• Last Synced: 2026-01-01T13:23:24.071Z (5 months ago)
• Topics: djvu, internet-archive, pdf, wikimedia-commons, wikisource
• Language: PHP
• Homepage: https://ia-upload.wmcloud.org
• Size: 689 KB
• Stars: 18
• Watchers: 11
• Forks: 9
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

README

          
Internet Archive Upload Tool

============================

![CI](https://github.com/wikisource/ia-upload/workflows/CI/badge.svg)

A small tool to import DjVu files from Internet Archive to Wikimedia Commons.

See it in operation at [ia-upload.wmcloud.org](https://ia-upload.wmcloud.org)

(or the test site at [ia-upload-test.wmcloud.org](https://ia-upload-test.wmcloud.org))

and read the documentation at [wikitech.wikimedia.org/wiki/Tool:IA_Upload](https://wikitech.wikimedia.org/wiki/Tool:IA_Upload).

Please report bugs on Phabricator under the [#IA Upload project](https://phabricator.wikimedia.org/tag/ia_upload).

## Prerequesites

The actual format conversions are done by the following external tools, called from within IA Upload:

1. [ImageMagick](https://www.imagemagick.org)

2. [DjVuLibre](https://sourceforge.net/p/djvu/)

## Installation

1. Clone from GitHub: `git clone https://github.com/wikisource/ia-upload` 

2. Install dependencies: `composer install`

3. Set up URL rewriting:

   * For Apache use the following in `public/.htacess`:

         RewriteEngine On

         RewriteCond %{REQUEST_FILENAME} !-f

         RewriteRule ^(.*)$ index.php/$1 [L]

   * For Lighttpd, use:

         url.rewrite-if-not-file += ( "/(.*)" => "/index.php$0" )

4. Register an OAuth consumer on [Meta](https://meta.wikimedia.org/wiki/Special:OAuthConsumerRegistration)

   with a callback to e.g. `http://localhost/ia-upload/public/oauth/callback` (i.e. ending in `oauth/callback`)

   and rights to "Create, edit, and move pages" and "Upload new files".

6. Edit `config.ini` to add your consumer key and secret, and the OAuth consumer's ID number

   (this is used to link to recent changes).

8. Make sure the `jobqueue` directory is writable by the web server.