{"id":15437792,"url":"https://github.com/victorb/dweb.cat","last_synced_at":"2026-02-27T08:08:39.282Z","repository":{"id":148376843,"uuid":"103559664","full_name":"victorb/dweb.cat","owner":"victorb","description":"Archive and entrypoint for important Catalan culture and language","archived":false,"fork":false,"pushed_at":"2017-10-27T13:16:50.000Z","size":10,"stargazers_count":2,"open_issues_count":0,"forks_count":3,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-01-02T16:22:52.215Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://dweb.cat/","language":"HCL","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/victorb.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-09-14T17:07:30.000Z","updated_at":"2018-12-19T20:31:40.000Z","dependencies_parsed_at":null,"dependency_job_id":"f0a72099-aec9-4268-8658-b39bea768784","html_url":"https://github.com/victorb/dweb.cat","commit_stats":{"total_commits":1,"total_committers":1,"mean_commits":1.0,"dds":0.0,"last_synced_commit":"42df2590afc6d180250334690495b8b42cf961ca"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/victorb%2Fdweb.cat","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/victorb%2Fdweb.cat/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/victorb%2Fdweb.cat/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/victorb%2Fdweb.cat/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/victorb","download_url":"https://codeload.github.com/victorb/dweb.cat/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240122610,"owners_count":19751145,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-01T18:58:50.837Z","updated_at":"2026-02-27T08:08:34.262Z","avatar_url":"https://github.com/victorb.png","language":"HCL","funding_links":[],"categories":[],"sub_categories":[],"readme":"## dweb.cat\n\u003e Portal for Catalan content on the distributed web\n\n\u003e Archive and entrypoint for Catalan culture and language on the distributed web\n\n# Purpose\n\nThe purpose of this repository and the beloning infrastructure is to provide\nability to archive and host content relevant to Catalan culture and language.\n\nInfrastructure costs are paid by a fund from donations. Once these run out, we\ncan no longer guarantee that the content will be available.\n\nEach submission will be reviewing to make sure it's:\n\n* Actually relevant to Catalan culture and/or language\n* Not too big (submitting content of 1TB is too big [depending on current funding])\n\nAnything that passes those two criterias will be provided space and bandwidth\nto live on dweb.cat for as long as possible.\n\nSee it as the Internet Archive, but specifically for Catalunya and Catalan content.\n\n# Process\n\nContent needs to go through a process of verification, hosting and then publishing.\n\nIt works the following way:\n\n- If you already have the content ready, proceed to the next step. If the content\n\tis NOT ready for hosting yet, open a issue before pulling down the data locally\n\tso you don't waste your bandwidth on something that won't be accepted.\n- Add the content to IPFS and save the resulting hash. The basics of IPFS can be\n\tread in the file IPFS.md in the root of this repository\n- Submit a PR adding your hash and the metadata to `content.json`\n- Upon approved, the content will be pushed out to the gateways and applicable\n\tsubdomains created in the infrastructure.\n\n# Process for operators\n\n- Once a change is in master, the following commands should be run:\n- `./pin-content.sh`\n- `./build-website.js`\n- `(cd gateways/ \u0026\u0026 terraform plan -out wanted-change)`\n- Confirm changes\n- `(cd gateways/ \u0026\u0026 terraform apply wanted-change)`\n\n# Architecture\n\nWebsite is a simple HTML website that lists all the content that is available\nand some metadata if available.\n\nContent that gets added to `content.json` is hosted by a couple of gateway\nnodes that are running under `https://dweb.cat/ipfs/:hash`. These gateways\nare also connected to the general IPFS network so can be fetched from anywhere\nas well as from dweb.cat\n\nShortlinks can also be made by adding them to `subdomains.json` which is a\nobject that lists names to their hashes. The hash linked must exists in `content.json`\nif it's listed in `subdomains.json`.\n\n# Deployment\n\nDeployment is handled with Terraform in the `gateways/` directory.\n\n# Website\n\nSteps taken upon deploy of website:\n\n- Build website in `website/`\n- Add to IPFS\n- If website changed (content.json updated)\n\t- `last-website-publish` will be different from new hash\n\t- Update DNS record for `archive.dweb.cat`\n\n# Replication\n\nAll content on `content.json` is replicated to at least four places (please \ncontact us if you can help replicate it more):\n\n- Gateways running under dweb.cat/ipfs\n- Online IPFS node running at Victor Bjelkholm's house\n- Offline cache available at Victor's house\n- S3 backup hosted by Amazon\n\n# Domains\n\n- dweb.cat\n- catalan-gateway.com\n\n# License\n\n2017 MIT - Victor Bjelkholm\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvictorb%2Fdweb.cat","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvictorb%2Fdweb.cat","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvictorb%2Fdweb.cat/lists"}