Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bbepis/hayden
Ultra-low resource 4chan/altchan thread and board archiver
https://github.com/bbepis/hayden
4chan archiver imageboard lynxchan vichan
Last synced: 19 days ago
JSON representation
Ultra-low resource 4chan/altchan thread and board archiver
- Host: GitHub
- URL: https://github.com/bbepis/hayden
- Owner: bbepis
- License: mit
- Created: 2019-06-26T07:41:47.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2024-07-11T15:12:55.000Z (4 months ago)
- Last Synced: 2024-10-11T09:54:50.802Z (about 1 month ago)
- Topics: 4chan, archiver, imageboard, lynxchan, vichan
- Language: C#
- Homepage:
- Size: 3.5 MB
- Stars: 62
- Watchers: 9
- Forks: 6
- Open Issues: 10
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Hayden
[LIVE TESTING INSTANCE](https://ultra.gondola.pics/)
Hayden is a 4chan / altchan archiver written in .NET Core for ultra-low resource usage and high performance.
It also doubles as imageboard software.
It was originally writen as a drop-in alternative to [Asagi](https://github.com/eksopl/asagi), however Asagi compatibility currently has no guarantees.
Developer documentation is in `ARCHITECTURE.md`.
[**README for running the scraper**](doc/scraper.md)
[**README for running the webserver / imageboard**](doc/webserver.md)
## Supported imageboard software
[**Detailed information**](doc/imageboards.md)
| Software | API-less fallback | Example sites |
| --------------------------------------------------------------------------------------------------------------------- | ----------------- | ----------------------------- |
| [Yotsuba](https://www.4channel.org/faq#software) | ❌ | 4chan.org |
| [LynxChan](https://gitgud.io/LynxChan/LynxChan) | ❌ | 8chan.moe
endchan.org |
| [Vichan](https://github.com/vichan-devel/vichan)/[Infinity](https://github.com/ctrlcctrlv/infinity) (not OpenIB/8kun) | ❌ | sportschan.org
smuglo.li |
| [InfinityNext](https://github.com/infinity-next/infinity-next/) | ❌ | 9chan.tw |
| [Meguca / shamichan](https://github.com/bakape/meguca) | ✅ | 2chen.moe
shamik.ooo |
| [FoolFuuka](https://github.com/FoolCode/FoolFuuka) | ❌ | desuarchive.org |
| [Ponychan](https://bitbucket.org/ponychan/ponychan-tinyboard/src/master/) | ❌ | ponychan.net |
| ASPNetChan | ✅ | mlpol.net |
### Features
- Much smaller memory consumption than Asagi.
- For comparison, Hayden requires roughly 40MB of working memory to archive a single board (including all archived threads), while Asagi consumes several gigabytes to do the same.
- Uses a much more efficient algorithm to perform API calls, reducing overall network calls made considerably and eliminates cloudflare rate limit issues.
- Supports using multiple SOCKS proxies to distribute network load and allow parallel network operations.
- Supports writing to multiple types of data stores.
### Planned
- Thread ID-based scraping system. Currently the only logic for thread archival operates on a per-board basis
----
## Frontend screenshots
## FAQ
### Why make it?
I wanted to archive 4chan threads and display them, but didn't like what was already offered. As per usual, this turned into making a very large project to do so.
### Why C#? Doesn't it have a GC like Java and other managed languages, and consume a lot of memory as a result?
Yeah sure. Maybe you could get better performance / memory usage out of something like Rust.
But you could also just not be wasteful and be considerate of how you structure your data, and achieve very similar results?
### What's with the name?
I was listening to the [Doom 2016 soundtrack](https://www.youtube.com/watch?v=b2YG8DX0ees) as I was programming this.
I was not a fan of Eternal.