https://github.com/lastaapps/silicon-gallery
A command line utility used to watch list of photo albums published by Silicon Hill and send them to a Discord channel.
https://github.com/lastaapps/silicon-gallery
discord-bot haskell scraping
Last synced: 8 months ago
JSON representation
A command line utility used to watch list of photo albums published by Silicon Hill and send them to a Discord channel.
- Host: GitHub
- URL: https://github.com/lastaapps/silicon-gallery
- Owner: Lastaapps
- License: gpl-3.0
- Created: 2025-05-18T14:25:48.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-05-24T10:12:56.000Z (about 1 year ago)
- Last Synced: 2025-06-19T01:03:38.899Z (12 months ago)
- Topics: discord-bot, haskell, scraping
- Language: HTML
- Homepage: https://www.siliconhill.cz/photogalleries
- Size: 56.6 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Silicon Gallery
A command line utility used to watch list of photo albums published
by [Silicon Hill](https://www.siliconhill.cz/photogalleries)
and send them to a Discord channel.
## Usage
Set and source environment variables according to `env_example`.
`ALBUM_BOT_DISCORD_BOT_TOKEN` is a bot token obtained from Discord developer portal,
`ALBUM_BOT_DISCORD_CHANNEL_ID` is a Discord channel ID to post into,
`ALBUM_BOT_STORAGE_FILE` is a file name to store and read from already published photo albums,
`ALBUM_BOT_REFRESH_DELAY_MINUTES` is a refresh delay in minutes after which the page is scraped again, and
`ALBUM_BOT_POST_N_LATEST` is a number of latest photo albums to post, so the chats are not overflown.
## Implementation milestones
- read configuration from environment variables
- fetch HTML
- parse HTML (using a library) and extract models
- File IO - check already published photo albums
- Discord API - send a message (HTTP endpoint call with custom flags)
- File IO - store that a new album was just posted
- repeat every n minutes
- build on CI
## Notable Haskell features
- Combined Monad types using `ExceptT`
- Http requests using `req` library (self implemented rate limiting retry)
- Tests using `HSpec` and `QuickCheck` and docs with `Haddock`
- Hidden constructors (where it makes sense like `EventID`)
- and more...
## Used Haskell language extensions
```haskell
-- Have to be added
{-# LANGUAGE DeriveDataTypeable #-} -- Allows automatic derivation of the `Data` and `Typeable` type classes.
{-# LANGUAGE DeriveGeneric #-} -- Allows automatic derivation of the `Generic` type class.
{-# LANGUAGE GADTs #-} -- Extends Haskell's type system to allow Generalized Algebraic Data Types.
{-# LANGUAGE RankNTypes #-} -- Allows quantification of types at arbitrary positions (rank-N types).
-- Enabled globally
{-# LANGUAGE DuplicateRecordFields #-} -- Allows record fields with the same name in different data types.
{-# LANGUAGE OverloadedRecordDot #-} -- Enables accessing record fields using the dot notation (e.g., `record.field`).
{-# LANGUAGE OverloadedStrings #-} -- Allows string literals to be interpreted as instances of `IsString`.
{-# LANGUAGE RecordWildCards #-} -- Allows all fields of a record to be brought into scope without listing them individually.
{-# LANGUAGE NamedFieldPuns #-} -- Allows pattern matching on specific record fields by name, even if others are present.
{-# LANGUAGE MultiParamTypeClasses #-} -- Enables type classes to have more than one type parameter.
```
## License
Silicon Gallery is licensed under the `GNU GPL v3.0` license.