https://github.com/filyp/yourtube
Better youtube recommendations
https://github.com/filyp/yourtube
clickbait group-recommendations human-computer-interaction humane-tech information-bubbles privacy recommender-system youtube
Last synced: 6 months ago
JSON representation
Better youtube recommendations
- Host: GitHub
- URL: https://github.com/filyp/yourtube
- Owner: filyp
- License: lgpl-2.1
- Created: 2021-07-11T17:22:20.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2024-08-31T13:16:12.000Z (almost 2 years ago)
- Last Synced: 2024-11-05T10:44:54.007Z (over 1 year ago)
- Topics: clickbait, group-recommendations, human-computer-interaction, humane-tech, information-bubbles, privacy, recommender-system, youtube
- Language: Jupyter Notebook
- Homepage: http://yourtube.quest
- Size: 454 KB
- Stars: 17
- Watchers: 1
- Forks: 1
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# YourTube
[](https://github.com/psf/black)
Better youtube recommendations
- [x] More autonomy when choosing what to watch
- [x] Very customizable
- [x] Recommendations for two or more people
- [x] You can install it locally for completely private recommendations
- [x] Sharing and browsing information bubbles
- [ ] Less clickbait
You can install it on your computer following the [instructions below](https://github.com/filyp/yourtube#local-installation), or just use it [online](http://yourtube.quest). You can try it out as the `default` user, but to have personalized recommendations you will need to follow these steps:
1. Export your data from youtube ([instructions here](https://github.com/filyp/yourtube#export-your-youtube-data))
2. Choose your username, in the panel on the left. Note that anyone who knows your username can use your account, so if you don't want that, choose a hard to guess one.
3. Upload the zip file with your youtube takeout, with the `Choose File` button.
4. Click refresh button below
5. You will be able to use the system the next day.
## Saving clusters
You can save some cluster of videos for later using controls on the top. Note that on default your clusters will be publicly visible, along with your username. If you want to create a private cluster, start its name with `_`, for example `_music`.
You can also browse clusters that the other users saved.
# FAQ
How does it work?
- For every video you have liked on youtube, its recommended videos are collected.
- This way, we create a graph, where two videos are connected if one recomends the other.
- Now we divide this graph into clusters (groups of videos around common theme). For example we can have a `folk rock` cluster, or a `science podcasts` cluster or a `travel vlogs` cluster.
- Small clusters are a part of larger clusters. For example `folk rock` and `boomer rock` are inside of `rock` cluster, and `rock` is inside `music`.
- This forms a tree, with big branches (like `music`), splitting into smaller and smaller branches and twigs.
- Now, to choose what to watch you can start at the trunk, and "climb" this tree, by choosing which branch to go into.
- Note, that some clusters are too big to be clearly labeled, but by looking at the videos in them, you can usually get a general idea about this cluster's theme.
How are the clusters found?
- When a group of videos is densely connected, it's assumed do be a cluster. When two clusters are well connected, they are joined into a bigger cluster. The exact method we use is [here](https://github.com/filyp/krakow).
Why rely on youtube recommendations instead of providing our own and having more control over them?
- Creating a recommender system from scratch is much harder than you may think at first. In addition to having accurate recommendations, you also have to defend against attacks, like click farms trying to boost some content, or intelligence agencies spreading misinformation. You also have to detect illegal or NSFL stuff, and filter it out. See [this](https://www.youtube.com/watch?v=1PGm8LslEb4) to get a sense of how hard this is.
- Another critical problem is the network effect. To build a good recommender system, we need data from a lot of users. To have a lot of users, we need a good recommender system.
- For these reasons, it's better to start with an existing recomender system as a "bottom layer", and then build any new features we want, on top of it.
# Local installation
```bash
mkdir -p ~/.yourtube ; curl -s https://raw.githubusercontent.com/filyp/yourtube/master/docker-compose-release.yml > ~/.yourtube/yourtube.yml ; docker-compose -f ~/.yourtube/yourtube.yml run yourtube poetry run yourtube-install
```
## Export YouTube data and scrape it
### Export your youtube data
1. Login to your YouTube account
2. Click on your profile picture in the top right corner of the web page
3. Make sure your preferred language is English
4. Click on "Your data in YouTube" in the displayed drop down
5. Click on "More" in the "Your YouTube dashboard" card
6. Click on "Download YouTube data"
7. Under "Create a New Export", make sure "YouTube and YouTube Music" is selected
8. Click "Next step"
9. Select your preferred method of delivery (Email, Dropbox, etc.) and click on "Create Export"
10. Download the .zip file
11. Unzip the file
### Load your takeout file into yourtube
```bash
sudo chown -R $USER:$USER ~/.yourtube
mkdir ~/.yourtube/data/takeouts/default
mv __PATH_TO_YOUR_TAKEOUT__/Takeout .yourtube/data/takeouts/default
```
To add other users, do the same, but replace `default` with the username you want to use.
### Scrape videos
Now run:
```bash
docker-compose -f ~/.yourtube/yourtube.yml run yourtube poetry run yourtube-scrape
```
It will collect recommendations from the videos in your playlists and from your liked videos, which can take up to an hour.
## Running
```bash
docker-compose -f ~/.yourtube/yourtube.yml down ; docker-compose -f ~/.yourtube/yourtube.yml up -d
```
YourTube shuld be now available at: `http://localhost:8866/`