Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/clemsos/writings
Taking back control of my writing
https://github.com/clemsos/writings
Last synced: about 1 month ago
JSON representation
Taking back control of my writing
- Host: GitHub
- URL: https://github.com/clemsos/writings
- Owner: clemsos
- Created: 2019-04-24T09:00:49.000Z (over 5 years ago)
- Default Branch: master
- Last Pushed: 2022-10-06T04:58:48.000Z (about 2 years ago)
- Last Synced: 2024-10-14T01:23:17.905Z (2 months ago)
- Language: JavaScript
- Homepage: https://clementrenaud.com/writings/
- Size: 97.6 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 8
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Clément Renaud's Writings
This repo contains things I wrote over the course of the years.
The goals are :
- consolidate previous writings into a single repo
- exit platforms and own my things locally
- convert everything into markdown (with meta and date)
- run some stats / generators for fun
- document how to do all that
## TODO
- Backup
- [ ] Where did I write again?
- [x] Quora
- [X] Blogspot
- [x] Tumblr Blogs
- [x] Jekyll RW
- [x] old Wordpress Blog
- [x] Ecriture Exemplaire
- [x] twitter (not worth it ?)
- [x] facebook (not worth it ?)
- [x] Media archives from https://clementrenaud.com/write
- [x] Instagram
- [ ] Scientific papers and conferences
- [ ] Quora fr (require some date conversion)
- [ ] other github repos
- Convert
- [x] Define proper meta format: date, title, source, original_url
- [x] HTML > markdown
- Tools / stats
- [x] make UI / website
- [x] words/ signs counter
- [ ] proper indexation for easy search
- [ ] trending words
## How To
### Backup Quora
1. Used https://github.com/t3nsor/quora-backup to backed things up and clean up html (successfully followed instructions). -- NB: after retrying to update, this is not working anymore. Looks like quora has blocked crawling (Feb 27 2020)
2. Run `./bin/quora_convert_to_md.sh` to convert to md with proper names and dates (requires [pandoc](http://pandoc.org))
3. Manually copy PNG files to an `img` folder and find/replace `)
### Backup Tumblr
Very straightforward: just use the official [Jekyll importer](https://import.jekyllrb.com/docs/tumblr/), then some grep/replace to fix folders.
```
bundle exec jekyll import tumblr --url=http://clementrenaud.tumblr.com --format=md --grab_images --rewrite_urls
```
NB: Add some trouble due to GRDP policy that were preventing API calls... Finally found [a fix](https://github.com/jekyll/jekyll-import/issues/379).
### Import old Wordpress DBs
```
brew install mysql
mysql.server start
mysql > CREATE USER 'wp_user'@'localhost' IDENTIFIED BY '$PASSWORD';
mysql > GRANT ALL PRIVILEGES ON * . * TO 'wp_user'@'localhost';
# import data
mysql -u wp_user -p$PASSWORD < $SQL_FILE_PATH
# import to jekyll
ruby -r rubygems -e 'require "jekyll-import";
JekyllImport::Importers::WordPress.run({
"dbname" => "clemsos_wp",
"user" => "wp_user",
"password" => "$PASSWORD",
"table_prefix" => "wp2_",
"site_prefix" => "",
"clean_entities" => false,
"extension" => "md",
"status" => ["publish"]
})'
```
### Backup Instagram
The new registration process to use Instagram API (aka Facebook Developer Application) is so fastidious that I gave up altogether. Only in China I remembered having to submit such long and detailed application to get an API key.
Anyway, you can request your data in your profile page (web version only), then from that you will need some reformat.
### Backup Twitter & Facebook
Twitter and Facebook both offer a fairly complete data takeaway. You can request all your data from our profile, then process it as you wish. To reduce the noise I'll keep these but as archive only. I am pretty sure there are some interesting posts with original writings there but I don't have the courage to go through all this today. Maybe someday I will...