https://github.com/ignytis/deletex
A cleanup tool for X (ex-Twitter)
https://github.com/ignytis/deletex
cli go golang twitter twitter-api
Last synced: 2 months ago
JSON representation
A cleanup tool for X (ex-Twitter)
- Host: GitHub
- URL: https://github.com/ignytis/deletex
- Owner: ignytis
- License: gpl-3.0
- Created: 2024-07-11T20:52:15.000Z (11 months ago)
- Default Branch: main
- Last Pushed: 2024-07-17T21:21:27.000Z (11 months ago)
- Last Synced: 2024-07-18T01:40:01.598Z (11 months ago)
- Topics: cli, go, golang, twitter, twitter-api
- Language: Go
- Homepage:
- Size: 25.4 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# deletex : Twitter history eraser
## Requirements
This application uses OAuth 1 for user authentication. To obtain a consumer key and a consumer key secret,
the application has to be registered at Twitter Developer Platform https://developer.twitter.com - see _Projects & apps_ -> _(your app)_ -> _keys and tokens_ -> _consumer key_
__Note:__ X had introduced paid access level, BUT some features, like deletion of posts by list, still work (as of 2024.07.10)
## Usage
### Help
```
deletex h
deletex -h
deletex help
deletex --help
```
__Common parameters__
- -c / --config - path to configuration file. See [config.example.yaml](config.example.yaml). Default value is `config.yaml`, so configuration file will be read from current directory.
### A typical workflow
- Register a client Twitter app at https://developer.twitter.com, obtain consumer API keys, save them to [config.yaml](config.example.yaml). Note: it's NOT needed if you would like just to generate a list of tweets to delete without actual deletion; Twitter credentials are needed for API calls.
- Generate and download a twitter archive: [Link](https://help.twitter.com/en/managing-your-account/how-to-download-your-twitter-archive)
- Convert the `data/tweets.js` file in arctive from Javascript to JSON Lines format
- Filter the JSON Lines file using expressions (see below)
- Delete tweets using the filtered JSON lines file
### 1 Convert of Javascript tweet dump file into JSON Lines
Twitter provides dumps as JavaScript files which are inapproptiate for analysis and filtering of records. This command converts the original JavaScript file into [JSON Lines format](https://jsonlines.org/).
```bash
deletex tweets:dump:to_jsonl \
-i /home/john/somefolder/twitter_dump/data/tweet.js \
-o /home/john/somefolder/twitter_dump_processed/tweets.json
```
### 2. Filter the JSON Lines file
```bash
deletex tweets:jsonl:filter \
-i /home/john/somefolder/twitter_dump_processed/tweets.json \
-o /home/john/somefolder/twitter_dump_processed/tweets.filtered.json \
-e "created_time >= '2022-01-01 00:00:00' && created_time < '2022-02-01 00:00:00'"
```
### 3. Delete tweets using the filtered JSON Lines file
```bash
deletex tweets:delete:using_csv \
-c $PWD/.local/config.yaml \
-i /home/john/somefolder/twitter_dump_processed/tweets.filtered.json
```
## Filtering expressions
The [govaluate](https://github.com/Knetic/govaluate) library is used to parse expressions. Following tweet properties are defined for each record:
- created_time
- favorite_count
- full_text
- id
- retweet_count
### Examples of expressions
```
favorite_count + (retweet_count * 20) > 100
created_time >= '2022-01-01 00:00:00' && created_time < '2022-02-01 00:00:00'
```