https://github.com/margostino/walpurgis

Command-line tool to query any social network and collect some stats and ease the effective clean-up removing inactive, old and non-suitable accounts according your parameters.
https://github.com/margostino/walpurgis

golang social-network twitter

Last synced: 27 days ago
JSON representation

Command-line tool to query any social network and collect some stats and ease the effective clean-up removing inactive, old and non-suitable accounts according your parameters.

• Host: GitHub
• URL: https://github.com/margostino/walpurgis
• Owner: margostino
• License: mit
• Created: 2021-08-29T18:50:11.000Z (about 3 years ago)
• Default Branch: master
• Last Pushed: 2022-11-29T20:32:19.000Z (almost 2 years ago)
• Last Synced: 2024-09-29T21:21:59.735Z (about 1 month ago)
• Topics: golang, social-network, twitter
• Language: Go
• Homepage: https://margostino.com/lighting-the-bonfire/
• Size: 70.3 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Walpurgis 🔥

Command-line tool to query any social network and collect some stats and ease the effective clean-up removing inactive,

old and non-suitable accounts according your parameters.

## Configuration

```shell

> export WALPURGIS_PATH={APP_PATH}

> export API_KEY={TWITTER_TWITTER_API_KEY}

> export API_SECRET={TWITTER_API_SECRET}

> export ACCESS_KEY={TWITTER_ACCESS_KEY}

> export ACCESS_SECRET={TWITTER_ACCESS_SECRET}

```

Walpurgis uses a static configuration file. See example [here](config.yml)

## Run

```shell

> go run .

```

## Commands

### List of available options: 

```shell

margostino@walpurgis> help

[ snapshot users ] - Collect and save an updated list of friends

[ help ] - List available commands

[ exit ] - Exit shell

[ show stats ] - Show general stats from user

[ rank users by x2 ] - Get friends ranking sorted by field(s)

[ select users where x3 ] - Select and filter users by condition(s)

```

### Take a snapshot of the users you follow

```shell

margostino@walpurgis> snapshot users

```

### Calculate some pre-defined stats

```shell

margostino@walpurgis> show stats

Username: margostino

Created at: Sun Jun 21 23:46:07 +0000 2009

Description: 𝙴𝚟𝚎𝚗𝚝 𝙳𝚛𝚒𝚟𝚎𝚗 𝚂𝚒𝚗𝚐𝚞𝚕𝚊𝚛𝚒𝚝𝚢 • 𝙱𝚞𝚒𝚕𝚍𝚒𝚗𝚐 @NextGreenGene • 🇦🇷 🇸🇪 🌎 👨🏻‍💻 📖 ⚽️🏔 ❄️ 🎶 🚲

Location: Stockholm, Sweden 🇸🇪

Followers: 478

Following: 550

Last Activity at: Mon Oct 18 19:53:27 +0000 2021

Following 0.01% accounts related with climate change

Following 0.02% accounts related with climate

Following 0.47% accounts with Geo Location enabled

Following 0.16% accounts which are following less than 100 accounts

Following 0.35% accounts which are following less than 300 accounts

Following 0.51% accounts which are following less than 600 accounts

Following 0.69% accounts which are following less than 1000 accounts

Following 0.31% accounts which are following more than 1000 accounts

Following 0.01% accounts with less than 100 followers

Following 0.03% accounts with less than 300 followers

Following 0.04% accounts with less than 600 followers

Following 0.07% accounts with less than 1000 followers

Following 0.93% accounts with more than 1000 followers

Following 0.00% accounts with email

...

```

### Rank users by conditions (age, last activity, followers, following)

```shell

margostino@walpurgis> rank users by age asc

User: jack - Created At: 2006-03-21 20:50:14 +0000 +0000 - Last Activity: 2021-10-23 02:22:30 +0000 +0000]

User: sama - Created At: 2006-07-16 22:01:55 +0000 +0000 - Last Activity: 2021-10-22 15:48:07 +0000 +0000]

User: Werner - Created At: 2006-12-21 15:12:02 +0000 +0000 - Last Activity: 0001-01-01 00:00:00 +0000 UTC]

...

```

### Select users by conditions (text in description, email, status, name)

```shell

margostino@walpurgis> select users where description like climate

[jabeckx] - RT @aiyanabodi: American companies representing over 6.5M employees and 13% of the U.S. economy support strong climate investments—because…]

[UNDRR] - #UN Office for #Disaster #Risk Reduction %44%  dedicated to building disaster #resilience and tackling #climatechange through implementation of the Sendai Framework]

[GlobalEcoGuy] - RT @DavidRVetter: People talk a lot of crap about scientists not being able to communicate their work. I interview climate researchers day…]

[ClimateSignals] - Climate Signals provides resources in real time explaining how climate change worsens extreme weather and other impacts. A project of Climate Nexus.]

[AntarcticReport] - Follow for News on Antarctica and the Southern Ocean %44%  esp the hard science underlining the importance of Antarctica as a bellwether of global climate change.]

...

```

### Exit

```shell

margostino@walpurgis> exit

bye!

```

### TODO

- [ ] Validations (wrong or missing config)

- [ ] Preprocessing (users)

- [ ] Alias for recurrent commands

- [ ] Smart and more insightful queries

- [ ] Pattern matching

- [ ] Streaming processing

- [ ] Cross validation and metrics

- [ ] Tests