Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/swyxio/automation

bots and their source
https://github.com/swyxio/automation

Last synced: about 1 month ago
JSON representation

bots and their source

Awesome Lists containing this project

README 

        
> this list is now archived - look inside https://github.com/sw-yx/brain if you would like an updated list! thank you.



# automation



## human



- [fancyhands](https://www.fancyhands.com/) - US virtual assistant

- [gethuman](https://gethuman.com/) - Help for customer service

- [pickfu](https://www.pickfu.com/) - Market feedback from US consumers 

- [Gosquaredaway](https://www.gosquaredaway.com/)- military spouse personal assistants



## code



### reddit bots and their source



- [Reddit CSS bot](https://github.com/Lachcim/css-irl-bot/blob/master/README.md)

- [Making a Reddit Reply Bot](https://dev.to/seiyria/making-a-reddit-reply-bot-f55)

- [Bot that scrapes reddit for keywords](https://intoli.com/blog/f5bot/)



### HN



- [SQL social media queries](https://github.com/antontarasenko/smq/blob/master/README.md)



### twitter bots



- [Self-care Twitter Bots](https://medium.com/@carolstran/a-guide-to-self-care-twitter-bots-f2430160fad4)

- [Make @hydratebot](https://medium.com/@NoraReed/make-your-own-hydratebot-a-tutorial-for-non-coders-d4c149da29b8)

- [Wikipedia scraper bot](https://github.com/catleeball/tmnt_wikipedia_bot/)

- [Year Progress Twitter bot](https://github.com/MrDatastorage/Year-Progress-Twitter-Bot)

- [100daysofcode bot](https://github.com/freeCodeCamp/100DaysOfCode-twitter-bot)

- [Tweepy Twitter Bot](https://realpython.com/twitter-bot-python-tweepy/)

- [Github release -> Twitter bot](https://dev.to/prahladyeri/announcing-ghannounce-a-python-bot-that-posts-a-tweet-each-time-you-make-a-release-on-github-5abc)

- Tracery generative story twitter bots: [BotWiki](https://botwiki.org/learn/), [Intro to Twitter Bots](https://programminghistorian.org/en/lessons/intro-to-twitterbots), [Cheap bots done quick](https://cheapbotsdonequick.com/)

- [Google Earth stills over time bot](https://github.com/doersino/earthacrosstime)

- [AWS markov chain bot](https://github.com/pndurette/aws_prodbot) - js version https://github.com/swang/markovchain

- [Ace Attorney bot](https://github.com/LuisMayo/ace-attorney-twitter-bot)



twint https://nixintel.info/osint/the-attrition-of-information-in-osint-why-acting-quickly-matters-and-how-to-recover-when-you-dont/



small replit twitter bots (usually useless) 



- [Another tweepy bot](https://repl.it/talk/share/Twitter-Bot/2738)

- [Old tweepy bot](https://repl.it/@LilyInskip_Shes/Twitter-Bot)



### discord bots



- [Discordpy bots](https://repl.it/talk/learn/Hosting-discordpy-bots-with-replit/11008)

- [Nodejs discord bot](https://www.codementor.io/@garethdwyer/building-a-discord-bot-with-node-js-and-repl-it-mm46r1u8y)

- [Typescript community bot](https://github.com/typescript-community/community-bot)

- discord bot for community moderation - https://top.gg/bot/677184239472607299

  - snowpack comunity has it



### whatsapp



- [Build a Whatsapp bot](https://repl.it/talk/challenge/Build-a-WhatsApp-bot-in-30-minutes/7673)



### tiktok 



- [Tiktok Scraper](https://dev.to/id1/tiktok-scraper-25a9)



### general automation



- https://github.com/huginn/huginn (Ruby)

- https://n8n.io/

- https://nodered.org/

- https://github.com/agenda/agenda nodes jobrunner

- https://airflow.apache.org/

- more https://news.ycombinator.com/item?id=21772610

- https://news.ycombinator.com/item?id=20822637

- python! https://automatetheboringstuff.com/2e/



### scraping



Info from Checkly/Tim Nolet ([podcast](https://stackoverflow.blog/2020/12/15/podcast-295-diving-into-headless-automation-active-monitoring-playwright-and-puppeteer/))



- Old: Selenium

- New: https://developers.google.com/web/tools/puppeteer (Google), https://playwright.dev/ (ex Puppeteer team left for Microsoft), [Headless Recorder from checkly](https://github.com/checkly/headless-recorder) generates scripts for either

- learn either: https://theheadless.dev

- https://mihaisplace.blog/2021/10/03/the-state-of-web-scraping-in-2021/



misc



- https://github.com/lorien/awesome-web-scraping

- https://simonwillison.net/2020/Nov/14/personal-data-warehouses/

- https://beepb00p.xyz/exports.html

- https://news.ycombinator.com/item?id=23142220

- https://news.ycombinator.com/item?id=22778089

- https://www.scrapingbee.com/blog/web-scraping-javascript/

  - https://www.scrapingbee.com/

  - https://www.scrapingbee.com/blog/web-scraping-without-getting-blocked/

  - their Twitter surfaces good stuff

- setting cookies https://theheadless.dev/posts/managing-cookies/

- https://twitter.com/SahinKevin/status/1216343661459451906?s=20

- https://qoob.cc/web-scraping/

- https://chrome.google.com/webstore/detail/simplescraper-%E2%81%A0%E2%80%94-a-fast-a/lnddbhdmiciimpkbilgpklcglkdegdkg?utm_source=brainpint&utm_medium=email&utm_campaign=its_ok_to_go_off_script&utm_term=2021-07-06

* [Beehive](https://github.com/muesli/beehive) - A flexible event/agent & automation system with lots of bees

* [DataFire](https://github.com/DataFire/DataFire) - An open source framework for building and integrating APIs. Each integration provides a set of composable actions. New actions can be built by combining existing actions, JavaScript, and external libraries. They are driven by JavaScript Promises, and can be triggered by a URL, on a schedule, or manually.

* [Kibitzr](https://kibitzr.github.io) - Get notified when important things happen

* [Netflix Scumblr](https://github.com/Netflix/Scumblr) ([#1522](https://github.com/cantino/huginn/issues/1522)) - A web application that allows performing periodic searches and storing / taking actions on the identified results. 

* [Node-RED](http://nodered.org) ([#1296](https://github.com/cantino/huginn/issues/1296)) - A tool for wiring together hardware devices, APIs, and online services in new and interesting ways.

* [NoFlo](https://NoFlojs.org) - A JavaScript implementation of Flow-Based Programming (FBP). Separating the control flow of software from the actual software logic. Helping you organize large applications easier than traditional OOP paradigms, especially when importing and modifying large data sets.

* [Pico-Engine](https://github.com/Picolab/pico-engine/) - A prototype implementation of the pico-engine written in node.js

* [Riemann](https://github.com/riemann/riemann) - "A network event stream processing system, in Clojure. Riemann aggregates events from your servers and applications with a powerful stream processing language."

* [RSS-Bridge](https://github.com/RSS-Bridge/rss-bridge) - A PHP application offering a wide selection of feeds for popular and niche services. This includes several services where queries are involved, such as translating Twitter accounts or searches into atom/JSON feeds. Possibly a valuable source of easy data for simpler Huginn scenarios.

* [Trigger Happy](https://github.com/foxmask/django-th) - "opensource clone of IFTTT, a bridge between your internet services"

* [Welcomer Framework](https://github.com/welcomer/framework) - Supports building microservices to flexibly automate your online tasks, putting control of your personal data back in your hands.

* https://apify.com



to Scrape Twitter you have to fake googlebot

https://twitter.com/magusnn/status/1339833122456662017?s=20



webscraper.io



### companies



- Tray.io https://techcrunch.com/2019/11/26/tray-io-brings-in-50m-more-at-a-600m-valuation-for-its-workflow-automation-tools/

- pipedream

- https://n8n.io/



## text generation



- https://github.com/minimaxir/gpt-2-simple



## users



- webflow

  - https://twitter.com/tomjohndesign/status/1199027657473712128



## Scraping



- https://www.daolf.com/posts/avoiding-being-blocked-while-scraping-ultimate-guide/

- https://tryspider.com/

- https://medium.com/hackernoon/scraping-the-web-with-node-js-f7da67d2f734

- https://github.com/paperswithcode/sota-extractor

- https://github.com/karpathy/arxiv-sanity-preserver

- https://theheadless.dev/



WEBCRAWLING ARCHITECTURE https://nlp.stanford.edu/IR-book/information-retrieval-book.html https://news.ycombinator.com/item?id=24338964



## Low Code



- Slack https://slackhq.com/automate-tasks-in-slack-with-workflow-builder



## Funny



- https://github.com/pjf/rickastley