https://github.com/wallaroolabs/spamdetector

Sample XMPP spam detection pipeline
https://github.com/wallaroolabs/spamdetector

example python wallaroo

Last synced: 8 months ago
JSON representation

Sample XMPP spam detection pipeline

• Host: GitHub
• URL: https://github.com/wallaroolabs/spamdetector
• Owner: WallarooLabs
• License: apache-2.0
• Created: 2018-06-08T16:40:19.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2018-07-12T15:34:39.000Z (over 7 years ago)
• Last Synced: 2025-02-23T13:51:20.556Z (11 months ago)
• Topics: example, python, wallaroo
• Language: Python
• Homepage: https://blog.wallaroolabs.com/2018/07/detecting-spam-as-it-happens-getting-erlang-and-python-working-together-with-wallaroo/
• Size: 79.1 KB
• Stars: 1
• Watchers: 32
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Spamdetector

A demo of how Wallaroo can be used alongside a chat installation to detect, in

near-real-time, the presence of malicious clients.

# Howto (Docker-compose)

    $ make deps

    $ docker-compose up

        (.. wait for docker to download the world ..)

    $ tail -f sink_output/sink.log

Open [http://localhost:4000](http://localhost:4000) to see the runtime statistics for

your pipeline.

# Development & running w/out Docker

  - Install Erlang 18.x .. 20.x and the development libraries for:

	`ssl`, `expat`, `zlib`, and `unixodbc`. MongooseIM will not currently

	run with Erlang 21.

  - Run `make deps build-chat`

  - You now have two directories: `mongooseim` and `amoc`.

  - The chat server lives in `mongooseim` and is preconfigured for:  

    a) Allowing logins from any `@localhost`, where password=``  

    b) Sending a copy of every XMPP stanza to a TCP socket defined by

  	  the environment variable `WALLAROO_TCP_HOSTPORT`

  - The spam simluation script lives `amoc/spambots.erl` and can be

    launched with the `run.sh` script found in `amoc`.  

    Use `CHAT_SERVER_HOSTNAME=127.0.0.1 ./run.sh spambots 1 13`

    to launch 12 regular users and 1 spammer, as every 13th user will

    be a spammer.

  - Run `make setup` to set up a Virtualenv in `.env`

  - As instructed, copy the `machida` executable and `wallaroo.py` into the

    virtualenv. If you don't have these, follow the [Wallaroo Tutorial

	](https://docs.wallaroolabs.com/book/getting-started/setting-up-your-environment.html)

    to get them.

  - Run `make run-locally` to launch all the required components locally. If

    you modify anything under `mongooseim`, you will have to `make build-chat`

    to recompile the chat server.

  - Take a look at `log/local_sink.log` to see the spam detector publishing

    its results.