https://github.com/cxuesong/legacy-tiebastat

A light-weight service that can log members count, posts count, etc. every definie time in a Baidu Tieba forum based on Baidu Tieba webpage.
https://github.com/cxuesong/legacy-tiebastat

Last synced: about 1 month ago
JSON representation

A light-weight service that can log members count, posts count, etc. every definie time in a Baidu Tieba forum based on Baidu Tieba webpage.

• Host: GitHub
• URL: https://github.com/cxuesong/legacy-tiebastat
• Owner: CXuesong
• License: apache-2.0
• Created: 2015-03-23T12:39:23.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2015-03-23T14:04:34.000Z (almost 10 years ago)
• Last Synced: 2024-10-14T15:55:31.016Z (2 months ago)
• Language: Visual Basic
• Size: 148 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# legacy-TiebaStat

## Overview

This is a light-weight service that can log members count, posts count, etc. every definie time in a Baidu Tieba forum based on Baidu Tieba webpage. I programmed it in 2013 and it's a rather simple project.

It can download the first page of specified forums on Baidu Tieba every, for example, 10 minutes, analyze the content, and save some overall info to the output file. Info includes:

* Name of the forum

* Members count

* Threads count

* Signed-in members count

Note this app is a service, so after build the project, you should install it using *installutil.exe* and start it up using Computer Management Console or net start command

The service needs some configuration files, the default path is defined in TiebaStatService.vb as follows:

	Private ConfigurationPath As String = "F:\Dump\Tieba_Stat\config.xml"

	Private OutputPath As String = "F:\Dump\Tieba_Stat\stat.txt"

You can change the path manually, or specify the parameter during the startup of the service as follows:

	-C:ConfigurationPath -O:OutputPath

You can specify it temporarily in Computer Management Console. Unfortunately, I just forgot how to specify the parameter for a service permanently.

## Configuation File

As mentioned above, the service needs a configuration file (config.xml). A sample is as follows :

	

	

	  600

	  600

	  http://tieba.baidu.com/f?ie=utf-8&kw={0}

	  

		%E7%8C%AB%E5%A4%B4%E9%B9%B0%E7%8E%8B%E5%9B%BD

		%E7%BB%9D%E5%A2%83%E7%8B%BC%E7%8E%8B

		%E7%8C%AB%E6%AD%A6%E5%A3%AB

		%CE%F7%B0%B2%BD%BB%CD%A8%B4%F3%D1%A7

	  

	

*interval* specifies the duration between two scan procedure, in seconds,

*timerModule* is specified to ensure that the scan is started when the system time (in seconds since midnight) can be exactly divided by this number. This parameter is set to avert ragged time in log files.

And the url of the pages that'll be repetitively downloaded can be decided using *urlTemplate* specified above, along with the *entry* elements. That is, the configuration file above will cause the following pages be downloaded:

* http://tieba.baidu.com/f?ie=utf-8&kw=%E7%8C%AB%E5%A4%B4%E9%B9%B0%E7%8E%8B%E5%9B%BD

* http://tieba.baidu.com/f?ie=utf-8&kw=%E7%BB%9D%E5%A2%83%E7%8B%BC%E7%8E%8B

* *and so on*

The *key* attribute is only used as a mnemonic and will be copied to output file, so you can set it at will. Better not to duplicate among the entries ^^

## TODO

As you can see, this project is rather simple, and the analyze is only based on plain HTML code search. Maybe a HTML parser is needed.

CXuesong a.k.a. *forest93*  

2015-3-23