https://github.com/retarfi/economy-watchers-survey

Auto uploader for Economy Watchers Survey data
https://github.com/retarfi/economy-watchers-survey

Last synced: about 17 hours ago
JSON representation

Auto uploader for Economy Watchers Survey data

• Host: GitHub
• URL: https://github.com/retarfi/economy-watchers-survey
• Owner: retarfi
• License: mit
• Created: 2024-05-01T05:10:56.000Z (7 months ago)
• Default Branch: main
• Last Pushed: 2024-11-11T12:07:29.000Z (5 days ago)
• Last Synced: 2024-11-11T12:23:06.681Z (5 days ago)
• Language: Python
• Size: 129 MB
• Stars: 3
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        


Economy Watchers Survey data




  

    

  

  

    

  

  

    

  


  

    

  

  

    

  

  

    

  



Auto uploader for [Economy Watchers Survey data](https://www5.cao.go.jp/keizai3/watcher-e/index-e.html).  

It is automatically updated by GitHub Actions as the economy watcher is updated.  

Dataset on HuggingFace: https://huggingface.co/datasets/retarfi/economy-watchers-survey  

[景気ウォッチャー調査](https://www5.cao.go.jp/keizai3/watcher/watcher_menu.html)のデータを自動更新・整形・抽出を行います。  

自動更新はGitHub Actionsによって月次で行われます。  

データセットはHuggingFaceからも利用可能です: https://huggingface.co/datasets/retarfi/economy-watchers-survey  

## Data Structure

The csv data of the economy watcher is stored as `data/2024/202401_watcher4.csv`.  

The `watcher4.csv` is a questionnaire about the current judgment of the economy and `watcher5.csv` is a questionnaire about the future judgment of the economy.  

The extracted data after filtering for current and future judgments in json format are stored as `data/current/202401.json` and `data/future/202401.json`, respectively.

景気ウォッチャーのcsvデータは`data/2024/202401_watcher4.csv`のように格納されています。  

`watcher4.csv`は景気の現状判断について、`watcher5.csv`は景気の先行き判断についてのアンケートです。  

json形式での現状・先行きの判断についてフィルタリングを行った後に抽出したものをそれぞれ`data/current/202401.json`や`data/future/202401.json`のように格納しています。

## Data detail

Please refer to the following papers for the data detail.    

データの詳細は、以下の論文を参照してください。

- English paper: https://arxiv.org/abs/2407.14727

## License

The codes in this repository are distributed under MIT.  

The data is distributed under CC BY 4.0.

## Citation

```

@preprint{suzuki2024-ews,

  title={{Economy Watchers Survey provides Datasets and Tasks for Japanese Financial Domain}}, 

  author={Masahiro Suzuki and Hiroki Sakaji},

  year={2024},

  doi={10.48550/arXiv.2407.14727} 

}

```

## Usage for local download

```sh

poetry run python -m src.economy_watchers_survey.crawl

poetry run python -m src.economy_watchers_survey.create_json

```

## Format

```sh

poetry run black --check --diff --quiet --skip-magic-trailing-comma .

poetry run isort --check --diff --quiet .

```