https://github.com/toyama0919/fluent-plugin-http_shadow
copy http request. use shadow proxy server.
https://github.com/toyama0919/fluent-plugin-http_shadow
fluentd fluentd-plugin shadow-proxy-server
Last synced: 10 months ago
JSON representation
copy http request. use shadow proxy server.
- Host: GitHub
- URL: https://github.com/toyama0919/fluent-plugin-http_shadow
- Owner: toyama0919
- Created: 2015-01-26T05:14:08.000Z (almost 11 years ago)
- Default Branch: master
- Last Pushed: 2018-04-01T11:40:51.000Z (almost 8 years ago)
- Last Synced: 2025-03-18T02:51:34.958Z (10 months ago)
- Topics: fluentd, fluentd-plugin, shadow-proxy-server
- Language: Ruby
- Homepage:
- Size: 24.4 KB
- Stars: 21
- Watchers: 2
- Forks: 4
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# fluent-plugin-http_shadow
[](http://travis-ci.org/toyama0919/fluent-plugin-http_shadow)
[](http://badge.fury.io/rb/fluent-plugin-http_shadow)
copy http request. use shadow proxy server.
restored the http request from the logs that are sent to the fluentd.
## Examples
```
type tail
format apache
path /var/log/httpd/access_log
pos_file /var/log/td-agent/access.pos
tag apache.access
type http_shadow
host staging.exsample.com
path_format ${path}
method_key method
header_hash { "Referer": "${referer}", "User-Agent": "${agent}" }
```
Assume following input is coming:
```
{
"host": "exsample.com",
"ip_address": "127.0.0.1",
"server": "10.0.0.11",
"remote": "-",
"time": "22/Dec/2014:03:20:26 +0900",
"method": "GET",
"path": "/hoge/?id=1",
"code": "200",
"size": "1578",
"x_forwarded_proto": "http",
"referer": "http://exsample.com/other/",
"agent": "Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko"
}
```
then result becomes as below (indented):
```
GET http://staging.exsample.com/hoge/?id=1
#=> HTTP HEADER
#=> "referer": "http://exsample.com/other/"
#=> "agent": "Mozilla/5.0 (Windows NT 6.1; Trident/7.0; rv:11.0) like Gecko"
```
## Examples(Virtual Host)
```
type http_shadow
host_hash {
"www.example.com": "staging.example.com",
"api.example.com": "api-staging.example.com",
"blog.ipros.jp": "blog-staging.ipros.jp"
}
host_key host
path_format ${path}
method_key method
protocol_format ${x_forwarded_proto} # default: http
header_hash { "Referer": "${referer}", "User-Agent": "${user_agent}" }
no_send_header_pattern ^(-|)$
```
## Examples(use cookie)
```
type http_shadow
host_hash {
"www.example.com": "staging.example.com",
"api.example.com": "api-staging.example.com",
"blog.ipros.jp": "blog-staging.ipros.jp"
}
host_key host
path_format ${path}
method_key method
header_hash { "Referer": "${referer}", "User-Agent": "${user_agent}" }
cookie_hash {"rails-app_session": "${session_id}"}
```
## Examples(use rate_per_method_hash)
```
type http_shadow
host_hash {
"www.example.com": "staging.example.com",
"api.example.com": "api-staging.example.com",
"blog.ipros.jp": "blog-staging.ipros.jp"
}
host_key host
path_format ${path}
method_key method
header_hash { "Referer": "${referer}", "User-Agent": "${user_agent}" }
rate_per_method_hash {
"get": 30, # This means 30% requests of GET will be sent. Default(when not defined) value is 100.
"post": 90
}
```
## Examples(use support_methods)
```
type http_shadow
host_hash {
"www.example.com": "staging.example.com",
"api.example.com": "api-staging.example.com",
"blog.ipros.jp": "blog-staging.ipros.jp"
}
host_key host
path_format ${path}
method_key method
header_hash { "Referer": "${referer}", "User-Agent": "${user_agent}" }
support_methods [ "get", "post" ] # It means that only GET and POST are sent. By default all methods are sent.
```
## note
default GET Request.
## parameter
TODO
## todo
more test
## Installation
```
fluent-gem install fluent-plugin-http_shadow
```
## Contributing
1. Fork it
2. Create your feature branch (`git checkout -b my-new-feature`)
3. Commit your changes (`git commit -am 'Add some feature'`)
4. Push to the branch (`git push origin my-new-feature`)
5. Create new [Pull Request](../../pull/new/master)
## Information
* [Homepage](https://github.com/toyama0919/fluent-plugin-http_shadow)
* [Issues](https://github.com/toyama0919/fluent-plugin-http_shadow/issues)
* [Documentation](http://rubydoc.info/gems/fluent-plugin-http_shadow/frames)
* [Email](mailto:toyama0919@gmail.com)
## Copyright
Copyright (c) 2015 Hiroshi Toyama