{"id":28560156,"url":"https://github.com/dtstack/jlogstash","last_synced_at":"2025-06-10T09:07:41.675Z","repository":{"id":49963388,"uuid":"67188344","full_name":"DTStack/jlogstash","owner":"DTStack","description":"java 版本的logstash","archived":false,"fork":false,"pushed_at":"2022-12-14T20:27:12.000Z","size":2370,"stargazers_count":267,"open_issues_count":19,"forks_count":127,"subscribers_count":36,"default_branch":"master","last_synced_at":"2024-02-25T12:35:20.641Z","etag":null,"topics":["java","logstash"],"latest_commit_sha":null,"homepage":null,"language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/DTStack.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-09-02T03:56:39.000Z","updated_at":"2024-02-23T05:39:51.000Z","dependencies_parsed_at":"2023-01-29T00:46:06.464Z","dependency_job_id":null,"html_url":"https://github.com/DTStack/jlogstash","commit_stats":null,"previous_names":[],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DTStack%2Fjlogstash","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DTStack%2Fjlogstash/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DTStack%2Fjlogstash/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DTStack%2Fjlogstash/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/DTStack","download_url":"https://codeload.github.com/DTStack/jlogstash/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/DTStack%2Fjlogstash/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259043767,"owners_count":22797163,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["java","logstash"],"created_at":"2025-06-10T09:07:39.875Z","updated_at":"2025-06-10T09:07:41.655Z","avatar_url":"https://github.com/DTStack.png","language":"HTML","readme":"# 注释：\n\n   jlogstash前期的有部分代码引用了hangout项目里的代码，这里也感谢hangout的作者。\n   \n# 说明：\n\n   用java版本重写logstash目的是提升性能,跟ruby logstash 对比 请看 https://github.com/DTStack/jlogstash-performance-testing\n\n   不同的业务，性能会有所不同，dtstack 后台日志解析 java 版本是ruby版本的5倍，在单台4g 4cores 虚拟机上。\n\n   jlogstash 的参数配置和使用看wiki介绍，现在的插件跟ruby版本相比还太少，希望更多的人参与开发。\n\n# Inputs详情：\n  https://github.com/DTStack/jlogstash/tree/master/pipeline/inputs/README.md\n\n# Filters详情：\n   https://github.com/DTStack/jlogstash/tree/master/pipeline/filters/README.md\n\n# Outputs详情：\n   https://github.com/DTStack/jlogstash/tree/master/pipeline/outputs/README.md\n   \n# 性能采集：\n  \n  目前支持将jlogstash运行时的性能数据采集到promethues.\n  \n  详情：https://github.com/DTStack/jlogstash/tree/master/core/metrics.md   \n\n# Jar放置目录（编译的jar必须要有版本号 ）：\n  \n   jlogstash 核心代码放在jlogstash/lib/下\n\n   插件的代码分别的放到jlogstash/plugin 下的filter,input,output目录下\n   \n# 启动命令:\n    \n  sh jlogstash.sh -f /home/admin/ysq.yaml vv\n\n# 启动参数：\n\n  -name:任务名称\n\n  -f:配置文件 yaml格式路径(必填)\n\n  -l:日志文件路径\n  \n  -i:input queue size coefficient 默认 200f/1024\n\n  -w:filter work number 默认是根据的机器cpu核数+2\n\n  -o:output work number 默认是根据的机器cpu核数\n\n  -c:output queue size coefficient 默认 500f/1024\n  \n  -dev: 开发模式，直接在pom.xml引用包即可。\n\n  v: error级别\n  \n  vv: warn级别\n\n  vvv:info级别\n\n  vvvv:debug级别\n\n  vvvvv:trace级别\n\n# 插件开发：\n\n  1.现在各自的plugin 的包 都会有各自的classloder去加载，parent classloder是AppClassLoder，所以各自的plugin的代码即使引用了相同的第三的jar版   本不一样也不会导致版本冲突\n   \n  \n  2.各个插件的代码不能相互引用，如果有公共代码需要打入到各自的jar包中\n  \n  3.所需依赖到maven中心库 搜索 jlogstash(http://search.maven.org/ 或https://oss.sonatype.org)\n  \n  4.插件开发样列 https://github.com/DTStack/jlogstash/tree/master/src/test/java/com/dtstack/jlogstash\n  \n  5.每一个plugin打的包名的前缀要跟插件的类名一致，不区分大小写，不然会报类找不到，列如：input.kafka-1.0.0.jar 或\n    kafka-1.0.0.jar \n    \n# 招聘：\n   1.大数据平台开发工程师，想了解岗位详细信息可以添加本人微信号ysqwhiletrue,注明招聘，如有意者发送简历至sishu@dtstack.com。\n  \n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdtstack%2Fjlogstash","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdtstack%2Fjlogstash","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdtstack%2Fjlogstash/lists"}