{"id":15645464,"url":"https://github.com/v5tech/solrj-example","last_synced_at":"2025-09-18T13:29:29.708Z","repository":{"id":149461774,"uuid":"43946981","full_name":"v5tech/solrj-example","owner":"v5tech","description":"solrj示例","archived":false,"fork":false,"pushed_at":"2016-02-03T09:35:53.000Z","size":5499,"stargazers_count":55,"open_issues_count":0,"forks_count":44,"subscribers_count":9,"default_branch":"master","last_synced_at":"2025-04-30T11:23:12.996Z","etag":null,"topics":["selenium","solr","solrj","webmagic"],"latest_commit_sha":null,"homepage":null,"language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/v5tech.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-10-09T09:48:22.000Z","updated_at":"2024-05-24T17:44:25.000Z","dependencies_parsed_at":"2023-04-19T03:16:33.810Z","dependency_job_id":null,"html_url":"https://github.com/v5tech/solrj-example","commit_stats":null,"previous_names":["v5tech/solrj-example"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/v5tech/solrj-example","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/v5tech%2Fsolrj-example","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/v5tech%2Fsolrj-example/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/v5tech%2Fsolrj-example/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/v5tech%2Fsolrj-example/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/v5tech","download_url":"https://codeload.github.com/v5tech/solrj-example/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/v5tech%2Fsolrj-example/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":265322316,"owners_count":23746596,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["selenium","solr","solrj","webmagic"],"created_at":"2024-10-03T12:07:51.587Z","updated_at":"2025-09-18T13:29:24.667Z","avatar_url":"https://github.com/v5tech.png","language":"Java","readme":"# solrj-example\n\nsolrj+webmagic+selenium示例\n\n使用webmagic和selenium-java爬取京东商品信息并入库MySQL。采用solr dataimport创建索引，采用solrj检索商品信息。\n\n# solr单机模式\n\nhttps://coding.net/u/aimeizi/p/solr/git\n\n基于solr4.10.4集成IKAnalyzer、mmseg4j、ansj中文分词及Dataimport功能\n\n# solr集群模式\n\nhttps://coding.net/u/aimeizi/p/SolrCloud/git\n\nsolr集群模式。基于solr4.10.4集成IKAnalyzer、mmseg4j、ansj中文分词及Dataimport等功能\n\n# 运行\n\nJDProductProcessor 是JD商品采集的入口，main方法直接运行。\n\nCcdiPageProcessor 是纪检委网站采集的入口，main方法直接运行。\n\n启动solr服务，运行爬虫采集程序，启动搜索服务，完成搜索。\n\n# Screenshots\n\nwebmagic jmx监控\n![](Screenshots/jconsole-1.png)\n\nwebmagic jmx监控查看总抓取页数\n![](Screenshots/jconsole-2.png)\n\nwebmagic爬取JD商品数据入库数据\n![](Screenshots/jddata.png)\n\nsolrdataimport数据导入\n![](Screenshots/solrdataimport.png)\n\nsolr搜索 查询`所有商品`按`评论降序`排列，以`表格`的方式展现\n![](Screenshots/search-1.png)\n\nsolr搜索 查询`名称`为`手机`的商品按`价格降序`排列，以`表格`的方式展现\n![](Screenshots/search-2.png)\n\nsolr搜索 查询`名称`为`手机`且过滤`产品类别为手机`的商品信息按`价格降序`，以`列表`的方式展现\n![](Screenshots/search-3.png)\n\nsolr搜索 查询名称为`洗衣机`且过滤`产品类别为洗衣机`的商品信息按`价格降序`，以`表格`的方式展现\n![](Screenshots/search-4.png)\n\nsolr搜索 查询名称为`iPhone`的商品信息按`价格降序`，以`表格`的方式展现\n![](Screenshots/search-5.png)\n\n# 参考文档\n\nhttp://webmagic.io/docs/zh/","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fv5tech%2Fsolrj-example","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fv5tech%2Fsolrj-example","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fv5tech%2Fsolrj-example/lists"}