https://github.com/hemin1003/java-spider

一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。

elasticsearch scraper spider webmagic

Last synced: 06 Apr 2025

https://github.com/jinhx128/springboot-demo

基于SpringBoot 2.x整合各种常用开发工具，包括但不限于Redis，MyBatisPlus，RocketMQ，RabbitMQ，Elasticsearch，Quartz，Xxl-Job，Kafka等。

aop docker easyexcel elasticsearch kafka knife4j logback mail mybatis-plus quartz rabbitmq redis rocketmq sms springboot swagger thymeleaf webmagic websocket xxl-job

Last synced: 14 Oct 2025

https://github.com/liyifeng1994/webmagic-csdnblog

基于WebMagic写的一个csdn博客小爬虫

java webmagic

Last synced: 01 May 2025

https://github.com/v5tech/solrj-example

solrj示例

selenium solr solrj webmagic

Last synced: 18 Sep 2025

https://github.com/tghoul/spider914j

91 web spider for java.

91porn crawler spring-boot webmagic

Last synced: 11 Jul 2025

https://github.com/xiaoyvyv/androidcrawlerengine

A dynamic crawler plug-in for the Android platform based on Dex dynamic loading, which can dynamically load and execute the dex plug-in package, and can realize real-time updates of crawler and other functions.

android apk class crawler dex dynamic execute java jsoup jvm kotlin module okhttp pak plugin reflection scrapy spider web webmagic

Last synced: 22 Jan 2026

https://github.com/jhonatanit/cl-generator-ai-service

Cover letter generator with Generative AI

java langchain4j spring-boot webmagic

Last synced: 02 Aug 2025

https://github.com/sutra/webmagic-delayed-proxy

WebMagic ProxyProvider implementation using DelayQueue.

proxy webmagic

Last synced: 26 Feb 2026

https://github.com/daniellin07/baidu-map-crawler

:beetle: 基于 WebMagic 的百度地图数据爬虫

java spyder webmagic

Last synced: 24 Dec 2025

https://github.com/anylisten/edps-spider

java spider webmagic

Last synced: 04 Apr 2025

https://github.com/threadnew/encycproject

一个爬取宠物百科内容的后台demo。

solr springboot-mybatis springboot2 vue-router vuejs2 webmagic

Last synced: 13 Oct 2025