https://github.com/jogiter/crawler-6

mongoose + express demo
https://github.com/jogiter/crawler-6

Last synced: 9 days ago
JSON representation

mongoose + express demo

• Host: GitHub
• URL: https://github.com/jogiter/crawler-6
• Owner: Jogiter
• License: mit
• Created: 2017-10-13T10:11:23.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2017-11-06T08:55:31.000Z (about 7 years ago)
• Last Synced: 2024-11-07T18:22:58.880Z (2 months ago)
• Language: JavaScript
• Homepage:
• Size: 18.6 KB
• Stars: 0
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Nodejs实战

## 网络爬虫和数据操作

>mongoose客户端推荐robomongo:https://github.com/Studio3T/robomongo

### issues

- [x] 抓包有丢失，数据库数据不是完整的

- [ ] mongoose连接数据库内存占用过高，待优化

- [ ] mongoose对数据库操作，如果出错，如何回滚

## 项目开发

项目使用es6开发，需要安装`babel`和`babel-node`。

```sh

npm install # 按照项目依赖

npm run dev # 开启服务

```

打开[http://localhost:3000](http://localhost:3000)，查看爬取的博客内容。

## readings

+	[mongoose-connection-best-practice](http://theholmesoffice.com/mongoose-connection-best-practice/)

+	[Native cross-platform MongoDB management tool](https://github.com/Studio3T/robomongo)