https://github.com/MontFerret/ferret

Declarative web scraping
https://github.com/MontFerret/ferret

cdp chrome cli crawler crawling data-mining dsl go golang hacktoberfest library query-language scraper scraping scraping-websites tool

Last synced: about 2 months ago
JSON representation

Declarative web scraping

• Host: GitHub
• URL: https://github.com/MontFerret/ferret
• Owner: MontFerret
• License: apache-2.0
• Created: 2018-08-23T02:42:46.000Z (about 6 years ago)
• Default Branch: master
• Last Pushed: 2024-04-01T21:12:20.000Z (6 months ago)
• Last Synced: 2024-04-13T21:05:39.137Z (5 months ago)
• Topics: cdp, chrome, cli, crawler, crawling, data-mining, dsl, go, golang, hacktoberfest, library, query-language, scraper, scraping, scraping-websites, tool
• Language: Go
• Homepage: https://www.montferret.dev/
• Size: 3.87 MB
• Stars: 5,615
• Watchers: 103
• Forks: 301
• Open Issues: 52
• Metadata Files:
  • Readme: README.md
  • Changelog: CHANGELOG.md
  • Funding: .github/FUNDING.yml
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

Awesome Lists containing this project

• awesome-go - MontFerret/ferret
• my-awesome - MontFerret/ferret - mining,dsl,go,golang,hacktoberfest,library,query-language,scraper,scraping,scraping-websites,tool pushed_at:2024-04 star:5.7k fork:0.3k Declarative web scraping (Go)
• awesome - MontFerret/ferret - Declarative web scraping (Go)
• awesome-repositories - MontFerret/ferret - Declarative web scraping (Go)
• awesome-go - Ferret - Declarative web scraping (CLI frameworks)
• awesome-starts - MontFerret/ferret - Declarative web scraping (Go)
• go-awesome - Ferret - Declarative web scraping (Open source library / Crawlers)
• awesome-list - ferret
• awesome-golang-repositories - ferret

README

        
# Ferret



	

		

	

	

		

	

	

		

	

	

		

	

	

		

	

	

		

	

	

		

	



![ferret](https://raw.githubusercontent.com/MontFerret/ferret/master/assets/intro.jpg)



	

		Try it!

	

	

		Docs

	

	

		CLI

	

	

		Test runner

	

	

		Web worker

	



## What is it?

```ferret``` is a web scraping system. It aims to simplify data extraction from the web for UI testing, machine learning, analytics and more.    

```ferret``` allows users to focus on the data. It abstracts away the technical details and complexity of underlying technologies using its own declarative language. 

It is extremely portable, extensible, and fast.

[Read the introductory blog post about Ferret here!](https://medium.com/@ziflex/say-hello-to-ferret-a-modern-web-scraping-tool-5c9cc85ba183)

### Features

* Declarative language

* Support of both static and dynamic web pages

* Embeddable

* Extensible

Documentation is available [at our website](https://www.montferret.dev/docs/introduction/).

### Different languages

* Ferret for python. [Pyfer](https://github.com/MontFerret/pyfer)