Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/FriendsOfPHP/Goutte
Goutte, a simple PHP Web Scraper
https://github.com/FriendsOfPHP/Goutte
Last synced: about 1 month ago
JSON representation
Goutte, a simple PHP Web Scraper
- Host: GitHub
- URL: https://github.com/FriendsOfPHP/Goutte
- Owner: FriendsOfPHP
- License: mit
- Archived: true
- Created: 2010-04-21T19:21:54.000Z (over 14 years ago)
- Default Branch: master
- Last Pushed: 2023-04-01T09:06:44.000Z (over 1 year ago)
- Last Synced: 2024-07-09T08:44:10.219Z (5 months ago)
- Language: PHP
- Homepage:
- Size: 2.84 MB
- Stars: 9,260
- Watchers: 349
- Forks: 1,010
- Open Issues: 138
-
Metadata Files:
- Readme: README.rst
- License: LICENSE
Awesome Lists containing this project
- awesome-php - Goutte - A simple web scraper. (Table of Contents / Scraping)
- awesome-projects - Goutte - A simple web scraper. (PHP / Scraping)
- awesome-php-cn - Goutte - 一个简单的web刮刀. (目录 / 爬虫 Scraping)
README
Goutte, a simple PHP Web Scraper
================================
Goutte is a screen scraping and web crawling library for PHP.
Goutte provides a nice API to crawl websites and extract data from the HTML/XML
responses.
**WARNING**: This library is deprecated. As of v4, Goutte became a simple proxy
to the `HttpBrowser class
`_
from the `Symfony BrowserKit `_ component. To
migrate, replace ``Goutte\Client`` by
``Symfony\Component\BrowserKit\HttpBrowser`` in your code.
Requirements
------------
Goutte depends on PHP 7.1+.
Installation
------------
Add ``fabpot/goutte`` as a require dependency in your ``composer.json`` file:
.. code-block:: bash
composer require fabpot/goutte
Usage
-----
Create a Goutte Client instance (which extends
``Symfony\Component\BrowserKit\HttpBrowser``):
.. code-block:: php
use Goutte\Client;
$client = new Client();
Make requests with the ``request()`` method:
.. code-block:: php
// Go to the symfony.com website
$crawler = $client->request('GET', 'https://www.symfony.com/blog/');
The method returns a ``Crawler`` object
(``Symfony\Component\DomCrawler\Crawler``).
To use your own HTTP settings, you may create and pass an HttpClient
instance to Goutte. For example, to add a 60 second request timeout:
.. code-block:: php
use Goutte\Client;
use Symfony\Component\HttpClient\HttpClient;
$client = new Client(HttpClient::create(['timeout' => 60]));
Click on links:
.. code-block:: php
// Click on the "Security Advisories" link
$link = $crawler->selectLink('Security Advisories')->link();
$crawler = $client->click($link);
Extract data:
.. code-block:: php
// Get the latest post in this category and display the titles
$crawler->filter('h2 > a')->each(function ($node) {
print $node->text()."\n";
});
Submit forms:
.. code-block:: php
$crawler = $client->request('GET', 'https://github.com/');
$crawler = $client->click($crawler->selectLink('Sign in')->link());
$form = $crawler->selectButton('Sign in')->form();
$crawler = $client->submit($form, ['login' => 'fabpot', 'password' => 'xxxxxx']);
$crawler->filter('.flash-error')->each(function ($node) {
print $node->text()."\n";
});
More Information
----------------
Read the documentation of the `BrowserKit`_, `DomCrawler`_, and `HttpClient`_
Symfony Components for more information about what you can do with Goutte.
Pronunciation
-------------
Goutte is pronounced ``goot`` i.e. it rhymes with ``boot`` and not ``out``.
Technical Information
---------------------
Goutte is a thin wrapper around the following Symfony Components:
`BrowserKit`_, `CssSelector`_, `DomCrawler`_, and `HttpClient`_.
License
-------
Goutte is licensed under the MIT license.
.. _`Composer`: https://getcomposer.org
.. _`BrowserKit`: https://symfony.com/components/BrowserKit
.. _`DomCrawler`: https://symfony.com/doc/current/components/dom_crawler.html
.. _`CssSelector`: https://symfony.com/doc/current/components/css_selector.html
.. _`HttpClient`: https://symfony.com/doc/current/components/http_client.html