https://github.com/jaymon/que

CSS selectors for parsing html on the command line
https://github.com/jaymon/que

command-line command-line-tool commandline css-selector python utility

Last synced: 10 days ago
JSON representation

CSS selectors for parsing html on the command line

• Host: GitHub
• URL: https://github.com/jaymon/que
• Owner: Jaymon
• License: mit
• Created: 2017-05-16T09:20:31.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2023-11-26T21:59:10.000Z (12 months ago)
• Last Synced: 2024-10-12T09:42:25.944Z (26 days ago)
• Topics: command-line, command-line-tool, commandline, css-selector, python, utility
• Language: Python
• Size: 14.6 KB
• Stars: 2
• Watchers: 3
• Forks: 0
• Open Issues: 6
• Metadata Files:
  • Readme: README.md
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
# Que

Slice and dice html on the command line using CSS selectors.

## Quick start

Let's say you want to grab all the links on **http://example.com/foo/bar**:

    $ que "a->href" "http://example.com/foo/bar"

Let's say that gave you 3 lines that looked like this:

    /some/url?val=1

    /some/url2?val=2

    /some/url3?val=3

Ugh, that's not very helpful, so let's modify our argument a bit:

    $ que "a->http://example.com{href}" "http://example.com/foo/bar"

Now, that will print:

    http://example.com/some/url?val=1

    http://example.com/some/url2?val=2

    http://example.com/some/url3?val=3

## Selecting

Not sure how to use CSS Selectors?

* [Beautiful Soup CSS select docs](https://www.crummy.com/software/BeautifulSoup/bs4/doc/#searching-by-css-class)

* [JQuery's CSS Selector docs](http://api.jquery.com/category/selectors/)

* [Sauce Labs Tutorial](https://saucelabs.com/resources/articles/selenium-tips-css-selectors)

* [W3CSchools CSS Selector Reference](https://www.w3schools.com/cssref/css_selectors.asp)

The selector is divided into two parts separated by `->`, the first part is the traditional selector talked about in the above links and the second part is the attributes you want to print to the screen for each match:

    $ css.selector->attribute,...

The Selector part uses [Python's string formatting syntax](https://docs.python.org/2/library/string.html#formatspec) so you can embed the attributes you want within a larger string.

## Examples

Find all the "Download" links on a page:

que has support for the the non-standard [:contains css selector](https://www.w3.org/TR/2001/CR-css3-selectors-20011113/#content-selectors)

    $ curl http://example.com | que "a:contains(Download)->href"

Select all the links with attribute `data` that starts with "foo":

    $ curl http://example.com | que "a[data|=foo]->href"

## Installation

You can use pip to install stable:

    $ pip install que

or the latest and greatest (which might be different than what's on [pypi](https://pypi.python.org/pypi/que):

    $ pip install git+https://github.com/jaymon/que#egg=que

## Notes

* If you need a way more fully featured html command line parser, try [hq](https://github.com/rbwinslow/hq).