https://github.com/vkitchen/crawler

Simple web scraper to test out real world OCaml (WIP)
https://github.com/vkitchen/crawler

Last synced: 10 days ago
JSON representation

Simple web scraper to test out real world OCaml (WIP)

• Host: GitHub
• URL: https://github.com/vkitchen/crawler
• Owner: vkitchen
• License: isc
• Created: 2020-08-03T05:06:23.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2024-03-23T03:12:15.000Z (9 months ago)
• Last Synced: 2024-10-29T16:59:54.285Z (about 2 months ago)
• Language: Zig
• Size: 28.3 KB
• Stars: 0
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# Scraper

What will be a simple web scraper in OCaml to try out using the language on a real world project

## Building

First you will need to make sure you have `ocaml`, `opam` and `dune` instealled. Then you will need to install the dependencies like so `opam install cohttp-lwt-unix lwt_ppx lambdasoup` finally run `dune build main.exe` which will build in `_build/default/main.exe`

N.B. if building on OpenBSD you'll likely have to increase your stack size limit during dependency install as `parsexp` uses a large stack allocated array. This can by done by running `ulimit -s 32768` in the shell before you start