https://github.com/michigan-tech-courses/scraper

a package to scrape various information from Michigan Tech
https://github.com/michigan-tech-courses/scraper

cheerio got typescript

Last synced: 6 months ago
JSON representation

a package to scrape various information from Michigan Tech

• Host: GitHub
• URL: https://github.com/michigan-tech-courses/scraper
• Owner: Michigan-Tech-Courses
• License: mit
• Created: 2020-12-29T23:22:01.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2024-10-26T23:12:44.000Z (about 1 year ago)
• Last Synced: 2025-06-10T03:52:35.345Z (7 months ago)
• Topics: cheerio, got, typescript
• Language: TypeScript
• Homepage:
• Size: 6.88 MB
• Stars: 0
• Watchers: 2
• Forks: 2
• Open Issues: 16
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# @mtucourses/scraper

[![codecov](https://codecov.io/gh/Michigan-Tech-Courses/scraper/branch/master/graph/badge.svg?token=E7AG8R5XN0)](https://codecov.io/gh/Michigan-Tech-Courses/scraper)

Scrapes various types of information from [Michigan Tech](https://www.mtu.edu/), including faculty members and offered courses.

## 🏗 Usage

```js

const {getAllSections} = require('@mtucourses/scraper');

(async () => {

  const fallTerm = new Date();

  fallTerm.setFullYear(2020, 7);

  const sections = await getAllSections(fallTerm);

  console.log(sections);

})();

```

See the [documentation for details](docs/modules/index.md).

## 🧰  Development

```bash

# First:

# install dependencies

yarn install

# then:

# build in watch mode

yarn build:watch

# and you can:

# run tests

yarn test

# run tests in watch mode

yarn test:watch

```

To publish a new package version, run `npm version [patch|minor|major]` and then `git push && git push --tags` on the master branch.