{"id":19096293,"url":"https://github.com/cobular/campuswire-scraper","last_synced_at":"2026-05-26T18:30:15.454Z","repository":{"id":229357725,"uuid":"728525042","full_name":"Cobular/Campuswire-Scraper","owner":"Cobular","description":null,"archived":false,"fork":false,"pushed_at":"2024-03-23T18:51:25.000Z","size":5,"stargazers_count":1,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-03T00:21:30.589Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Cobular.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2023-12-07T05:58:09.000Z","updated_at":"2024-02-14T05:53:11.000Z","dependencies_parsed_at":"2024-03-23T19:50:36.823Z","dependency_job_id":null,"html_url":"https://github.com/Cobular/Campuswire-Scraper","commit_stats":null,"previous_names":["cobular/campuswire-scraper"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cobular%2FCampuswire-Scraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cobular%2FCampuswire-Scraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cobular%2FCampuswire-Scraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Cobular%2FCampuswire-Scraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Cobular","download_url":"https://codeload.github.com/Cobular/Campuswire-Scraper/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240149744,"owners_count":19755743,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-09T03:36:21.925Z","updated_at":"2026-05-26T18:30:15.356Z","avatar_url":"https://github.com/Cobular.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Campuswire Scraper\n\nEasily scrape a whole campuswire class in one go! Great for saving all those important resources you don't want to miss out on.\n\n## Usage\n\n1. Clone the repo\n2. Make a venv `python3 -m venv venv`, activate the venv `source venv/bin/activate`\n3. Install requirements `pip install -r requirements.txt`\n4. Copy over the example environment `cp environment.example.py environment.py` and update the values. You'll need to extract both from a request in your browser, see below for more details.\n5. Run the script `python3 fetch_posts_script.py`\n\n## Getting the values for environment.py\n\nYou'll need to get the values for the CLASS and BEARER from a sample request on campuswire. To do this, open up the network tab in your browser's dev tools and reload the page. Pick a request titled `posts` and take the following values:\n\n1. The `CLASS` variable comes from the first UUID in the url. For a class like this: `https://api.campuswire.com/v1/group/209b3a18-c94a-4a57-9431-dab10c53ea1e/posts?number=20` you want `209b3a18-c94a-4a57-9431-dab10c53ea1e`\n2. The header `Authorization`, in it's entirety, is the `BEARER` variable. You want the whole thing, including the `Bearer ` part and the whole JWT blob after it.\n\n\n## Other notes\n\nI take no liability for anything here! This is probably against TOS and while I've taken some basic steps to limit the throughput of the script, I can't guarantee it won't get you banned. Use at your own risk!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcobular%2Fcampuswire-scraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcobular%2Fcampuswire-scraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcobular%2Fcampuswire-scraper/lists"}