{"id":21399177,"url":"https://github.com/chrischrislolo/courseldapscraper","last_synced_at":"2026-01-02T19:35:21.295Z","repository":{"id":45887548,"uuid":"164183065","full_name":"ChrisChrisLoLo/courseLdapScraper","owner":"ChrisChrisLoLo","description":"Scrapes information from UofA's Calendar LDAP system","archived":false,"fork":false,"pushed_at":"2022-12-08T04:32:15.000Z","size":52610,"stargazers_count":2,"open_issues_count":3,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-01-23T02:42:05.613Z","etag":null,"topics":["beartracks","calendar","schedule","ualberta","university-of-alberta","uofa"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ChrisChrisLoLo.png","metadata":{"files":{"readme":"readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-01-05T04:53:36.000Z","updated_at":"2022-07-20T17:21:27.000Z","dependencies_parsed_at":"2023-01-24T15:45:12.181Z","dependency_job_id":null,"html_url":"https://github.com/ChrisChrisLoLo/courseLdapScraper","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisChrisLoLo%2FcourseLdapScraper","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisChrisLoLo%2FcourseLdapScraper/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisChrisLoLo%2FcourseLdapScraper/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ChrisChrisLoLo%2FcourseLdapScraper/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ChrisChrisLoLo","download_url":"https://codeload.github.com/ChrisChrisLoLo/courseLdapScraper/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243892036,"owners_count":20364621,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["beartracks","calendar","schedule","ualberta","university-of-alberta","uofa"],"created_at":"2024-11-22T15:13:22.445Z","updated_at":"2026-01-02T19:35:21.255Z","avatar_url":"https://github.com/ChrisChrisLoLo.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# CourseLdapScraper\nThis is a scraper that collects information from the UofA calandar LDAP system.\nThis information includes course information, class times, when classes are offered, credits offered, and alot more.\n\nThis code requires that python-ldap and sqlite3 is installed.\nSeveral prerequisite programs are needed before python-ldap can be installed.\n\n## Status\nCurrently, the script available copies the LDAP system \"verbatim\", as in most of the schema matches that of the current LDAP system. There are pros and cons of this approach. The schema currently has multiple redundencies and probably violates 3NF, likley making it unsuitable for any write operations. However, this schema has a TON of information which can be further extracted from. Explanations of each column can be found here https://sites.google.com/a/ualberta.ca/open-data/calendar-data.\n\n## Future Plans\nMore scripts can be made to further process/refactor the data. This data is supposedly updated frequently (daily-ish), and more course data becomes available when more courses appear on bear tracks (around march). What ever information beartracks has, the LDAP system, and by extension, the SQLite db has. Check the date of the SQLite file to see if it is up to date.\n\n## How To Use\nThere are two things that can be done\n1) Take the SQL file directly.\n    If the file is fairly recent simply take the db file, read the documentation above, and do with the data as you will.\n2) Run the script.\n    If the db file is fairly dated, running the script may be necessary. \n    The script requires both python-ldap as well as sqlite3, and any prerequisites those programs might need. https://www.python-ldap.org/en/latest/installing.html. \n    Running the script will generate a new DB file with updated data, which should match information beartracks has, atleast for the next couple of years.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchrischrislolo%2Fcourseldapscraper","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchrischrislolo%2Fcourseldapscraper","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchrischrislolo%2Fcourseldapscraper/lists"}