{"id":20980779,"url":"https://github.com/spwareing/azuretimertrigger","last_synced_at":"2026-05-15T08:05:54.658Z","repository":{"id":44958882,"uuid":"443991320","full_name":"SPWareing/AzureTimerTrigger","owner":"SPWareing","description":"Azure Timer Trigger Function to check website and output results to Blob Storage.","archived":false,"fork":false,"pushed_at":"2022-01-15T19:32:49.000Z","size":15,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-20T06:35:16.309Z","etag":null,"topics":["azure-functions","beatifulsoup","pandas","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/SPWareing.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-01-03T08:34:48.000Z","updated_at":"2024-09-16T02:54:57.000Z","dependencies_parsed_at":"2022-09-09T20:21:26.769Z","dependency_job_id":null,"html_url":"https://github.com/SPWareing/AzureTimerTrigger","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SPWareing%2FAzureTimerTrigger","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SPWareing%2FAzureTimerTrigger/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SPWareing%2FAzureTimerTrigger/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SPWareing%2FAzureTimerTrigger/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/SPWareing","download_url":"https://codeload.github.com/SPWareing/AzureTimerTrigger/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243382934,"owners_count":20282051,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["azure-functions","beatifulsoup","pandas","python"],"created_at":"2024-11-19T05:30:06.069Z","updated_at":"2026-05-15T08:05:54.608Z","avatar_url":"https://github.com/SPWareing.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Azure Timer Function to check for dataset update\n\nThis azure function uses the [Pandas](https://pandas.pydata.org/) library with the [Beautiful Soup](https://pypi.org/project/beautifulsoup4/) extension in order to check if any dataset has been updated on the [Historic England](https://historicengland.org.uk/listing/the-list/data-downloads/) listing website and any heritage dataset from Historic Scotland.\n\n___\n\n\n## How it Works\n\nThe NCRON expression for this repository is set to run daily at 7am.\n~~~\n\n\"schedule\": \"0 0 7 * * *\"\n\n~~~\n\nThis is **purely for testing**, and it is recommended that a longer expression be used when uploaded to Azure, for example *monthly*:\n~~~\n\"schedule\": 0 0 7 1 1-12 *\n~~~\n\n- When the timer is triggered it will send a `request.get()` call to the website. Upon a successful request code the `request.text` will be passed to a Pandas dataframe and processed. \n- A dataframe containing a reference to only the updated datasets will be output to Blob storage as a CSV.\n- The output CSV is uniquely identified by appending a DateTime to the filename: `HE_event_{Datetime}.csv`\n- For simplicity an Azure Logic App then checks the Blob storage for updates and then emails the results.\n\nTo do:\n\n- [ ] Update NCRON\n- [X] Add Historic Scotland code\n- [X] Add CADW code","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspwareing%2Fazuretimertrigger","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fspwareing%2Fazuretimertrigger","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fspwareing%2Fazuretimertrigger/lists"}