{"id":15546193,"url":"https://github.com/codingo/succinct","last_synced_at":"2025-04-23T17:42:35.059Z","repository":{"id":176682883,"uuid":"617184443","full_name":"codingo/succinct","owner":"codingo","description":"A tool to create a text summary of a provided list of websites","archived":false,"fork":false,"pushed_at":"2023-03-21T22:53:14.000Z","size":73,"stargazers_count":11,"open_issues_count":0,"forks_count":3,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-20T09:59:21.362Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/codingo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-03-21T21:31:40.000Z","updated_at":"2025-03-16T15:43:37.000Z","dependencies_parsed_at":null,"dependency_job_id":"47ea36d0-49c8-430e-9e64-95c53fad4a2c","html_url":"https://github.com/codingo/succinct","commit_stats":null,"previous_names":["codingo/succinct"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingo%2Fsuccinct","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingo%2Fsuccinct/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingo%2Fsuccinct/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/codingo%2Fsuccinct/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/codingo","download_url":"https://codeload.github.com/codingo/succinct/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":250482952,"owners_count":21437970,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-02T13:01:15.718Z","updated_at":"2025-04-23T17:42:35.053Z","avatar_url":"https://github.com/codingo.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Succinct\nThis Go script takes a list of URLs and outputs the most common words for each URL along with a summary paragraph describing the website. The script uses the `github.com/JesusIslam/tldr` library for summarization.\n\n## Usage\n\n1. Install the required libraries:\n\n   ```\n   go get github.com/JesusIslam/tldr\n   go get github.com/PuerkitoBio/goquery\n   ```\n\n2. Build the script:\n\n   ```\n   go build main.go\n   ```\n\n3. Run the script with the required flags:\n\n   ```\n   ./main -t \u003ctargets-file\u003e [-e \u003cexclude-file\u003e] [-n \u003cnumber-of-common-words\u003e] [-threads \u003cnumber-of-threads\u003e] [-s \u003cnumber-of-summary-sentences\u003e]\n   ```\n\n   - `-t` or `--targets`: Targets file (newline per webpage to load)\n   - `-e` or `--exclude`: Exclude file (newline per word to exclude) - optional\n   - `-n`: The number of most common words to output - optional, default is 10\n   - `--threads`: The number of threads to use - optional, default is 10\n   - `-s`: The number of sentences in the summary - optional, default is 3\n\n## Example\n\nCreate a `targets.txt` file with a list of URLs to process:\n\n```\nhttps://example.com\nhttps://example.org\n```\n\nCreate an `exclude.txt` file with a list of words to exclude:\n\n```\nthe\nand\n```\n\nRun the script:\n\n```\n./main -t targets.txt -e exclude.txt -n 10 -threads 10 -s 3\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingo%2Fsuccinct","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcodingo%2Fsuccinct","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcodingo%2Fsuccinct/lists"}