{"id":15138630,"url":"https://github.com/incquerylabs/repo-crawler","last_synced_at":"2025-10-23T15:30:33.247Z","repository":{"id":53102563,"uuid":"102834282","full_name":"IncQueryLabs/repo-crawler","owner":"IncQueryLabs","description":"A small utility for crawling model repositories","archived":false,"fork":false,"pushed_at":"2024-07-08T15:10:47.000Z","size":205,"stargazers_count":6,"open_issues_count":4,"forks_count":2,"subscribers_count":17,"default_branch":"master","last_synced_at":"2025-01-30T19:11:17.258Z","etag":null,"topics":["cloud","kotlin","magicdraw","performance","rest","teamwork","vert-x","vertx","viatra"],"latest_commit_sha":null,"homepage":"","language":"Kotlin","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/IncQueryLabs.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-09-08T07:50:53.000Z","updated_at":"2024-09-18T14:15:11.000Z","dependencies_parsed_at":"2024-02-04T12:57:44.480Z","dependency_job_id":"5ba614a4-3489-4abb-a14b-b9dac57802f5","html_url":"https://github.com/IncQueryLabs/repo-crawler","commit_stats":null,"previous_names":[],"tags_count":3,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IncQueryLabs%2Frepo-crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IncQueryLabs%2Frepo-crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IncQueryLabs%2Frepo-crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/IncQueryLabs%2Frepo-crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/IncQueryLabs","download_url":"https://codeload.github.com/IncQueryLabs/repo-crawler/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":237843858,"owners_count":19375218,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cloud","kotlin","magicdraw","performance","rest","teamwork","vert-x","vertx","viatra"],"created_at":"2024-09-26T07:42:36.267Z","updated_at":"2025-10-23T15:30:32.823Z","avatar_url":"https://github.com/IncQueryLabs.png","language":"Kotlin","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![Build Status](https://build.incquerylabs.com/jenkins/buildStatus/icon?job=incquery-suite%2Ftwc-repo-crawler%2Fmaster)](https://build.incquerylabs.com/jenkins/job/incquery-suite/job/twc-repo-crawler/job/master/)\n\n# Repository and revision crawler for Teamwork Cloud\n\n## Run the crawler\n\n1. Download `twc.repo-crawler-\u003cversion\u003e-all.jar` from [GitHub releases](https://github.com/IncQueryLabs/repo-crawler/releases)\n1. `java -jar twc.repo-crawler-\u003cversion\u003e-all.jar \u003cargs\u003e` with arguments (see below)\n\n## Example arguments\n\nRunning the jar without arguments prints out the usage instructions.\n\n- Running the crawler without workspace, resource, branch, and revision will result in crawling the repository structure of the given scope\n- Running the crawler with workspace, resource, branch, and revision will result in crawling the model content of the given revision\n\n### Repository structure of OpenSE Cookbook workspace on twc.openmbee.org\n\n`-S twc.openmbee.org -P 8111 -ssl -W 9c368adc-10cc-45d9-bec6-27aedc80e68b -C 2000 -u openmbeeguest -pw guest`\n\n### OpenSE Cookbook model on twc.openmbee.org\n\n`-S twc.openmbee.org -P 8111 -ssl -W 9c368adc-10cc-45d9-bec6-27aedc80e68b -R c6bede89-cd5e-487b-aca8-a4f384370759 -B 29110c0f-bdc1-4294-ae24-9fd608629cac -REV 350 -C 2000 -u openmbeeguest -pw guest`\n\n### TMT on twc.openmbee.org\n\n`-S twc.openmbee.org -P 8111 -ssl -W 9c368adc-10cc-45d9-bec6-27aedc80e68b -R 6819171d-1f52-4792-a08d-15d50d47985a -B a95e8bd1-f7d2-433e-a0a1-0c1cd7702e59 -REV 229 -C 2000 -u openmbeeguest -pw guest`\n\n## Configuring self-signed certificate when using SSL on Teamwork Cloud OSMC API\n\n- Java has to start with `-Djavax.net.ssl.trustStore=\u003cpath to JKS file\u003e -Djavax.net.ssl.trustStorePassword=\u003cpassword of JKS file\u003e`\n  - **Note**: These are JVM parameters that should be added before the `-jar` part\n  - You can add `-Djavax.net.debug=all` to check whether Java loaded the certificate correctly\n- Make sure that `ssl` is enabled in CLI arguments\n\n## Bypass host verification and trust all certificates by default\n\nAt your own risk you can use the `--trustAll` option to disable validation.\n\n## Running from source\n\n1. Clone this repository or download the sources for a [release](https://github.com/IncQueryLabs/repo-crawler/releases).\n\n### IntelliJ IDEA\n\n1. Install `IntelliJ IDEA` with Kotlin plugin.\n1. Open IntelliJ IDEA and open project. `File -\u003e Open.. -\u003e \u003cproject_path\u003e` (Select `Gradle` if needed.)\n1. `Build -\u003e Build Project`\n1. `Run -\u003e Run... -\u003e com.incquerylabs.twc.repo.crawler.Crawler.kt` (set arguments in Configuration)\n\n### Gradle\n\n1. `./gradlew run --args='\u003cargs\u003e'` with arguments (see above)\n\n### Shadow Jar\n\n1. `./gradlew shadowJar`\n1. `java -jar build/libs/twc.repo-crawler-\u003cversion\u003e-all.jar \u003cargs\u003e` with arguments (see above)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fincquerylabs%2Frepo-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fincquerylabs%2Frepo-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fincquerylabs%2Frepo-crawler/lists"}