{"id":15823472,"url":"https://github.com/slippyex/cnft-crawler","last_synced_at":"2025-07-27T19:05:33.501Z","repository":{"id":150256302,"uuid":"405381088","full_name":"slippyex/cnft-crawler","owner":"slippyex","description":null,"archived":false,"fork":false,"pushed_at":"2021-09-26T10:21:02.000Z","size":1153,"stargazers_count":3,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-10-06T08:10:49.051Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"JavaScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/slippyex.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-11T13:04:49.000Z","updated_at":"2021-11-29T22:15:43.000Z","dependencies_parsed_at":"2023-04-16T21:02:38.623Z","dependency_job_id":null,"html_url":"https://github.com/slippyex/cnft-crawler","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/slippyex/cnft-crawler","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slippyex%2Fcnft-crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slippyex%2Fcnft-crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slippyex%2Fcnft-crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slippyex%2Fcnft-crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/slippyex","download_url":"https://codeload.github.com/slippyex/cnft-crawler/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/slippyex%2Fcnft-crawler/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267408434,"owners_count":24082515,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-27T02:00:11.917Z","response_time":82,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-05T08:10:50.480Z","updated_at":"2025-07-27T19:05:33.459Z","avatar_url":"https://github.com/slippyex.png","language":"JavaScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"# CNFT crawler and price floor checker for rarities on sale\n\nGathers information about currently offered NFTs and tries to evaluate them against the provided\nrarity chart (de-duplicated version).\n\n### pre-requisites\nIn order to run the script, you have to have NodeJS installed and should be familiar\nwith editing a simple configuration file\n\n### prior to first run\n* clone the project from github (`git clone https://github.com/slippyex/cnft-crawler.git`)\n* `cd cnft-crawler/`\n* `npm install`\n\n### usage\nsimply edit the file under /config/ to fit your lookup criteria\nand run it via \n`❯ node src/index.js`\n\nAdditionally, you can override any parameter in the config file by using it as an argument\n\n```text\n❯ node src/index.js --project=\"Cardano Caricatures\" --extraTags=\"epic\" \"rare\" --minPrice=20 --maxPrice=120 --filter=\"extraTags\"\n\n❯ node src/index.js crawl --minPrice=600 --maxPrice=1800 --project=\"Cardano Waifus\" --extraTags=\"SS\" --filter=\"extraTags\"\n```\n\n\nfor instance would look for the given project and checks for trait tags epic and rare and flags them\n\nYou can also check for the floor of a given project by calling it via\n`❯ node src/index.js --project=\"Spacebudz\" --floor`\n\nwhich would give an output similar to this\n```text\n❯ node src/index.js floor --project=\"Spacebudz\" \nentering cnft crawler with floor check on project Spacebudz\nCurrent floor for project Spacebudz is 3550 ADA\n```\n\nHave a closer look to the output and decide if you want to check and buy\n\n```text\n❯ node src/index.js --help\n```\nprovides an overview of all possible combinations and options, you can use\n\n### example configuration\n```javascript\nmodule.exports = {\n// project to crawl (as shown on cnft.io projects list)\n//  project: 'Clay Nation by Clay Mates',\nproject: 'Bitlands',\n// threshold of trait in percent\n// if 5 that means, that the trait has to have a minimum of 5% in order to be considered\nthreshold: 5,\n// minimum amount of traits with the above threshold in order to be considered valuable\n// if 3 that means, we have to have at least 3 traits with a minimum of 5% in rarity\nminTrigger: 5,\n// if any of the given extra tags is found in the traits, we consider the item\n// valuable, regardless of the percent coverage above\n//extraTags: ['blue clay', 'green clay', 'laser eyes', 'duck', 'angel wings', 'orangutan'],\nextraTags: ['rare'],\n// filters results just based on the given rarity criteria\nfilter: 'rarity',  \n// minimum price in ADA\nminPrice: 1000,\n// maximum price in ADA\nmaxPrice: 1200,\n// maximum amount of pages to crawl - each page has an output of 25 items\nmaxPages: 15\n}\n```\n\n### example output\n```text\nClay Nation #47XX - price 125 ADA \u003e\u003e overall rarity -\u003e\u003e 10%\n        body: White Clay (31.21%) \n        eyes: Crying eye (4.83%) ***\n        brows: Pierced Eyebrows (13.33%) \n        mouth: Fly Tounge (3.7%) ***\n        clothes: Peace Logo Shirt (4.87%) ***\n        background: Peach (14.44%) \n        accessories: Parrot (3.91%) ***\n        hats and hair: Beanie (3.34%) ***\n        hats and hair: Beanie (3.34%) ***\nat least 4 items below 5% - considered worth checking under: https://cnft.io/token.php?id=xxxx3b8b66xxxxxxxxx\nClay Nation #02XX - price 200 ADA \u003e\u003e overall rarity -\u003e\u003e 10%\n        body: White Clay (31.21%) \n        eyes: Angry Eyes (4.29%) ***\n        brows: Pierced Eyebrows (13.33%) \n        mouth: Screaming (1.31%) ***\n        clothes: Pink Fluffy Jacket (3.56%) ***\n        background: Serenity (14.23%) \n        accessories: Gold Chain (7.9%) \n        hats and hair: Spikey Black Hair (4.01%) ***\nat least 4 items below 5% - considered worth checking under: https://cnft.io/token.php?id=xxxxx22da1xxxxxxxxxx\n\n```\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fslippyex%2Fcnft-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fslippyex%2Fcnft-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fslippyex%2Fcnft-crawler/lists"}