{"id":18292412,"url":"https://github.com/shreshthmohan/wildex","last_synced_at":"2026-03-19T03:45:15.067Z","repository":{"id":254066233,"uuid":"845314139","full_name":"shreshthmohan/wildex","owner":"shreshthmohan","description":null,"archived":false,"fork":false,"pushed_at":"2025-10-03T10:41:56.000Z","size":3546,"stargazers_count":1,"open_issues_count":5,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-11-30T08:28:40.695Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://wildex.blrhikes.com","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shreshthmohan.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2024-08-21T02:27:55.000Z","updated_at":"2025-10-03T10:41:59.000Z","dependencies_parsed_at":"2025-10-01T07:17:37.955Z","dependency_job_id":"9a90b633-1923-4374-9bbb-bf34e325a679","html_url":"https://github.com/shreshthmohan/wildex","commit_stats":null,"previous_names":["shreshthmohan/wildex"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/shreshthmohan/wildex","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shreshthmohan%2Fwildex","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shreshthmohan%2Fwildex/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shreshthmohan%2Fwildex/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shreshthmohan%2Fwildex/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shreshthmohan","download_url":"https://codeload.github.com/shreshthmohan/wildex/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shreshthmohan%2Fwildex/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28671197,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-22T20:48:19.482Z","status":"ssl_error","status_checked_at":"2026-01-22T20:48:14.968Z","response_time":144,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-05T14:18:07.606Z","updated_at":"2026-01-22T21:02:40.021Z","avatar_url":"https://github.com/shreshthmohan.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Wildex\n\nA web application showcasing plant species from the Auroville Herbarium, built with modern web technologies and powered by custom web scrapers.\n\n## Tech Stack\n\n**Web App:**\n\n- [Astro](https://astro.build) - Static site framework\n- [TailwindCSS](https://tailwindcss.com) - Utility-first CSS\n\n**Data Collection:**\n\n- [Scrapy](https://scrapy.org) - Web scraping framework\n- Python 3.13+\n- [uv](https://github.com/astral-sh/uv) - Fast Python package installer\n\n## Project Structure\n\n```\nwildex/\n├── src/                    # Astro web app source\n│   ├── components/         # Reusable Astro components\n│   ├── data/              # Species data (species.js)\n│   ├── layouts/           # Page layouts\n│   ├── pages/             # Site pages\n│   └── styles/            # Global styles\n├── spider/                # Scrapy web scraping project\n│   ├── crawler/           # Spider implementations\n│   ├── output/            # Sample spider outputs (reference)\n│   └── README.md          # Spider documentation\n├── ui-mockups/            # Design explorations and mockups\n└── public/                # Static assets\n```\n\n## Quick Start\n\n### Web App Development\n\n**Install dependencies:**\n\n```sh\npnpm install\n```\n\n**Start development server:**\n\n```sh\npnpm dev\n```\n\n**Build for production:**\n\n```sh\npnpm build\n```\n\n**Preview production build:**\n\n```sh\npnpm preview\n```\n\n### Spider (Data Collection)\n\nThe spider scrapes plant species data from the Auroville Herbarium website.\n\n**Setup:**\n\nInstall [uv](https://docs.astral.sh/uv/getting-started/installation/) if not already installed:\n\n```sh\n# macOS (using Homebrew)\nbrew install uv\n```\n\n**Run spider** (from `spider/` directory):\n\n```sh\n# Scrape a batch of species\nuv run scrapy crawl species -a max_species=5\n\n# Scrape specific species by ID\n\n# automatically saves to output/species/species-172.json\nuv run scrapy crawl species -a species_id=172\n\n# save to custom file location\nuv run scrapy crawl species -a species_id=172 -O custom-dir/filename.json\n\n# Scrape all species\nuv run scrapy crawl species\n```\n\nSee [`spider/README.md`](spider/README.md) for detailed spider documentation.\n\n## Development Workflow\n\n1. **Scrape data** using the spider (in `spider/` directory)\n2. **Process/transform data** as needed\n3. **Import into web app** (currently using `src/data/species.js`)\n4. **Build and deploy** the Astro site\n\n## Current State\n\n- Species data is currently stored in `src/data/species.js`\n- Spider can extract comprehensive species information including descriptions, ecology, human uses, and conservation status\n- Web app displays species in card format\n\n## Contributing\n\nThis is a personal project, but feel free to fork and adapt for your own use!\n\n## License\n\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshreshthmohan%2Fwildex","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshreshthmohan%2Fwildex","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshreshthmohan%2Fwildex/lists"}