{"id":21489899,"url":"https://github.com/ewertoncodes/mind-crawler","last_synced_at":"2026-05-14T12:31:59.295Z","repository":{"id":36626446,"uuid":"192539448","full_name":"ewertoncodes/mind-crawler","owner":"ewertoncodes","description":" A simple api written in Rails to extract quotations from the Quotes to Scrape site.","archived":false,"fork":false,"pushed_at":"2023-01-19T13:24:35.000Z","size":66,"stargazers_count":2,"open_issues_count":9,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-10-19T02:38:36.531Z","etag":null,"topics":["crawler","ruby","ruby-on-rails"],"latest_commit_sha":null,"homepage":"","language":"Ruby","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ewertoncodes.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-06-18T12:51:57.000Z","updated_at":"2023-03-08T21:26:18.000Z","dependencies_parsed_at":"2023-02-11T01:15:37.541Z","dependency_job_id":null,"html_url":"https://github.com/ewertoncodes/mind-crawler","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/ewertoncodes/mind-crawler","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ewertoncodes%2Fmind-crawler","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ewertoncodes%2Fmind-crawler/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ewertoncodes%2Fmind-crawler/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ewertoncodes%2Fmind-crawler/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ewertoncodes","download_url":"https://codeload.github.com/ewertoncodes/mind-crawler/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ewertoncodes%2Fmind-crawler/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33024919,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-13T13:14:54.681Z","status":"online","status_checked_at":"2026-05-14T02:00:06.663Z","response_time":57,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["crawler","ruby","ruby-on-rails"],"created_at":"2024-11-23T14:29:05.491Z","updated_at":"2026-05-14T12:31:59.276Z","avatar_url":"https://github.com/ewertoncodes.png","language":"Ruby","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Mind Crawler\n\nUma simples api escrita em Rails para extrair citações do site Quotes to Scrape.\n\n## Como funciona\n\n O usuário deve se autenticar para usar o sistema. \n Após colocar a tag das citações que procura, o script irá buscar no site [quotes to scrape](http://quotes.toscrape.com/) os dados. Se a tag existir a aplicação realiza a extração dos dados por todas as páginas com aquela tag. Caso a tag não existe a aplicação irá retornar uma  mensagem avisando que a tag não existe.\n\n---\n## Instalação\n\n#### **Pré-requisitos**\n\n- Ruby 2.5 - Recomendo instalar com o [RVM](https://rvm.io/)\n- MongoDB - [Instalação do MongoDB](https://docs.mongodb.com/manual/administration/install-community/)\n\nClone o projeto:\n\n```bash \ngit clone https://github.com/ewertondev/mind-crawler.git \n```\nAcesse o diretorio:\n\n```bash \ncd mind-crawler/\n```\n\nInstale as dependências:\n\n```bash\nbundle install\n```\n\nCopie o .env.sample para um arquivo .env:\n\n```bash\ncp .env.sample .env\n```\n\nInicie o serviço do **MongoDB** rodando:\n\n```bash\nsudo systemctl start mongodb\n```\nRode os testes:\n\n```bash\nrspec spec\n```\n\n Levante sua aplicação com o comando:\n\n```bash\nrails server\n```\n---\n\n\n## Como usar\n\n### Opção 1 - via linha de comando\n\nInstale o [httpie](https://github.com/jakubroztocil/httpie#installation)\n\n```bash\napt-get install httpie\n```\n\n\n### Realizando uma requisição sem se autenticar:\n\n```bash\nhttp get http://localhost:3000/quotes/life`\n```\n\nResposta:\n\n`401 Unauthorized`\n\n\n\n### Criando um usuário:\n\n```bash\necho '{ \"user\": { \"email\":\"foo@foo.com\", \"name\":\"foo\", \"password\":\"123456\"  } }' | http post http://localhost:3000/signup\n```\n\nResposta: \n\n`200 OK`\n\n\n\n\n\n### **Logando com um usuário:**\n\n```bash\necho '{ \"auth\": { \"email\":\"foo@foo.com\", \"password\":\"123456\"  } }' | http post http://localhost:3000/user_token\n```\n\nResposta:  \n\n`201 Created`\n\n```bash\n{\n\"jwt\": \"eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJleHAiOjE1NjA5Mzg1ODksInN1YiI6eyIkb2lkIjoiNWQwOGI1ZmQ2YjBmODgzNDJjYzNhM2FkIn19.4q5k$\nU1a-kl5H637jKmIcGkk3t6vA79T_IGO-yIACFg\"\n}\n```\n\n### Acessando um recurso:\n\n```bash \nhttp get http://localhost:3000/quotes/life \"Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJleHAiOjE1NjA5MTg0ODgsInN1YiI6eyIkb2lkIjoiNWQwODY4MTE2YjBmODg3YmFhYjZkOWFlIn19.ARfP3EfzIt9pEc0eyIcgkKe4GUNIoTE5I7aexPgOpJQ\"\n```\n\nResposta:\n\n `200 OK` \n\n---\n\n### Opção 2 - via Postman\n\n\n[![Run in Postman](https://run.pstmn.io/button.svg)](https://app.getpostman.com/run-collection/a7dbd3a1bb6729add572)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fewertoncodes%2Fmind-crawler","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fewertoncodes%2Fmind-crawler","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fewertoncodes%2Fmind-crawler/lists"}