{"id":17146540,"url":"https://github.com/mikeumus/phishnet-firstgen","last_synced_at":"2025-06-15T09:09:04.208Z","repository":{"id":151878646,"uuid":"45641418","full_name":"mikeumus/phishnet-firstgen","owner":"mikeumus","description":"Backed-up mostly for historical purposes. Thanks for the space GitHub \u003c3 :D","archived":false,"fork":false,"pushed_at":"2015-11-05T21:49:33.000Z","size":0,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-03-24T10:53:49.852Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mikeumus.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2015-11-05T21:45:52.000Z","updated_at":"2019-01-09T09:31:54.000Z","dependencies_parsed_at":"2023-04-12T05:34:17.952Z","dependency_job_id":null,"html_url":"https://github.com/mikeumus/phishnet-firstgen","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/mikeumus/phishnet-firstgen","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeumus%2Fphishnet-firstgen","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeumus%2Fphishnet-firstgen/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeumus%2Fphishnet-firstgen/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeumus%2Fphishnet-firstgen/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mikeumus","download_url":"https://codeload.github.com/mikeumus/phishnet-firstgen/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mikeumus%2Fphishnet-firstgen/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":259949680,"owners_count":22936411,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-10-14T21:08:57.473Z","updated_at":"2025-06-15T09:09:04.190Z","avatar_url":"https://github.com/mikeumus.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"#Scrapetank\n\nA scrapy spider for getting all the offline valid scripts from PhishTank.com\n\nRun the spider: `$ scrapy crawl offline_phishies -a target_id=7`\nSee Spider-Arugements-Key.md for `target_id`\n\n![Creative Commons license image](http://creativecommons.org/images/public/somerights20.png)\nAll content from [PhishTank.com](https://www.phishtank.com/) is under a [Creative Commons Attribution-ShareAlike 2.5 License](http://creativecommons.org/licenses/by-sa/2.5/).\n\n_ _ _\n\n\n### Project Notes\n\n###### Deleting Tables\nIn `./manage.py shell`\n```\nIn [2]: from pishing.models import Phish                                                               \n                                                                                                       \nIn [3]: Phish.objects.all().count()                                                                    \nOut[3]: 4821                                                                                           \n                                                                                                       \nIn [4]: Phish.objects.all().delete()                                                                   \n                                                                                                       \nIn [5]: Phish.objects.all().count()                                                                    \nOut[5]: 0   \n```\n\nto clear out an application is as simple as writing:\n`./manage.py sqlclear app_name | ./manage.py dbshell`\nthen in order to rebuild your tables just type:\n`./manage.py syncdb`\n\n##### Notes\n\n###### Saving Images in Scrapy\nhttp://doc.scrapy.org/en/latest/topics/images.html\n\n###### Don't forget to install service_indentity (for C9)!\nhttps://service-identity.readthedocs.org/en/14.0.0/installation.html\n\n###### Scrapy formrequest\nhttp://stackoverflow.com/questions/11213467/cant-get-through-a-form-with-scrapy\n\n###### Code modeled after \n- http://stackoverflow.com/questions/5851213/crawling-with-an-authenticated-session-in-scrapy?answertab=votes#tab-top\n\nOther references\n- https://scrapy.readthedocs.org/en/latest/topics/request-response.html?highlight=login#using-formrequest-from-response-to-simulate-a-user-login\n-- http://stackoverflow.com/questions/5850755/using-scrapy-with-authenticated-logged-in-user-session\n-- http://stackoverflow.com/questions/17403596/python-scrapy-cant-post-information-to-forms\n\n\n_ _ _ \n\n\n\n### Cloud9 ReadMe \n\n     ,-----.,--.                  ,--. ,---.   ,--.,------.  ,------.\n    '  .--./|  | ,---. ,--.,--. ,-|  || o   \\  |  ||  .-.  \\ |  .---'\n    |  |    |  || .-. ||  ||  |' .-. |`..'  |  |  ||  |  \\  :|  `--, \n    '  '--'\\|  |' '-' ''  ''  '\\ `-' | .'  /   |  ||  '--'  /|  `---.\n     `-----'`--' `---'  `----'  `---'  `--'    `--'`-------' `------'\n    ----------------------------------------------------------------- \n\n\nWelcome to your Django project on Cloud9 IDE!\n\nYour Django project is already fully setup. Just click the \"Run\" button to start\nthe application. On first run you will be asked to create an admin user. You can\naccess your application from 'https://scrapy-phishtank-mikeumus.c9.io/' and the admin page from \n'https://scrapy-phishtank-mikeumus.c9.io/admin'.\n\n## Starting from the Terminal\n\nIn case you want to run your Django application from the terminal just run:\n\n1) Run syncdb command to sync models to database and create Django's default superuser and auth system\n\n    $ python manage.py syncdb\n\n2) Run Django\n\n    $ python manage.py runserver $IP:$PORT\n    \n## Support \u0026 Documentation\n\nDjango docs can be found at https://www.djangoproject.com/\n\nYou may also want to follow the Django tutorial to create your first application:\nhttps://docs.djangoproject.com/en/1.7/intro/tutorial01/\n\nVisit http://docs.c9.io for support, or to learn more about using Cloud9 IDE.\nTo watch some training videos, visit http://www.youtube.com/user/c9ide","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikeumus%2Fphishnet-firstgen","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmikeumus%2Fphishnet-firstgen","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmikeumus%2Fphishnet-firstgen/lists"}