{"id":40159122,"url":"https://github.com/labster/taparip","last_synced_at":"2026-01-19T16:01:41.158Z","repository":{"id":61148570,"uuid":"99189325","full_name":"labster/taparip","owner":"labster","description":"Rip threads from a Tapatalk forum into a Sqlite3 database","archived":false,"fork":false,"pushed_at":"2025-07-24T04:00:00.000Z","size":51,"stargazers_count":13,"open_issues_count":0,"forks_count":3,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-07-24T07:41:48.116Z","etag":null,"topics":["forum","phpbb","rip","tapatalk","yuku"],"latest_commit_sha":null,"homepage":null,"language":"Perl","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/labster.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2017-08-03T04:05:32.000Z","updated_at":"2025-07-24T04:58:05.000Z","dependencies_parsed_at":"2025-07-24T06:04:28.428Z","dependency_job_id":"7fd5e6c0-074b-4c13-99f0-7df214d878cb","html_url":"https://github.com/labster/taparip","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/labster/taparip","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/labster%2Ftaparip","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/labster%2Ftaparip/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/labster%2Ftaparip/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/labster%2Ftaparip/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/labster","download_url":"https://codeload.github.com/labster/taparip/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/labster%2Ftaparip/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28573281,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-19T15:45:05.669Z","status":"ssl_error","status_checked_at":"2026-01-19T15:44:23.317Z","response_time":67,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["forum","phpbb","rip","tapatalk","yuku"],"created_at":"2026-01-19T16:01:41.017Z","updated_at":"2026-01-19T16:01:41.150Z","avatar_url":"https://github.com/labster.png","language":"Perl","funding_links":[],"categories":[],"sub_categories":[],"readme":"# taparip\nRip threads from a Tapatalk forum into a Sqlite3 database\n\n## What is this, then\n\nTapatalk recently* took over Yuku, which, while it had it's problems,\nstill looked like a proper PHPBB host.  Then came Tapatalk, with its\npromises of being mobile friendly, which of course means \"modern UX\nwith MOAR WHITESPACE and gray-on-gray\", hiding tons of details from\nusers, 33 external stylesheets, 18 external JS files, and 5 tons of\nflax.\n\nIf you feel like moving on from such amazing software, you are (not)\nalone.  This is a way to extract the HTML content of each forum post\ninto a Sqlite database.  Each post's content, sig, and metadata are\nstored separately, on the assumption that you're going to do something\nto move it into another forum.  It might be on different software, but\nat least you have a DB to keep it organized, right?\n\nOr are you just put off by the constant stream of 503s and 99 luftbaloon\nerror messages?  Do you want a backup of your forum in case it hits the\nfan yet again?  This software also for you.\n\n\\* for certain values of \"recent\".  The appear to be eating other forum\nsoftware companies because it's a low margin industry.\n\n## Requirements\n* Perl 5.18 or higher.  (I grudgingly removed postfix dereferencing, but really there's no excuse being more than 5 versions behind, Apple.)  But also consider [Perlbrew](https://perlbrew.pl/) to get a new version, which can also build cpanm easily.\n* [Sqlite 3](http://sqlite.org/download.html) is probably already installed on your system if you're considering this\n* A few perl modules from CPAN.  If you have `cpanm` installed, just do: `cpanm Mojo::UserAgent Carp DBI Date::Manip`.  Seriously Mojolicious' Mojo::DOM is great, I learned a lot from this project.\n* A sense of wonder and adventure\n\n## Installation\n\n* Download this repository with the link to the left\n* Consider using something like Homebrew or Apt to install perl, cpanm, or sqlite if you need them.\n* Install modules:\n+ If you have `cpanm` installed, you can `cd` into the install directory and run:\n        cpanm --installdeps .\n+ If you just have cpan, most likely you can run the `cpan` interactive shell and\n        install Mojo::UserAgent\n        install Carp\n        install DBD::SQLite\n        install Date::Manip\n\n\n## Configuration\n\nRead the first part of the file `taparip.pl`.  You'll need to specify\nthe URL of your site, where you want to save your database, what thread\nids you want to download, as a list or range.  There's some more stuff,\nbut it's documented in the file.\n\nIf you're having trouble generating the schema file, you may have luck\ndoing:\n         sqlite3 --init schema.sql\nBut this should happen automatically in most versions.\n\n## Execution\n\n`perl taparip.pl`\n\nWill download and rip from the forum based on the configuration you\nprovided above, and fill the data into the database.\nMany painless, much simple wow.\n\n`perl taparip.pl thread1.html thread2.html ...`\n\nInstead of downloading, this will just extract the data from files\nyou've already downloaded.  If someone has already ripped the forum\nwith other software, this is probably the way to go.\n\n## What's ripped, what's not\n\nThis only grabs textual content of threads, along with its sigs.  It's\nin HTML format, not PHPBB format.  Anything that's metadata about the\nposts or threads gets saved -- post time, number of times edited, author,\nthread, forum, etc.\n\nImages and avatars are not downloaded.  While each thread gets a forum ID,\nit does not save the names of forums.  Nor does it gather thread-level\ninformation like last edited/posted, but hey, you can calculate that\nyourself from the post data.  That's why I gave you the data in an RDBMS.\n\n## Is this 100% legal?\n\nWell... OK, the Tapatalk ToS say that you are not allowed to harvest or\nscrape data from their website for any purpose not expressly allowed by them.\nThey then state that you are solely responsible for backing up data, and\nWE ARE ALLCAPS TOTES INDEMNIFIED IF WE LOSE ANYTHING BECAUSE\nIT'S ALL UP TO YOU.\nAnyway IANAL so this is not legal advice but it sounds\nto me like they are expressly allowing it for backup purposes.  Also it's not\nlike they have a robots.txt that matches what their ToS says.  Also also\ndid you agree to these terms when you signed up for Yuku?  Probably not.\n(Terms of Service: They make me violate them, no matter who they are.)\n\n## Author\n\nBrent Laabs \u003cbslaabs@gmail.com\u003e\n\n## License\n\nMIT License\n\n## Terms of Service\n\nBy using taparip, hereafter \"the software\", you agree to eat one (1) cookie.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flabster%2Ftaparip","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Flabster%2Ftaparip","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Flabster%2Ftaparip/lists"}