{"id":13636879,"url":"https://github.com/chopicalqui/TurboDataMiner","last_synced_at":"2025-04-19T08:33:32.752Z","repository":{"id":37699803,"uuid":"267864003","full_name":"chopicalqui/TurboDataMiner","owner":"chopicalqui","description":"The objective of this Burp Suite extension is the flexible and dynamic extraction, correlation, and structured presentation of information from the Burp Suite project as well as the flexible and dynamic on-the-fly modification of outgoing or incoming HTTP requests using Python scripts. Thus, Turbo Data Miner shall aid in gaining a better and faster understanding of the data collected by Burp Suite.","archived":false,"fork":false,"pushed_at":"2022-12-31T19:13:17.000Z","size":2588,"stargazers_count":56,"open_issues_count":0,"forks_count":15,"subscribers_count":3,"default_branch":"master","last_synced_at":"2024-08-02T00:23:18.435Z","etag":null,"topics":["burp","burp-api","burp-extensions","burp-plugin","burpsuite","burpsuite-extender","data-mining","intelligence","intelligence-gathering"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"gpl-3.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chopicalqui.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-05-29T13:25:10.000Z","updated_at":"2024-06-06T12:14:19.000Z","dependencies_parsed_at":"2023-01-31T19:45:59.318Z","dependency_job_id":null,"html_url":"https://github.com/chopicalqui/TurboDataMiner","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chopicalqui%2FTurboDataMiner","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chopicalqui%2FTurboDataMiner/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chopicalqui%2FTurboDataMiner/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chopicalqui%2FTurboDataMiner/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chopicalqui","download_url":"https://codeload.github.com/chopicalqui/TurboDataMiner/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223795257,"owners_count":17204136,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["burp","burp-api","burp-extensions","burp-plugin","burpsuite","burpsuite-extender","data-mining","intelligence","intelligence-gathering"],"created_at":"2024-08-02T00:01:06.830Z","updated_at":"2024-11-09T06:30:59.584Z","avatar_url":"https://github.com/chopicalqui.png","language":"Python","funding_links":[],"categories":["Misc","Python","Python (1887)"],"sub_categories":["Template Injection","SSRF"],"readme":"# Turbo Data Miner\n\nTurbo Data Miner is a [Burp Suite Extension](https://portswigger.net/bappstore/84350b8f090a4388a9d12cca141f201b), which\nadds a new tab `Turbo Miner` to Burp Suite's UI as well as a new entry `Turbo Data Miner` \nto Burp Suite's `Extensions` context menu entry. In the new tab, you are able to write new or select \nexisting Python scripts that are executed on each request/response item currently stored in the Proxy History, Side \nMap, or on each request/response item that is sent or received by Burp Suite.\n  \nThe objective of these Python scripts is the flexible and dynamic extraction, correlation, and structured \npresentation of information from the Burp Suite state as well as the flexible and dynamic on-the-fly modification \nof outgoing or incoming HTTP requests. Thus, Turbo Data Miner shall aid in gaining a better and faster understanding of \nthe data collected and processed by Burp Suite.\n\nThe following screenshot provides an example how Turbo Data Miner can be used to obtain a structured presentation of all \ncookies (and their attributes) that are stored in the current Burp Suite project. At the bottom, we select the \ncorresponding Python script in the dropdown menu (see 1), which automatically loads the selected Python script into the \nIDE text area (see 2) and there, we can customize it, if needed. Alternatively, we can create our own script by \nclicking button `New Script`. The analysis is started by clicking button `Start` (see 3). Afterwards, Turbo Data Miner \nexecutes the compiled Python script on each Request/Response item. Thereby, the script extracts cookie \ninformation from each response (see source code in 2) and adds it to the table (see 4). Finally, in the table, we \ncan sort per column to gain a better understanding of each cookie attribute or we can perform additional operations \nvia the table's context menu (see 5).\n\n![Turbo Data Miner's Proxy History Analyzer](media/example.png)\n\nAs we can see, with Python skills, an understanding of the \n[Burp Suite Extender API](https://portswigger.net/Burp/extender/api/index.html) as well as an understanding of Turbo \nMiner's API (see Turbo Data Miner tab `About` or directly the \n[HTML page](https://github.com/chopicalqui/TurboDataMiner/blob/master/turbodataminer/about.html) used by the `About` tab), \nwe can extract and structure any information available in the current Burp Suite project.\n\n# Usage\n\nRefer to [Turbo Data Miner's Wiki](https://github.com/chopicalqui/TurboDataMiner/wiki).\n\n# Author\n\n**Lukas Reiter** ([@chopicalquy](https://twitter.com/chopicalquy)) - \n[Turbo Data Miner](https://github.com/chopicalqui/TurboDataMiner)\n\n# License\n\nThis project is licensed under the GPLv3 License - see the \n[license](https://github.com/chopicalqui/TurboDataMiner/blob/master/LICENSE) file for details.","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchopicalqui%2FTurboDataMiner","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchopicalqui%2FTurboDataMiner","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchopicalqui%2FTurboDataMiner/lists"}