An open API service indexing awesome lists of open source software.

0 "http-requests" Awesome Lists

awesome-web-scraping

A list of libraries, tools, and APIs for web scraping and data processing. Find everything you need for extracting, managing, and processing data from the web, from HTTP libraries to browser automation tools and proxy services.

crawling data data-collection frameworks golang guides http-requests java javascript perl

9 stars
3 forks
46 projects

Last updated: 24 Dec 2025

Search
Keywords
awesome-list 3,912 awesome 3,562 awesome-lists 544 machine-learning 444 list 419 deep-learning 374 resources 324 ai 255 hacktoberfest 238 python 219 lists 204 llm 198 javascript 193 security 166 programming 164 artificial-intelligence 152 blockchain 140 computer-vision 133 open-source 120 nlp 119 tools 115 large-language-models 113 data-science 111 react 107 chatgpt 100 android 92 curated-list 88 natural-language-processing 87 linux 85 learning 84 devops 81 css 79 awesome-readme 79 papers 76 ethereum 75 awesome-resources 75 ios 75 reinforcement-learning 72 cybersecurity 70 computer-science 65 rust 63 nodejs 63 kubernetes 63 robotics 60 playground 60 collection 60 design 59 game-development 59 free-resources 59 free 57 macos 57 getvm 57 java 56 golang 55 frontend 54 openai 54 tutorials 54 survey 53 privacy 53 tutorial 52 bitcoin 52 datasets 51 developer-tools 51 hacking 50 web 50 llms 49 go 49 web3 49 paper 48 data 48 cloud 47 php 46 dataset 46 education 46 hands-on 45 swift 45 development 45 labex 45 github 44 html 44 deep-neural-networks 44 gpt 44 books 44 cryptocurrency 43 security-tools 42 generative-ai 41 automation 41 data-visualization 41 exercises 41 vue 40 database 39 web-development 39 opensource 39 typescript 39 algorithms 38 research 38 gamedev 38 docker 38 documentation 38 software 37 collections 37 ml 37 mcp 35 iot 35 agent 35 neural-network 34 paper-list 34 testing 33 courses 33 reactjs 33 framework 33 diffusion-models 33 aws 33 cpp 32 api 32 productivity 32 game 31 projects 30 hardware 30 multimodal 30 software-engineering 30 community 30 graph-neural-networks 30 solidity 30 ai-agents 30 transformer 30 dotnet 29 prompt-engineering 29 flutter 29 ruby 29 games 28 video 28 defi 28 libraries 28 csharp 28 architecture 28 smart-contracts 28 bioinformatics 28 react-native 27 crypto 27 links 27 agents 27 tensorflow 27 science 26 cryptography 26 windows 26 penetration-testing 26 self-hosted 26 pytorch 25 ai-tools 25 django 25 self-supervised-learning 25 sql 25 microsoft 25 cli 25 music 25 data-analysis 25 angular 25 serverless 25 data-mining 24 coding 24 osint 24 neural-networks 24 object-detection 24 pentesting 24 slam 24 computer-graphics 24 git 24 learning-resources 23 jobs 23 awsome-list 23 r 23 markdown 23 engineering 23 best-practices 23 claude 23 3d 23 unity 23 game-engine 23 ui 23 embedded 23 roadmap 23 library 23 mobile 23 infosec 23 c 23 programming-language 22 deeplearning 22 interview 22 python3 22 mlops 22 knowledge-graph 22 mathematics 22 statistics 22 segmentation 22 nextjs 22 hacktoberfest-accepted 22 visualization 22 cloud-computing 21 website 21 audio 21 startups 21 data-structures 21 software-development 21 opendata 21 kotlin 21 free-tutorials 21 gpt-4 21 blog 21 gpt-3 21 apple 21 azure 21 reverse-engineering 21 federated-learning 21 time-series 21 autonomous-driving 21 awesomeness 21 awsome 20 graph 20 marketing 20 front-end 20 saas 20 chinese 20 blogs 20 js 20 chatbot 20 foundation-models 20 machinelearning 20 guidelines 20 apps 20 raspberry-pi 19 big-data 19 llama 19 curated 19 youtube 19 reasoning 19 bugbounty 19 startup 19 decentralized 19 networking 18 stable-diffusion 18 code 18 aigc 18 monitoring 18 transformers 18 anthropic 18 agentic-ai 18 graphql 18 optimization 18 finance 18 bash 18 backend 18 representation-learning 18 image-generation 17 knowledge 17 cheatsheet 17 open-data 17 analytics 17 prompt 17 seo 17 containers 17 beginner-friendly 17 generative-art 17 gemini 17 cloud-native 17 language 16 devsecops 16 webgl 16 data-engineering 16 bert 16 algorithm 16 articles 16 vscode 16 text-to-image 16 microservices 16 claude-code 16 deepseek 16 autonomous-vehicles 16 image-processing 16 animation 15 pentest 15 prompts 15 detection 15 malware-analysis 15 graphics 15 readme 15 mysql 15 laravel 15 plugins 15 p2p 15 selfhosted 15 mcp-server 15 generative-model 15 cms 15 technology 15 terminal 15 resource 15 evm 15 dart 15 nerf 15 command-line 15 android-development 15 ros 15 mac 14 videos 14 vuejs 14 code-generation 14 databases 14 wasm 14 webassembly 14 awesome-ai 14 language-model 14 oss 14 icons 14 large-language-model 14 generative-adversarial-network 14 anomaly-detection 14 multimodal-deep-learning 14 performance 14 telegram 14 diffusion 14 vlm 14 rag 14 node 14 embodied-ai 14 remote-sensing 14 react-components 14 foss 14 benchmark 14 leetcode 14 art 14 vibe-coding 14 distributed-systems 14 android-library 14 recommender-system 14 wordpress 13 search 13 interview-questions 13 podcast 13 deep-reinforcement-learning 13 quantum-computing 13 npm 13 video-generation 13 svelte 13 transfer-learning 13 microservice 13 cross-platform 13 gis 13 fuzzing 13 unicorns 13 multimodal-large-language-models 13 vision-language-model 13 frameworks 13 application 13 developer 13 speech-recognition 13 webdevelopment 13 dotnet-core 13 pose-estimation 13 pwa 13 gan 13 postgresql 13 swiftui 13 article 12 google 12 infrastructure-as-code 12 discord 12 time-series-analysis 12 automl 12 programming-languages 12 image 12 ui-design 12 datascience 12 graphics-programming 12 vision-and-language 12 medical-imaging 12 gaming 12 guide 12 multimodal-learning 12 authentication 12 search-engine 12 solana 12 web-design 12 static-site-generator 12 es6 12 storage 12 static-analysis 12 webapp 12 workflow 12 model-compression 12 chain-of-thought 12 langchain 12 mllm 12 hosting 12 sustainability 12 rails 12 model-context-protocol 12 elasticsearch 12 dapp 12 webpack 11 point-cloud 11 3d-graphics 11 design-systems 11 rl 11 font 11 ux 11 ctf 11 interpretability 11 sysadmin 11 cvpr 11 unsupervised-learning 11 ai-agent 11 cuda 11 open-science 11 planning 11 front-end-development 11 system-design 11 golang-library 11 yolo 11 free-software 11 threat-intelligence 11 rest-api 11 objective-c 11 creative-coding 11 hacktoberfest2020 11 unity3d 11 course 11 book 11 climate-change 11 question-answering 11 bookmarks 11 ecommerce 11 few-shot-learning 11 utilities 11 writing 11 anime 11 minecraft 10 cyber-security 10 blockchain-technology 10 neuroscience 10 xai 10 students 10 llmops 10 knowledge-base 10 fpga 10 webdesign 10 flutter-apps 10 movies 10 flask 10 cursor 10 semantic-segmentation 10 malware 10 email 10 drones 10 arduino 10 test-automation 10 quantization 10 hacking-tools 10 bug-bounty 10 3d-reconstruction 10 text-mining 10 templates 10 hacktoberfest2021 10 management 10 sre 10 augmented-reality 10 classification 10 reading-list 10 in-context-learning 10 healthcare 10 machine-learning-algorithms 10 vr 10 ionic 10 chatgpt-api 10 webcomponents 10 semantic-web 10 podcasts 10 software-architecture 10 privacy-tools 10 bot 10 infrastructure 10 meta-learning 10 qwen 10 jupyter-notebook 10 edge-computing 10 ai-art 10 cv 10 android-application 10 docs 10 android-app 10 ide 10 haskell 10 redis 10 ansible 10 cicd 10 geospatial 10 social-network 10 applications 10 mcp-servers 10 speech-processing 10