https://github.com/jeamon/gofetching
Go source code to demonstrate three techniques for concurrent fetching of multiple urls over http.
https://github.com/jeamon/gofetching
concurrency concurrent-programming go golang goroutines http-client http-requests mutlithreading worker-pool
Last synced: 10 months ago
JSON representation
Go source code to demonstrate three techniques for concurrent fetching of multiple urls over http.
- Host: GitHub
- URL: https://github.com/jeamon/gofetching
- Owner: jeamon
- License: mit
- Created: 2021-10-26T20:32:31.000Z (about 4 years ago)
- Default Branch: master
- Last Pushed: 2023-10-14T19:32:15.000Z (about 2 years ago)
- Last Synced: 2025-01-17T23:17:27.006Z (12 months ago)
- Topics: concurrency, concurrent-programming, go, golang, goroutines, http-client, http-requests, mutlithreading, worker-pool
- Language: Go
- Homepage:
- Size: 12.7 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# go-concurrent-urls-fetching
A go-based repository to demonstrate multiple techniques to concurrently fetch multiple url over http.
## Outputs
* **Below is the program execution output**
```
~$ go run main.go
https://twitter.com : 200 OK
https://google.com : 200 OK
https://microsoft.com : 200 OK
https://cisco.com : 200 OK
https://amazon.com : 200 OK
https://facebook.com : 200 OK
https://google.com : 200 OK
https://twitter.com : 200 OK
https://microsoft.com : 200 OK
https://facebook.com : 200 OK
https://amazon.com : 200 OK
https://cisco.com : 200 OK
https://twitter.com : 200 OK
https://google.com : 200 OK
https://amazon.com : 200 OK
https://facebook.com : 200 OK
https://microsoft.com : 200 OK
https://cisco.com : 200 OK
worker 1 :: https://google.com : 200 OK
worker 0 :: https://microsoft.com : 200 OK
worker 3 :: https://facebook.com : 200 OK
worker 1 :: https://amazon.com : 200 OK
worker 0 :: https://twitter.com : 200 OK
worker 2 :: https://cisco.com : 200 OK
```
* **Below is the tests execution output**
```
:~$ go test -cover -failfast -v
=== RUN TestFetch_Valid
--- PASS: TestFetch_Valid (0.01s)
=== RUN TestFetch_Invalid
--- PASS: TestFetch_Invalid (0.00s)
=== RUN TestFetch_Timeout
--- PASS: TestFetch_Timeout (6.02s)
=== RUN TestFetch_Error
--- PASS: TestFetch_Error (0.00s)
=== RUN TestFetch_EndToEnd
=== RUN TestFetch_EndToEnd/testing_status_200
=== RUN TestFetch_EndToEnd/testing_status_400
=== RUN TestFetch_EndToEnd/testing_status_401
=== RUN TestFetch_EndToEnd/testing_status_404
=== RUN TestFetch_EndToEnd/testing_status_503
=== RUN TestFetch_EndToEnd/testing_status_n/a
--- PASS: TestFetch_EndToEnd (2.53s)
--- PASS: TestFetch_EndToEnd/testing_status_200 (0.70s)
--- PASS: TestFetch_EndToEnd/testing_status_400 (0.38s)
--- PASS: TestFetch_EndToEnd/testing_status_401 (0.34s)
--- PASS: TestFetch_EndToEnd/testing_status_404 (0.32s)
--- PASS: TestFetch_EndToEnd/testing_status_503 (0.31s)
--- PASS: TestFetch_EndToEnd/testing_status_n/a (0.47s)
=== RUN ExampleFirstWorker
--- PASS: ExampleFirstWorker (1.82s)
=== RUN ExampleSecondWorker
--- PASS: ExampleSecondWorker (1.08s)
=== RUN ExampleThirdWorker
--- PASS: ExampleThirdWorker (1.02s)
=== RUN ExampleFourthWorker
--- PASS: ExampleFourthWorker (1.04s)
PASS
coverage: 85.5% of statements
ok github.com/jeamon/gofetching 13.692s
```
## License
Please check & read [the license details](https://github.com/jeamon/gofetching/blob/master/LICENSE)
## Contact
Feel free to [reach out to me](https://blog.cloudmentor-scale.com/contact) before any action.