https://github.com/shubhamv108/web-crawler-inverted-index
https://github.com/shubhamv108/web-crawler-inverted-index
inverted-index java web-crawler
Last synced: 7 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/shubhamv108/web-crawler-inverted-index
- Owner: shubhamv108
- Created: 2021-10-13T11:14:32.000Z (almost 4 years ago)
- Default Branch: master
- Last Pushed: 2021-10-13T14:46:44.000Z (almost 4 years ago)
- Last Synced: 2025-01-29T22:44:46.747Z (8 months ago)
- Topics: inverted-index, java, web-crawler
- Language: Java
- Homepage:
- Size: 226 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
L Searcher
Given a set of urls in a text file, implement a program which should take a set of keywords as input and output the urls in which the keywords exists.
Note: Max depth level for searching href links inside the URL content is 1.
#### Problem Statement
Sample Input:
String to search: fkie multimaster
Sample Output:
https://userdocs.rapyuta.io/5_deep-dives/53_networking-and-communication/535_ros-network-native/
String to search: RoboEarth
Sample Output:
https://userdocs.rapyuta.io/1_understanding-rio/11_introduction-to-rapyuta-io/
Urls to be searched:
https://userdocs.rapyuta.io/1_understanding-rio/11_introduction-to-rapyuta-io/
https://userdocs.rapyuta.io/1_understanding-rio/12_core-concepts/
https://userdocs.rapyuta.io/1_understanding-rio/13_use-cases/
https://userdocs.rapyuta.io/2_getting-started/21_setting-up-your-rapyuta-io-account/
https://userdocs.rapyuta.io/2_getting-started/22_ros-101/
https://userdocs.rapyuta.io/2_getting-started/23_turtlesim_on_cloud/
https://userdocs.rapyuta.io/2_getting-started/24_what-next/
https://userdocs.rapyuta.io/how-to-guides/account-management/managing-projects
https://userdocs.rapyuta.io/how-to-guides/account-management/managing-users
https://userdocs.rapyuta.io/how-to-guides/account-management/setup-private-git-access
https://userdocs.rapyuta.io/how-to-guides/account-management/setup-private-docker-registry
https://userdocs.rapyuta.io/3_how-tos/32_device-management/321_onboarding-a-device/
https://userdocs.rapyuta.io/3_how-tos/32_device-management/323_managing-labels-on-devices/
https://userdocs.rapyuta.io/3_how-tos/32_device-management/324_applying-configuration-on-devices/
https://userdocs.rapyuta.io/3_how-tos/33_software-development/331_create-builds/
https://userdocs.rapyuta.io/3_how-tos/33_software-development/333_create-packages/
https://userdocs.rapyuta.io/3_how-tos/33_software-development/334_deploy-packages/
https://userdocs.rapyuta.io/3_how-tos/33_software-development/335_adding-persistent-storage-to-a-deployment/
https://userdocs.rapyuta.io/3_how-tos/34_networking-and-communication/ros-creating-routed-networks/
https://userdocs.rapyuta.io/3_how-tos/34_networking-and-communication/342_exposing-cloud-services-using-endpoints/
https://userdocs.rapyuta.io/3_how-tos/34_networking-and-communication/343_creating-custom-urls-for-external-endpoints-using-static-routes/
https://userdocs.rapyuta.io/3_how-tos/34_networking-and-communication/344_exposing-tcp-services-internally-using-endpoints/
https://userdocs.rapyuta.io/3_how-tos/35_tooling_and_debugging/remote-ssh-devices/
https://userdocs.rapyuta.io/3_how-tos/35_tooling_and_debugging/file-management-devices/
https://userdocs.rapyuta.io/3_how-tos/35_tooling_and_debugging/debugging-logs/
https://userdocs.rapyuta.io/3_how-tos/35_tooling_and_debugging/working-with-rosbags/
https://userdocs.rapyuta.io/3_how-tos/35_tooling_and_debugging/rapyuta-io-python-sdk/
https://userdocs.rapyuta.io/3_how-tos/35_tooling_and_debugging/358_metric_visualization/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/411_ros-pub-sub/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/412_basic-web-app/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/413_dynamic-configurations/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/414_hardware-interfacing/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/415_preinstalled-runtime/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/417_preparing-a-raspberry-pi/
https://userdocs.rapyuta.io/4_tutorials/41_beginner/418_ros-pub-sub-native-network/
https://userdocs.rapyuta.io/4_tutorials/42_advanced/421_basic-simulation/
https://userdocs.rapyuta.io/4_tutorials/42_advanced/421_ros-pub-sub-with-sdk/
https://userdocs.rapyuta.io/4_tutorials/42_advanced/dependency-composition/
https://userdocs.rapyuta.io/4_tutorials/42_advanced/local-communication/
https://userdocs.rapyuta.io/4_tutorials/42_advanced/separate-navigation-simulation/
https://userdocs.rapyuta.io/5_deep-dives/51_managing-devices/511_device-runtime/
https://userdocs.rapyuta.io/5_deep-dives/51_managing-devices/512_device-details/
https://userdocs.rapyuta.io/5_deep-dives/51_managing-devices/513_device-config-variables/
https://userdocs.rapyuta.io/5_deep-dives/51_managing-devices/514_device-env-variables/
https://userdocs.rapyuta.io/5_deep-dives/51_managing-devices/device-manager-architecture/
https://userdocs.rapyuta.io/5_deep-dives/51_managing-devices/dynamic-configuration/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/522_trigger-and-rollback-builds/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/523_ros-support-for-builds/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/524_package-catalog/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/525_package-internals/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/526_package-ros-support/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/527_build-recipe/
https://userdocs.rapyuta.io/5_deep-dives/52_software-development/528_deployment-phase/
https://userdocs.rapyuta.io/5_deep-dives/53_networking-and-communication/531_ros-network-routed/
https://userdocs.rapyuta.io/5_deep-dives/53_networking-and-communication/532_standard-web-protocol/
https://userdocs.rapyuta.io/5_deep-dives/53_networking-and-communication/534_ros-communication/
https://userdocs.rapyuta.io/5_deep-dives/53_networking-and-communication/535_ros-network-native/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/541_logs/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/542_rosbag-collection/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/543_upload-files-from-device/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/544_system-metrics/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/545_qos_guarentee/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/546_metrics-ros-topics/
https://userdocs.rapyuta.io/5_deep-dives/54_tooling-and-debugging/547_simulation/
https://userdocs.rapyuta.io/5_deep-dives/58_account-management/581_plans-and-billing/
https://userdocs.rapyuta.io/5_deep-dives/58_account-management/understanding-usage/
https://userdocs.rapyuta.io/5_deep-dives/58_account-management/583_pricing-calculation/
https://userdocs.rapyuta.io/5_deep-dives/58_account-management/fair-policy/
https://userdocs.rapyuta.io/6_troubleshoot/610_device-onboarding-failure-codes/
https://userdocs.rapyuta.io/6_troubleshoot/611_deployment-error-codes/
https://userdocs.rapyuta.io/6_troubleshoot/612_reonboarding-devices/
https://userdocs.rapyuta.io/7_faq/72_development/
https://userdocs.rapyuta.io/7_faq/74_tooling-and-debugging/
https://userdocs.rapyuta.io/7_faq/76_account-management/
https://userdocs.rapyuta.io/8_release-updates/2019/april/
https://userdocs.rapyuta.io/8_release-updates/2019/august/
https://userdocs.rapyuta.io/8_release-updates/2019/december/
https://userdocs.rapyuta.io/8_release-updates/2019/february/
https://userdocs.rapyuta.io/8_release-updates/2019/january/
https://userdocs.rapyuta.io/8_release-updates/2019/july/
https://userdocs.rapyuta.io/8_release-updates/2019/june/
https://userdocs.rapyuta.io/8_release-updates/2019/march/
https://userdocs.rapyuta.io/8_release-updates/2019/may/
https://userdocs.rapyuta.io/8_release-updates/2019/november/
https://userdocs.rapyuta.io/8_release-updates/2019/october/
https://userdocs.rapyuta.io/8_release-updates/2019/september/
https://userdocs.rapyuta.io/8_release-updates/2020/april/
https://userdocs.rapyuta.io/8_release-updates/2020/august/
https://userdocs.rapyuta.io/8_release-updates/2020/december/
https://userdocs.rapyuta.io/8_release-updates/2020/february/
https://userdocs.rapyuta.io/8_release-updates/2020/january/
https://userdocs.rapyuta.io/8_release-updates/2020/july/
https://userdocs.rapyuta.io/8_release-updates/2020/june/
https://userdocs.rapyuta.io/8_release-updates/2020/march/
https://userdocs.rapyuta.io/8_release-updates/2020/may/
https://userdocs.rapyuta.io/8_release-updates/2020/november/
https://userdocs.rapyuta.io/8_release-updates/2020/october/
https://userdocs.rapyuta.io/8_release-updates/2020/september/
https://userdocs.rapyuta.io/8_release-updates/2021/february/
https://userdocs.rapyuta.io/8_release-updates/2021/january/
https://userdocs.rapyuta.io/8_release-updates/2021/march/
https://userdocs.rapyuta.io/search
//
Case insensitive