https://github.com/tr-reny/mapreduce_wikipedia

A MapReduce-based approach to compute relative frequencies of each word that occurs in 100,000 Wikipedia documents, output the top 100-word pairs sorted in a decreasing order of relative frequency.
https://github.com/tr-reny/mapreduce_wikipedia

Last synced: about 2 months ago
JSON representation

A MapReduce-based approach to compute relative frequencies of each word that occurs in 100,000 Wikipedia documents, output the top 100-word pairs sorted in a decreasing order of relative frequency.

• Host: GitHub
• URL: https://github.com/tr-reny/mapreduce_wikipedia
• Owner: Tr-reny
• Created: 2022-11-21T19:48:58.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2022-11-27T21:40:45.000Z (almost 3 years ago)
• Last Synced: 2025-01-19T10:31:31.072Z (9 months ago)
• Language: Java
• Homepage:
• Size: 40 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          


MapReduce_Wikipedia





   📄 🚀





  

   Description

  





The goal of the project is to Explored a set of 100,000 Wikipedia documents: [100KWikiText.txt](https://web.njit.edu/~chasewu/Courses/Spring2022/CS644BigData/HW/100KWikiText.txt), in which each line consists of the plain text extracted from an individual Wikipedia document