{"id":19422837,"url":"https://github.com/kwaikeg/kuaipedia","last_synced_at":"2026-02-03T06:35:37.232Z","repository":{"id":62988646,"uuid":"561204403","full_name":"KwaiKEG/Kuaipedia","owner":"KwaiKEG","description":"the world's first large-scale multi-modal short-video encyclopedia,  where the primitive units are items, aspects, and short videos.","archived":false,"fork":false,"pushed_at":"2023-11-28T03:36:19.000Z","size":2090,"stargazers_count":62,"open_issues_count":0,"forks_count":3,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-07-21T00:42:09.105Z","etag":null,"topics":["ai","encyclopedia","knowledge","knowledge-graph","knowledgebase","multimodal","video","wikipedia"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/KwaiKEG.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-11-03T07:17:42.000Z","updated_at":"2025-07-02T01:33:03.000Z","dependencies_parsed_at":"2024-11-10T13:35:58.267Z","dependency_job_id":"5c1c0ad4-b1ac-4b7c-b72e-8b7b83be4f8c","html_url":"https://github.com/KwaiKEG/Kuaipedia","commit_stats":null,"previous_names":["kwaikeg/kuaipedia"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/KwaiKEG/Kuaipedia","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KwaiKEG%2FKuaipedia","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KwaiKEG%2FKuaipedia/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KwaiKEG%2FKuaipedia/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KwaiKEG%2FKuaipedia/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/KwaiKEG","download_url":"https://codeload.github.com/KwaiKEG/Kuaipedia/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KwaiKEG%2FKuaipedia/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29035755,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-03T06:11:29.234Z","status":"ssl_error","status_checked_at":"2026-02-03T06:11:03.146Z","response_time":96,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","encyclopedia","knowledge","knowledge-graph","knowledgebase","multimodal","video","wikipedia"],"created_at":"2024-11-10T13:35:28.465Z","updated_at":"2026-02-03T06:35:37.207Z","avatar_url":"https://github.com/KwaiKEG.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cp align=\"center\"\u003e\n\u003cimg width=\"256px\" src=\"./images/logo.jpeg\"/\u003e\n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n🤗 \u003ca href=\"https://huggingface.co/datasets/kwaikeg/kuaipedia\" target=\"_blank\"\u003eDataset\u003c/a\u003e • 📃 \u003ca href=\"https://arxiv.org/abs/2211.00732\" target=\"_blank\"\u003ePaper\u003c/a\u003e\n\u003c/p\u003e\n\u003chr/\u003e\n\n**Kuaipedia** is developed by Knowledge Engineering Group in Kuaishou [(KwaiKEG)](https://github.com/KwaiKEG), collaborating with HIT and HKUST. It is the world's first large-scale multi-modal short-video encyclopedia where the primitive units are items, aspects, and short videos. \n\n![demo](./images/demo-case.gif)\n\n* **Items** is a set of entities and concepts, such as [Shiba Inu](https://en.wikipedia.org/wiki/Shiba_Inu), [Moon](https://en.wikipedia.org/wiki/Moon) and [Galileo Galilei](https://en.wikipedia.org/wiki/Galileo_Galilei), which can be edited at one Wikipedia page. An item may have a title, a subtitle, a summary, attributes, and other detailed information of the item.\n* **Aspects** is a set of keywords or keyphrases attached to items. Those keywords are used to describe specific aspects of the item. For example, \"selection\", \"food-protecting\", \"color\" of item [Shiba Inu](https://en.wikipedia.org/wiki/Shiba_Inu), or \"formation\", \"surface conditions\", \"how-to-draw\" of item [Moon](https://en.wikipedia.org/wiki/Moon).\n* **Videos** is a set of short-videos whose duration may not exceed 5 minutes. In this paper, we only focus on knowledge videos we detected, Where we follow OECD to define knowledge as:\n    * *Know-what* refers to knowledge about facts. E.g. How many people live in New York? \n    * *Know-why* refers to scientific knowledge of the principles and laws of nature. E.g. Why does the earth revolve around the sun?\n    * *Know-how* refers to skills or the capability to do something. E.g. How to cook bacon in the oven.\n\nPlease refer to the paper for more details.\n\nKuaipedia: a Large-scale Multi-modal Short-video Encyclopedia [[Manuscript]](https://arxiv.org/abs/2211.00732)\n\n\n## News\n* 2023.06 - Release a subset of [[data]](#data)\n* 2022.11 - 业界首个！快手提出亿级别多模态短视频百科体系快知 (The first! Kuaishou proposed a large-scale multi-modal short-video encyclopedia \"Kuaipeida\") [[机器之心]](https://mp.weixin.qq.com/s/_ngcmULg9-FwZER-Jlljvg)[[澎湃]](https://www.thepaper.cn/newsDetail_forward_20618591) [[知乎]](https://zhuanlan.zhihu.com/p/580890046) [[CSDN]](https://www.csdn.net/article/2022-11-07/127733976)[[51CTO]](https://www.51cto.com/article/722206.html) [[IT之家]](https://www.ithome.com/0/651/810.htm)\n* 2022.08 - Obtain **\"Outstanding Project Award\"** in Kuaishou AI Day. \n\n## Data\n\nWe are excited to release a subset of Kuaipedia, featuring the most popular wiki entries for enhanced research opportunities. Along with this, we've also shared our experimental findings. Sample files can be located in the `./data` folder, accompanied by a `README.md` file to clarify each field.\n\nTo download the full subset and experimental results of Kuaipedia, please go ahead to [huggingface/dataset/kuaipedia](https://huggingface.co/datasets/kwaikeg/kuaipedia), or use the following link: \n\n\u003e link: https://pan.baidu.com/s/1yUB97aL2rBVt-Q0c6sYIcw code: kwyw\n\nThe raw video can be found by concatenating `video_id` with the prefix `kuaishou.com/short-video`.  E.g. [kuaishou.com/short-video/3xwwuqndapzs6nu](https://www.kuaishou.com/short-video/3xwwuqndapzs6nu).\n\nIf you're experiencing any issues with downloading the data file, please don't hesitate to reach out to myscarletpan@gmail.com for assistance.\n\n**Statistics**\n\n|            | Full Dump       | Subset Dump |\n|------------|-----------------|-------------|\n| #Items     | \u003e 26 million    | 51,702      |\n| #Aspects   | \u003e 2.5 million   | 1,074,539   |\n| #Videos    | \u003e 200 million   | 769,096     |\n\nThe comparative results with the baseline models are as follows:\n \n|  Model   | Item P  | Item R | Item-Aspect P | Item-Aspect R | \n|  ----  | ----  |  ----  |  ----  |  ----  | \n| Random  | 87.7 | 49.8 | 36.4 | 49.6 | \n| LR  | 90.4 | 68.3 | 55.1 | 2.7 | \n| T5-small  | 93.7 | 76.1 | 79.3 | 58.5 | \n| BERT-base  | 94.3 | 77.8 | 81.5 | 62.7 | \n| GPT-3.5  | 90.5 | 86.4 | 41.8 | 95.7 | \n| Ours  | 94.7 | 79.7 | 83.0 | 65.7 | \n\nFeel free to explore and utilize this valuable dataset for your research and projects.\n\n## Reference\n```\n@article{Kuaipedia22,\n  author    = {Haojie Pan and\n               Yuzhou Zhang and\n               Zepeng Zhai and\n               Ruiji Fu and\n               Ming Liu and\n               Yangqiu Song and\n               Zhongyuan Wang and\n               Bing Qin\n               },\n  title     = {{Kuaipedia:} a Large-scale Multi-modal Short-video Encyclopedia},\n  journal   = {CoRR},\n  volume    = {abs/2211.00732},\n  year      = {2022}\n}\n```\n\n\n## Acknowledgment\n\nExcept for the contributers to the paper. We also appreciate efforts and helps from Jingrun Zhang, Yuelei Li, Lijun Mei, Chunguang Pan, Xing Hu, Lingyu Zou, Yang Li, Dexing Yang, Wenzheng Zhao, Guixin Qiu, Lin Yang, Meijuan Yang, Teng Tu, Xinyi Zheng, Yunhui Guo and others who contributes to this project.\n\n## Contact Us\n\nIf you are insterested in Kuaipedia and more cases, please contact us by e-mail myscarletpan@gmail.com\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkwaikeg%2Fkuaipedia","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkwaikeg%2Fkuaipedia","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkwaikeg%2Fkuaipedia/lists"}