{"id":13639079,"url":"https://github.com/XiaoMi/MiLM-6B","last_synced_at":"2025-04-19T21:35:30.802Z","repository":{"id":185556974,"uuid":"673701787","full_name":"XiaoMi/MiLM-6B","owner":"XiaoMi","description":null,"archived":false,"fork":false,"pushed_at":"2023-08-09T13:20:40.000Z","size":12,"stargazers_count":433,"open_issues_count":22,"forks_count":15,"subscribers_count":16,"default_branch":"main","last_synced_at":"2024-11-06T04:10:02.120Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/XiaoMi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2023-08-02T08:24:12.000Z","updated_at":"2024-10-30T03:49:00.000Z","dependencies_parsed_at":null,"dependency_job_id":"2ebabaaa-ece4-417f-a499-4b8f3453af02","html_url":"https://github.com/XiaoMi/MiLM-6B","commit_stats":null,"previous_names":["xiaomi/milm-6b"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/XiaoMi%2FMiLM-6B","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/XiaoMi%2FMiLM-6B/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/XiaoMi%2FMiLM-6B/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/XiaoMi%2FMiLM-6B/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/XiaoMi","download_url":"https://codeload.github.com/XiaoMi/MiLM-6B/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223810256,"owners_count":17206722,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-08-02T01:00:57.424Z","updated_at":"2024-11-09T09:30:33.912Z","avatar_url":"https://github.com/XiaoMi.png","language":null,"funding_links":[],"categories":["预训练模型","Summary"],"sub_categories":[],"readme":"# MiLM-6B\n\n## 介绍\n\nMiLM-6B 是由小米开发的一个大规模预训练语言模型，参数规模为64亿。在 C-Eval 和 CMMLU 上均取得同尺寸最好的效果。\n\n模型相关信息持续更新中...\n\n\n## 评测结果\n\n### C-Eval\n\n\n[C-Eval 数据集](https://cevalbenchmark.com/index.html)是一个全面的中文基础模型评测数据集，涵盖了 52 个学科和四个难度的级别。\n\n\n|            模型             |  Average  |  STEM     | Social Sciences | Humanities      | Others     | Avg(Hard) |\n| :-------------------------: | :-------: | :-------: | :-------------: | :-------------: | :--------: | :-------: |\n|        MiLM-6B              |  **60.2** |  **54.5** |  **71.7**       |    **62.7**     |   **57.7** |  **42.0** |\n|        MiLM-1.3B            |  **45.8** |  **38.0** |  **59.5**       |    **49.8**     |   **43.4** |  **29.9** |\n\n\u003e 测试采用zero-shot\n\n### CMMLU\n\n\n[CMMLU 数据集](https://github.com/haonan-li/CMMLU/)是一个综合性的中文评估基准，专门用于评估语言模型在中文语境下的知识和推理能力。CMMLU涵盖了从基础学科到高级专业水平的67个主题。\n\n* zero-shot\n\n| 模型                 |   平均分  |   STEM    | 人文学科  | 社会科学 |   其他    | 中国特定主题 |\n| :------------------: | :-------: | :-------: | :-------: | :------: | :-------: | :----------: |\n|   MiLM-6B            | **60.37** | **48.88** | **63.49**| **66.2**  | **62.14** | **62.07**    |\n|   MiLM-1.3B          | **50.79** | **40.51** | **54.82**| **54.15** | **53.99** | **52.26**    |\n\n\n* five-shot\n\n| 模型                 |   平均分  |   STEM    | 人文学科  | 社会科学 |   其他    | 中国特定主题 |\n| :------------------: | :-------: | :-------: | :-------: | :------: | :-------: | :----------: |\n|   MiLM-6B            | **57.17** | **46.85** | **61.12**| **61.68** | **58.84** | **59.39**    |\n|   MiLM-1.3B          | **45.39** | **35.59** | **49.58**| **49.03** | **47.56** | **48.17**    |","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FXiaoMi%2FMiLM-6B","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FXiaoMi%2FMiLM-6B","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FXiaoMi%2FMiLM-6B/lists"}