https://github.com/RUCAIBox/MVP

This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.
https://github.com/RUCAIBox/MVP

data-to-text dialog multi-task-learning natural-language-generation natural-language-processing nlg nlp plm pre-trained-model question-answering question-generation seq2seq sequence-to-sequence story-generation summarization text-generation

Last synced: about 1 month ago
JSON representation

This repository is the official implementation of our paper MVP: Multi-task Supervised Pre-training for Natural Language Generation.

• Host: GitHub
• URL: https://github.com/RUCAIBox/MVP
• Owner: RUCAIBox
• License: apache-2.0
• Created: 2022-06-03T03:26:32.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2022-11-01T12:48:44.000Z (about 2 years ago)
• Last Synced: 2024-08-03T09:07:05.509Z (5 months ago)
• Topics: data-to-text, dialog, multi-task-learning, natural-language-generation, natural-language-processing, nlg, nlp, plm, pre-trained-model, question-answering, question-generation, seq2seq, sequence-to-sequence, story-generation, summarization, text-generation
• Homepage:
• Size: 77.6 MB
• Stars: 68
• Watchers: 8
• Forks: 3
• Open Issues: 0

Awesome Lists containing this project

• StarryDivineSky - RUCAIBox/MVP - 解码器架构。使用标记数据集进行监督预训练。还具有特定于任务的软提示，以刺激模型执行特定任务的能力。专为自然语言生成而设计，可以适应各种生成任务。我们的模型也可以适应自然语言理解任务。收集了7种代表性生成任务的45个有标签数据集，共计3200千万条样本（23GB），来作为预训练语料。第一阶段，使用这些语料训练一个标准的Transformer，即MVP；第二阶段，冻结住MVP，利用每个任务的数据训练任务特定的连续型提示（即7组提示）。 (A01_文本生成_文本对话 / 其他_文本生成_文本对话)