{"id":25971892,"url":"https://github.com/CarperAI/autocrit","last_synced_at":"2025-03-05T00:02:18.640Z","repository":{"id":158172248,"uuid":"624885388","full_name":"CarperAI/autocrit","owner":"CarperAI","description":"A repository for transformer critique learning and generation","archived":false,"fork":false,"pushed_at":"2023-12-07T17:58:14.000Z","size":1177,"stargazers_count":88,"open_issues_count":6,"forks_count":18,"subscribers_count":5,"default_branch":"main","last_synced_at":"2025-03-01T03:23:21.243Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CarperAI.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-04-07T13:57:34.000Z","updated_at":"2024-12-29T11:39:32.000Z","dependencies_parsed_at":"2024-11-10T17:47:41.629Z","dependency_job_id":null,"html_url":"https://github.com/CarperAI/autocrit","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CarperAI%2Fautocrit","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CarperAI%2Fautocrit/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CarperAI%2Fautocrit/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CarperAI%2Fautocrit/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CarperAI","download_url":"https://codeload.github.com/CarperAI/autocrit/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":241940573,"owners_count":20045881,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-05T00:02:17.538Z","updated_at":"2025-03-05T00:02:18.613Z","avatar_url":"https://github.com/CarperAI.png","language":"Python","funding_links":[],"categories":["Code 🖥️"],"sub_categories":[],"readme":"# AutoCrit\nA repository for transformer critique learning and generation.\n\n## Scalar reward models\nTrain [OpenLLaMA-13B](https://github.com/openlm-research/open_llama) on [Helpful and Harmless dataset](https://github.com/anthropics/hh-rlhf):\n\n```bash\naccelerate launch --config_file configs/accelerate/zero2.yaml \\\n           train_reward_model.py \\\n           --model_path openlm-research/open_llama_13b \\\n           --dataset pvduy/rm_oa_hh \\\n           --batch_size 1 \\\n           --eval_interval 1000 \\\n           --lr 0.00001 \\\n           --weight_decay 0 \\\n           --num_unfrozen_layers 12 \\\n           --gradient_checkpointing \\\n           --checkpoint_dir checkpoints \\\n           --calibration_datasets reciprocate/vicuna-fair-eval\n```\n\nUsage:\n```python\nfrom transformers import AutoModelForSequenceClassification, AutoTokenizer\n\nckpt = \"reciprocate/openllama-13b_rm_oasst-hh\"\nmodel = AutoModelForSequenceClassification.from_pretrained(ckpt, load_in_4bit=True)\ntokenizer = AutoTokenizer.from_pretrained(ckpt)\n\nmodel(**tokenizer(\"ASSISTANT: This sentence is a lie.\", return_tensors=\"pt\"))[0].item()\n```\n\nOutput:\n```python\n-1.626953125\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FCarperAI%2Fautocrit","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FCarperAI%2Fautocrit","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FCarperAI%2Fautocrit/lists"}