{"id":21887783,"url":"https://github.com/arjuntheprogrammer/finetune_codellama_alpaca20k","last_synced_at":"2025-03-22T02:22:16.187Z","repository":{"id":242081090,"uuid":"808571186","full_name":"arjuntheprogrammer/finetune_codellama_alpaca20K","owner":"arjuntheprogrammer","description":null,"archived":false,"fork":false,"pushed_at":"2024-05-31T14:14:55.000Z","size":8358,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-01-26T20:29:22.506Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/arjuntheprogrammer.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-31T10:47:54.000Z","updated_at":"2024-12-18T07:50:38.000Z","dependencies_parsed_at":"2024-05-31T15:21:51.676Z","dependency_job_id":null,"html_url":"https://github.com/arjuntheprogrammer/finetune_codellama_alpaca20K","commit_stats":null,"previous_names":["arjuntheprogrammer/finetune_codellama_alpaca20k"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arjuntheprogrammer%2Ffinetune_codellama_alpaca20K","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arjuntheprogrammer%2Ffinetune_codellama_alpaca20K/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arjuntheprogrammer%2Ffinetune_codellama_alpaca20K/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/arjuntheprogrammer%2Ffinetune_codellama_alpaca20K/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/arjuntheprogrammer","download_url":"https://codeload.github.com/arjuntheprogrammer/finetune_codellama_alpaca20K/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244895078,"owners_count":20527829,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-28T11:12:31.240Z","updated_at":"2025-03-22T02:22:16.162Z","avatar_url":"https://github.com/arjuntheprogrammer.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# CODE LLAMA TRAINING\n\n- GPU TYPE: A100 80GB\n- VRAM USED: 11.6GB\n\n- Training Dataset: HuggingFaceH4/CodeAlpaca_20K\n- Dataset Link: \u003chttps://huggingface.co/datasets/HuggingFaceH4/CodeAlpaca_20K\u003e\n- Dataset Size: 20K rows (train: 18K, test: 2K)\n\n- Pretrained Model: codellama/CodeLlama-7b-hf\n- Pretrained Model Link: \u003chttps://huggingface.co/codellama/CodeLlama-7b-hf\u003e\n\n- Finetuning Training Time: 1 hour 47 mins\n\n- HF Uploaded Model: \u003chttps://huggingface.co/arjuntheprogrammer/trained-model\u003e\n- Wandb Logs Link: \u003chttps://wandb.ai/arjuntheprogrammer/huggingface/runs/dezc4vzs/overview?nw=nwuserarjuntheprogrammer\u003e\n\n\n## DATASET EXAMPLE\n\nPrompt: `Use a loop in Java to print out the squares of numbers from 1 to 10.`\n\nCompletion: `for (int i = 1; i \u003c= 10; i++) { System.out.println(i * i); }`\n\n\n## TRAINING LOGS\n\n![alt text](image.png)\n\n![alt text](image-1.png)\n\n![alt text](image-2.png)\n\n![alt text](image-3.png)\n\n---\n\n## YT RECORDING\n\n[![CodeLlama Finetuning](https://img.youtube.com/vi/s6uqbqxXXao/0.jpg)](https://youtu.be/s6uqbqxXXao)\n\n---\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farjuntheprogrammer%2Ffinetune_codellama_alpaca20k","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Farjuntheprogrammer%2Ffinetune_codellama_alpaca20k","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Farjuntheprogrammer%2Ffinetune_codellama_alpaca20k/lists"}