{"id":18429022,"url":"https://github.com/afondiel/prompt-engineering-for-vision-models-deeplearningai","last_synced_at":"2025-08-25T17:05:49.275Z","repository":{"id":250719353,"uuid":"824267398","full_name":"afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI","owner":"afondiel","description":"These notes and resources are compiled from the crash course Prompt Engineering for Vision Models offered by DeepLearning.AI.","archived":false,"fork":false,"pushed_at":"2024-08-20T15:41:00.000Z","size":108342,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-04-13T22:58:46.921Z","etag":null,"topics":["cnn","computer-vision","convnets","diffusion-models","fine-tuning","generative-models","image-processing","large-vision-language-models","large-vision-models","meta-sam","prompt-engineering","video-processing","vision-language-model","vision-model-prompting","vision-models","visual-prompting","vit"],"latest_commit_sha":null,"homepage":"https://learn.deeplearning.ai/courses/prompt-engineering-for-vision-models/lesson/1/introduction","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/afondiel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-04T18:13:11.000Z","updated_at":"2024-11-12T11:51:03.000Z","dependencies_parsed_at":"2024-12-24T20:50:32.548Z","dependency_job_id":null,"html_url":"https://github.com/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI","commit_stats":null,"previous_names":["afondiel/prompt-engineering-for-vision-models-deeplearningai"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/afondiel%2FPrompt-Engineering-for-Vision-Models-DeepLearningAI","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/afondiel%2FPrompt-Engineering-for-Vision-Models-DeepLearningAI/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/afondiel%2FPrompt-Engineering-for-Vision-Models-DeepLearningAI/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/afondiel%2FPrompt-Engineering-for-Vision-Models-DeepLearningAI/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/afondiel","download_url":"https://codeload.github.com/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/afondiel%2FPrompt-Engineering-for-Vision-Models-DeepLearningAI/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":272100683,"owners_count":24873442,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-25T02:00:12.092Z","response_time":1107,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["cnn","computer-vision","convnets","diffusion-models","fine-tuning","generative-models","image-processing","large-vision-language-models","large-vision-models","meta-sam","prompt-engineering","video-processing","vision-language-model","vision-model-prompting","vision-models","visual-prompting","vit"],"created_at":"2024-11-06T05:15:31.182Z","updated_at":"2025-08-25T17:05:49.249Z","avatar_url":"https://github.com/afondiel.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Prompt Engineering for Vision Models (DeepLearning.AI)\n\n\u003cimg width=\"600\" height=\"380\" src=\"https://raw.githubusercontent.com/facebookresearch/segment-anything/main/assets/masks2.jpg\"\u003e\n\n(Source: [SAM](https://github.com/facebookresearch/segment-anything))\n\n## Overview\n\nThese notes and resources are compiled from the crash course [Prompt Engineering for Vision Models](https://learn.deeplearning.ai/courses/prompt-engineering-for-vision-models/lesson/1/introduction) like [Meta's SAM (Segment Anything Model)](https://segment-anything.com/) or [Stable Diffusion](https://huggingface.co/stabilityai/stable-diffusion-3-medium), offered by [DeepLearning.AI](https://www.deeplearning.ai/).\n\nThe course, led by `Andrew Ng` and instructors from [Comet](https://www.comet.com/site/) (**Abby Morgan, Jacques Verré, and Caleb Kaiser**), explores techniques for prompting vision models like image generation and object detection.\n\n## Key Concepts\n\n- Gain a foundational understanding of prompt engineering techniques for guiding vision models.\n- Explore methods for image generation, object detection, and image segmentation using text prompts.\n- Learn to fine-tune diffusion models for personalized image creation with DreamBooth.\n- Discover best practices for experimenting and tracking progress in prompt engineering workflows.\n\n## Course Contents\n\n- [Lesson0: Introduction](./L0_introduction_notes.md)\n- [Lesson1: Overview](./L1_overview_notes.md)\n- [Lesson2: Image Segmentation](./L2_image_segmentation_notes.md)\n- [Lesson3: Object Detection](./L3_object_detection_notes.md)\n- [Lesson4: Image Generation](./L4_image_generation_notes.md)\n- [Lesson5: Fine-tuning](./L5_fine_tuning_notes.md)\n- [Lesson6: Conclusion](./L6_conclusion-notes.md)\n\n## Setup \u0026 Requirements  \n\n**Requirements**\n\n- All you need is a [Deep LearningAI](https://learn.deeplearning.ai/courses/prompt-engineering-for-vision-models/lesson/1/introduction) user account to start learning for free.\n\n## Lab: Hands-on Exercises \n\n|Chapter|Notebook|\n|--|--|\n|[Lesson0: Introduction](#)| -|\n|[Lesson1: Overview](#)|-|\n|[Lesson2: Image Segmentation](#)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI/blob/main/lab/notebooks/L2/L2_Image_Segmentation.ipynb)|\n|[Lesson3: Object Detection](#)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI/blob/main/lab/notebooks/L3/L3_Object_Detection.ipynb)|\n|[Lesson4: Image Generation](#)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI/blob/main/lab/notebooks/L4/L4_Image_Generation.ipynb)|\n|[Lesson5: Fine-tuning](#)|[![Open notebook in Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/afondiel/Prompt-Engineering-for-Vision-Models-DeepLearningAI/blob/main/lab/notebooks/L5/L5_Fine_Tuning.ipynb)|\n\n## References\n\nMain Course : \n- https://learn.deeplearning.ai/courses/prompt-engineering-for-vision-models/lesson/1/introduction\n\nOthers short Free Courses available on DeepLearning.AI : \n- https://learn.deeplearning.ai/\n\nResources:\n- [Awesome-Diffusion-Models: A collection of resources and papers on Diffusion Models](https://github.com/diff-usion/Awesome-Diffusion-Models)\n\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fafondiel%2Fprompt-engineering-for-vision-models-deeplearningai","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fafondiel%2Fprompt-engineering-for-vision-models-deeplearningai","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fafondiel%2Fprompt-engineering-for-vision-models-deeplearningai/lists"}