{"id":18368102,"url":"https://github.com/am-ankitgit/dvc-data-version-control-","last_synced_at":"2025-04-10T17:55:08.527Z","repository":{"id":250442001,"uuid":"831635696","full_name":"AM-Ankitgit/DVC-Data-Version-Control-","owner":"AM-Ankitgit","description":null,"archived":false,"fork":false,"pushed_at":"2024-07-27T12:23:12.000Z","size":460,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-15T20:52:06.732Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AM-Ankitgit.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-07-21T06:57:32.000Z","updated_at":"2024-07-27T12:23:15.000Z","dependencies_parsed_at":"2024-07-27T13:49:24.929Z","dependency_job_id":null,"html_url":"https://github.com/AM-Ankitgit/DVC-Data-Version-Control-","commit_stats":null,"previous_names":["am-ankitgit/dvc-data-version-control-"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AM-Ankitgit%2FDVC-Data-Version-Control-","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AM-Ankitgit%2FDVC-Data-Version-Control-/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AM-Ankitgit%2FDVC-Data-Version-Control-/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AM-Ankitgit%2FDVC-Data-Version-Control-/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AM-Ankitgit","download_url":"https://codeload.github.com/AM-Ankitgit/DVC-Data-Version-Control-/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248262438,"owners_count":21074308,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-05T23:24:36.759Z","updated_at":"2025-04-10T17:55:08.509Z","avatar_url":"https://github.com/AM-Ankitgit.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# this is the my demo of DVC File\n\n\u003ch1\u003ehttps://dvc.org/doc\u003c/h1\u003e\n\n\n# How to implement the DVC\n -git log\n    -- commit c10ccfde2df63457ab838786014fbe4f50\n    \n    File added\n\n    -- commit 6c0a7d15b50a95847e1b64f42b12487bac65e73a\n\n\n\n### if you want to go previous commit the Use the\n   -- git checkout 86014f\n\n\n# to add the data in dvc\n  -- dvc add data/data.csv\n  -- git commit -m \"this my latest version of data\"\n  \n  here you can add different version of data \n\n# if you want to retrieve specific version of data\n   -- git checkout commit_id\n   eg. git checkout 73782\n   dvc checkout \n\n\n\n# to create the repository at local workspace you can keep the track of all version of data\n --dvc remote add -d \u003crepo_name\u003e full_path_of_repo_location_where_you_want_create\n \n eg.dvc remote add -d dvc_demp D:/study/Data_Version_Controlled(DVC)/remotestorage\n\n  -- dvc push (you can see the latestversion of data in your workspace in remotestorage folder)\n\n  -- git add data/data.csv.dvc\n  -- git commit \"Latest Version\"\n  -- git add .dvc/config\n  -- git commit -m \"Config file added\"\n  -- dvc push\n\n\n\n\n\n# REPRODUCIBILITY\n - refers to the ability to achieve consistent results using the same dataset, computational methods, and analysis procedures. It ensures that experiments and their outcomes can be reliably repeated by others, including future versions of the project. Reproducibility is crucial for validating findings, building upon previous work, and fostering trust in scientific and analytical results.\n\n\n## Key Aspects of Reproducibility\n- Consistent Environment:\nEnsuring that the computational environment (libraries, software versions, configurations) is the same as when the original analysis was performed.\n\n- Version Control:\nUsing version control systems (e.g., Git) to track changes in code, data, and configurations. This helps in maintaining a history of modifications and understanding the evolution of the project.\n\n- Data Management:\nKeeping track of data versions and ensuring that the same data used in the original experiment is available for reproduction. Tools like DVC (Data Version Control) can help in managing data versions.\n \n\n- Clear Documentation:\nProviding detailed documentation of the procedures, methodologies, and parameters used in the experiment. This includes code comments, README files, and supplementary documents.\n\n- Pipeline Automation:\nAutomating the workflow using tools like DVC, Make, or other workflow management systems ensures that the steps of data processing, model training, and evaluation can be executed in the same order with the same parameters.\n\n![alt text](D:\\study\\Data_Version_Controlled(DVC)\\images\\structure_dvc_yaml.png)\n\n\n## Run the pipeline:\n- dvc repro  \u003e\u003e\u003e generate the dvc.lock file\n## Visualize the pipeline\n- dvc dag (Directed acyclic graph)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fam-ankitgit%2Fdvc-data-version-control-","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fam-ankitgit%2Fdvc-data-version-control-","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fam-ankitgit%2Fdvc-data-version-control-/lists"}