{"id":18627346,"url":"https://github.com/dizys/nyu-ai-lab-3","last_synced_at":"2025-07-26T16:08:27.519Z","repository":{"id":96764448,"uuid":"475179520","full_name":"dizys/nyu-ai-lab-3","owner":"dizys","description":"NYU Artificial Intelligence Course Lab 3: A generic Markov process solver.","archived":false,"fork":false,"pushed_at":"2022-05-10T20:08:26.000Z","size":12,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-05-17T09:07:50.069Z","etag":null,"topics":["artificial-intelligence","markov-decision-processes","mdp","nyu","solver"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dizys.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-03-28T21:08:24.000Z","updated_at":"2022-04-03T21:49:20.000Z","dependencies_parsed_at":"2023-04-14T20:35:08.752Z","dependency_job_id":null,"html_url":"https://github.com/dizys/nyu-ai-lab-3","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dizys/nyu-ai-lab-3","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dizys%2Fnyu-ai-lab-3","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dizys%2Fnyu-ai-lab-3/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dizys%2Fnyu-ai-lab-3/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dizys%2Fnyu-ai-lab-3/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dizys","download_url":"https://codeload.github.com/dizys/nyu-ai-lab-3/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dizys%2Fnyu-ai-lab-3/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":267191036,"owners_count":24050318,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-26T02:00:08.937Z","response_time":62,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","markov-decision-processes","mdp","nyu","solver"],"created_at":"2024-11-07T04:41:59.831Z","updated_at":"2025-07-26T16:08:27.499Z","avatar_url":"https://github.com/dizys.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# nyu-ai-lab-3\n\nNYU Artificial Intelligence Course Lab 3: A generic Markov process solver.\n\n## Prerequisite\n\n-   Python 3.8+\n\n## Getting-started\n\n### Switch to Python 3.8 on CIMS machines\n\nThe Python version has to at least have full type hint support, thus requiring Python 3.8+.\n\n```bash\nmodule load python-3.8\n```\n\nIf successful, the command `python3 --version` should give you:\n\n```bash\n$ python3 --version\nPython 3.8.6\n```\n\n### Script usages\n\n\u003e The main entrance is a python script, not a binary. It is in Shebang style,\n\u003e thus can be executed directly.\n\nUse `./mdp -h` command to see the usage:\n\n```\nusage: mdp [-h] [-d DISCOUNT] [-m] [-t TOLERANCE] [-i ITERATION] inputfile\n\nA generic Markov process solver.\n\npositional arguments:\n  inputfile             input file path\n\noptional arguments:\n  -h, --help            show this help message and exit\n  -d DISCOUNT, --discount DISCOUNT\n                        a float discount factor [0, 1] to use on future rewards, defaults to 1.0 if not set\n  -m, --min             whether to minimize values as costs, defaults to false which maximizes values as rewards\n  -t TOLERANCE, --tolerance TOLERANCE\n                        a float tolerance for convergence, defaults to 0.01 if not set\n  -i ITERATION, --iteration ITERATION\n                        the maximum number of iterations to run, defaults to 100 if not set\n```\n\nExamples:\n\n```bash\n$ ./mdp input.txt\n```\n\n```bash\n$ ./mdp -t 0.001 -i 1000 input.txt\n```\n\n```bash\n$ ./mdp --discount 0.9 --min input.txt\n```\n\n## Project structure\n\n```\nproject\n├─solving                       solving python module\n│  ├─__init__.py                    Module initialization\n│  ├─node.py                            Markov Node class\n│  ├─parser.py                          A parser for the input file\n│  └─solver.py                          MDP solver that takes the parsed as input\n│\n├─mdp                           Main entrance python script (shebang style)\n└─README.md                     The file you're reading\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdizys%2Fnyu-ai-lab-3","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdizys%2Fnyu-ai-lab-3","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdizys%2Fnyu-ai-lab-3/lists"}