{"id":15371347,"url":"https://github.com/sultaniman/dust","last_synced_at":"2025-12-11T23:50:57.222Z","repository":{"id":40305397,"uuid":"264513089","full_name":"sultaniman/dust","owner":"sultaniman","description":"Archive web pages with all relevant assets or save as a single file HTML","archived":false,"fork":false,"pushed_at":"2023-07-11T18:40:12.000Z","size":257,"stargazers_count":19,"open_issues_count":3,"forks_count":0,"subscribers_count":1,"default_branch":"develop","last_synced_at":"2024-05-01T22:26:36.835Z","etag":null,"topics":["elixir","http","http-requests","scraping"],"latest_commit_sha":null,"homepage":"","language":"Elixir","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sultaniman.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null},"funding":{"custom":["https://www.paypal.me/SultanIman"]}},"created_at":"2020-05-16T19:38:46.000Z","updated_at":"2022-05-29T11:11:59.000Z","dependencies_parsed_at":"2023-07-15T11:18:05.109Z","dependency_job_id":null,"html_url":"https://github.com/sultaniman/dust","commit_stats":null,"previous_names":["imanhodjaev/dust"],"tags_count":2,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sultaniman%2Fdust","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sultaniman%2Fdust/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sultaniman%2Fdust/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sultaniman%2Fdust/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sultaniman","download_url":"https://codeload.github.com/sultaniman/dust/tar.gz/refs/heads/develop","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":249072288,"owners_count":21208156,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["elixir","http","http-requests","scraping"],"created_at":"2024-10-01T13:46:31.298Z","updated_at":"2025-12-11T23:50:57.194Z","avatar_url":"https://github.com/sultaniman.png","language":"Elixir","readme":"\u003ch1 align=\"center\"\u003eDust\u003c/h1\u003e\n\u003cp align=\"center\"\u003e\n  \u003cimg width=\"150\" height=\"150\" src=\"https://raw.githubusercontent.com/imanhodjaev/dust/develop/assets/dust.svg\"/\u003e\n\u003c/p\u003e\n\n**NOTE:** Please note this project is still under development so you might experience issues.\n\n## Installation 💾\n\nIf [available in Hex](https://hex.pm/docs/publish), the package can be installed\nby adding `dust` to your list of dependencies in `mix.exs`:\n\n```elixir\ndef deps do\n  [\n    {:dust, \"~\u003e 0.0.2-dev\"}\n  ]\nend\n```\n\n## Usage 🧠\n\n```elixir\n\"https://github.com\"\n|\u003e Dust.get()\n|\u003e Dust.persist(\"AWESOME/PAGE.HTML\")\n\n\"https://times.com\"\n|\u003e Dust.get(\n  headers: headers,\n  proxy: %Proxy{...} | \"socks5://user:pass@awesome.host:port\",\n  max_retries: 3\n)\n|\u003e Dust.persist(result, \"AWESOME/PAGE.HTML\")\n```\n\n## Documentation\n\nDocumentation can be generated with [ExDoc](https://github.com/elixir-lang/ex_doc)\nand published on [HexDocs](https://hexdocs.pm). Once published, the docs can\nbe found at [https://hexdocs.pm/dust](https://hexdocs.pm/dust).\n\n## Assets 💄\n\nhttps://www.flaticon.com/free-icon/dust_867847\n","funding_links":["https://www.paypal.me/SultanIman"],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsultaniman%2Fdust","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsultaniman%2Fdust","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsultaniman%2Fdust/lists"}