{"id":13464528,"url":"https://github.com/ferventdesert/Hawk","last_synced_at":"2025-03-25T11:31:48.294Z","repository":{"id":44425758,"uuid":"55284016","full_name":"ferventdesert/Hawk","owner":"ferventdesert","description":"visualized crawler \u0026 ETL IDE written with C#/WPF","archived":false,"fork":false,"pushed_at":"2019-12-21T10:26:40.000Z","size":40981,"stargazers_count":3159,"open_issues_count":67,"forks_count":974,"subscribers_count":287,"default_branch":"master","last_synced_at":"2024-10-29T17:49:42.244Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"C#","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ferventdesert.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2016-04-02T07:54:41.000Z","updated_at":"2024-10-26T06:19:03.000Z","dependencies_parsed_at":"2022-09-15T03:50:57.501Z","dependency_job_id":null,"html_url":"https://github.com/ferventdesert/Hawk","commit_stats":null,"previous_names":[],"tags_count":7,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ferventdesert%2FHawk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ferventdesert%2FHawk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ferventdesert%2FHawk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ferventdesert%2FHawk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ferventdesert","download_url":"https://codeload.github.com/ferventdesert/Hawk/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245454034,"owners_count":20617966,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T14:00:45.571Z","updated_at":"2025-03-25T11:31:43.281Z","avatar_url":"https://github.com/ferventdesert.png","language":"C#","funding_links":[],"categories":["All","C#","C\\#"],"sub_categories":[],"readme":"\r\nHawk: Advanced ETL \u0026 Crawler Stream Engine \r\n\r\n***\r\n\r\nWelcome to use Hawk! Hawk can graphically crawle webpage, clean, process and save data without programming， written in C#/WPF, open source according to the GPL protocol.\r\n\r\n- Github : https://github.com/ferventdesert/Hawk\r\n- Documentation: https://ferventdesert.github.io/Hawk/\r\n- Project Respository: https://github.com/ferventdesert/Hawk-Projects/Hawk3\r\n- Download:  https://github.com/ferventdesert/Hawk/releases\r\n- Download(chs): https://gitee.com/deserthawk/Hawk/attach_files\r\n## Introduction\r\n\r\nThe meaning of Hawk is \"Eagle\", which can kill prey efficiently and accurately. Its design idea comes from Lisp language , and its function mimics awk in Unix.\r\n\r\nThe key features are as follows:\r\n\r\n- Intelligent analysis of web content without programming.\r\n- WYSIWYG, conversion, filtering \u0026 storage with visually drag and drop.\r\n- Parallel processing \u0026 high speed\r\n- Support mutli-file \u0026 database: xml, csv, sqlite,mongodb...\r\n- Tasks can be save, pause, restart \u0026 reused.\r\n- Focus on crawler but power is far beyond that.\r\n\r\n\r\n![splash](https://upload-images.jianshu.io/upload_images/9608527-2185c11706ccf618.png?imageMogr2/auto-orient/strip%7CimageView2/2/w/1240)\r\n\r\n\r\nFast \u0026 Smart webpage crawling :\r\n\r\n![1.gif-1001.8kB](https://raw.githubusercontent.com/ferventdesert/Hawk/master/Docs/imgs/1.gif-1001.8kB.gif)\r\n\r\nWYSIWYG ETL:\r\n\r\n![2.gif](https://raw.githubusercontent.com/ferventdesert/Hawk/master/Docs/imgs/2.gif)\r\n\r\n\r\n****\r\n\r\n\r\n欢迎使用Hawk! HAWK无需编程，可见即所得的图形化数据采集和清洗工具，依据GPL协议开源。\r\n\r\n- 项目主页：https://github.com/ferventdesert/Hawk\r\n- 项目文档： https://ferventdesert.github.io/Hawk/\r\n- 示例工程文件： https://github.com/ferventdesert/Hawk-Projects/Hawk3\r\n- 下载地址： https://github.com/ferventdesert/Hawk/releases\r\n- 国内下载地址:  https://gitee.com/deserthawk/Hawk/attach_files\r\n\r\n## 介绍\r\nHawk的含义为“鹰”，能够高效，准确地捕杀猎物。它的思想来源于Lisp语言，功能模仿了Linux工具awk。\r\n\r\n特点如下：\r\n\r\n- 智能分析网页内容，无需编程\r\n- 所见即所得，可视化拖拽，快地实现转换和过滤等数据清洗操作\r\n- 能从各类数据库和文件实现导入导出\r\n- 任务可以被保存和复用\r\n- 其最适合的领域是爬虫和数据清洗，但其威力远超于此。\r\n\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fferventdesert%2FHawk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fferventdesert%2FHawk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fferventdesert%2FHawk/lists"}