{"id":22297506,"url":"https://github.com/zhum/laplang","last_synced_at":"2025-03-25T22:43:54.125Z","repository":{"id":137922313,"uuid":"78531245","full_name":"zhum/laplang","owner":"zhum","description":"Dynamic data processing language","archived":false,"fork":false,"pushed_at":"2017-10-31T10:49:30.000Z","size":789,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-01-30T20:14:54.187Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/zhum.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-01-10T12:24:07.000Z","updated_at":"2019-10-18T12:00:49.000Z","dependencies_parsed_at":null,"dependency_job_id":"f2f6a8bf-91d3-4b81-92c3-4102a769852b","html_url":"https://github.com/zhum/laplang","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhum%2Flaplang","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhum%2Flaplang/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhum%2Flaplang/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/zhum%2Flaplang/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/zhum","download_url":"https://codeload.github.com/zhum/laplang/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245556960,"owners_count":20634889,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-12-03T17:49:59.724Z","updated_at":"2025-03-25T22:43:54.103Z","avatar_url":"https://github.com/zhum.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"Internal Commands\n=================\n\nAll data and commands are passed via LapData struct. Its fields are:\n\n  Cmd    string     // command ('[' for data)\n  Id     int64      // almost uniq message ID\n  From   string     // sender\n  To     string     // receiver\n  Fields map[string]*LapField // data\n\nCommands\n--------\n\n- [ Data\n- n New child\n- f Set filter\n- c Connect output to node\n- d Delete node\n- v View all nodes\n- e Send EOD to node\n\nNew child\n---------\n\n- name = new node name\n- type = new node processor\n\nSet filter\n----------\n\n- name = target node\n- field = name of field to filter\n- filter = filter description\n\nFilter can be specified as list of strings/integers via comma or as integer interval: '[98 123]'\n\nTODO: make intervals float, add multiple intervals, add open intervals\n\nConnect output\n--------------\n\n- target = node, to which connect out output\n\nDelete node\n-----------\n\n- list = list of target node names via COMMA\n\nView all nodes\n--------------\n\nno options\n\nSend EOD\n--------\n\nno options\n\nData processors (names)\n---------------\nBy default all processors copy all input fields values. In aggregation processors only last values are copied. In special cases only specified out fields go to output.\n\n- avg = compute average value till EOD\n    - count_field = field to compute avg\n    - out_field = new name for aggregated field \n- min = compute minimum value till EOD\n    - like avg\n- max  = compute maximum value till EOD\n    - like avg\n- print = output data AS IS. Just for debugging\n  - none\n- file = read csv-file\n    - filename = name of input file\n    - headers = name of file with headers description (T:name,..., where T is\n      'n' for number and 's' for string)\n- http_csv = read csv from http (not tested)\n    - delim = fields delimiter\n    - addr = address\n    - h = headers description (as is) - see 'file' processor\n- http_hopsa = not works\n- exec = read data from executed program\n    - delim = fields delimiter\n    - cmd = command to execute\n    - h = headers description (as is) - see 'file' processor\n    - skip = number of lines to skip at first run\n- outcsv = print data to csv-file\n    - filename = name of output file\n    - out_fields = list of fields to put in file\n    - print_header = 1/0 (y/n) to print header line or not\n    - print_source = add column with data source name\n- null = put data to /dev/null\n- slice = put EOD every N data pieces or/and by delta in one field\n    - count = number of data pieces\n    - delta_field = name of field to watch delta\n    - delta = value of delta\n- agr = do aggregation on one field\n    - count_field = name of field by which do aggregation\n    - out_field = name of aggregation field in output\n    - grp_field = name of field to be uniq in aggregation\n    - agr_type = type of aggregation: min, max or avg\n    - maxbuf = maximum number of data pieces while aggregation\n- sort = local sort data by one field\n    - sort_field = name of field to sort by\n    - sort_descend = if specified (any value, FIXME), sort descending\n    - max_count = maximum data pieces in sort pool\n- grid = do aggregation by several fields inside intervals, specified in one field\n    - by_field = name of field, which specify aggregation interval\n    - max_count = maximum number of intervals to store in memory\n    - max_hole = maximum number of intervals, which will be tried to fill\n    - start = start value for aggregation field\n    - step = width of aggregation interval\n    - save_fields = fields to copy in output via comma\n    - grid_fields = fields to be uniq inside interval via comma\n- join = just join several sources data into one piece\n    - by_fields = list of fields, to be uniq in joining\n    - sources = list of source nodes via comma\n    - maps = list of source fields and their new names in format source_node/source_field/new_field,...\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzhum%2Flaplang","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fzhum%2Flaplang","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fzhum%2Flaplang/lists"}