Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/microsoft/lightgbm-transform
Transformation library for LightGBM
https://github.com/microsoft/lightgbm-transform
lightgbm microsoft transformation
Last synced: about 2 months ago
JSON representation
Transformation library for LightGBM
- Host: GitHub
- URL: https://github.com/microsoft/lightgbm-transform
- Owner: microsoft
- License: mit
- Created: 2021-11-01T06:04:44.000Z (about 3 years ago)
- Default Branch: main
- Last Pushed: 2023-11-24T08:38:46.000Z (about 1 year ago)
- Last Synced: 2024-10-20T21:53:25.222Z (2 months ago)
- Topics: lightgbm, microsoft, transformation
- Language: C++
- Homepage:
- Size: 4.17 MB
- Stars: 33
- Watchers: 6
- Forks: 8
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Code of conduct: CODE_OF_CONDUCT.md
- Security: SECURITY.md
Awesome Lists containing this project
README
# LightGBM Transformation Library
The LightGBM transformation library aims at providing a flexible and automatic way to do feature transformation when using [`LightGBM`](https://github.com/microsoft/LightGBM). Compared to separate transformation. this way has several pros:
- More efficient. Data preprocessing can go with parsing each line, and take advantage of multi-processing designed by lightgbm naturally. No need to store whole transformed data in file/memory.
- More convenient for development and iteration. Built-in transformation could keep offline and online consistent well by saved/loaded along with model.In the repo, user could learn about:
- How to customize favorite parser by playing with LightGBM Parser interface.
- How to use [`FreeForm2Parser`](./examples/freeform2_parser.cpp), a powerful and efficient tool built in the repo, in model training. Instead of handling data yourself, user just need to prepare a feature spec which contains feature name, transform type and expression, and make slight changes in experiment iterations.## Get Started and Documentation
- [Installation guide](./docs/Installation-Guide.rst)
- [Customized parser tutorial](./docs/Customized-Parser-Tutorial.rst)
- [Transform tutorial](./docs/Transform-Tutorial.rst)
- [FreeForm2 language spec](./docs/FreeForm2-Language.rst)## Contributing
This project welcomes contributions and suggestions. Most contributions require you to agree to a
Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us
the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.When you submit a pull request, a CLA bot will automatically determine whether you need to provide
a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions
provided by the bot. You will only need to do this once across all repos using our CLA.This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).
For more information see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or
contact [[email protected]](mailto:[email protected]) with any additional questions or comments.## Trademarks
This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft
trademarks or logos is subject to and must follow
[Microsoft's Trademark & Brand Guidelines](https://www.microsoft.com/en-us/legal/intellectualproperty/trademarks/usage/general).
Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship.
Any use of third-party trademarks or logos are subject to those third-party's policies.