https://github.com/writecrow/crow_training
Examples, scaffolding, and sandbox for Crow code tools
https://github.com/writecrow/crow_training
Last synced: 6 months ago
JSON representation
Examples, scaffolding, and sandbox for Crow code tools
- Host: GitHub
- URL: https://github.com/writecrow/crow_training
- Owner: writecrow
- License: mit
- Created: 2018-02-18T01:48:34.000Z (almost 8 years ago)
- Default Branch: master
- Last Pushed: 2018-02-28T12:48:18.000Z (almost 8 years ago)
- Last Synced: 2025-04-13T03:46:14.278Z (9 months ago)
- Language: Python
- Size: 473 KB
- Stars: 6
- Watchers: 6
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
## Crow Training Materials
This is a general-purpose repository for learning the central concepts and main tools used by the Corpus and Repository of Writing team for text processing.
### Command Line
This directory includes example scripts written in `bash`, primarily demonstrating how scripts written in various computer programming languages can be chained together to perform a series of steps on given texts.
### Python
1. `basic_concepts` includes scripts that use the simplest python commands to open a given text file, tokenize the words, and perform computational analysis like identifying average sentence length and finding sentences containing passive voice.
2. `better_coding` builds on many of the other lessons in this section to introduce ways to make your code:
* more readable through use of comments and adherence to PEP8 standards
* more re-usable through use of functions and imports
* more user-friendly by using parameters instead of hardcoded values
* more reliable by integrating tests
3. `conversion` focuses on methods to manipulating text input, including:
* conversion from Word or PDF formats to plaintext
* conversion into UTF-8 format
4. `natural_language_toolkit` includes code snippets that illustrate using the Natural Language Toolkit ([https://nltk.org](https://nltk.org)), including:
* tokenization
* text cleaning
* collocations
5. `regex` provides sample code snippets for various methods of complex parsing of texts, including:
* Finding a "header" value in markup like ``
* Finding all header values and putting into a manipulable list
* Finding all matches of phrases like "were xxx by" or "was xxx by"
6. `remote_data` demonstrates basic methods for retrieving content from non-local files
## Sandbox
This is a directory to be used for simply trying out coding ideas, and using Git in order
to keep track of that code. One of the team scaffolding assignments is to create an issue
in this repository, create a branch that adds a file to this "Sandbox" directory, and open
that as a "pull request" for team review.