https://github.com/zuphilip/csl-analysis
https://github.com/zuphilip/csl-analysis
citation-style-language
Last synced: 4 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/zuphilip/csl-analysis
- Owner: zuphilip
- Created: 2017-04-30T15:21:18.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2017-05-01T18:21:47.000Z (about 9 years ago)
- Last Synced: 2025-06-04T07:50:20.250Z (12 months ago)
- Topics: citation-style-language
- Language: XQuery
- Homepage:
- Size: 3.48 MB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# CSL Analysis
In the subfolders are some scripts and tools for an analysis
the styles of the Citation Style Language (CSL). These scripts
are in some standard formats, e.g. XQuery, and can be reuse
hopefully easily in various ways. However, we describe here
our technology stack to work with this scripts as one example:
## CSL Styles
Start with cloning the current csl styles:
```
git clone https://github.com/citation-style-language/styles.git
```
This gives you the most recent version of the styles. If you want
to work with an older snapshot you can simply `git checkout` it.
## baseX
1. Download and install [baseX](http://basex.org/) for performing the
XQueries.
2. Open baseX
3. Create a new database (Database>New...)
1. Select the csl styles directory
2. Choose a reasonable name, e.g. `csl-styles`
3. Change the file patterns to `*.csl`, cf. with [this picture](img/basex-new-database.jpg)
4. Click `Ok`
4. Open the XQuery files `.xq` from the subfolder `xquery` you are
interested in (Editor>Open...)
## Open Refine
We use [Open Refine](http://openrefine.org/) for enrichting
our data with the help of the
[SRU interface of the ZDB](http://www.zeitschriftendatenbank.de/services/schnittstellen/sru/),
which stores informations about journals. Especially we are
interested in the
[main DDC groups](http://www.dnb.de/SharedDocs/Downloads/DE/DNB/service/ddcSachgruppenDNB.pdf?__blob=publicationFile)
for a information about the discipline of the journal.
1. Download and install [Open Refine](http://openrefine.org/).
2. Open the result of the `csl-basic-statistics.xq` TODO w/o Excel
3. Create a new column which calls the URLs and download the
result as XML data. !!For the whole data this took at least 1 hour!!
1. Create new column based on some column
2. Use this GREL
```
"http://services.dnb.de/sru/zdb?version=1.1&operation=searchRetrieve&recordSchema=MARC21-xml&query=dnb.iss%3D" + cells.issn.value + "+OR+" + cells.eissn.value
```
3. Change the waiting time between several requests
4. Start
5. Wait...
4. Create a new column for extracting the DDC info
1. Create a new column based on the previous column with the xml data
2. Use this GREL
```
uniques(forEach(value.parseHtml().select('datafield[tag=082]>subfield[code=a]'), v, htmlText(v))).join(", ")
```
3. Click `OK`
5. Create a text facet from the row `ddc`
6. Cluster it to merge the same combinations with different order
7. Explore further..
Our current output from this is saved as a CSV file at [open-refine/csl-analysis.csv](open-refine/csl-analysis.csv).
## Gephi
1. Download and install [Gephi](https://gephi.org/).
2. Open Gephi, create a `New Project`
3. Go to the `Data Labratory`
1. click on `Import spreadsheet`
2. Choose `open-refine/csl-analysis.csv` as the `Nodes table`
3. In the `Import Settings` choose `Integer` as type for `#depend`
4. Click `Finish`
4. Delete the nodes corresponding to dependent styles, i.e. where `#depend` is `-1`.
5. Open `csl-template.csv` with your text editor and add `Source,Target` as your first line.
6. Click again on `Import spreadsheet`, select the adapted [`csl-template.csv`](gephy/csl-template-with-header.csv) as the `Edge table`.
7. Switch to the `Overview` tab
8. Click on `Statistics` and run the detection of the `Connected Components`, afterwards you can in the `Filter` tab filter on the size of the connected componentent (`Partition Count` and choose `Partition ID`). In this way you can filter out single nodes or small components of just a handful nodes to see the big picture.
9. `Appearance>Nodes>Color>Partition` choose for example `ddc-first`
10. `Appearance>Nodes>Size>Ranking` choose for example `#depend`
11. TODO labels
12. For export make sure that you have activated the labels also in the `Preview` tab
See [gephi/graph.png](gephi/graph.png) for the current output.
## pivottable
Using the JavaScript implementation with drag'n'drop https://github.com/nicolaskruchten/pivottable for our exploring our data.
* code: [docs](docs)
* result: https://zuphilip.github.io/csl-analysis/
(Hint: For your own local csv files try this: http://nicolas.kruchten.com/pivottable/examples/local.html)