https://github.com/justingosses/geovec-playground

playground for exploring geoVec pre-trained glove model of geoscience embeddings
https://github.com/justingosses/geovec-playground

geology geoscience nlp notebook playground

Last synced: 3 days ago
JSON representation

playground for exploring geoVec pre-trained glove model of geoscience embeddings

• Host: GitHub
• URL: https://github.com/justingosses/geovec-playground
• Owner: JustinGOSSES
• Created: 2020-07-25T03:06:01.000Z (over 4 years ago)
• Default Branch: master
• Last Pushed: 2020-08-04T15:37:32.000Z (over 4 years ago)
• Last Synced: 2024-05-02T06:03:51.072Z (7 months ago)
• Topics: geology, geoscience, nlp, notebook, playground
• Language: HTML
• Homepage:
• Size: 2.66 MB
• Stars: 8
• Watchers: 5
• Forks: 3
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# geoVec-playground

playground for exploring geoVec pre-trained glove model of geoscience embeddings

Pay attention to .gitignore file as otherwise your git can be clogged with files that are too big!

#### Use this notebook, not the other one: Exploration of GeoVec Word Embeddings & Parsed English Only Version.ipynb

Theoretically should front-end only with identical notebook as run from local machine but there's some bug I haven't figured out yet!!!! and the size of the embedding file requires git large file service, which has now stopped working on any repositories for me even though I have data left before the cap, fun. 

For now the quickest way to play with the geovec embedding in the projector is to use this github pages page (clone of the google embedding projector page) and load the vecs.tsv file and metadata1.tsv file into it from this repository. https://justingosses.github.io/embedding-projector-standalone/

For now, second quickest way to see the embedding is to clone this repo and run from source folder `python3 -m http.server http://0.0.0.0:8000/embedding-projector-standalone/embedding-projector-standalone-master/`

Alternatively, you can load the notebook and run through it, specifically this one: https://github.com/JustinGOSSES/geoVec-playground/blob/master/Exploration%20of%20GeoVec%20Word%20Embeddings%20%26%20Parsed%20English%20Only%20Version.ipynb

![Image of Silt in Embedding Projector](images/silt.png)

## This repo is just messing around with this original word embedded work by these authors:

paper: https://soil.copernicus.org/articles/5/177/2019/soil-5-177-2019.html

article of interest: https://towardsdatascience.com/deep-learning-and-soil-science-part-1-8c0669b18097

researchgate: https://www.researchgate.net/publication/341342446_3D_lithological_mapping_of_borehole_descriptions_using_word_embeddings

phd thesis: https://ses.library.usyd.edu.au/bitstream/handle/2123/22081/Padarian_J_thesis.pdf?sequence=1&isAllowed=y 

Data file link: https://osf.io/4uyeq/wiki/home/

See gloVe-test example for the basic idea.

CITATION¶

@misc{padarian2019geovec, title={GeoVec}, url={https://osf.io/4uyeq}, DOI={10.17605/OSF.IO/4UYEQ}, publisher={OSF}, author={Padarian, José and Fuentes, Ignacio}, year={2019} }z

Article

@misc{padarian2019word, title={Word embeddings for application in geosciences: development, evaluation and examples of soil-related concepts}, url={https://doi.org/10.5194/soil-2018-44} DOI={10.5194/soil-2018-44}, publisher={Copernicus GmbH}, author={Padarian, José and Fuentes, Ignacio}, year={2019}, journal={SOIL Discuss} }

Data file of the pretrained emb

Windows 10 Notes for anyone doing further investigation:

some sage advice for glove installation

pip install glove==1.0.0

(after trying builds and installation in visual studio developer prompts etc etc)