Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/multivacplatform/multivac-pubmed

Update PubMed articles daily on HDFS by using Spark Cluster
https://github.com/multivacplatform/multivac-pubmed

apache-spark dataframe hadoop hdfs pubmed pubmed-parser spark-sql yarn

Last synced: 14 days ago
JSON representation

Update PubMed articles daily on HDFS by using Spark Cluster

Host: GitHub
URL: https://github.com/multivacplatform/multivac-pubmed
Owner: multivacplatform
License: apache-2.0
Created: 2020-04-08T15:34:02.000Z (almost 5 years ago)
Default Branch: master
Last Pushed: 2022-11-18T09:00:02.000Z (about 2 years ago)
Last Synced: 2024-11-13T08:37:23.321Z (2 months ago)
Topics: apache-spark, dataframe, hadoop, hdfs, pubmed, pubmed-parser, spark-sql, yarn
Language: Scala
Size: 30.3 KB
Stars: 1
Watchers: 2
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

        # multivac-pubmed [![GitHub license](https://img.shields.io/badge/license-Apache_2.0-blue.svg)](https://github.com/multivacplatform/multivac-pubmed/blob/master/LICENSE) [![Build Status](https://travis-ci.org/multivacplatform/multivac-pubmed.svg?branch=master)](https://travis-ci.org/multivacplatform/multivac-pubmed) [![Multivac Discuss](https://img.shields.io/badge/multivac-discuss-ff69b4.svg)](https://discourse.iscpif.fr/c/multivac) [![Multivac Channel](https://img.shields.io/badge/multivac-chat-ff69b4.svg)](https://chat.iscpif.fr/channel/multivac)

## Testing Environment

* Spark 2.4.4 Local / IntelliJ

* Spark 2.4 / Cloudera CDH 6.3 / YARN (cluster - client)

## Code of Conduct

This, and all github.com/multivacplatform projects, are under the [Multivac Platform Open Source Code of Conduct](https://github.com/multivacplatform/code-of-conduct/blob/master/code-of-conduct.md). Additionally, see the [Typelevel Code of Conduct](http://typelevel.org/conduct) for specific examples of harassing behavior that are not tolerated.

## Copyright and License

Code and documentation copyright (c) 2020 [ISCPIF - CNRS](http://iscpif.fr). Code released under the [Apache 2.0 license](https://github.com/multivacplatform/multivac-pubmed/blob/master/LICENSE).