Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/airoldilab/sgd
An R package for large scale estimation with stochastic gradient descent
https://github.com/airoldilab/sgd
big-data data-analysis gradient-descent r statistics
Last synced: 24 days ago
JSON representation
An R package for large scale estimation with stochastic gradient descent
- Host: GitHub
- URL: https://github.com/airoldilab/sgd
- Owner: airoldilab
- Created: 2014-12-05T23:10:59.000Z (almost 10 years ago)
- Default Branch: master
- Last Pushed: 2024-02-06T04:21:50.000Z (9 months ago)
- Last Synced: 2024-03-27T12:18:03.857Z (7 months ago)
- Topics: big-data, data-analysis, gradient-descent, r, statistics
- Language: C++
- Homepage:
- Size: 2.03 MB
- Stars: 59
- Watchers: 12
- Forks: 18
- Open Issues: 41
-
Metadata Files:
- Readme: README.md
- Changelog: NEWS.md
Awesome Lists containing this project
README
# sgd
sgd is an R package for large
scale estimation. It features many stochastic gradient methods, built-in models,
visualization tools, automated hyperparameter tuning, model checking, interval
estimation, and convergence diagnostics.
## Features
At the core of the package is the function
```{R}
sgd(formula, data, model, model.control, sgd.control)
```
It estimates parameters for a given data set and model using stochastic gradient
descent. The optional arguments `model.control` and `sgd.control` specify
attributes about the model and stochastic gradient method. Taking advantage of
the bigmemory package, sgd also operates on data sets which are too large to fit
in RAM as well as streaming data.
Example of large-scale linear regression:
```{R}
library(sgd)
# Dimensions
N <- 1e5 # number of data points
d <- 1e2 # number of features
# Generate data.
X <- matrix(rnorm(N*d), ncol=d)
theta <- rep(5, d+1)
eps <- rnorm(N)
y <- cbind(1, X) %*% theta + eps
dat <- data.frame(y=y, x=X)
sgd.theta <- sgd(y ~ ., data=dat, model="lm")
```
Any loss function may be specified. For convenience the following are
built-in:
* Linear models
* Generalized linear models
* Method of moments
* Generalized method of moments
* Cox proportional hazards model
* M-estimation
The following stochastic gradient methods exist:
* (Standard) stochastic gradient descent
* Implicit stochastic gradient descent
* Averaged stochastic gradient descent
* Averaged implicit stochastic gradient descent
* Classical momentum
* Nesterov's accelerated gradient
Check out the vignette in [`vignettes/`](vignettes/) or examples in [`demo/`](demo/).
In R, the equivalent commands are `vignette(package="sgd")` and
`demo(package="sgd")`.
## Installation
To install the latest version from CRAN:
```{R}
install.packages("sgd")
```
To install the latest development version from Github:
```{R}
# install.packages("devtools")
devtools::install_github("airoldilab/sgd")
```
## Authors
sgd is written by [Dustin Tran](http://dustintran.com), [Junhyung Lyle Kim](https://jlylekim.github.io/) and
[Panos Toulis](https://www.ptoulis.com/). Please feel free to contribute by
submitting any issues or requests—or by solving any current issues!
We thank all other members of the Airoldi Lab (led by Prof. Edo Airoldi) for their feedback and contributions.
## Citation
```
@article{tran2015stochastic,
author = {Tran, Dustin and Toulis, Panos and Airoldi, Edoardo M},
title = {Stochastic gradient descent methods for estimation with large data sets},
journal = {arXiv preprint arXiv:1509.06459},
year = {2015}
}
```