Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/alekcz/pcp
PCP: Clojure Processor -- A Clojure replacement for PHP
https://github.com/alekcz/pcp
clojure nginx pcp
Last synced: 5 days ago
JSON representation
PCP: Clojure Processor -- A Clojure replacement for PHP
- Host: GitHub
- URL: https://github.com/alekcz/pcp
- Owner: alekcz
- License: mit
- Created: 2020-03-21T07:22:50.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2022-03-12T11:07:05.000Z (almost 3 years ago)
- Last Synced: 2024-10-29T10:44:33.023Z (about 2 months ago)
- Topics: clojure, nginx, pcp
- Language: Clojure
- Homepage: https://clojure-pulse.musketeers.io
- Size: 4.73 MB
- Stars: 232
- Watchers: 8
- Forks: 5
- Open Issues: 9
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
  
**Welcome to PCP**
> PCP: Clojure Processor -- _Like drugs but better_
## Introduction
Too long have we hustled to deploy Clojure websites. Too long have we spun up one server instance per site. Too long have we reminisced about the simplicty of deploying PHP. Today we enjoy the benefits of both. Welcome to PCP.
### Status
Active development. Stabilizing.
Latest version: `v0.0.2`
### Goals
* An easy to use, drop-in Clojure replacement for php scripts
* Allow multiple websites to be hosted on a single $5 VPS
### Non-goals
* Performance. _PCP should be sufficient for prototypes and small websites (< 1400 req/s)_
### Demo site
You can view a demo site built in PCP here: [https://clojure-pulse.musketeers.io](https://clojure-pulse.musketeers.io/)
## Overview
1. [Quick start](#quick-start)
1. [How PCP works](#how-pcp-works)
1. [System requirements](#system-requirements)
1. [Project structure and requiring files](#project-structure-and-requiring-files)
1. [Environment variables and secrets](#environment-variables-and-secrets)
1. [Core PCP namespace](#core-pcp-namespace)
1. [Other built into PCP](#other-built-in-namespaces)
1. [Performance](#performance)
1. [Deploying PCP](#deploying-pcp)
1. [Roadmap](#performance)
## Quick start
Install pcp via the installer script:
``` shellsession
$ bash -c "$(curl -sSL https://raw.githubusercontent.com/alekcz/pcp/master/install.sh)"
```
Query the PCP service status:
``` shellsession
$ pcp service status
```
Create a new project:
``` shellsession
$ pcp new project-name
```
When you create a new project some example code is generated as well which, for convenience, you can view using the local server built in to the pcp utility. This local server behaves as your pcp site would when deployed with nginx.
``` shellsession
$ cd project-name
$ pcp -s public/
```
Navigate to [http://localhost:3000/](http://localhost:3000/) and voilà.
This is the corresponding code.
```clojure
(ns index
(:require [pcp :as pcp] ;this is the core namespace with various useful functions
[api.info :as a] ;this is another name space in the same project.
[garden.core :refer [css]])) ;this is 3rd party namespace from the hosted environment
(def resp
(pcp/html
[:html {:style "font-family: 'Source Sans Pro', Arial, Helvetica, sans-serif;"
:lang "en"}
[:head
[:title "PCP website"]
[:style
(css [:html { :text-align "center"}])
(css [:p.info { :background-color "#EEE"
:font-size "13px"
:margin-top "40px"
:padding "10px"
:text-align "left"
:width "300px"}])
(css [:strong { :font-size "13px"}])
(css [:code { :font-size "12px" :font-weight "normal"}])
(css [:.main { :display "flex"
:flex-direction "column"
:justify-content "center"
:align-items "center"
:min-height "90vh"
:font-weight "normal"}])]]
[:body
[:div.main
[:img
{:src "//raw.githubusercontent.com/alekcz/pcp/master/assets/logo/logo-alt.svg"
:width "200px"}]
[:h1 "Your PCP site is up and running."]
[:p "Your json endpoint is here " [:a {:href "/api/info.clj"} "here"]
[:br]
"Learn more about pcp at " [:a {:href a/repo :target "_blank"} "here"]
[:br]
"Happy scripting!"]
[:p.info
[:strong "Request uri "] [:span (str (-> pcp/request :request-uri))]
[:br]
[:strong "Request method "] [:span (str (-> pcp/request :request-method))]
[:br]
[:strong "Request scheme "] [:span (str (-> pcp/request :request-scheme))]
[:br]
[:strong "User agent "]
[:br]
[:code (str (-> pcp/request :http-user-agent))]
[:br]]]]]))
(pcp/response 200 resp "text/html")
```
When navigating to your site, if you see `Connection refused (Connection refused)` it means the PCP service not running. It could still be booting or be down.
You can find instructions on [replacing php and deploying to production here](./docs/replacing-php.md)
## How PCP works
PCP has two parts. The utility is a simple binary, built with GraalVM, that allows you to work effectively with pcp.
```
PCP: Clojure Processor -- Like drugs but better
Usage: pcp [option] [value]
Options:
new [project] Create a new pcp project in the [project] directory
service [stop/start] Stop/start the PCP service
passphrase [project] Set passphrase for [project]
secret [path] Add and encrypt secrets at . or [path]
secret [path] Add and encrypt secrets at . or [path]
-e, --evaluate [path] Evaluate a clojure file using PCP
-s, --serve [root] Start a local server at . or [root]
-v, --version Print the version string and exit
-h, --help Print the command line help
```
The heavy lifting is done by an PCP service. This server runs on port 9000 and receives requests from the local pcp server or from nginx. The PCP service is a uberjar that runs as a daemon.
## System requirements
PCP is designed to work on Linux and OSX. It requires the following to work:
- bash
- java 8+
- systemd / launchd
- unzip
- persitent disk space
- nginx (for production deployment)
## Project structure and requiring files
Requiring files in PCP mostly works as it does in Clojure, the primary exception being that a project cannot require a file outside of its root.
Given a project like this:
```
. # project root
├── .pcp
│ └── a24d...cfdcb8.npy # encrypted secret, touch this and bad things will happen
├── public # server root
│ ├── index.clj
│ └── login.clj
│ └── dashboard.clj
│ └── logic
│ └── orders.clj
│ └── payments.clj
│ └── stock.clj
│ └── users.clj
├── pcp.edn # pcp configuration file
└── README.md # surely you don't need a comment to tell you what this is.
```
Your dashboard could require business logic as follows
```clojure
(ns dashboard
(:require [logic.users :as lu]
[logic.orders :as lo]
[logic.stock :as ls]
[logic.payments :as lp]))
```
## Environment variables and secrets
To allow API keys, tokens, and the like to be stored and retrieved securely, PCP encrypts them and stores them in the project. Secrets are created using the PCP CLI. They are encrypted using the passphrase selected. Here is an example of the process.
```shellsession
$ pcp secret
--------------------------------------------------
Set an encrypted secret variable for project: pcp-demo
Please ensure you use the same passphrase for all your secrets in this project
and that you add your passphrase to your production server using:
pcp passphrase pcp-demo
--------------------------------------------------
Secret name: GITHUB_PERSONAL_ACCESS_TOKEN
Secret value: ghp_eR17e5vHq0Sdmj22oracJd0Y7je1IM3g7oPV7yT7sq31
Passphrase: my-super-secure-passphrase-that-i-will-also-store-on-the-server
encrypting...
done.
```
Symmetric encryption is used, so the passphrase needs to be added to the server too.
```shellsession
$ pcp passphrase pcp-demo
--------------------------------------------------
Set passphrase for project: pcp-demo
This passphrase will be used for decrypting secrets at runtime.
--------------------------------------------------
Passphrase: my-super-secure-passphrase-that-i-will-also-store-on-the-server
```
## PCP namespace
The following functions are part of the core PCP namespace and are made available for convenience.
#### pcp/persist
`(pcp/persist :cache-key f-on-miss)`
This macro allows expensive operations to only be recomputed if they are not in the cache.
On a cache miss, the `f-on-miss` is computed, its value stored in the cache and returned. Caches are isolated
across projects. Pages in the same project share cache keys. The cache uses a TTL (30 min) as its invalidation strategy.
#### pcp/clear
`(pcp/clear :cache-key)`
Removes a key from the cache
#### pcp/request
`pcp/request`
The request map. The request map conforms to the [ring spec](https://github.com/ring-clojure/ring/blob/master/SPEC).
#### pcp/response
`(pcp/response status body mime-type)`
A convenience function for generating a response map. Response map conforms to the [ring spec](https://github.com/ring-clojure/ring/blob/master/SPEC).
#### pcp/redirect
`(pcp/redirect target)`
A convenience function for generating a redirect. Response map conforms to the [ring spec](https://github.com/ring-clojure/ring/blob/master/SPEC).
#### pcp/render-html
`(pcp/render-html options & content)`
Renders html from Clojure data structures using [hiccup](https://github.com/weavejester/hiccup)
#### pcp/secret
`(pcp/secret "SECRET_NAME")`
Retrieves a secret from the project. The secret is read from disk. It may be worthwhile using `pcp/persist` to improve performance.
See [Environment variables and secrets](#environment-variables-and-secrets) for more info.
#### pcp/now
`(pcp/now)`
Returns the current time in milliseconds (according to your server).
#### pcp/slurp
`(pcp/slurp "../file-name")`
Opens a reader on f and reads all its contents, returning a string. Cannot access files higher than project root (i.e. server root -1). Does not currently accept any optional arguments.
#### pcp/slurp-upload
`(pcp/slurp-upload "/var/tmp/temp-file-name")`
`(pcp/slurp-upload (-> pcp/request :params :uploaded :tempfile))`
Opens a reader on f and reads all its contents, returning a string. Cannot access files higher up that project root (i.e. server root -1). Does not currently accept any optional arguments.
#### pcp/spit
`(pcp/spit "../file-name" "like drugs but better")`
Opposite of slurp. Opens f with writer, writes content, then closes f. Cannot access files higher than project root (i.e. server root -1). Does not currently accept any optional arguments.
## Other built-in namespaces
In addition to the core clojure namespaces in [sci](https://github.com/borkdude/sci), the following namespaces are also available.
- `clojure.string`
- `clojure.core.async`
- `clojure.edn`
- `cheshire.core`
- `selmer.parser`
- `selmer.filters`
- `org.httpkit.client`
- `org.httpkit.sni-client`
- `next.jdbc`
- `honeysql.core`
- `honeysql.helpers`
- `postal.core`
- `tick.alpha.api`
- `buddy.sign.jwt`
- `buddy.sign.jwe`
- `buddy.core.hash`
- `buddy.core.codecs`
- `buddy.core.keys`
- `buddy.auth.backends`
- `buddy.auth.middleware`
- `buddy.hashers`
- `garden.core`
- `garden.stylesheet`
- `garden.units`
- `konserve.core`
- `konserve.filestore`
- `konserve-jdbc.core`
## Performance
A modest PCP website can handle its own pretty well.
This test was run for 90 minutes with 500 VUs and 1400 req/s. Of the 7.7M requests generated and 0 failed.
You can see the spike in CPU and bandwidth on the $5 droplet, but the CPU never saturates.
These are by no means comprehensive benchmarks but give you a sense of what a PCP server can withstand for a simple use case.
Going above 1400 req/s generally results in bad things happening. You can test your own site using [k6](https://k6.io/) with the instructions in [loadtest.js](./loadtest.js)
## Deploying PCP
You can find instructions on deploying your PCP site with nginx [here](./docs/replacing-php.md).
Or you could just use this nifty button to deploy to DigitalOcean (experimental).
[](https://cloud.digitalocean.com/apps/new?repo=https://github.com/alekcz/pcp-template/tree/master&refcode=a0cfd79e40a2)
We both get credits for DigitalOcean if you end using their services so be a mate.
# Roadmap & releases
## Release 0.0.1
- [x] Run arbitrary scripts
- [x] Generate HTML with hiccup
- [x] Invoke scripts from Nginx
- [x] Emulate Nginx environment locally
- [x] Store secrets in projects
- [x] Restrict `pcp/slurp` and `pcp/spit` to project root
- [x] Cache expensive operations
- [x] Expose request data to scripts
- [x] Require external namespaces as in Clojure
- [x] Generate new project from CLI
- [x] Document PCP
- [x] Load test a production deployment
## Release 0.0.2
- [x] Perfomance improvements.
- [x] Only read source file from disk if it is not in cache (LRU) or has been modified
- [x] Add `pcp/slurp-upload` for reading temporary files
- [x] Add `pcp/redirect` for convenience redirect
## Release 0.1.0
- [ ] Store passphrases with [konserve](https://github.com/replikativ/konserve)
- [ ] Add sponsorship button
- [ ] Deploy without ssh-ing into VPS
- [ ] More robust CLI processing
- [ ] Automate deployment from repo
## Release 0.2.0
- [ ] Add PEDL (PCP, Nginx, Datahike Server, and Linux) stack template on Digital Ocean.
- [ ] Other things that even the wisest cannont tell; things that were, things that are, and some things... that have not yet come to pass.
## Special thanks
For the guidance and examples, special thanks to
- [@BrunoBonacci](https://github.com/BrunoBonacci)
- [@borkdude](https://github.com/borkdude)
- [@Baeldung](https://twitter.com/Baeldung)
## License
Copyright © 2020 Alexander Oloo
PCP is licensed under the MIT License.