https://github.com/ldaniels528/lollypop
Lollypop is a development platform built to suit the needs of developers of small to medium software projects, and features an integrated database, web services, scenario-driven test suite, and more.
https://github.com/ldaniels528/lollypop
csv dataframe declarative-programming etl functional-programming java json json-parser jvm kafka lollypop matrix matrix-calculations matrix-multiplication reactive-programming scala scripting-language spark sql
Last synced: 22 days ago
JSON representation
Lollypop is a development platform built to suit the needs of developers of small to medium software projects, and features an integrated database, web services, scenario-driven test suite, and more.
- Host: GitHub
- URL: https://github.com/ldaniels528/lollypop
- Owner: ldaniels528
- License: mit
- Created: 2023-10-19T15:51:05.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-06-22T14:52:47.000Z (over 1 year ago)
- Last Synced: 2024-07-31T23:55:29.101Z (over 1 year ago)
- Topics: csv, dataframe, declarative-programming, etl, functional-programming, java, json, json-parser, jvm, kafka, lollypop, matrix, matrix-calculations, matrix-multiplication, reactive-programming, scala, scripting-language, spark, sql
- Language: Scala
- Homepage:
- Size: 5.45 MB
- Stars: 2
- Watchers: 3
- Forks: 2
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
Lollypop v0.1.7.2
============
## Table of Contents
* Introduction
* Project Status
* Getting Started
* As a Shell-Scripting Language Alternative
* Basic Features
* Array Comprehensions
* Array Literals
* Dataframe Literals
* Define and Instantiate JVM classes
* Dictionary/Object Literals
* Implicit Class Declarations
* Implicit Class Importing
* Matrix and Vector Literals
* Matter of taste
* No semicolons required
* String Literals (Double-quoted)
* String Literals (Single-quoted)
* String Literals (Triple-Double-quoted)
* String Literals (Triple-Single-quoted)
* Featured Examples By Category
* Aggregation and Sorting (27)
* Concurrency (10)
* Control Flow (21)
* Dataframe I/O (23)
* Dataframe Management (14)
* Filtering and Matching (25)
* JVM and Reflection (14)
* Machine Learning (2)
* REPL Tools (32)
* Scope and Session (15)
* System Tools (15)
* Testing - Unit/Integration (5)
* Transformation (8)
## Introduction
Lollypop is a general-purpose programming/scripting language for the JVM.
Features include:
* Native support for Scala and Java classes, objects and packages.
* Native support for JSON (arrays, dictionaries and objects).
* Native support for Maven package repositories.
* Data-oriented types - Dataframes, BLOB/CLOB and Matrices and Vectors.
* Multi-paradigm programming model - declarative/SQL, functional, object-oriented and reactive.
Preview — there are still a number of experimental features to sort out.
## Getting Started
### To build Lollypop Core (Client and Server)
```bash
sbt "project core" clean assembly
```
The Jar binary should be `./app/core/target/scala-2.13/core-assembly-0.1.7.2.jar`
### To build the Lollypop JDBC driver
```bash
sbt "project jdbc_driver" clean assembly
```
The Jar binary should be `./app/jdbc-driver/target/scala-2.13/jdbc-driver-assembly-0.1.7.2.jar`
### Run Lollypop REPL
```bash
sbt "project core" run
```
OR
```bash
java -jar ./app/core/target/scala-2.13/core-assembly-0.1.7.2.jar
```
## As a Shell-Scripting Language Alternative
Lollypop offers developers the opportunity to use a Scala/SQL-hybrid scripting language for writing
shell-scripts. And because your scripts will be running within the JVM you can leverage Maven Central
and the myriads of libraries available to it.
#### A new approach to shell-scripting
Lollypop provides native variants of the following UNIX-like commands:
* cat - Retrieves the contents of a file.
* cd - Changes the current directory.
* cp - Copies a source file or directory to a target.
* echo - Prints text to the standard output.
* find - Returns a dataframe containing a recursive list of files matching any specified criterion.
* ls - Returns a dataframe containing a list of files matching any specified criterion.
* md5 - Returns an MD5 digest of a file or byte-encode-able value.
* mkdir - Creates a new directory.
* mv - Renames a file or moves the file to a directory.
* pwd - Retrieves the contents of a file.
* rm - Removes a file or a collection of files via pattern-matching.
* rmdir - Removes a specific directory.
* rmr - Recursively removes files or collections of files via pattern-matching.
* touch - Creates or updates the last modified time of a file. Return true if successful.
* wc - Returns the count of lines of a text file.
* www - A non-interactive HTTP client
#### Let's try something simple
* What if I ask you to write some Bash code to retrieve the top 5 largest files by size in descending order?
Could you write it without consulting a search engine or manual pages? Off the cuff, here's what I came up with to do it. It's crude, and it only works on the Mac...
```bash
ls -lS ./app/examples/ | grep -v ^total | head -n 5
```
##### produced the following:
```text
-rw-r--r--@ 1 ldaniels staff 4990190 Nov 11 23:50 stocks-100k.csv
-rw-r--r--@ 1 ldaniels staff 336324 Nov 11 23:50 stocks.csv
-rw-r--r--@ 1 ldaniels staff 249566 Nov 11 23:50 stocks-5k.csv
drwxr-xr-x@ 6 ldaniels staff 192 Jul 5 14:57 target
drwxr-xr-x@ 5 ldaniels staff 160 Jul 5 14:52 src
```
And here's the equivalent in Lollypop:
```sql
ls app/examples where not isHidden order by length desc limit 5
```
##### produced the following:
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
| stocks-5k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-5k.csv | 2023-11-12T07:50:27.491Z | 249566 | false | true | false |
| .DS_Store | /Users/ldaniels/GitHub/lollypop/app/examples/.DS_Store | 2023-11-12T05:53:49.722Z | 6148 | false | true | true |
| target | /Users/ldaniels/GitHub/lollypop/app/examples/target | 2023-07-05T21:57:46.435Z | 192 | true | false | false |
| companylist | /Users/ldaniels/GitHub/lollypop/app/examples/companylist | 2023-11-12T07:50:27.476Z | 128 | true | false | false |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
```
* What if I ask for the same as above except find files recursively?
```sql
find './app/examples/' where not isHidden order by length desc limit 5
```
##### produced the following:
```sql
|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
```
#### Let's try something practical
* What if you want a list of the top 5 CPU hungry processes?
```sql
def ps() := TableArray((? ps aux ?).map(x =>
x.trim()
.replaceAll(" ", " ")
.split("[ ]")
.filter(x => not x.isEmpty())
))
select PID, `%CPU`, `%MEM`, STARTED, TIME, VSZ, RSS
from (ps())
order by `%CPU` desc
limit 5
```
##### produced the following:
```sql
|--------------------------------------------------------------------|
| PID | %CPU | %MEM | STARTED | TIME | VSZ | RSS |
|--------------------------------------------------------------------|
| 1542 | 83.6 | 0.2 | 13Dec23 | 1657:48.74 | 36408744 | 231972 |
| 25369 | 19.1 | 10.7 | Thu09AM | 728:56.39 | 438577760 | 10803088 |
| 21272 | 12.4 | 3.2 | 9:39AM | 0:25.86 | 437902704 | 3271536 |
| 28637 | 8.2 | 0.6 | Wed04PM | 414:47.08 | 1594687744 | 612032 |
| 360 | 8.1 | 0.8 | 13Dec23 | 669:52.88 | 416009088 | 790640 |
|--------------------------------------------------------------------|
```
#### Let's try something cool
The system command `iostat 1 5` yielded the following text output:
```text
disk0 disk4 disk5 cpu load average
KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us sy id 1m 5m 15m
37.13 105 3.80 127.34 11 1.31 1017.11 6 5.97 10 4 86 2.79 2.33 2.18
22.67 3 0.07 0.00 0 0.00 0.00 0 0.00 5 3 92 2.79 2.33 2.18
0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 6 3 91 2.65 2.31 2.17
0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 7 3 90 2.65 2.31 2.17
0.00 0 0.00 0.00 0 0.00 0.00 0 0.00 7 3 90 2.65 2.31 2.17
```
We could use system evaluation tags `(?` and `?)` to easily capture then parse them into a dataframe:
```sql
def iostat(n, m) := TableArray((? iostat $n $m ?).drop(1).map(x =>
x.trim()
.replaceAll(" ", " ")
.split("[ ]")
.filter(x => not x.isEmpty())
))
iostat(1, 5)
```
##### produced the following:
```sql
|--------------------------------------------------------------------------------------------------|
| KB/t | tps | MB/s | KB/t | tps | MB/s | KB/t | tps | MB/s | us | sy | id | 1m | 5m | 15m |
|--------------------------------------------------------------------------------------------------|
| 37.19 | 105 | 3.81 | 37.19 | 105 | 3.81 | 37.19 | 105 | 3.81 | 10 | 4 | 86 | 2.62 | 2.44 | 2.43 |
| 5.62 | 338 | 1.85 | 5.62 | 338 | 1.85 | 5.62 | 338 | 1.85 | 18 | 5 | 78 | 2.62 | 2.44 | 2.43 |
| 22.67 | 3 | 0.07 | 22.67 | 3 | 0.07 | 22.67 | 3 | 0.07 | 11 | 4 | 85 | 2.62 | 2.44 | 2.43 |
| 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 11 | 4 | 85 | 2.62 | 2.44 | 2.43 |
| 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 10 | 4 | 85 | 2.62 | 2.44 | 2.43 |
|--------------------------------------------------------------------------------------------------|
```
Now we have a dataframe (table) containing the metrics outputted by `iostat`
### Array Comprehensions
*Description*: Define logical arrays
```sql
['A' to 'F'].reverse()
```
##### Results
```sql
['F', 'E', 'D', 'C', 'B', 'A']
```
### Array Literals
*Description*: Define arrays and apply monadic functions
```sql
[1, 3, 5, 7].foldLeft(0, (a, b) => a + b)
```
##### Results
```sql
16
```
### Dataframe Literals
*Description*: Produces graphical charts
```sql
graph { shape: "pie3d", title: "Powered By Lollypop" } from (
|------------------|
| exchange | total |
|------------------|
| NASDAQ | 24 |
| AMEX | 5 |
| NYSE | 28 |
| OTCBB | 32 |
| OTHEROTC | 7 |
|------------------|
)
```
##### Results
### Define and Instantiate JVM classes
*Description*: Creates a new ephemeral (in-memory) JVM-compatible class
```sql
class StockQuote(symbol: String, exchange: String, lastSale: Double, lastSaleTime: Date)
stock = new StockQuote("ABC", "OTCBB", 0.0231, DateTime())
stock.toString()
```
##### Results
```sql
StockQuote("ABC", "OTCBB", 0.0231, "2025-10-30T02:14:55.036Z")
```
### Dictionary/Object Literals
*Description*: Dynamically create objects (e.g. JSON)
```sql
response = { 'message1' : 'Hello World' }
response.message2 = 'Hallo Monde'
response.message3 = ['Hello', 'Hallo', 'World', 'Monde']
response
```
##### Results
```sql
{"message1": "Hello World", "message2": "Hallo Monde", "message3": ["Hello", "Hallo", "World", "Monde"]}
```
### Implicit Class Declarations
*Description*: Binds a virtual method to a class
```sql
implicit class `java.lang.String` {
def reverseString(self) := {
import "java.lang.StringBuilder"
val src = self.toCharArray()
val dest = new StringBuilder(self.length())
val eol = self.length() - 1
var n = 0
while (n <= eol) {
dest.append(src[eol - n])
n += 1
}
dest.toString()
}
}
"Hello World".reverseString()
```
##### Results
```sql
dlroW olleH
```
### Implicit Class Importing
*Description*: Imports the methods of a Scala implicit class
```sql
import implicit "com.lollypop.util.StringRenderHelper$StringRenderer"
DateTime().renderAsJson()
```
##### Results
```sql
"2025-10-30T02:14:55.089Z"
```
### Matrix and Vector Literals
*Description*: Creates a new matrix
```sql
vector = [2.0, 1.0, 3.0]
matrixA = new Matrix([
[1.0, 2.0, 3.0],
[4.0, 5.0, 6.0],
[7.0, 8.0, 9.0]
])
matrixA * vector
```
##### Results
```sql
[13.0, 31.0, 49.0]
```
### Matter of taste
*Description*: The solution to a problem can be achieved many different ways...
```sql
import 'java.lang.Runtime'
rt = Runtime.getRuntime()
chart = { shape: "pie3d", title: "Memory Usage" }
graph chart from {
// (1) the following declarative expression ...
[{ name: 'totalMemory', value: rt.totalMemory() },
{ name: 'freeMemory', value: rt.freeMemory() }].toTable()
// (2) and the following SQL statement ...
select name: 'totalMemory', value: rt.totalMemory()
union
select name: 'freeMemory', value: rt.freeMemory()
// (3) and the following multi-paradigm statement are all equivalent.
transpose(select totalMemory: rt.totalMemory(), freeMemory: rt.freeMemory())
}
```
##### Results
### No semicolons required
*Description*: Separators are unnecessary between most statements
```sql
x = ['A', 'B', 'C', 1, 5, 7] x ++ (x + 5)
```
##### Results
```sql
['A', 'B', 'C', 1, 5, 7, 'F', 'G', 'H', 6, 10, 12]
```
### String Literals (Double-quoted)
*Description*: Declare strings
```sql
item = { name : "Larry" }
"Hello {{ item.name }},\nhow are you?\nFine, I hope!"
```
##### Results
```sql
Hello Larry,
how are you?
Fine, I hope!
```
### String Literals (Single-quoted)
*Description*: Declare strings
```sql
item = { name : "Larry" }
'Hello {{ item.name }},\nhow are you?\nFine, I hope!'
```
##### Results
```sql
Hello Larry,
how are you?
Fine, I hope!
```
### String Literals (Triple-Double-quoted)
*Description*: Declare multiline strings
```sql
item = { name : "Larry" }
"""|Hello {{ item.name }},
|how are you?
|Fine, I hope!
|""".stripMargin('|')
```
##### Results
```sql
Hello Larry,
how are you?
Fine, I hope!
```
### String Literals (Triple-Single-quoted)
*Description*: Declare multiline strings
```sql
item = { name : "Larry" }
'''|Hello {{ item.name }},
|how are you?
|Fine, I hope!
|'''.stripMargin('|')
```
##### Results
```sql
Hello Larry,
how are you?
Fine, I hope!
## Aggregation and Sorting Examples
### avg¹ (Aggregation and Sorting — Functional)
*Description*: Computes the average of a numeric expression.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
avg(stocks#lastSale)
```
##### Results
```sql
61.89333333333334
```
### avg² (Aggregation and Sorting — Functional)
*Description*: Computes the average of a numeric expression.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
select avgLastSale: avg(lastSale) from @stocks
```
##### Results
```sql
|-------------------|
| avgLastSale |
|-------------------|
| 61.89333333333334 |
|-------------------|
```
### count¹ (Aggregation and Sorting — Functional)
*Description*: Returns the number of rows matching the query criteria.
```sql
stocks =
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NYSE | RPPI | 51.8413 | 2023-09-28T00:58:42.974Z |
| AMEX | MDLA | 177.1311 | 2023-09-28T00:58:44.363Z |
| OTCBB | VMUT | | 2023-09-28T00:58:35.392Z |
| AMEX | QTZUA | 120.5353 | 2023-09-28T00:58:08.024Z |
| OTCBB | JCJMT | | 2023-09-28T00:58:17.985Z |
| NASDAQ | EMY | 24.6447 | 2023-09-28T00:58:22.595Z |
|---------------------------------------------------------|
count(stocks)
```
##### Results
```sql
6
```
### count² (Aggregation and Sorting — Functional)
*Description*: Returns the number of rows matching the query criteria.
```sql
stocks =
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NYSE | RPPI | 51.8413 | 2023-09-28T00:58:42.974Z |
| AMEX | MDLA | 177.1311 | 2023-09-28T00:58:44.363Z |
| OTCBB | VMUT | | 2023-09-28T00:58:35.392Z |
| AMEX | QTZUA | 120.5353 | 2023-09-28T00:58:08.024Z |
| OTCBB | JCJMT | | 2023-09-28T00:58:17.985Z |
| NASDAQ | EMY | 24.6447 | 2023-09-28T00:58:22.595Z |
|---------------------------------------------------------|
count(stocks#lastSale)
```
##### Results
```sql
6
```
### count³ (Aggregation and Sorting — Functional)
*Description*: Returns the number of rows matching the query criteria.
```sql
stocks =
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NYSE | RPPI | 51.8413 | 2023-09-28T00:58:42.974Z |
| AMEX | MDLA | 177.1311 | 2023-09-28T00:58:44.363Z |
| OTCBB | VMUT | | 2023-09-28T00:58:35.392Z |
| AMEX | QTZUA | 120.5353 | 2023-09-28T00:58:08.024Z |
| OTCBB | JCJMT | | 2023-09-28T00:58:17.985Z |
| NASDAQ | EMY | 24.6447 | 2023-09-28T00:58:22.595Z |
|---------------------------------------------------------|
select total: count(*) from @stocks
```
##### Results
```sql
|-------|
| total |
|-------|
| 6 |
|-------|
```
### count⁴ (Aggregation and Sorting — Functional)
*Description*: Returns the number of rows matching the query criteria.
```sql
stocks =
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NYSE | RPPI | 51.8413 | 2023-09-28T00:58:42.974Z |
| AMEX | MDLA | 177.1311 | 2023-09-28T00:58:44.363Z |
| OTCBB | VMUT | | 2023-09-28T00:58:35.392Z |
| AMEX | QTZUA | 120.5353 | 2023-09-28T00:58:08.024Z |
| OTCBB | JCJMT | | 2023-09-28T00:58:17.985Z |
| NASDAQ | EMY | 24.6447 | 2023-09-28T00:58:22.595Z |
|---------------------------------------------------------|
select total: count(lastSale) from @stocks
```
##### Results
```sql
|-------|
| total |
|-------|
| 4 |
|-------|
```
### countUnique¹ (Aggregation and Sorting — Functional)
*Description*: Returns the distinct number of rows matching the query criteria.
```sql
stocks =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| VDON | OTCBB | 0.4002 | 2023-07-29T05:06:56.232Z |
| XETQ | OTCBB | 5.1147 | 2023-07-29T05:06:56.233Z |
| XGDJ | NASDAQ | 51.5446 | 2023-07-29T05:06:56.236Z |
| FQPY | NASDAQ | 75.4873 | 2023-07-29T05:06:56.238Z |
| VNQR | NASDAQ | 38.5333 | 2023-07-29T05:06:56.239Z |
|---------------------------------------------------------|
select total: count(unique(exchange)) from @stocks
```
##### Results
```sql
|-------|
| total |
|-------|
| 2 |
|-------|
```
### countUnique² (Aggregation and Sorting — Functional)
*Description*: Returns the distinct number of rows matching the query criteria.
```sql
stocks =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| VDON | OTCBB | 0.4002 | 2023-07-29T05:06:56.232Z |
| XETQ | OTCBB | 5.1147 | 2023-07-29T05:06:56.233Z |
| XGDJ | NASDAQ | 51.5446 | 2023-07-29T05:06:56.236Z |
| FQPY | NASDAQ | 75.4873 | 2023-07-29T05:06:56.238Z |
| VNQR | NASDAQ | 38.5333 | 2023-07-29T05:06:56.239Z |
|---------------------------------------------------------|
select total: countUnique(exchange) from @stocks
```
##### Results
```sql
|-------|
| total |
|-------|
| 2 |
|-------|
```
### group by¹ (Aggregation and Sorting — Declarative)
*Description*: Aggregates a result set by a column
```sql
select kind, total: count(*)
from (this)
group by kind
```
##### Results
```sql
|------------------------|
| kind | total |
|------------------------|
| PrintStream | 2 |
| Random$ | 1 |
| OS | 1 |
| WebSockets$ | 1 |
| BufferedReader | 1 |
| Double | 1 |
| Nodes | 1 |
|------------------------|
```
### group by² (Aggregation and Sorting — Declarative)
*Description*: Aggregates a result set by a column
```sql
chart = { shape: "pie3d", title: "Types in Session" }
graph chart from (
select kind, total: count(*)
from (this)
group by kind
)
```
##### Results
### max¹ (Aggregation and Sorting — Functional)
*Description*: Returns the maximum value of a numeric expression.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
max(stocks#lastSale)
```
##### Results
```sql
97.61
```
### max² (Aggregation and Sorting — Functional)
*Description*: Returns the maximum value of a numeric expression.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
select maxLastSale: max(lastSale) from @stocks
```
##### Results
```sql
|-------------|
| maxLastSale |
|-------------|
| 97.61 |
|-------------|
```
### min¹ (Aggregation and Sorting — Functional)
*Description*: Returns the minimum value of a numeric expression.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
min(stocks#lastSale)
```
##### Results
```sql
31.95
```
### min² (Aggregation and Sorting — Functional)
*Description*: Returns the minimum value of a numeric expression.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
select minLastSale: min(lastSale) from @stocks
```
##### Results
```sql
|-------------|
| minLastSale |
|-------------|
| 31.95 |
|-------------|
```
### order by (Aggregation and Sorting — Declarative)
*Description*: Sorts a result set by a column
```sql
from (
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| HWWM | NASDAQ | 191.6725 | 2023-08-06T18:33:08.661Z |
| VLYW | AMEX | 197.9962 | 2023-08-06T18:33:08.670Z |
| VSOM | NASDAQ | 166.8542 | 2023-08-06T18:33:08.672Z |
| FHWS | NYSE | 22.5909 | 2023-08-06T18:33:08.673Z |
| SRGN | AMEX | 180.2358 | 2023-08-06T18:33:08.675Z |
| PTFY | NYSE | 19.9265 | 2023-08-06T18:33:08.676Z |
|---------------------------------------------------------|
) order by lastSale desc
```
##### Results
```sql
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| VLYW | AMEX | 197.9962 | 2023-08-06T18:33:08.670Z |
| HWWM | NASDAQ | 191.6725 | 2023-08-06T18:33:08.661Z |
| SRGN | AMEX | 180.2358 | 2023-08-06T18:33:08.675Z |
| VSOM | NASDAQ | 166.8542 | 2023-08-06T18:33:08.672Z |
| FHWS | NYSE | 22.5909 | 2023-08-06T18:33:08.673Z |
| PTFY | NYSE | 19.9265 | 2023-08-06T18:33:08.676Z |
|---------------------------------------------------------|
```
### sum¹ (Aggregation and Sorting — Functional)
*Description*: Returns the sum of a numeric expression.
```sql
stocks = (
|-------------------|
| symbol | lastSale |
|-------------------|
| VHLH | 153.2553 |
| GPI | 89.7307 |
| SGE | 131.6038 |
| GVABB | 31.1324 |
| GTIT | 110.6881 |
| JDXEZ | 243.4389 |
| RNUBE | 157.2571 |
| DBY | 237.5894 |
| CO | 109.6587 |
| BIU | 232.9175 |
|-------------------|
)
sum(stocks#lastSale)
```
##### Results
```sql
1497.2719
```
### sum² (Aggregation and Sorting — Functional)
*Description*: Returns the sum of a numeric expression.
```sql
select total: sum(lastSale) from (
|-------------------|
| symbol | lastSale |
|-------------------|
| VHLH | 153.2553 |
| GPI | 89.7307 |
| SGE | 131.6038 |
| GVABB | 31.1324 |
| GTIT | 110.6881 |
| JDXEZ | 243.4389 |
| RNUBE | 157.2571 |
| DBY | 237.5894 |
| CO | 109.6587 |
| BIU | 232.9175 |
|-------------------|
)
```
##### Results
```sql
|-----------|
| total |
|-----------|
| 1497.2719 |
|-----------|
```
### TableArray¹ (Aggregation and Sorting — Declarative)
*Description*: Transforms an array of an array of primitive values (Boolean, Int, String et al) into a table
```sql
def iostat(n, m) := TableArray((? iostat $n $m ?).drop(1).map(x =>
x.trim()
.replaceAll(" ", " ")
.split("[ ]")
.filter(x => not x.isEmpty())
))
iostat(1, 5)
```
##### Results
```sql
|---------------------------------------------------------|
| KB/t | tps | MB/s | us | sy | id | 1m | 5m | 15m |
|---------------------------------------------------------|
| 17.48 | 35 | 0.59 | 7 | 3 | 90 | 3.9 | 4.07 | 3.69 |
| 16.0 | 1 | 0.02 | 6 | 3 | 91 | 3.9 | 4.07 | 3.69 |
| 4.92 | 13 | 0.06 | 11 | 6 | 84 | 3.9 | 4.07 | 3.69 |
| 4.56 | 212 | 0.95 | 16 | 3 | 82 | 3.9 | 4.07 | 3.69 |
| 137.11 | 94 | 12.53 | 13 | 2 | 85 | 3.9 | 4.07 | 3.69 |
|---------------------------------------------------------|
```
### TableArray² (Aggregation and Sorting — Declarative)
*Description*: Transforms an array of an array of primitive values (Boolean, Int, String et al) into a table
```sql
def ps() := TableArray((? ps aux ?).map(x =>
x.trim()
.replaceAll(" ", " ")
.split("[ ]")
.filter(x => not x.isEmpty())
))
select PID, `%CPU`, `%MEM`, STARTED, TIME, VSZ, RSS
from (ps())
order by `%CPU` desc
limit 5
```
##### Results
```sql
|------------------------------------------------------------------|
| PID | %CPU | %MEM | STARTED | TIME | VSZ | RSS |
|------------------------------------------------------------------|
| 21997 | 201.9 | 9.7 | Sun10PM | 149:08.41 | 439574544 | 9767296 |
| 385 | 10.4 | 0.3 | 20Oct25 | 572:30.44 | 416779888 | 285568 |
| 40959 | 9.6 | 0.7 | 7:14PM | 0:06.24 | 441731952 | 675968 |
| 24315 | 6.3 | 0.9 | Mon12AM | 143:05.96 | 418138896 | 917232 |
| 587 | 3.1 | 0.1 | 20Oct25 | 5:00.92 | 412368896 | 61872 |
|------------------------------------------------------------------|
```
### to (Aggregation and Sorting — Declarative)
*Description*: Defines an inclusive range of values
```sql
'A' to 'G'
```
##### Results
```sql
['A', 'B', 'C', 'D', 'E', 'F', 'G']
```
### transpose¹ (Aggregation and Sorting — Declarative)
*Description*: Makes columns into rows and rows into columns. The function returns a table with the rows and columns transposed.
```sql
transpose(items: [1 to 5])
```
##### Results
```sql
|-------|
| items |
|-------|
| 1 |
| 2 |
| 3 |
| 4 |
| 5 |
|-------|
```
### transpose² (Aggregation and Sorting — Declarative)
*Description*: Makes columns into rows and rows into columns. The function returns a table with the rows and columns transposed.
```sql
faces = transpose(face: ["2", "3", "4", "5", "6", "7", "8", "9", "10", "J", "Q", "K", "A"])
suits = transpose(suit: ["♠", "♦", "♥", "♣"])
deck = faces * suits
deck.shuffle()
@deck limit 5
```
##### Results
```sql
|-------------|
| face | suit |
|-------------|
| 2 | ♣ |
| 8 | ♠ |
| 7 | ♣ |
| 3 | ♦ |
| 7 | ♦ |
|-------------|
```
### transpose³ (Aggregation and Sorting — Declarative)
*Description*: Makes columns into rows and rows into columns. The function returns a table with the rows and columns transposed.
```sql
transpose(help('select'))
```
##### Results
```sql
|----------------------------------------------------------------------------------------------------|
| name | value |
|----------------------------------------------------------------------------------------------------|
| name | select |
| category | Dataframe I/O |
| paradigm | Declarative |
| description | Returns row(s) of data based on the expression and options |
| example | select symbol: 'GMTQ', exchange: 'OTCBB', lastSale: 0.1111, lastSaleTime: DateTime() |
|----------------------------------------------------------------------------------------------------|
```
### transpose⁴ (Aggregation and Sorting — Declarative)
*Description*: Makes columns into rows and rows into columns. The function returns a table with the rows and columns transposed.
```sql
transpose(new Matrix([
[1.0, 2.0, 3.0],
[4.0, 5.0, 6.0],
[7.0, 8.0, 9.0]
]))
```
##### Results
```sql
|-----------------|
| A | B | C |
|-----------------|
| 1.0 | 4.0 | 7.0 |
| 2.0 | 5.0 | 8.0 |
| 3.0 | 6.0 | 9.0 |
|-----------------|
```
### unique (Aggregation and Sorting — Functional)
*Description*: Returns a unique collection of elements based on the query criteria.
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | NYSE | 56.12 |
| YOKE | NYSE | 56.12 |
| DNS | AMEX | 97.61 |
|------------------------------|
select exchange: unique(exchange) from @stocks
```
##### Results
```sql
|------------------|
| exchange |
|------------------|
| ["AMEX", "NYSE"] |
|------------------|
```
### unnest (Aggregation and Sorting — Declarative)
*Description*: Explodes a column of a collection into multiple rows.
```sql
declare table stocks(symbol: String(4), exchange: String(6), transactions: Table(price: Double, transactionTime: DateTime)[5])
insert into @stocks (symbol, exchange, transactions)
values ('AAPL', 'NASDAQ', {price:156.39, transactionTime:"2021-08-05T19:23:11.000Z"}),
('AMD', 'NASDAQ', {price:56.87, transactionTime:"2021-08-05T19:23:11.000Z"}),
('INTC', 'NYSE', {price:89.44, transactionTime:"2021-08-05T19:23:11.000Z"}),
('AMZN', 'NASDAQ', {price:988.12, transactionTime:"2021-08-05T19:23:11.000Z"}),
('SHMN', 'OTCBB', [{price:0.0010, transactionTime:"2021-08-05T19:23:11.000Z"},
{price:0.0011, transactionTime:"2021-08-05T19:23:12.000Z"}])
select symbol, exchange, unnest(transactions) from @stocks where symbol is 'SHMN'
```
##### Results
```sql
|-------------------------------------------------------|
| symbol | exchange | price | transactionTime |
|-------------------------------------------------------|
| SHMN | OTCBB | 0.001 | 2021-08-05T19:23:11.000Z |
| SHMN | OTCBB | 0.0011 | 2021-08-05T19:23:12.000Z |
|-------------------------------------------------------|
```
### until (Aggregation and Sorting — Declarative)
*Description*: Defines an exclusive range of values
```sql
'A' until 'G'
```
##### Results
```sql
['A', 'B', 'C', 'D', 'E', 'F']
```
## Concurrency Examples
### after (Concurrency — Reactive)
*Description*: Schedules a one-time execution of command(s) after a specific delay period
```sql
var ticker = 5
after Duration('100 millis') ticker += 3
import "java.lang.Thread"
Thread.sleep(Long(250))
ticker is 8
```
##### Results
```sql
true
```
### async (Concurrency — Reactive)
*Description*: Asynchronously executes an instruction
```sql
async { OS.listFiles("./app") }
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------|
| kungfu | /Users/ldaniels/GitHub/lollypop/app/kungfu | 2024-07-30T03:15:25.887Z | 160 | true | false | false |
| .DS_Store | /Users/ldaniels/GitHub/lollypop/app/.DS_Store | 2025-10-30T02:10:47.127Z | 8196 | false | true | true |
| core | /Users/ldaniels/GitHub/lollypop/app/core | 2023-05-23T21:20:11.818Z | 160 | true | false | false |
| target | /Users/ldaniels/GitHub/lollypop/app/target | 2024-02-16T14:34:39.104Z | 192 | true | false | false |
| examples | /Users/ldaniels/GitHub/lollypop/app/examples | 2023-11-12T07:50:27.491Z | 288 | true | false | false |
| jdbc-driver | /Users/ldaniels/GitHub/lollypop/app/jdbc-driver | 2023-06-29T22:26:20.960Z | 160 | true | false | false |
|-------------------------------------------------------------------------------------------------------------------------------------|
```
### every (Concurrency — Reactive)
*Description*: Schedules the execution of command(s) on a specific interval
```sql
var n = 0
val timer = every Duration("20 millis") n += 1
import "java.lang.Thread"
Thread.sleep(Long(1000))
timer.cancel()
n
```
##### Results
```sql
51
```
### Nodes¹ (Concurrency — Declarative)
*Description*: Executes a statement on a running Lollypop peer node.
```sql
node = Nodes.start()
node.awaitStartup(Duration('1 second'))
results = node.exec('''
from (
|-------------------------------------------------------|
| ticker | market | lastSale | lastSaleTime |
|-------------------------------------------------------|
| NKWI | OTCBB | 98.9501 | 2022-09-04T23:36:47.846Z |
| AQKU | NASDAQ | 68.2945 | 2022-09-04T23:36:47.860Z |
| WRGB | AMEX | 46.8355 | 2022-09-04T23:36:47.862Z |
| ESCN | AMEX | 42.5934 | 2022-09-04T23:36:47.865Z |
| NFRK | AMEX | 28.2808 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------|
) where lastSale < 30
''')
node.stop()
results
```
##### Results
```sql
|-------------------------------------------------------|
| ticker | market | lastSale | lastSaleTime |
|-------------------------------------------------------|
| NFRK | AMEX | 28.2808 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------|
```
### Nodes² (Concurrency — Functional)
*Description*: Creates a new REST API endpoint.
```sql
node = Nodes.start()
node.awaitStartup(Duration('1 second'))
node.api('/api/comments/', {
post: (message: String) => "post '{{message}}'"
get: (id: UUID) => "get {{(id}}"
put: (id: UUID, message: String) => "put '{{message}}' ~> {{(id}}"
delete: (id: UUID) => "delete {{(id}}"
})
www post "http://0.0.0.0:{{node.server.port()}}/api/comments/" <~ { message: "Hello World" }
```
##### Results
```sql
HttpResponse(body="post 'Hello World'", message="OK", statusCode=200, responseID=5e58a6f8-aca9-4aa8-a11f-2e4cf726b8a2)
```
### Nodes³ (Concurrency — Declarative)
*Description*: Opens a commandline interface to a remote Lollypop peer node.
```sql
node = Nodes.start()
node.awaitStartup(Duration('1 second'))
try
node.exec(["x = 1", "y = 2", "z = x + y", "z"])
catch e => stderr <=== e
finally
node.stop()
```
##### Results
```sql
|--------|
| result |
|--------|
| 3 |
|--------|
```
### Nodes⁴ (Concurrency — Declarative)
*Description*: Creates a new HTML/CSS/File endpoint
```sql
node = Nodes.start()
node.awaitStartup(Duration('1 second'))
node.files('/www/notebooks/', {
"" : "public/index.html",
"*" : "public"
})
```
##### Results
```sql
false
```
### once (Concurrency — Reactive)
*Description*: Invokes an instruction or set of instructions one-time only
```sql
[1 to 5].foreach(n => {
stdout <=== 'This happens every cycle {{n}}\n'
once stdout <=== 'This happens once {{n}}\n'
})
```
##### Results
```sql
()
```
##### Console Output
```
This happens every cycle 1
This happens once 1
This happens every cycle 2
This happens every cycle 3
This happens every cycle 4
This happens every cycle 5
```
### whenever¹ (Concurrency — Reactive)
*Description*: Executes an instruction at the moment the conditional expression evaluates as true
```sql
whenever n_bricks is 0 { stdout <=== "n_bricks is empty\n" }
stdout <=== "Setting n_bricks to 0\n"
n_bricks = 0
stdout <=== "Did it work?"
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
Setting n_bricks to 0
n_bricks is empty
Did it work?
```
### whenever² (Concurrency — Reactive)
*Description*: Executes an instruction at the moment the regular expression evaluates as true
```sql
whenever '^set(.*)'
stdout <=== "instruction was '{{__INSTRUCTION__}}'\n"
set x = { message: "Confirmed" }
stdout <=== "Did it work?"
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
instruction was 'set x = { message: "Confirmed" }'
Did it work?
```
## Control Flow Examples
### && (Control Flow — Declarative)
*Description*: Binds multiple statements together
```sql
declare table if not exists TradingSystem (
stock_id: RowNumber,
symbol: String(5),
exchange: Enum ('AMEX', 'NASDAQ', 'NYSE', 'OTCBB', 'OTHEROTC'),
lastSale: Double,
lastSaleTime: DateTime = DateTime())
&& insert into TradingSystem (symbol, exchange, lastSale, lastSaleTime)
values ("MSFT", "NYSE", 56.55, DateTime()),
("AAPL", "NASDAQ", 98.55, DateTime()),
("AMZN", "NYSE", 56.55, DateTime()),
("GOOG", "NASDAQ", 98.55, DateTime())
&& from TradingSystem
```
##### Results
```sql
|--------------------------------------------------------------------|
| stock_id | symbol | exchange | lastSale | lastSaleTime |
|--------------------------------------------------------------------|
| 0 | MSFT | NYSE | 56.55 | 2025-10-30T02:15:01.978Z |
| 1 | AAPL | NASDAQ | 98.55 | 2025-10-30T02:15:01.978Z |
| 2 | AMZN | NYSE | 56.55 | 2025-10-30T02:15:01.978Z |
| 3 | GOOG | NASDAQ | 98.55 | 2025-10-30T02:15:01.978Z |
|--------------------------------------------------------------------|
```
### ??? (Control Flow — Declarative)
*Description*: `???` can be used for marking methods that remain to be implemented.
```sql
def blowUp() := ???
try
blowUp()
catch e =>
stdout <=== e.getMessage()
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
an implementation is missing on line 3 at 3
```
### call (Control Flow — Procedural)
*Description*: Executes a stored procedure; returns a row set
```sql
namespace "test.examples"
stockQuotes =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| DBGK | AMEX | 46.2471 | 2023-08-06T04:50:07.478Z |
| GROT | NASDAQ | 44.3673 | 2023-08-06T04:50:07.480Z |
| SCOF | NASDAQ | 60.8058 | 2023-08-06T04:50:07.482Z |
| CYCR | NASDAQ | 83.9982 | 2023-08-06T04:50:07.483Z |
| IIDA | NASDAQ | 126.3182 | 2023-08-06T04:50:07.484Z |
|---------------------------------------------------------|
drop if exists getStockQuote
create procedure getStockQuote(theExchange: String,
--> exchange: String,
--> total: Double,
--> maxPrice: Double,
--> minPrice: Double) as
select exchange, total: count(*), maxPrice: max(lastSale), minPrice: min(lastSale)
from @stockQuotes
where exchange is theExchange
group by exchange
call getStockQuote("NASDAQ")
```
##### Results
```sql
|----------------------------------------|
| exchange | total | maxPrice | minPrice |
|----------------------------------------|
| NASDAQ | 4.0 | 126.3182 | 44.3673 |
|----------------------------------------|
```
### create function (Control Flow — Procedural)
*Description*: Creates a function
```sql
create function if not exists calc_add(a: Int, b: Int) := a + b
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
### create macro (Control Flow — Declarative)
*Description*: Creates a persistent macro
```sql
namespace "temp.examples"
create macro if not exists n_tickers := "tickers %e:qty" {
[1 to qty].map(_ => {
exchange = ['AMEX', 'NASDAQ', 'NYSE', 'OTCBB', 'OTHER_OTC'][Random.nextInt(5)]
is_otc = exchange.startsWith("OT")
lastSaleLimit = switch exchange case "OTCBB" then 5.0 case "OTHER_OTC" then 1.0 case _ then 100.0
lastSale = scaleTo(lastSaleLimit * Random.nextDouble(1.0), 4)
lastSaleTime = DateTime(DateTime() - Duration(1000 * 60 * Random.nextDouble(1.0)))
symbol = Random.nextString(['A' to 'Z'], iff(exchange.startsWith("OT"), Random.nextInt(2) + 4, Random.nextInt(4) + 2))
select lastSaleTime, lastSale, exchange, symbol
}).toTable()
}
tickers 5
```
##### Results
```sql
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTHER_OTC | YRKCD | 0.7349 | 2025-10-30T02:14:33.582Z |
| AMEX | IB | 1.2678 | 2025-10-30T02:14:59.131Z |
| AMEX | NNOG | 15.0754 | 2025-10-30T02:14:41.042Z |
| NYSE | UN | 72.5213 | 2025-10-30T02:14:07.038Z |
| NASDAQ | SZYSL | 45.1858 | 2025-10-30T02:14:14.629Z |
|----------------------------------------------------------|
```
### create procedure (Control Flow — Procedural)
*Description*: Creates a database procedure
```sql
namespace "test.examples"
stockQuotes =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| DBGK | AMEX | 46.2471 | 2023-08-06T04:50:07.478Z |
| GROT | NASDAQ | 44.3673 | 2023-08-06T04:50:07.480Z |
| SCOF | NASDAQ | 60.8058 | 2023-08-06T04:50:07.482Z |
| CYCR | NASDAQ | 83.9982 | 2023-08-06T04:50:07.483Z |
| IIDA | NASDAQ | 126.3182 | 2023-08-06T04:50:07.484Z |
|---------------------------------------------------------|
drop if exists getStockQuote
create procedure getStockQuote(theExchange: String,
--> exchange: String,
--> total: Double,
--> maxPrice: Double,
--> minPrice: Double) :=
select exchange, total: count(*), maxPrice: max(lastSale), minPrice: min(lastSale)
from @stockQuotes
where exchange is theExchange
group by exchange
call getStockQuote("NASDAQ")
```
##### Results
```sql
|----------------------------------------|
| exchange | total | maxPrice | minPrice |
|----------------------------------------|
| NASDAQ | 4.0 | 126.3182 | 44.3673 |
|----------------------------------------|
```
### def¹ (Control Flow — Functional)
*Description*: Defines a named user-defined function
```sql
def ¡(n: Double) := iff(n <= 1.0, 1.0, n * ¡(n - 1.0))
¡(5)
```
##### Results
```sql
120.0
```
### def² (Control Flow — Functional)
*Description*: Defines a named user-defined function
```sql
def msec(op) := {
import ["java.lang.System"]
val startTime = System.nanoTime()
val result = op()
val elapsedTime = (System.nanoTime() - startTime) / 1000000.0
(elapsedTime, result)
}
def ¡(n: Double) := iff(n <= 1.0, 1.0, n * ¡(n - 1.0))
msec(() => ¡(6))
```
##### Results
```sql
Tuple2(_1=0.329667, _2=720.0)
```
### def³ (Control Flow — Functional)
*Description*: Defines a named user-defined function
```sql
def roman(value: Int) := ("I" * value)
.replaceAll("IIIII", "V")
.replaceAll("IIII", "IV")
.replaceAll("VV", "X")
.replaceAll("VIV", "IX")
.replaceAll("XXXXX", "L")
.replaceAll("XXXX", "XL")
.replaceAll("LL", "C")
.replaceAll("LXL", "XC")
.replaceAll("CCCCC", "D")
.replaceAll("CCCC", "CD")
.replaceAll("DD", "M")
.replaceAll("DCD", "CM")
roman(1023)
```
##### Results
```sql
MXXIII
```
### do (Control Flow — Procedural)
*Description*: Creates a loop that executes enclosed statement(s) until the test condition evaluates to false
```sql
var x = 0
var y = 1
do { x += 1; y *= x } while x < 5
y
```
##### Results
```sql
120
```
### each¹ (Control Flow — Declarative)
*Description*: Iterates over a dataframe applying a function to each row and optionally yields a new transformed dataframe
```sql
stocks =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| LORI | NYSE | 89.6033 | 2023-07-29T04:09:04.524Z |
| AVSR | AMEX | 477.5694 | 2023-07-29T04:09:04.529Z |
| KXYP | OTCBB | 475.6416 | 2023-07-29T04:09:04.531Z |
| JYVV | NYSE | 197.1071 | 2023-07-29T04:09:04.532Z |
| EVDX | OTCBB | 77.1829 | 2023-07-29T04:09:04.533Z |
|---------------------------------------------------------|
var messages = []
each item in (select symbol, lastSale from @stocks where lastSale < 100)
messages = messages.push('{{item.symbol}} is {{item.lastSale}}/share')
messages
```
##### Results
```sql
["LORI is 89.6033/share", "EVDX is 77.1829/share"]
```
### each² (Control Flow — Declarative)
*Description*: Iterates a dataframe in reverse order applying a function to each row
```sql
stocks =
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTHER_OTC | WAEQK | 0.6713 | 2023-10-14T18:40:32.998Z |
| NASDAQ | RQNMU | 19.6168 | 2023-10-14T18:40:32.335Z |
| NASDAQ | WP | 45.7338 | 2023-10-14T18:40:24.264Z |
| OTHER_OTC | NNFO | 0.151 | 2023-10-14T18:39:51.236Z |
| NASDAQ | LVEBB | 8.4378 | 2023-10-14T18:39:58.491Z |
| NASDAQ | SWTD | 22.5552 | 2023-10-14T18:39:50.783Z |
| OTHER_OTC | CZYBQ | 0.8543 | 2023-10-14T18:40:40.513Z |
| NASDAQ | CQ | 174.0586 | 2023-10-14T18:39:55.858Z |
| NYSE | QOVGA | 1.9199 | 2023-10-14T18:40:14.590Z |
| NYSE | ZJWL | 17.3107 | 2023-10-14T18:40:13.205Z |
|----------------------------------------------------------|
each item in (stocks.reverse()) yield item
```
##### Results
```sql
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| NYSE | ZJWL | 17.3107 | 2023-10-14T18:40:13.205Z |
| NYSE | QOVGA | 1.9199 | 2023-10-14T18:40:14.590Z |
| NASDAQ | CQ | 174.0586 | 2023-10-14T18:39:55.858Z |
| OTHER_OTC | CZYBQ | 0.8543 | 2023-10-14T18:40:40.513Z |
| NASDAQ | SWTD | 22.5552 | 2023-10-14T18:39:50.783Z |
| NASDAQ | LVEBB | 8.4378 | 2023-10-14T18:39:58.491Z |
| OTHER_OTC | NNFO | 0.151 | 2023-10-14T18:39:51.236Z |
| NASDAQ | WP | 45.7338 | 2023-10-14T18:40:24.264Z |
| NASDAQ | RQNMU | 19.6168 | 2023-10-14T18:40:32.335Z |
| OTHER_OTC | WAEQK | 0.6713 | 2023-10-14T18:40:32.998Z |
|----------------------------------------------------------|
```
### if (Control Flow — Procedural)
*Description*: If the `expression` is true, then `outcomeA` otherwise `outcomeB`
```sql
value = 123
if(value > 99) "Yes!" else "No."
```
##### Results
```sql
Yes!
```
### iff (Control Flow — Functional)
*Description*: If the `condition` is true, then `trueValue` otherwise `falseValue`
```sql
value = 123
iff(value > 99, 'Yes!', 'No.')
```
##### Results
```sql
Yes!
```
### macro (Control Flow — Declarative)
*Description*: Creates a user-defined instruction
```sql
macro "drawCircle ( %e:size ) @ ( %e:x , %e:y )" := {
"Circle({{size}}) <- ({{x * 2}}, {{y / 2}})"
}
stdout <=== drawCircle(100)@(80, 650)
```
##### Results
```sql
Circle(100) <- (160, 325)
```
### return (Control Flow — Procedural)
*Description*: Returns a result set (from a daughter scope)
```sql
return 'Hello World'
```
##### Results
```sql
Hello World
```
### throw (Control Flow — Procedural)
*Description*: Throws a JVM exception
```sql
try
throw new `java.lang.RuntimeException`('A processing error occurred')
catch e => stdout <=== e.getMessage()
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
A processing error occurred on line 2 at 3
```
### try¹ (Control Flow — Functional)
*Description*: Attempts an operation and catches any exceptions that occur preventing them from stopping program execution
```sql
def connect() := throw new `java.lang.RuntimeException`("Connection error")
try connect() catch e => stderr <=== e.getMessage()
```
##### Results
```sql
java.io.PrintStream@5bb2fb2b
```
##### Console Error
```
Connection error on line 1 at 17 on line 2 at 5
```
### try² (Control Flow — Functional)
*Description*: Attempts an operation and catches any exceptions that occur preventing them from stopping program execution
```sql
var n = 0
try n /= 0 catch e => stderr <=== e.getMessage() finally n = -1
this
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------|
| name | kind | value |
|-------------------------------------------------------------------------------------------------------------|
| WebSockets | WebSockets$ | lollypop.io.WebSockets$@63485d7 |
| n | Integer | -1 |
| stdout | PrintStream | java.io.PrintStream@23ea8830 |
| stdin | BufferedReader | java.io.BufferedReader@790ac3e0 |
| stderr | PrintStream | java.io.PrintStream@5bb2fb2b |
| OS | OS | lollypop.lang.OS |
| π | Double | 3.141592653589793 |
| Nodes | Nodes | lollypop.io.Nodes@2cee5365 |
| e | DivisionByZeroError | com.lollypop.runtime.errors.DivisionByZeroError: Division by zero: n / 0 |
| Random | Random$ | lollypop.lang.Random |
|-------------------------------------------------------------------------------------------------------------|
```
##### Console Error
```
Division by zero: n / 0
```
### while (Control Flow — Procedural)
*Description*: Repeats the `command` while the `expression` is true
```sql
var x = 0
var y = 1
while x < 5 do { x += 1; y *= x }
y
```
##### Results
```sql
120
```
### with (Control Flow — Functional)
*Description*: Provides a closure over a resource; closing it upon completion.
```sql
namespace "temp.examples"
drop if exists `Stocks`
create table `Stocks` (
symbol: String(8),
exchange: Enum (AMEX, NASDAQ, NYSE, OTCBB, OTHEROTC),
lastSale: Double
) containing (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
| JUNK | AMEX | 97.61 |
| ABC | OTCBB | 5.887 |
|------------------------------|
)
with ns("Stocks") { stocks => @stocks where lastSale < 50 }
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
|------------------------------|
```
## Dataframe I/O Examples
### # (Dataframe I/O — Declarative)
*Description*: Returns a column slice of a data frame
```sql
declare table stocks(symbol: String(4), exchange: String(6), lastSale: Double, lastSaleTime: DateTime)
containing (
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NQOO | AMEX | 190.1432 | 2023-08-10T01:44:20.075Z |
| LVMM | NASDAQ | 164.2654 | 2023-08-10T01:44:20.092Z |
| VQLJ | AMEX | 160.753 | 2023-08-10T01:44:20.093Z |
| LRBJ | OTCBB | 64.0764 | 2023-08-10T01:44:20.095Z |
| QFHM | AMEX | 148.6447 | 2023-08-10T01:44:20.096Z |
|---------------------------------------------------------|
)
stocks#[symbol, lastSale]
```
##### Results
```sql
|-------------------|
| symbol | lastSale |
|-------------------|
| NQOO | 190.1432 |
| LVMM | 164.2654 |
| VQLJ | 160.753 |
| LRBJ | 64.0764 |
| QFHM | 148.6447 |
|-------------------|
```
### delete (Dataframe I/O — Declarative)
*Description*: Deletes rows matching an expression from a table
```sql
val stocks =
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| OWWO | NYSE | 483.0286 |
| SJJR | OTCBB | 56.7381 |
| EGXY | OTCBB | 309.8648 |
| NXSQ | OTCBB | 254.2278 |
| LQRQ | AMEX | 88.42 |
|------------------------------|
delete from @stocks where symbol is "EGXY"
stocks
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| OWWO | NYSE | 483.0286 |
| SJJR | OTCBB | 56.7381 |
| NXSQ | OTCBB | 254.2278 |
| LQRQ | AMEX | 88.42 |
|------------------------------|
```
### describe (Dataframe I/O — Declarative)
*Description*: Returns a table representing the layout of the query expression
```sql
describe (select v1: 123, v2: 'abc')
```
##### Results
```sql
|------------------------------------------------------------|
| name | type | description | defaultValue | isNullable |
|------------------------------------------------------------|
| v1 | Int | | | |
| v2 | String(3) | | | |
|------------------------------------------------------------|
```
### from (Dataframe I/O — Declarative)
*Description*: Retrieves rows from a datasource
```sql
from [{ item: "Apple" }, { item: "Orange" }, { item: "Cherry" }]
```
##### Results
```sql
|--------|
| item |
|--------|
| Apple |
| Orange |
| Cherry |
|--------|
```
### graph¹ (Dataframe I/O — Declarative)
*Description*: Produces graphical charts from dataframes
```sql
graph { shape: "pie3d", title: "Exchange Exposure" } from (
|------------------|
| exchange | total |
|------------------|
| NASDAQ | 24 |
| AMEX | 5 |
| NYSE | 28 |
| OTCBB | 32 |
| OTHEROTC | 7 |
|------------------|
)
```
##### Results
### graph² (Dataframe I/O — Declarative)
*Description*: Produces graphical charts from queries
```sql
chart = { shape: "pie", title: "Member Types of OS" }
graph chart from (
select memberType, total: count(*) from (membersOf(OS))
group by memberType
)
```
##### Results
### graph³ (Dataframe I/O — Declarative)
*Description*: Produces graphical charts declaratively or procedurally
```sql
chart = { shape: "scatter", title: "Scatter Demo" }
samples = {
import "java.lang.Math"
def series(x) := "Series {{ (x % 2) + 1 }}"
select w, x, y from ([0 to 500]
.map(x => select w: series(x), x, y: x * iff((x % 2) is 0, Math.cos(x), Math.sin(x)))
.toTable())
}
graph chart from samples
```
##### Results
### insert¹ (Dataframe I/O — Declarative)
*Description*: Appends new row(s) to a table
```sql
stagedActors =
|------------------------------------------|
| name | popularity | ratio |
|------------------------------------------|
| John Wayne | 42 | 0.4206 |
| Carry Grant | 87 | 0.8712 |
| Doris Day | 89 | 0.8907 |
| Audrey Hepburn | 97 | 0.9732 |
| Gretta Garbeaux | 57 | 0.5679 |
|------------------------------------------|
declare table Actors (name: String(64), popularity: Int)
insert into Actors (name, popularity) select name, popularity from @stagedActors
graph { shape: "bar", title: "Popularity" } from Actors
```
##### Results
### insert² (Dataframe I/O — Declarative)
*Description*: Appends new row(s) to a table
```sql
declare table Stocks(symbol: String(8), exchange: String(8), transactions: Table(price: Double, transactionTime: DateTime))
insert into Stocks (symbol, exchange, transactions)
values ('AAPL', 'NASDAQ', {"price":156.39, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('AMD', 'NASDAQ', {"price":56.87, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('INTC','NYSE', {"price":89.44, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('AMZN', 'NASDAQ', {"price":988.12, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('SHMN', 'OTCBB', [{"price":0.0010, "transactionTime":"2021-08-05T19:23:11.000Z"},
{"price":0.0011, "transactionTime":"2021-08-05T19:23:12.000Z"}])
insert into Stocks#transactions (price, transactionTime)
values (35.11, "2021-08-05T19:23:12.000Z"),
(35.83, "2021-08-05T19:23:15.000Z"),
(36.03, "2021-08-05T19:23:17.000Z")
where symbol is 'AMD'
```
##### Results
```sql
|---------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|---------------------------------------------------------------------------------------------------------|
| 0 | 0 | 0 | 0 | 3 | 1 | 5 | 0 | 0 | [6, 7, 8] |
|---------------------------------------------------------------------------------------------------------|
```
### intersect (Dataframe I/O — Declarative)
*Description*: Computes the intersection of two queries
```sql
from (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
|------------------------------|
) intersect (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| JUNK | AMEX | 97.61 |
| AAXX | NYSE | 56.12 |
| ABC | OTCBB | 5.887 |
|------------------------------|
)
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| ABC | OTCBB | 5.887 |
|------------------------------|
```
### into (Dataframe I/O — Declarative)
*Description*: Inserts a result set into a table
```sql
pennyStocks = Table(symbol: String(10), exchange: String(10), lastSale: Double, lastSaleTime: DateTime)
from (
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTHER_OTC | YVWY | 0.5407 | 2023-09-21T04:47:37.370Z |
| OTHER_OTC | EPOFJ | 0.8329 | 2023-09-21T04:47:27.720Z |
| OTHER_OTC | QEQA | 0.7419 | 2023-09-21T04:48:07.901Z |
| OTHER_OTC | SFWCS | 0.9577 | 2023-09-21T04:47:54.694Z |
| OTHER_OTC | VBJHF | 0.8121 | 2023-09-21T04:47:56.769Z |
| OTHER_OTC | SDLMF | 0.2186 | 2023-09-21T04:48:18.913Z |
| OTHER_OTC | JXDZ | 0.0157 | 2023-09-21T04:48:08.459Z |
| OTCBB | ZMNF | 0.5647 | 2023-09-21T04:47:23.112Z |
| OTCBB | VVAH | 0.5786 | 2023-09-21T04:47:40.420Z |
| OTCBB | HSCKG | 0.2719 | 2023-09-21T04:47:43.268Z |
| OTCBB | SHDF | 0.0161 | 2023-09-21T04:57:07.529Z |
| OTCBB | QJGVO | 0.0026 | 2023-09-21T04:57:39.230Z |
| OTHER_OTC | PMBFY | 0.0139 | 2023-09-21T04:57:46.146Z |
| OTCBB | CAVY | 0.0047 | 2023-09-21T04:57:43.503Z |
|----------------------------------------------------------|
) where lastSale <= 0.02 into @pennyStocks
```
##### Results
```sql
|----------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|----------------------------------------------------------|
| JXDZ | OTHER_OTC | 0.0157 | 2023-09-21T04:48:08.459Z |
| SHDF | OTCBB | 0.0161 | 2023-09-21T04:57:07.529Z |
| QJGVO | OTCBB | 0.0026 | 2023-09-21T04:57:39.230Z |
| PMBFY | OTHER_OTC | 0.0139 | 2023-09-21T04:57:46.146Z |
| CAVY | OTCBB | 0.0047 | 2023-09-21T04:57:43.503Z |
|----------------------------------------------------------|
```
### pagination¹ (Dataframe I/O — Declarative)
*Description*: Setups a pagination query
```sql
stocks =
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTCBB | RPYM | 0.4932 | 2023-10-02T01:57:31.086Z |
| OTCBB | EGBQ | 0.6747 | 2023-10-02T01:57:09.991Z |
| OTHER_OTC | PEMCQ | 0.6176 | 2023-10-02T01:57:23.684Z |
| NASDAQ | IPHBY | 113.9129 | 2023-10-02T01:57:01.837Z |
| NASDAQ | HLOQW | 159.1307 | 2023-10-02T01:57:50.139Z |
| NYSE | WQN | 177.4067 | 2023-10-02T01:57:17.371Z |
| NASDAQ | JONV | 139.6465 | 2023-10-02T01:57:55.758Z |
| NASDAQ | KKLPE | 135.2768 | 2023-10-02T01:57:07.520Z |
| AMEX | KHGRO | 163.3631 | 2023-10-02T01:57:21.286Z |
| NASDAQ | GSCF | 75.8721 | 2023-10-02T01:57:21.640Z |
| NASDAQ | ZEP | 91.009 | 2023-10-02T01:57:03.740Z |
| OTHER_OTC | KMUEH | 0.2605 | 2023-10-02T01:57:03.702Z |
| OTCBB | WLXIM | 0.6886 | 2023-10-02T01:57:45.739Z |
| NASDAQ | OVTS | 153.5991 | 2023-10-02T01:57:23.061Z |
| OTCBB | YGIVQ | 0.8364 | 2023-10-02T01:57:38.882Z |
|----------------------------------------------------------|
stocksP = pagination(select * from stocks)
stocksP.first(5)
```
##### Results
```sql
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTCBB | RPYM | 0.4932 | 2023-10-02T01:57:31.086Z |
| OTCBB | EGBQ | 0.6747 | 2023-10-02T01:57:09.991Z |
| OTHER_OTC | PEMCQ | 0.6176 | 2023-10-02T01:57:23.684Z |
| NASDAQ | IPHBY | 113.9129 | 2023-10-02T01:57:01.837Z |
| NASDAQ | HLOQW | 159.1307 | 2023-10-02T01:57:50.139Z |
|----------------------------------------------------------|
```
### pagination² (Dataframe I/O — Declarative)
*Description*: Setups a pagination query
```sql
stocks =
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTCBB | RPYM | 0.4932 | 2023-10-02T01:57:31.086Z |
| OTCBB | EGBQ | 0.6747 | 2023-10-02T01:57:09.991Z |
| OTHER_OTC | PEMCQ | 0.6176 | 2023-10-02T01:57:23.684Z |
| NASDAQ | IPHBY | 113.9129 | 2023-10-02T01:57:01.837Z |
| NASDAQ | HLOQW | 159.1307 | 2023-10-02T01:57:50.139Z |
| NYSE | WQN | 177.4067 | 2023-10-02T01:57:17.371Z |
| NASDAQ | JONV | 139.6465 | 2023-10-02T01:57:55.758Z |
| NASDAQ | KKLPE | 135.2768 | 2023-10-02T01:57:07.520Z |
| AMEX | KHGRO | 163.3631 | 2023-10-02T01:57:21.286Z |
| NASDAQ | GSCF | 75.8721 | 2023-10-02T01:57:21.640Z |
| NASDAQ | ZEP | 91.009 | 2023-10-02T01:57:03.740Z |
| OTHER_OTC | KMUEH | 0.2605 | 2023-10-02T01:57:03.702Z |
| OTCBB | WLXIM | 0.6886 | 2023-10-02T01:57:45.739Z |
| NASDAQ | OVTS | 153.5991 | 2023-10-02T01:57:23.061Z |
| OTCBB | YGIVQ | 0.8364 | 2023-10-02T01:57:38.882Z |
|----------------------------------------------------------|
stocksP = pagination(select * from stocks)
stocksP.last(5)
```
##### Results
```sql
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| NASDAQ | ZEP | 91.009 | 2023-10-02T01:57:03.740Z |
| OTHER_OTC | KMUEH | 0.2605 | 2023-10-02T01:57:03.702Z |
| OTCBB | WLXIM | 0.6886 | 2023-10-02T01:57:45.739Z |
| NASDAQ | OVTS | 153.5991 | 2023-10-02T01:57:23.061Z |
| OTCBB | YGIVQ | 0.8364 | 2023-10-02T01:57:38.882Z |
|----------------------------------------------------------|
```
### pagination³ (Dataframe I/O — Declarative)
*Description*: Setups a pagination query
```sql
stocks =
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTCBB | RPYM | 0.4932 | 2023-10-02T01:57:31.086Z |
| OTCBB | EGBQ | 0.6747 | 2023-10-02T01:57:09.991Z |
| OTHER_OTC | PEMCQ | 0.6176 | 2023-10-02T01:57:23.684Z |
| NASDAQ | IPHBY | 113.9129 | 2023-10-02T01:57:01.837Z |
| NASDAQ | HLOQW | 159.1307 | 2023-10-02T01:57:50.139Z |
| NYSE | WQN | 177.4067 | 2023-10-02T01:57:17.371Z |
| NASDAQ | JONV | 139.6465 | 2023-10-02T01:57:55.758Z |
| NASDAQ | KKLPE | 135.2768 | 2023-10-02T01:57:07.520Z |
| AMEX | KHGRO | 163.3631 | 2023-10-02T01:57:21.286Z |
| NASDAQ | GSCF | 75.8721 | 2023-10-02T01:57:21.640Z |
| NASDAQ | ZEP | 91.009 | 2023-10-02T01:57:03.740Z |
| OTHER_OTC | KMUEH | 0.2605 | 2023-10-02T01:57:03.702Z |
| OTCBB | WLXIM | 0.6886 | 2023-10-02T01:57:45.739Z |
| NASDAQ | OVTS | 153.5991 | 2023-10-02T01:57:23.061Z |
| OTCBB | YGIVQ | 0.8364 | 2023-10-02T01:57:38.882Z |
|----------------------------------------------------------|
stocksP = pagination(select * from stocks)
stocksP.first(5)
stocksP.next(5)
```
##### Results
```sql
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NYSE | WQN | 177.4067 | 2023-10-02T01:57:17.371Z |
| NASDAQ | JONV | 139.6465 | 2023-10-02T01:57:55.758Z |
| NASDAQ | KKLPE | 135.2768 | 2023-10-02T01:57:07.520Z |
| AMEX | KHGRO | 163.3631 | 2023-10-02T01:57:21.286Z |
| NASDAQ | GSCF | 75.8721 | 2023-10-02T01:57:21.640Z |
|---------------------------------------------------------|
```
### select (Dataframe I/O — Declarative)
*Description*: Returns row(s) of data based on the expression and options
```sql
select symbol: 'GMTQ', exchange: 'OTCBB', lastSale: 0.1111, lastSaleTime: DateTime()
```
##### Results
```sql
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| GMTQ | OTCBB | 0.1111 | 2025-10-30T02:15:03.165Z |
|---------------------------------------------------------|
```
### subtract (Dataframe I/O — Declarative)
*Description*: Computes the subtraction of two queries
```sql
from (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| JUNK | AMEX | 97.61 |
| XYZ | AMEX | 31.95 |
|------------------------------|
) subtract (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| JUNK | AMEX | 97.61 |
| ABC | OTCBB | 5.887 |
| XYZ | AMEX | 31.95 |
|------------------------------|
)
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
|------------------------------|
```
### undelete (Dataframe I/O — Declarative)
*Description*: Restores rows matching an expression from a table
```sql
val stocks =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| CMHA | NASDAQ | 121.4325 | 2023-08-05T22:45:29.370Z |
| JPJI | NYSE | 185.8192 | 2023-08-05T22:45:29.371Z |
| QCYA | AMEX | 152.0165 | 2023-08-05T22:45:29.372Z |
| TGRV | NYSE | 80.225 | 2023-08-05T22:45:29.373Z |
| XHMQ | NASDAQ | 98.445 | 2023-08-05T22:45:29.374Z |
|---------------------------------------------------------|
delete from @stocks where symbol is "CMHA"
undelete from @stocks where symbol is "CMHA"
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 1 | [] |
|------------------------------------------------------------------------------------------------------|
```
### union (Dataframe I/O — Declarative)
*Description*: Combines two (or more) result sets (vertically)
```sql
from (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
|------------------------------|
) union (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| JUNK | AMEX | 97.61 |
| ABC | OTC BB | 5.887 |
|------------------------------|
)
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
| JUNK | AMEX | 97.61 |
| ABC | OTC BB | 5.887 |
|------------------------------|
```
### union distinct (Dataframe I/O — Declarative)
*Description*: Combines two (or more) result sets (vertically) retaining only distinct rows
```sql
from (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
|------------------------------|
) union distinct (
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| JUNK | AMEX | 97.61 |
| AAXX | NYSE | 56.12 |
| ABC | OTCBB | 5.887 |
|------------------------------|
)
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAXX | NYSE | 56.12 |
| UPEX | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
| JUNK | AMEX | 97.61 |
|------------------------------|
```
### update¹ (Dataframe I/O — Declarative)
*Description*: Modifies rows matching a conditional expression from a table
```sql
val stocks =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| ISIT | NASDAQ | 189.3509 | 2023-08-05T22:34:20.263Z |
| OBEA | NASDAQ | 99.1026 | 2023-08-05T22:34:20.279Z |
| IJYY | AMEX | 190.4665 | 2023-08-05T22:34:20.280Z |
| SMPG | NYSE | 184.6356 | 2023-08-05T22:34:20.282Z |
| UKHT | NASDAQ | 71.1514 | 2023-08-05T22:34:20.283Z |
|---------------------------------------------------------|
update @stocks set lastSaleTime = DateTime() where exchange is "NASDAQ"
stocks
```
##### Results
```sql
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| ISIT | NASDAQ | 189.3509 | 2025-10-30T02:15:03.196Z |
| OBEA | NASDAQ | 99.1026 | 2025-10-30T02:15:03.197Z |
| IJYY | AMEX | 190.4665 | 2023-08-05T22:34:20.280Z |
| SMPG | NYSE | 184.6356 | 2023-08-05T22:34:20.282Z |
| UKHT | NASDAQ | 71.1514 | 2025-10-30T02:15:03.197Z |
|---------------------------------------------------------|
```
### update² (Dataframe I/O — Declarative)
*Description*: Modifies rows matching a conditional expression from a table
```sql
declare table stocks (symbol: String(8), exchange: String(8), transactions: Table (price: Double, transactionTime: DateTime)[5])
insert into @stocks (symbol, exchange, transactions)
values ('AAPL', 'NASDAQ', {"price":156.39, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('AMD', 'NASDAQ', {"price":56.87, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('INTC','NYSE', {"price":89.44, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('AMZN', 'NASDAQ', {"price":988.12, "transactionTime":"2021-08-05T19:23:11.000Z"}),
('SHMN', 'OTCBB', [{"price":0.0010, "transactionTime":"2021-08-05T19:23:11.000Z"},
{"price":0.0011, "transactionTime":"2021-08-05T19:23:12.000Z"}])
update @stocks#transactions
set price = 0.0012
where symbol is 'SHMN'
and transactions wherein (price is 0.001)
limit 1
stocks
```
##### Results
```sql
|-----------------------------------------------------------------------------|
| symbol | exchange | transactions |
|-----------------------------------------------------------------------------|
| AAPL | NASDAQ | EmbeddedInnerTableRowCollection(price, transactionTime) |
| AMD | NASDAQ | EmbeddedInnerTableRowCollection(price, transactionTime) |
| INTC | NYSE | EmbeddedInnerTableRowCollection(price, transactionTime) |
| AMZN | NASDAQ | EmbeddedInnerTableRowCollection(price, transactionTime) |
| SHMN | OTCBB | EmbeddedInnerTableRowCollection(price, transactionTime) |
|-----------------------------------------------------------------------------|
```
### upsert¹ (Dataframe I/O — Declarative) 
*Description*: Inserts (or updates) new row(s) into a table
```sql
namespace "temp.examples"
drop if exists Stocks &&
create table Stocks (symbol: String(8), exchange: String(8), lastSale: Double) &&
create index Stocks#symbol &&
insert into Stocks (symbol, exchange, lastSale)
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| ATT | NYSE | 66.78 |
| UPEX | NASDAQ | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
|------------------------------|
upsert into Stocks (symbol, exchange, lastSale) values ('AAPL', 'NASDAQ', 156.39) where symbol is 'AAPL'
ns('Stocks')
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| ATT | NYSE | 66.78 |
| UPEX | NASDAQ | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
| AAPL | NASDAQ | 156.39 |
|------------------------------|
```
### upsert² (Dataframe I/O — Declarative)
*Description*: Inserts (or updates) new row(s) into a table
```sql
namespace "temp.examples"
drop if exists Stocks &&
create table Stocks (symbol: String(8), exchange: String(8), lastSale: Double) &&
create index Stocks#symbol &&
insert into Stocks (symbol, exchange, lastSale)
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAPL | NASDAQ | 156.12 |
| ATT | NYSE | 66.78 |
| UPEX | NASDAQ | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
|------------------------------|
upsert into Stocks (symbol, exchange, lastSale)
values ('AAPL', 'NASDAQ', 156.39)
where symbol is 'AAPL'
ns('Stocks')
```
##### Results
```sql
|------------------------------|
| symbol | exchange | lastSale |
|------------------------------|
| AAPL | NASDAQ | 156.39 |
| ATT | NYSE | 66.78 |
| UPEX | NASDAQ | 116.24 |
| XYZ | AMEX | 31.95 |
| ABC | OTCBB | 5.887 |
|------------------------------|
```
## Dataframe Management Examples
### alter (Dataframe Management — Declarative)
*Description*: Modifies the structure of a table
```sql
namespace "temp.examples"
drop if exists StockQuotes
create table StockQuotes(symbol: String(5), exchange: String(9), lastSale: Double) containing (
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTCBB | YSZUY | 0.2355 | 2023-10-19T23:25:32.886Z |
| NASDAQ | DMZH | 183.1636 | 2023-10-19T23:26:03.509Z |
| OTCBB | VV | | |
| NYSE | TGPNF | 51.6171 | 2023-10-19T23:25:32.166Z |
| OTHER_OTC | RIZA | 0.2766 | 2023-10-19T23:25:42.020Z |
| NASDAQ | JXMLB | 91.6028 | 2023-10-19T23:26:08.951Z |
|----------------------------------------------------------|
)
alter table StockQuotes
prepend column saleDate: DateTime = DateTime()
rename column symbol to ticker
label 'Stock quotes staging table'
ns('StockQuotes')
```
##### Results
```sql
|----------------------------------------------------------|
| saleDate | ticker | exchange | lastSale |
|----------------------------------------------------------|
| 2025-10-30T02:15:03.318Z | YSZUY | OTCBB | 0.2355 |
| 2025-10-30T02:15:03.318Z | DMZH | NASDAQ | 183.1636 |
| 2025-10-30T02:15:03.318Z | VV | OTCBB | |
| 2025-10-30T02:15:03.318Z | TGPNF | NYSE | 51.6171 |
| 2025-10-30T02:15:03.318Z | RIZA | OTHER_OTC | 0.2766 |
| 2025-10-30T02:15:03.318Z | JXMLB | NASDAQ | 91.6028 |
|----------------------------------------------------------|
```
### create external table (Dataframe Management — Declarative)
*Description*: Creates an external table
```sql
create external table if not exists customers (
customer_uid: UUID,
name: String,
address: String,
ingestion_date: Long
) containing { format: 'json', location: './datasets/customers/json/', null_values: ['n/a'] }
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
### create index (Dataframe Management — Declarative)
*Description*: Creates a table index
```sql
create index if not exists stocks#symbol
```
```scala
com.lollypop.LollypopException: assertion failed: Table configuration file for 'lollypop.public.stocks#symbol' (lollypop_db/ns/lollypop/public/stocks/stocks.json) was not found on line 1 at 0
at com.lollypop.LollypopException$.apply(LollypopException.scala:11)
at com.lollypop.language.models.InstructionErrors.die(InstructionErrors.scala:16)
at com.lollypop.language.models.InstructionErrors.die$(InstructionErrors.scala:16)
at com.lollypop.runtime.instructions.infrastructure.CreateIndex.die(CreateIndex.scala:16)
at com.lollypop.runtime.LollypopVM$.liftedTree1$1(LollypopVM.scala:38)
at com.lollypop.runtime.LollypopVM$.execute(LollypopVM.scala:33)
at com.lollypop.runtime.LollypopVM$.executeSQL(LollypopVM.scala:66)
at com.lollypop.docs.DocumentGeneratorFunSpec.$anonfun$invoke$6(DocumentGeneratorFunSpec.scala:70)
at scala.util.Try$.apply(Try.scala:217)
at com.lollypop.docs.DocumentGeneratorFunSpec.invoke(DocumentGeneratorFunSpec.scala:70)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$5(ReadMeTest.scala:97)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$5$adapted(ReadMeTest.scala:92)
at scala.collection.immutable.List.foreach(List.scala:334)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$4(ReadMeTest.scala:92)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$4$adapted(ReadMeTest.scala:90)
at scala.collection.immutable.List.foreach(List.scala:334)
at com.lollypop.docs.ReadMeTest.processCategory(ReadMeTest.scala:90)
at com.lollypop.docs.ReadMeTest.$anonfun$new$15(ReadMeTest.scala:72)
at com.lollypop.docs.ReadMeTest.$anonfun$new$15$adapted(ReadMeTest.scala:71)
at scala.collection.IterableOnceOps.foreach(IterableOnce.scala:619)
at scala.collection.IterableOnceOps.foreach$(IterableOnce.scala:617)
at scala.collection.AbstractIterable.foreach(Iterable.scala:935)
at scala.collection.IterableOps$WithFilter.foreach(Iterable.scala:905)
at com.lollypop.docs.ReadMeTest.$anonfun$new$5(ReadMeTest.scala:71)
at com.lollypop.docs.ReadMeTest.$anonfun$new$5$adapted(ReadMeTest.scala:22)
at com.lollypop.runtime.package$AutoClose$.use$extension(package.scala:126)
at com.lollypop.docs.ReadMeTest.$anonfun$new$2(ReadMeTest.scala:22)
at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
at org.scalatest.Transformer.apply(Transformer.scala:22)
at org.scalatest.Transformer.apply(Transformer.scala:20)
at org.scalatest.funspec.AnyFunSpecLike$$anon$1.apply(AnyFunSpecLike.scala:457)
at org.scalatest.TestSuite.withFixture(TestSuite.scala:196)
at org.scalatest.TestSuite.withFixture$(TestSuite.scala:195)
at org.scalatest.funspec.AnyFunSpec.withFixture(AnyFunSpec.scala:1631)
at org.scalatest.funspec.AnyFunSpecLike.invokeWithFixture$1(AnyFunSpecLike.scala:455)
at org.scalatest.funspec.AnyFunSpecLike.$anonfun$runTest$1(AnyFunSpecLike.scala:467)
at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)
at org.scalatest.funspec.AnyFunSpecLike.runTest(AnyFunSpecLike.scala:467)
at org.scalatest.funspec.AnyFunSpecLike.runTest$(AnyFunSpecLike.scala:449)
at org.scalatest.funspec.AnyFunSpec.runTest(AnyFunSpec.scala:1631)
at org.scalatest.funspec.AnyFunSpecLike.$anonfun$runTests$1(AnyFunSpecLike.scala:500)
at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413)
at scala.collection.immutable.List.foreach(List.scala:334)
at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:390)
at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:427)
at scala.collection.immutable.List.foreach(List.scala:334)
at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)
at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)
at org.scalatest.funspec.AnyFunSpecLike.runTests(AnyFunSpecLike.scala:500)
at org.scalatest.funspec.AnyFunSpecLike.runTests$(AnyFunSpecLike.scala:499)
at org.scalatest.funspec.AnyFunSpec.runTests(AnyFunSpec.scala:1631)
at org.scalatest.Suite.run(Suite.scala:1112)
at org.scalatest.Suite.run$(Suite.scala:1094)
at org.scalatest.funspec.AnyFunSpec.org$scalatest$funspec$AnyFunSpecLike$$super$run(AnyFunSpec.scala:1631)
at org.scalatest.funspec.AnyFunSpecLike.$anonfun$run$1(AnyFunSpecLike.scala:504)
at org.scalatest.SuperEngine.runImpl(Engine.scala:535)
at org.scalatest.funspec.AnyFunSpecLike.run(AnyFunSpecLike.scala:504)
at org.scalatest.funspec.AnyFunSpecLike.run$(AnyFunSpecLike.scala:503)
at org.scalatest.funspec.AnyFunSpec.run(AnyFunSpec.scala:1631)
at org.scalatest.tools.SuiteRunner.run(SuiteRunner.scala:45)
at org.scalatest.tools.Runner$.$anonfun$doRunRunRunDaDoRunRun$13(Runner.scala:1320)
at org.scalatest.tools.Runner$.$anonfun$doRunRunRunDaDoRunRun$13$adapted(Runner.scala:1314)
at scala.collection.immutable.List.foreach(List.scala:334)
at org.scalatest.tools.Runner$.doRunRunRunDaDoRunRun(Runner.scala:1314)
at org.scalatest.tools.Runner$.$anonfun$runOptionallyWithPassFailReporter$24(Runner.scala:993)
at org.scalatest.tools.Runner$.$anonfun$runOptionallyWithPassFailReporter$24$adapted(Runner.scala:971)
at org.scalatest.tools.Runner$.withClassLoaderAndDispatchReporter(Runner.scala:1480)
at org.scalatest.tools.Runner$.runOptionallyWithPassFailReporter(Runner.scala:971)
at org.scalatest.tools.Runner$.run(Runner.scala:798)
at org.scalatest.tools.Runner.run(Runner.scala)
at org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner.runScalaTest2or3(ScalaTestRunner.java:43)
at org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner.main(ScalaTestRunner.java:26)
Caused by: java.lang.AssertionError: assertion failed: Table configuration file for 'lollypop.public.stocks#symbol' (lollypop_db/ns/lollypop/public/stocks/stocks.json) was not found
at scala.Predef$.assert(Predef.scala:279)
at com.lollypop.runtime.DatabaseManagementSystem.createIndex(DatabaseManagementSystem.scala:173)
at com.lollypop.runtime.DatabaseManagementSystem.createIndex$(DatabaseManagementSystem.scala:171)
at com.lollypop.runtime.DatabaseManagementSystem$.createIndex(DatabaseManagementSystem.scala:503)
at com.lollypop.runtime.instructions.infrastructure.CreateIndex.execute(CreateIndex.scala:20)
at com.lollypop.runtime.LollypopVM$.liftedTree1$1(LollypopVM.scala:34)
... 71 more
```
### create table (Dataframe Management — Declarative)
*Description*: Creates a persistent database table
```sql
def generateStocks(qty: Int) := {
[1 to qty].map(_ => {
exchange = ['AMEX', 'NASDAQ', 'NYSE', 'OTCBB', 'OTHER_OTC'][Random.nextInt(5)]
is_otc = exchange.startsWith("OT")
lastSale = scaleTo(iff(is_otc, 1, 201) * Random.nextDouble(1.0), 4)
lastSaleTime = DateTime(DateTime() - Duration(1000 * 60 * Random.nextDouble(1.0)))
symbol = Random.nextString(['A' to 'Z'], iff(is_otc, Random.nextInt(2) + 4, Random.nextInt(4) + 2))
select lastSaleTime, lastSale, exchange, symbol
}).toTable()
}
namespace "temp.examples"
drop if exists Stocks
create table Stocks (symbol: String(10), exchange: String(10), lastSale: Double, lastSaleTime: DateTime)
containing (generateStocks(1000))
graph { shape: "pie3d", title: "Small Caps" }
select exchange, total: sum(lastSale) from Stocks
where lastSale <= 5.0
group by exchange
```
##### Results
### create type (Dataframe Management — Declarative)
*Description*: Creates a database type
```sql
create type mood := Enum (sad, okay, happy)
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
### create unique index (Dataframe Management — Declarative)
*Description*: Creates a unique index
```sql
namespace "temp.examples"
drop if exists Stocks
create table Stocks (
symbol: String(5),
exchange: Enum (AMEX, NASDAQ, NYSE, OTCBB, OTHEROTC),
lastSale: Double,
lastSaleTime: DateTime
)
create unique index Stocks#symbol
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
### create view (Dataframe Management — Declarative)
*Description*: Creates a view
```sql
namespace "temp.temp"
drop if exists Students
create table Students (name: String(64), grade: Char, ratio: Double) containing (
|----------------------------------|
| name | grade | ratio |
|----------------------------------|
| John Wayne | D | 0.6042 |
| Carry Grant | B | 0.8908 |
| Doris Day | A | 0.9936 |
| Audrey Hepburn | A | 0.9161 |
| Gretta Garbeaux | C | 0.7656 |
|----------------------------------|
)
drop if exists A_Students
create view A_Students as select * from Students where ratio >= 0.9
ns('A_Students')
```
##### Results
```sql
|---------------------------------|
| name | grade | ratio |
|---------------------------------|
| Doris Day | A | 0.9936 |
| Audrey Hepburn | A | 0.9161 |
|---------------------------------|
```
### declare table (Dataframe Management — Declarative)
*Description*: Creates a durable database table
```sql
declare table Stocks (
symbol: String(8),
exchange: Enum (AMEX, NASDAQ, NYSE, OTCBB, OTHEROTC),
lastSale: Double,
lastSaleTime: DateTime)
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
### declare view (Dataframe Management — Declarative)
*Description*: Creates a view
```sql
declare table Students (name: String(64), grade: Char, ratio: Double) containing (
|----------------------------------|
| name | grade | ratio |
|----------------------------------|
| John Wayne | D | 0.6042 |
| Carry Grant | B | 0.8908 |
| Doris Day | A | 0.9936 |
| Audrey Hepburn | A | 0.9161 |
| Gretta Garbeaux | C | 0.7656 |
|----------------------------------|
)
declare view A_Students as select * from Students where ratio >= 0.9
A_Students
```
##### Results
```sql
|---------------------------------|
| name | grade | ratio |
|---------------------------------|
| Doris Day | A | 0.9936 |
| Audrey Hepburn | A | 0.9161 |
|---------------------------------|
```
### drop (Dataframe Management — Declarative)
*Description*: Deletes a database object
```sql
namespace "temp.examples"
drop if exists Stocks
create table Stocks (
symbol: String(8),
exchange: Enum (AMEX, NASDAQ, NYSE, OTCBB, OTHEROTC),
lastSale: Double,
lastSaleTime: DateTime,
headlines Table ( headline String(128), newsDate DateTime )[100]
)
drop Stocks
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
### Table (Dataframe Management — Functional)
*Description*: Returns a new transient table
```sql
val stocks = Table(symbol: String(4), exchange: String(6), transactions: Table(price: Double, transactionTime: DateTime)[5])
insert into @stocks (symbol, exchange, transactions)
values ('AAPL', 'NASDAQ', {price:156.39, transactionTime:"2021-08-05T19:23:11.000Z"}),
('AMD', 'NASDAQ', {price:56.87, transactionTime:"2021-08-05T19:23:11.000Z"}),
('INTC', 'NYSE', {price:89.44, transactionTime:"2021-08-05T19:23:11.000Z"}),
('AMZN', 'NASDAQ', {price:988.12, transactionTime:"2021-08-05T19:23:11.000Z"}),
('SHMN', 'OTCBB', [{price:0.0010, transactionTime:"2021-08-05T19:23:11.000Z"},
{price:0.0011, transactionTime:"2021-08-05T19:23:12.000Z"}])
@stocks
```
##### Results
```sql
|--------------------------------------------------------------------|
| symbol | exchange | transactions |
|--------------------------------------------------------------------|
| AAPL | NASDAQ | (price, transactionTime) |
| AMD | NASDAQ | (price, transactionTime) |
| INTC | NYSE | (price, transactionTime) |
| AMZN | NASDAQ | (price, transactionTime) |
| SHMN | OTCBB | ByteArrayRowCollection(price, transactionTime) |
|--------------------------------------------------------------------|
```
### tableLike (Dataframe Management — Functional)
*Description*: Creates a new table file, which will be identical to the source table.
```sql
val stocksA =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NUBD | NYSE | 183.8314 | 2023-08-06T03:56:12.932Z |
| UAGU | NASDAQ | 105.9287 | 2023-08-06T03:56:12.940Z |
| XUWH | NASDAQ | 58.743 | 2023-08-06T03:56:12.941Z |
| EDVC | NYSE | 186.1966 | 2023-08-06T03:56:12.943Z |
| LFUG | NYSE | 128.5487 | 2023-08-06T03:56:12.944Z |
|---------------------------------------------------------|
val stocksB = tableLike(stocksA)
insert into @stocksB from stocksA where lastSale >= 120
stocksB
```
##### Results
```sql
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NUBD | NYSE | 183.8314 | 2023-08-06T03:56:12.932Z |
| EDVC | NYSE | 186.1966 | 2023-08-06T03:56:12.943Z |
| LFUG | NYSE | 128.5487 | 2023-08-06T03:56:12.944Z |
|---------------------------------------------------------|
```
### TableZoo (Dataframe Management — Functional)
*Description*: Returns a Table builder
```sql
stocks =
TableZoo(symbol: String(10), exchange: String(10), lastSale: Double, lastSaleTime: DateTime)
.withMemorySupport(150)
.build()
insert into @stocks
|----------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|----------------------------------------------------------|
| OTHER_OTC | MBANF | 0.0109 | 2023-09-21T04:57:58.702Z |
| OTHER_OTC | YAMJI | 0.0155 | 2023-09-21T04:57:24.456Z |
| OTCBB | HQCY | 0.0135 | 2023-09-21T04:57:53.351Z |
| OTHER_OTC | GEYSG | 0.0186 | 2023-09-21T04:57:28.014Z |
| OTHER_OTC | WYISA | 0.0132 | 2023-09-21T04:57:58.271Z |
| OTCBB | TXWFI | 0.0194 | 2023-09-21T04:58:06.199Z |
| OTCBB | ZIYBG | 0.0167 | 2023-09-21T04:58:03.392Z |
|----------------------------------------------------------|
stocks
```
##### Results
```sql
|----------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|----------------------------------------------------------|
| MBANF | OTHER_OTC | 0.0109 | 2023-09-21T04:57:58.702Z |
| YAMJI | OTHER_OTC | 0.0155 | 2023-09-21T04:57:24.456Z |
| HQCY | OTCBB | 0.0135 | 2023-09-21T04:57:53.351Z |
| GEYSG | OTHER_OTC | 0.0186 | 2023-09-21T04:57:28.014Z |
| WYISA | OTHER_OTC | 0.0132 | 2023-09-21T04:57:58.271Z |
| TXWFI | OTCBB | 0.0194 | 2023-09-21T04:58:06.199Z |
| ZIYBG | OTCBB | 0.0167 | 2023-09-21T04:58:03.392Z |
|----------------------------------------------------------|
```
### truncate (Dataframe Management — Declarative)
*Description*: Removes all of the data from a table
```sql
val stocks =
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| CJHK | OTCBB | 36.4423 | 2023-08-03T00:09:42.263Z |
| OZIS | NYSE | 97.3854 | 2023-08-03T00:09:42.279Z |
| DKRA | NASDAQ | 127.5813 | 2023-08-03T00:09:42.280Z |
| IWEC | AMEX | 132.1874 | 2023-08-03T00:09:42.282Z |
| JIRD | OTCBB | 22.0003 | 2023-08-03T00:09:42.283Z |
|---------------------------------------------------------|
truncate @stocks
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------|
| altered | created | destroyed | deleted | inserted | matched | scanned | shuffled | updated | rowIDs |
|------------------------------------------------------------------------------------------------------|
| 0 | 0 | 0 | 5 | 0 | 0 | 0 | 0 | 0 | [] |
|------------------------------------------------------------------------------------------------------|
```
## Filtering and Matching Examples
### == (Filtering and Matching — Declarative)
*Description*: returns true if the `value` is exactly the `expression`; otherwise false
```sql
x = 200
x == 200
```
##### Results
```sql
true
```
### between (Filtering and Matching — Declarative)
*Description*: determines whether the `value` is between the `to` and `from` (inclusive)
```sql
from (
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| NKWI | OTCBB | 98.9501 | 98.9 | 2022-09-04T23:36:47.846Z |
| AQKU | NASDAQ | 68.2945 | 68.2 | 2022-09-04T23:36:47.860Z |
| WRGB | AMEX | 46.8355 | 46.8 | 2022-09-04T23:36:47.862Z |
| ESCN | AMEX | 42.5934 | 42.5 | 2022-09-04T23:36:47.865Z |
| NFRK | AMEX | 28.2808 | 28.2 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------------------------|
) where lastSale between 28.2808 and 42.5934
order by lastSale desc
```
##### Results
```sql
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| ESCN | AMEX | 42.5934 | 42.5 | 2022-09-04T23:36:47.865Z |
| NFRK | AMEX | 28.2808 | 28.2 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------------------------|
```
### betwixt (Filtering and Matching — Declarative)
*Description*: determines whether the `value` is between the `to` and `from` (non-inclusive)
```sql
from (
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| NKWI | OTCBB | 98.9501 | 98.9 | 2022-09-04T23:36:47.846Z |
| AQKU | NASDAQ | 68.2945 | 68.2 | 2022-09-04T23:36:47.860Z |
| WRGB | AMEX | 46.8355 | 46.8 | 2022-09-04T23:36:47.862Z |
| ESCN | AMEX | 42.5934 | 42.5 | 2022-09-04T23:36:47.865Z |
| NFRK | AMEX | 28.2808 | 28.2 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------------------------|
) where lastSale betwixt 28.2808 and 42.5934
order by lastSale desc
```
##### Results
```sql
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| NFRK | AMEX | 28.2808 | 28.2 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------------------------|
```
### contains¹ (Filtering and Matching — Declarative)
*Description*: determines whether the `value` contains the `expression`
```sql
string = "Hello World"
string contains "World"
```
##### Results
```sql
true
```
### contains² (Filtering and Matching — Declarative)
*Description*: determines whether the `value` contains the `expression`
```sql
dict = {"name":"Tom", "DOB":"2003-09-28T00:00:00.000Z"}
dict contains "name"
```
##### Results
```sql
true
```
### contains³ (Filtering and Matching — Declarative)
*Description*: determines whether the `value` contains the `expression`
```sql
array = [{"name":"Jerry"}, {"name":"Tom"}, {"name":"Sheila"}]
array contains {"name":"Tom"}
```
##### Results
```sql
true
```
### exists (Filtering and Matching — Declarative)
*Description*: determines whether at least one row is found within the query
```sql
val stocks = (
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| OTCBB | BKULD | 0.8745 | 2023-09-26T21:30:24.127Z |
| OTCBB | SAFXV | 0.8741 | 2023-09-26T21:30:13.488Z |
| NASDAQ | ECN | 36.9565 | 2023-09-26T21:30:05.816Z |
| AMEX | HRB | 164.4908 | 2023-09-26T21:30:41.457Z |
| NASDAQ | CFF | 107.4943 | 2023-09-26T21:30:06.283Z |
|---------------------------------------------------------|
)
@stocks where lastSale > 5 and exists(select symbol from @stocks where exchange is 'OTCBB')
```
##### Results
```sql
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NASDAQ | ECN | 36.9565 | 2023-09-26T21:30:05.816Z |
| AMEX | HRB | 164.4908 | 2023-09-26T21:30:41.457Z |
| NASDAQ | CFF | 107.4943 | 2023-09-26T21:30:06.283Z |
|---------------------------------------------------------|
```
### expose (Filtering and Matching — Declarative)
*Description*: Exposes the components of a `matches` expression
```sql
isString = v => v.isString()
isUUID = v => v.isUUID()
isNumber = v => v.isNumber()
response = { id: "a891ee9b-6667-40fc-9ed1-a129d04c8b6d", symbol: "ABC", exchange: "NYSE", lastSale: "35.76" }
expose(response matches { id: isUUID, symbol: isString, exchange: isString, lastSale: isNumber })
```
##### Results
```sql
|----------------------------------------------------------------------------|
| expression | value | result |
|----------------------------------------------------------------------------|
| (v: Any) => v.isUUID() | "a891ee9b-6667-40fc-9ed1-a129d04c8b6d" | true |
| (v: Any) => v.isString() | "ABC" | true |
| (v: Any) => v.isString() | "NYSE" | true |
| (v: Any) => v.isNumber() | "35.76" | false |
|----------------------------------------------------------------------------|
```
### having (Filtering and Matching — Declarative)
*Description*: Applies a filter condition to an aggregate query
```sql
declare table travelers(id UUID, lastName String(12), firstName String(12), destAirportCode String(3))
containing (
|-------------------------------------------------------------------------------|
| id | lastName | firstName | destAirportCode |
|-------------------------------------------------------------------------------|
| b938c7e6-76b4-4c0c-a849-8c6f05474270 | JONES | GARRY | SNA |
| 10b6b0c1-cb90-4708-a57a-8e944bdbdd99 | JONES | DEBBIE | SNA |
| 10b6b0c1-cb90-4708-a57a-8e944bdb3499 | MILLER | SALLY MAE | MOB |
| 326d3c64-d09d-49ef-972d-cbf815e50c16 | JONES | TAMERA | SNA |
| c573d368-0f54-4f57-be31-4e6fe0059c23 | JONES | ERIC | SNA |
| b493e970-2814-4d7c-9003-dcc198b0a539 | ADAMS | KAREN | DTW |
| 8ab14ae0-a893-430d-bc3e-f4860d5feecb | ADAMS | MIKE | DTW |
| 8e3229f0-0ac7-45a2-90b2-7fca72e4918e | JONES | SAMANTHA | BUR |
| 10b6b0c1-cb90-4708-a1b0-8e944bdb34ee | MILLER | CAROL ANN | MOB |
| 324befc4-e584-4b94-a1b0-47faa0cb7b45 | SHARMA | PANKAJ | LAX |
|-------------------------------------------------------------------------------|
)
graph { shape: "bar", title: "Travelers" }
select lastName, members: count(*)
from @travelers
group by lastName having members > 1
```
##### Results
### in (Filtering and Matching — Declarative)
*Description*: determines whether the `value` matches the `expression`
```sql
val stocks = (
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| AQKU | NASDAQ | 68.2945 | 68.2 | 2022-09-04T23:36:47.860Z |
| WRGB | AMEX | 46.8355 | 46.8 | 2022-09-04T23:36:47.862Z |
| NKWI | OTCBB | 98.9501 | 98.9 | 2022-09-04T23:36:47.846Z |
| ESCN | AMEX | 42.5934 | 42.5 | 2022-09-04T23:36:47.865Z |
| NFRK | AMEX | 28.2808 | 28.2 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------------------------|
)
@stocks where market in ["NASDAQ", "OTCBB"]
```
##### Results
```sql
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| AQKU | NASDAQ | 68.2945 | 68.2 | 2022-09-04T23:36:47.860Z |
| NKWI | OTCBB | 98.9501 | 98.9 | 2022-09-04T23:36:47.846Z |
|-------------------------------------------------------------------------|
```
### inner join (Filtering and Matching — Declarative)
*Description*: Computes the inner join of two queries
```sql
namespace 'temp.examples'
drop if exists stockQuotes_A
create table stockQuotes_A (symbol: String(32), exchange: String(32), lastSale: Double)
insert into stockQuotes_A (symbol, exchange, lastSale)
values ('GREED', 'NASDAQ', 2345.78), ('BFG', 'NYSE', 113.56),
('ABC', 'AMEX', 11.46), ('ACME', 'NYSE', 56.78)
create index stockQuotes_A#symbol
drop if exists companies_A
create table companies_A (symbol: String(32), name: String(32))
insert into companies_A (symbol, name)
values ('ABC', 'ABC & Co'), ('BFG', 'BFG Corp.'),
('GREED', 'GreedIsGood.com'), ('ACME', 'ACME Inc.')
create index companies_A#symbol
select B.name, A.symbol, A.exchange, A.lastSale
from stockQuotes_A as A
inner join companies_A as B on A.symbol is B.symbol
```
##### Results
```sql
|------------------------------------------------|
| name | symbol | exchange | lastSale |
|------------------------------------------------|
| ABC & Co | ABC | AMEX | 11.46 |
| ACME Inc. | ACME | NYSE | 56.78 |
| BFG Corp. | BFG | NYSE | 113.56 |
| GreedIsGood.com | GREED | NASDAQ | 2345.78 |
|------------------------------------------------|
```
### is¹ (Filtering and Matching — Declarative)
*Description*: returns true if the `value` is exactly the `expression`; otherwise false
```sql
x = 201
x == 200
```
##### Results
```sql
false
```
### is² (Filtering and Matching — Declarative)
*Description*: returns true if the `value` is exactly the `expression`; otherwise false
```sql
x = 200
x is 200
```
##### Results
```sql
true
```
### is³ (Filtering and Matching — Declarative)
*Description*: returns true if the `value` is exactly the `expression`; otherwise false
```sql
x = 201
x is 200
```
##### Results
```sql
false
```
### isCodecOf (Filtering and Matching — Declarative)
*Description*: determines whether the `expression` is compatible with the `CODEC`
```sql
(new `java.util.Date`()) isCodecOf DateTime
```
##### Results
```sql
true
```
### isDefined (Filtering and Matching — Declarative)
*Description*: Returns true if the field or variable exists within the scope.
```sql
isDefined(counter)
```
##### Results
```sql
false
```
### isnt¹ (Filtering and Matching — Declarative)
*Description*: returns true if the `value` is not exactly the `expression`; otherwise false
```sql
x = 199
x isnt 200
```
##### Results
```sql
true
```
### isnt² (Filtering and Matching — Declarative)
*Description*: returns true if the `value` is not exactly the `expression`; otherwise false
```sql
x = 200
x isnt 200
```
##### Results
```sql
false
```
### limit (Filtering and Matching — Declarative)
*Description*: Limits the maximum number of rows returned by a query
```sql
from (
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| NKWI | OTCBB | 98.9501 | 98.9 | 2022-09-04T23:36:47.846Z |
| AQKU | NASDAQ | 68.2945 | 68.2 | 2022-09-04T23:36:47.860Z |
| WRGB | AMEX | 46.8355 | 46.8 | 2022-09-04T23:36:47.862Z |
| ESCN | AMEX | 42.5934 | 42.5 | 2022-09-04T23:36:47.865Z |
| NFRK | AMEX | 28.2808 | 28.2 | 2022-09-04T23:36:47.864Z |
|-------------------------------------------------------------------------|
) limit 3
```
##### Results
```sql
|-------------------------------------------------------------------------|
| ticker | market | lastSale | roundedLastSale | lastSaleTime |
|-------------------------------------------------------------------------|
| NKWI | OTCBB | 98.9501 | 98.9 | 2022-09-04T23:36:47.846Z |
| AQKU | NASDAQ | 68.2945 | 68.2 | 2022-09-04T23:36:47.860Z |
| WRGB | AMEX | 46.8355 | 46.8 | 2022-09-04T23:36:47.862Z |
|-------------------------------------------------------------------------|
```
### matches¹ (Filtering and Matching — Declarative)
*Description*: determines whether the `value` matches the `expression`
```sql
"Hello World 123" matches "H(.*) W(.*) \d+"
```
##### Results
```sql
true
```
### matches² (Filtering and Matching — Functional)
*Description*: determines whether the `value` matches the `expression`
```sql
isEven = x => (x.isNumber() is true) and ((x % 2) is 0)
5678 matches isEven
```
##### Results
```sql
true
```
### matches³ (Filtering and Matching — Functional)
*Description*: determines whether the `value` matches the `expression`
```sql
response = { id: 5678, symbol: "DOG", exchange: "NYSE", lastSale: 90.67 }
response matches {
id: _ => true
symbol: "DOG"
exchange: "NYSE"
lastSale: 90.67
}
```
##### Results
```sql
true
```
### matches⁴ (Filtering and Matching — Functional)
*Description*: determines whether the `value` matches the `expression`
```sql
class Stock(symbol: String, exchange: String, lastSale: Double)
stock = new Stock(symbol: "ATX", exchange: "NASDAQ", lastSale: 234.57)
stock matches Stock(
symbol: x => (x.isString() is true) and
(x.length() between 1 and 6) and
(x.forall(c => Character.isAlphabetic(c)) is true),
exchange: x => x in ['NYSE', 'AMEX', 'NASDAQ', 'OTCBB'],
lastSale: n => n >= 0 and n < 500
)
```
##### Results
```sql
true
```
### where (Filtering and Matching — Declarative)
*Description*: Filters a result set
```sql
from (
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| HWWM | NASDAQ | 191.6725 | 2023-08-06T18:33:08.661Z |
| VLYW | AMEX | 197.9962 | 2023-08-06T18:33:08.670Z |
| VSOM | NASDAQ | 166.8542 | 2023-08-06T18:33:08.672Z |
| FHWS | NYSE | 22.5909 | 2023-08-06T18:33:08.673Z |
| SRGN | AMEX | 180.2358 | 2023-08-06T18:33:08.675Z |
| PTFY | NYSE | 19.9265 | 2023-08-06T18:33:08.676Z |
|---------------------------------------------------------|
) where lastSale < 50.0
```
##### Results
```sql
|---------------------------------------------------------|
| symbol | exchange | lastSale | lastSaleTime |
|---------------------------------------------------------|
| FHWS | NYSE | 22.5909 | 2023-08-06T18:33:08.673Z |
| PTFY | NYSE | 19.9265 | 2023-08-06T18:33:08.676Z |
|---------------------------------------------------------|
```
### wherein (Filtering and Matching — Declarative)
*Description*: determines whether the `value` contains the `expression`
```sql
stocks = Table(symbol: String(4), exchange: String(8), transactions: Table(price: Double, transactionTime: DateTime)[2])
insert into @stocks (symbol, exchange, transactions)
values ('AAPL', 'NASDAQ', {price: 156.39, transactionTime: "2021-08-05T19:23:11.000Z"}),
('AMD', 'NASDAQ', {price: 56.87, transactionTime: "2021-08-05T19:23:11.000Z"}),
('INTC', 'NYSE', {price: 89.44, transactionTime: "2021-08-05T19:23:11.000Z"}),
('AMZN', 'NASDAQ', {price: 988.12, transactionTime: "2021-08-05T19:23:11.000Z"}),
('SHMN', 'OTCBB', [{price: 0.0010, transactionTime: "2021-08-05T19:23:11.000Z"},
{price: 0.0011, transactionTime: "2021-08-05T19:23:12.000Z"}])
select unnest(transactions)
from @stocks
where transactions wherein (price is 0.0011)
```
##### Results
```sql
|-----------------------------------|
| price | transactionTime |
|-----------------------------------|
| 0.001 | 2021-08-05T19:23:11.000Z |
| 0.0011 | 2021-08-05T19:23:12.000Z |
|-----------------------------------|
```
## JVM and Reflection Examples
### .! (JVM and Reflection — Object-Oriented)
*Description*: Invokes a virtual method
```sql
val items = values ("NASDAQ", 1276), ("AMEX", 1259), ("NYSE", 1275), ("OTCBB", 1190)
items.!toTable()
```
##### Results
```sql
|---------------|
| A | B |
|---------------|
| NASDAQ | 1276 |
| AMEX | 1259 |
| NYSE | 1275 |
| OTCBB | 1190 |
|---------------|
```
### ...¹ (JVM and Reflection — Declarative)
*Description*: The argument spread operator: can convert an array into individual arguments
```sql
def p3d(x: Double, y: Double, z: Double) := (x, y, z)
p3d([ x: 123, y:13, z: 67 ]...)
```
##### Results
```sql
Tuple3(_1=123, _2=13, _3=67)
```
### ...² (JVM and Reflection — Declarative)
*Description*: The argument spread operator: can convert a dictionary into individual arguments
```sql
def p3d(x: Double, y: Double, z: Double) := (x, y, z)
p3d({ x: 123, y:13, z: 67 }...)
```
##### Results
```sql
Tuple3(_1=123, _2=13, _3=67)
```
### .? (JVM and Reflection — Object-Oriented)
*Description*: determines whether the method exists within the instance
```sql
val num = 5
num.?MAX_VALUE
```
##### Results
```sql
true
```
### classOf (JVM and Reflection — Object-Oriented)
*Description*: Returns a class instance by name (e.g. "Class.forName")
```sql
classOf('java.io.File')
```
##### Results
```sql
`java.io.File`
```
### codecOf (JVM and Reflection — Functional)
*Description*: Returns the CODEC (encoder/decoder) of an expression.
```sql
val counter = 5
codecOf(counter)
```
##### Results
```sql
Int
```
### interfacesOf (JVM and Reflection — Object-Oriented)
*Description*: Returns the interfaces implemented by a class or instance
```sql
interfacesOf(classOf('java.util.ArrayList'))
```
##### Results
```sql
[`java.util.List`, `java.util.RandomAccess`, `java.lang.Cloneable`, `java.io.Serializable`, `java.util.Collection`, `java.lang.Iterable`]
```
### membersOf (JVM and Reflection — Functional)
*Description*: Returns the members (constructors, fields and methods) of a JVM Class as a Table
```sql
from membersOf(new `java.util.Date`()) limit 5
```
##### Results
```sql
|-----------------------------------------------------------------------------------------------------------------------------|
| modifiers | member | returnType | memberType |
|-----------------------------------------------------------------------------------------------------------------------------|
| public | java.util.Date(arg0: String) | java.util.Date | Constructor |
| public | java.util.Date(arg0: int, arg1: int, arg2: int, arg3: int, arg4: int, arg5: int) | java.util.Date | Constructor |
| public | java.util.Date(arg0: int, arg1: int, arg2: int, arg3: int, arg4: int) | java.util.Date | Constructor |
| public | java.util.Date() | java.util.Date | Constructor |
| public | java.util.Date(arg0: long) | java.util.Date | Constructor |
|-----------------------------------------------------------------------------------------------------------------------------|
```
### new¹ (JVM and Reflection — Functional)
*Description*: The new operator can be used to instantiate JVM classes.
```sql
new `java.util.Date`()
```
##### Results
```sql
2025-10-30T02:15:04.266Z
```
### new² (JVM and Reflection — Functional)
*Description*: The new operator can be used to instantiate Lollypop-defined classes.
```sql
import "java.util.Date"
class QStock(symbol: String, exchange: String, lastSale: Double, lastSaleTime: Date)
stock = new QStock("AAPL", "NASDAQ", 31.23, new Date())
stock.lastSale
```
##### Results
```sql
31.23
```
### new³ (JVM and Reflection — Functional)
*Description*: The new operator can be used to create anonymous objects from interfaces or traits.
```sql
import "java.awt.event.MouseListener"
import "java.awt.event.MouseEvent"
new MouseListener() {
mouseClicked: (e: MouseEvent) => stdout <=== "mouseClicked"
mousePressed: (e: MouseEvent) => stdout <=== "mousePressed"
mouseReleased: (e: MouseEvent) => stdout <=== "mouseReleased"
mouseEntered: (e: MouseEvent) => stdout <=== "mouseEntered"
mouseExited: (e: MouseEvent) => stdout <=== "mouseExited"
}
```
##### Results
```sql
new MouseListener() { mouseClicked: (e: MouseEvent) => stdout <=== "mouseClicked", mousePressed: (e: MouseEvent) => stdout <=== "mousePressed", mouseReleased: (e: MouseEvent) => stdout <=== "mouseReleased", mouseEntered: (e: MouseEvent) => stdout <=== "mouseEntered", mouseExited: (e: MouseEvent) => stdout <=== "mouseExited" }
```
### objectOf (JVM and Reflection — Object-Oriented)
*Description*: Returns a Scala object instance by name
```sql
objectOf('scala.Function1')
```
##### Results
```sql
scala.Function1$@18ff753c
```
### superClassesOf (JVM and Reflection — Object-Oriented)
*Description*: Returns the super-classes extended by a class or instance
```sql
superClassesOf(classOf('java.util.ArrayList'))
```
##### Results
```sql
[`java.util.AbstractList`, `java.util.AbstractCollection`, `java.lang.Object`]
```
### typeOf (JVM and Reflection — Procedural)
*Description*: Returns the type of an expression.
```sql
counter = 5
typeOf(counter)
```
##### Results
```sql
java.lang.Integer
```
## Machine Learning Examples
### decompose (Machine Learning — Declarative)
*Description*: Creates the decomposition of a table
```sql
declare table stocks(
symbol: String(8),
exchange: Enum(AMEX, NASDAQ, NYSE, OTC_BB, OTHER_OTC),
last_sale: Double
)
insert into @stocks
|--------------------------------|
| symbol | exchange | last_sale |
|--------------------------------|
| ABC | OTC_BB | 0.12 |
| JET | NASDAQ | 41.26 |
| APAC | NYSE | 116.24 |
| XYZ | AMEX | 31.95 |
| JUNK | OTHER_OTC | 97.61 |
|--------------------------------|
decompose table @stocks [
Histogram(last_sale, [0, 1, 5, 10, 20, 100])
]
```
##### Results
```sql
|-------------------------------------------------------------------------------|
| symbol | is_amex | is_nasdaq | is_nyse | is_otc_bb | is_other_otc | last_sale |
|-------------------------------------------------------------------------------|
| ABC | 0 | 0 | 0 | 1 | 0 | 0 |
| JET | 0 | 1 | 0 | 0 | 0 | 4 |
| APAC | 0 | 0 | 1 | 0 | 0 | |
| XYZ | 1 | 0 | 0 | 0 | 0 | 4 |
| JUNK | 0 | 0 | 0 | 0 | 1 | 4 |
|-------------------------------------------------------------------------------|
```
### Histogram (Machine Learning — Declarative)
*Description*: Creates a histogram function for attribution
```sql
last_sale = 98.99
Histogram(last_sale, [0, 1, 5, 10, 20, 100, 250, 1000])
```
##### Results
```sql
4
```
## REPL Tools Examples
### (% (REPL Tools — Declarative)
*Description*: Executes an application from the host operating system
```sql
(% iostat 1 3 %)
```
##### Results
```sql
|------------------------------------------------------------|
| lineNumber | output |
|------------------------------------------------------------|
| 1 | disk0 cpu load average |
| 2 | KB/t tps MB/s us sy id 1m 5m 15m |
| 3 | 17.49 35 0.59 7 3 90 3.83 4.05 3.68 |
| 4 | 10.91 11 0.12 4 2 94 3.60 4.00 3.67 |
| 5 | 0.00 0 0.00 3 2 95 3.60 4.00 3.67 |
|------------------------------------------------------------|
```
### (& (REPL Tools — Declarative)
*Description*: Executes an application from the host operating system
```sql
(& iostat 1 3 &)
```
##### Results
```sql
scala.sys.process.ProcessImpl$SimpleProcess@38856d6e
```
### (?¹ (REPL Tools — Declarative)
*Description*: Invokes a native process from the host operating system
```sql
def iostat(n, m) := transpose(output: (? iostat $n $m ?))
iostat(1, 5)
```
##### Results
```sql
|-----------------------------------------------|
| output |
|-----------------------------------------------|
| disk0 cpu load average |
| KB/t tps MB/s us sy id 1m 5m 15m |
| 17.49 35 0.59 7 3 90 3.60 4.00 3.67 |
| 0.00 0 0.00 3 1 96 3.60 4.00 3.67 |
| 0.00 0 0.00 2 2 96 3.60 4.00 3.67 |
| 1016.00 5 4.94 3 2 96 3.60 4.00 3.67 |
| 0.00 0 0.00 7 1 91 3.48 3.97 3.66 |
|-----------------------------------------------|
```
##### Console Output
```
disk0 cpu load average
KB/t tps MB/s us sy id 1m 5m 15m
17.49 35 0.59 7 3 90 3.60 4.00 3.67
0.00 0 0.00 3 2 96 3.60 4.00 3.67
0.00 0 0.00 2 2 96 3.60 4.00 3.67
```
### (?² (REPL Tools — Declarative)
*Description*: Invokes a native process from the host operating system
```sql
def ps() := transpose(output: (? ps aux ?))
from ps() limit 5
```
##### Results
```sql
|-----------------------------------------------------------------------------------------------------------|
| output |
|-----------------------------------------------------------------------------------------------------------|
| USER PID %CPU %MEM VSZ RSS TT STAT STARTED TIME COMMAND |
| ldaniels 21997 30.1 9.7 439573664 9768880 ?? S Sun10PM 149:13.04 /Applications/Intel ... |
| ldaniels 24315 6.8 0.9 418138896 917296 ?? S Mon12AM 143:07.05 /Applications/ChatGP ... |
| _windowserver 385 4.2 0.3 416767424 285440 ?? Ss 20Oct25 572:31.17 /System/Library/Priv ... |
| ldaniels 1147 3.3 0.5 458975056 512352 ?? S 20Oct25 80:01.95 /Users/ldaniels/Libr ... |
|-----------------------------------------------------------------------------------------------------------|
```
### cat (REPL Tools — Declarative)
*Description*: Retrieves the contents of a file.
```sql
cat 'app/examples/src/main/resources/log4j.properties'
```
##### Results
```sql
|---------------------------------------------------------------------------------------------|
| cat |
|---------------------------------------------------------------------------------------------|
| # Root logger option |
| log4j.rootLogger=INFO, stdout |
| |
| # Direct log messages to stdout |
| log4j.appender.stdout=org.apache.log4j.ConsoleAppender |
| log4j.appender.stdout.Target=System.out |
| log4j.appender.stdout.layout=org.apache.log4j.PatternLayout |
| log4j.appender.stdout.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %-5p %c{1}:%L - %m%n |
|---------------------------------------------------------------------------------------------|
```
### cd¹ (REPL Tools — Declarative)
*Description*: Changes the current directory.
```sql
cd ^/Users/karl/Documents
pwd
```
##### Results
```sql
/Users/karl/Documents
```
### cd² (REPL Tools — Declarative)
*Description*: Changes the current directory.
```sql
cd ~/Documents
pwd
```
##### Results
```sql
/Users/ldaniels/Documents
```
### cd³ (REPL Tools — Declarative)
*Description*: Changes the current directory.
```sql
cd "~/Documents"
pwd
```
##### Results
```sql
/Users/ldaniels/Documents
```
### cp (REPL Tools — Declarative)
*Description*: Copies a source file or directory to a target.
```sql
val `count` =
try
cp 'build.sbt' 'temp.txt'
catch e => -1
finally
rm 'temp.txt'
"{{`count`}} bytes copied.\n" ===> stdout
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
6610 bytes copied.
```
### echo¹ (REPL Tools — Declarative)
*Description*: Prints text to the standard output.
```sql
echo "Hello Lollypop!"
```
##### Results
```sql
()
```
##### Console Output
```
Hello Lollypop!
```
### echo² (REPL Tools — Declarative)
*Description*: Prints text to the standard output.
```sql
item = { symbol: "ABC", lastSale: 97.55 }
echo '{{item.symbol}} is {{item.lastSale}}/share'
```
##### Results
```sql
()
```
##### Console Output
```
ABC is 97.55/share
```
### find¹ (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a recursive list of files matching any specified criterion.
```sql
find "./app/examples/" where name matches "(.*)[.]csv"
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
| companylist-amex.csv | /Users/ldaniels/GitHub/lollypop/app/examples/companylist/csv/companylist-amex.csv | 2023-11-12T07:50:27.477Z | 44754 | false | true | false |
| companylist-nyse.csv | /Users/ldaniels/GitHub/lollypop/app/examples/companylist/csv/companylist-nyse.csv | 2023-11-12T07:50:27.479Z | 405461 | false | true | false |
| companylist-nasdaq.csv | /Users/ldaniels/GitHub/lollypop/app/examples/companylist/csv/companylist-nasdaq.csv | 2023-11-12T07:50:27.478Z | 456099 | false | true | false |
| stocks-5k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-5k.csv | 2023-11-12T07:50:27.491Z | 249566 | false | true | false |
| stocks.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks.csv | 2023-11-12T07:50:27.492Z | 336324 | false | true | false |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### find² (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of files matching any specified criterion.
```sql
find app/examples where name matches "(.*)[.]csv" order by lastModified desc
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| stocks.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks.csv | 2023-11-12T07:50:27.492Z | 336324 | false | true | false |
| stocks-5k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-5k.csv | 2023-11-12T07:50:27.491Z | 249566 | false | true | false |
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
| companylist-nyse.csv | /Users/ldaniels/GitHub/lollypop/app/examples/companylist/csv/companylist-nyse.csv | 2023-11-12T07:50:27.479Z | 405461 | false | true | false |
| companylist-nasdaq.csv | /Users/ldaniels/GitHub/lollypop/app/examples/companylist/csv/companylist-nasdaq.csv | 2023-11-12T07:50:27.478Z | 456099 | false | true | false |
| companylist-amex.csv | /Users/ldaniels/GitHub/lollypop/app/examples/companylist/csv/companylist-amex.csv | 2023-11-12T07:50:27.477Z | 44754 | false | true | false |
|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### find³ (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of files matching any specified criterion.
NOTE: ~ indicates the user's home directory.
```sql
find docs limit 5
```
##### Results
```sql
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| .DS_Store | /Users/ldaniels/GitHub/lollypop/docs/.DS_Store | 2025-10-30T02:15:05.642Z | 6148 | false | true | true |
| Travelers.png | /Users/ldaniels/GitHub/lollypop/docs/images/Travelers.png | 2025-10-30T02:15:04.048Z | 18784 | false | true | false |
| Small_Caps.png | /Users/ldaniels/GitHub/lollypop/docs/images/Small_Caps.png | 2025-10-30T02:15:03.853Z | 27470 | false | true | false |
| Exchange_Exposure.png | /Users/ldaniels/GitHub/lollypop/docs/images/Exchange_Exposure.png | 2025-10-30T02:15:02.343Z | 26520 | false | true | false |
| Powered_By_Lollypop.png | /Users/ldaniels/GitHub/lollypop/docs/images/Powered_By_Lollypop.png | 2025-10-30T02:14:55.025Z | 26480 | false | true | false |
|---------------------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### ls¹ (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of files matching any specified criterion.
```sql
ls
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------|
| .DS_Store | /Users/ldaniels/GitHub/lollypop/.DS_Store | 2025-10-30T02:15:05.633Z | 10244 | false | true | true |
| app | /Users/ldaniels/GitHub/lollypop/app | 2024-07-30T03:10:58.889Z | 256 | true | false | false |
| LICENSE | /Users/ldaniels/GitHub/lollypop/LICENSE | 2023-10-18T21:42:27.686Z | 1073 | false | true | false |
| test1.json | /Users/ldaniels/GitHub/lollypop/test1.json | 2025-10-30T02:11:05.341Z | 12 | false | true | false |
| target | /Users/ldaniels/GitHub/lollypop/target | 2023-11-24T20:42:51.377Z | 288 | true | false | false |
| .bsp | /Users/ldaniels/GitHub/lollypop/.bsp | 2023-10-19T16:00:17.226Z | 96 | true | false | true |
| vin-mapping.json | /Users/ldaniels/GitHub/lollypop/vin-mapping.json | 2025-10-30T02:11:07.086Z | 1345 | false | true | false |
| docs | /Users/ldaniels/GitHub/lollypop/docs | 2024-06-16T15:27:07.640Z | 160 | true | false | false |
| rebuild.sh | /Users/ldaniels/GitHub/lollypop/rebuild.sh | 2023-11-06T19:36:01.005Z | 227 | false | true | false |
| stock_quotes_output | /Users/ldaniels/GitHub/lollypop/stock_quotes_output | 2024-06-06T14:29:26.592Z | 224 | true | false | false |
| README.md | /Users/ldaniels/GitHub/lollypop/README.md | 2025-10-30T02:15:10.822Z | 134911 | false | true | false |
| project | /Users/ldaniels/GitHub/lollypop/project | 2024-06-16T15:27:07.640Z | 256 | true | false | false |
| kafka.properties | /Users/ldaniels/GitHub/lollypop/kafka.properties | 2025-06-21T20:55:05.060Z | 322 | false | true | false |
| .gitignore | /Users/ldaniels/GitHub/lollypop/.gitignore | 2024-06-22T15:02:11.128Z | 667 | false | true | true |
| StartDevEnv.sql | /Users/ldaniels/GitHub/lollypop/StartDevEnv.sql | 2024-06-16T15:27:07.566Z | 558 | false | true | false |
| lollypop_db | /Users/ldaniels/GitHub/lollypop/lollypop_db | 2025-10-30T02:14:20.634Z | 160 | true | false | false |
| .git | /Users/ldaniels/GitHub/lollypop/.git | 2025-10-30T02:07:30.548Z | 544 | true | false | true |
| build.sbt | /Users/ldaniels/GitHub/lollypop/build.sbt | 2024-07-30T18:53:37.585Z | 6610 | false | true | false |
| .idea | /Users/ldaniels/GitHub/lollypop/.idea | 2025-10-30T02:10:42.098Z | 544 | true | false | true |
|-------------------------------------------------------------------------------------------------------------------------------------------------|
```
### ls² (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of files matching any specified criterion.
```sql
ls app/examples where not isHidden order by length desc
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
| stocks.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks.csv | 2023-11-12T07:50:27.492Z | 336324 | false | true | false |
| stocks-5k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-5k.csv | 2023-11-12T07:50:27.491Z | 249566 | false | true | false |
| target | /Users/ldaniels/GitHub/lollypop/app/examples/target | 2023-07-05T21:57:46.435Z | 192 | true | false | false |
| src | /Users/ldaniels/GitHub/lollypop/app/examples/src | 2023-07-05T21:52:11.441Z | 160 | true | false | false |
| companylist | /Users/ldaniels/GitHub/lollypop/app/examples/companylist | 2023-11-12T07:50:27.476Z | 128 | true | false | false |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### ls³ (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of files matching any specified criterion.
```sql
ls "./app/examples/" where name matches ".*[.]csv"
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
| stocks-5k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-5k.csv | 2023-11-12T07:50:27.491Z | 249566 | false | true | false |
| stocks.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks.csv | 2023-11-12T07:50:27.492Z | 336324 | false | true | false |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### ls⁴ (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of files matching any specified criterion.
NOTE: ~ indicates the user's home directory.
```sql
ls ~ order by length desc limit 5
```
##### Results
```sql
|-----------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-----------------------------------------------------------------------------------------------------------------|
| examples.md | /Users/ldaniels/examples.md | 2025-05-08T01:09:28.212Z | 44180 | false | true | false |
| language.md | /Users/ldaniels/language.md | 2025-09-08T01:03:26.163Z | 16400 | false | true | false |
| Music | /Users/ldaniels/Music | 2023-07-26T17:40:28.631Z | 224 | true | false | false |
| .config | /Users/ldaniels/.config | 2024-02-07T22:23:38.054Z | 192 | true | false | true |
| ui | /Users/ldaniels/ui | 2024-01-02T14:27:00.036Z | 96 | true | false | false |
|-----------------------------------------------------------------------------------------------------------------|
```
### md5¹ (REPL Tools — Declarative)
*Description*: Returns an MD5 digest of a file or byte-encode-able value.
```sql
md5 "BadPassword123"
```
##### Results
```sql
��4p�`DVڙ���)
```
### md5² (REPL Tools — Declarative)
*Description*: Returns an MD5 digest of a file or byte-encode-able value.
```sql
md5 new `java.io.File`("app/core/src/main/scala/com/lollypop/repl/gnu/MD5Sum.scala")
```
##### Results
```sql
��W����C��z
```
### mkdir (REPL Tools — Declarative)
*Description*: Creates a new directory.
```sql
created = mkdir temp
response = iff(not created, "Couldn't do it", "Done")
rmdir temp
response
```
##### Results
```sql
Done
```
### mv (REPL Tools — Declarative)
*Description*: Renames a file or moves the file to a directory.
```sql
try {
cp 'build.sbt' 'temp.txt'
mv 'temp.txt' 'temp1.txt'
} catch e => {
e ===> stderr
false
} finally rm 'temp.txt' or rm 'temp1.txt'
```
##### Results
```sql
true
```
### nps (REPL Tools — Declarative)
*Description*: Returns a dataframe containing a list of active Lollypop peers
```sql
node = Nodes.start()
node.awaitStartup(Duration('1 second'))
node.exec("this where kind is 'Table'")
nps
```
##### Results
```sql
|-----------------------------------------------------------------------------------------------------------------------------------------------|
| host | port | uptimeInSeconds | lastCommand |
|-----------------------------------------------------------------------------------------------------------------------------------------------|
| 0.0.0.0 | 9667 | 0 | this where kind is 'Table' |
| 0.0.0.0 | 11995 | 8 | x = 1\ny = 2\nz = x + y\nz |
| 0.0.0.0 | 13682 | 9 | |
| 0.0.0.0 | 13273 | 9 | \nfrom (\n|-------------------------------------------------------|\n| ticker | market | lastSale | ... |
| 0.0.0.0 | 8149 | 8 | |
|-----------------------------------------------------------------------------------------------------------------------------------------------|
```
### pwd (REPL Tools — Declarative)
*Description*: Retrieves the contents of a file.
```sql
cd ~
pwd
```
##### Results
```sql
/Users/ldaniels
```
### rm (REPL Tools — Declarative)
*Description*: Removes a file or a collection of files via pattern-matching.
```sql
val `count` =
try
cp 'build.sbt' 'temp.txt'
catch e => -1
finally
rm 'temp.txt'
"{{`count`}} bytes copied.\n" ===> stdout
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
6610 bytes copied.
```
### rmdir (REPL Tools — Declarative)
*Description*: Removes a specific directory.
```sql
created = mkdir temp_zzz
response = iff(not created, "Couldn't do it", "Done")
rmdir temp_zzz
response
```
##### Results
```sql
Done
```
### rmr (REPL Tools — Declarative)
*Description*: Recursively removes files or collections of files via pattern-matching.
```sql
val `count` =
try
cp 'build.sbt' 'temp.txt'
catch e => -1
finally
rmr 'temp.txt'
"{{`count`}} bytes copied.\n" ===> stdout
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
6610 bytes copied.
```
### touch (REPL Tools — Declarative)
*Description*: Creates or updates the last modified time of a file. Return true if successful.
```sql
touch 'app/examples/src/main/resources/log4j.properties'
```
##### Results
```sql
true
```
### wc (REPL Tools — Declarative)
*Description*: Returns the count of lines of a text file.
```sql
wc LICENSE
```
##### Results
```sql
1073
```
### www¹ (REPL Tools — Reactive)
*Description*: A non-interactive HTTP client
```sql
www get('https://example.com/')
```
##### Results
```sql
HttpResponse(body="Example Domainbody{background:#eee;width:60vw;margin:15vh auto;font-family:system-ui,sans-serif}h1{font-size:1.5em}div{opacity:0.8}a:link,a:visited{color:#348}
Example Domain
This domain is for use in documentation examples without needing permission. Avoid use in operations.
", message="OK", statusCode=200, responseID=271116e3-c32c-4312-a31c-28d401e06d5b)
```
### www² (REPL Tools — Reactive)
*Description*: Returns a URL based on a relative path.
```sql
www path('users')
```
##### Results
```sql
HttpResponse(body=null, message=null, statusCode=200, responseID=a5a9dabf-b24e-4e32-91f6-a638da99e4ea)
```
### www³ (REPL Tools — Reactive)
*Description*: Returns a URI based on a relative path.
```sql
www uri('users')
```
##### Results
```sql
HttpResponse(body=null, message=null, statusCode=200, responseID=e2d7e3e3-d164-4521-8242-bfb657b87f44)
```
## Scope and Session Examples
### $ (Scope and Session — Declarative)
*Description*: used to disambiguate a variable from a field or other identifiers
```sql
x = 1
$x
```
##### Results
```sql
1
```
### <|> (Scope and Session — Functional)
*Description*: Horizontally combines two arrays.
```sql
['a', 'b', 'c'] <|> [1, 2, 3]
```
##### Results
```sql
[['a', 1], ['b', 2], ['c', 3]]
```
### =>¹ (Scope and Session — Functional)
*Description*: Defines an anonymous function
```sql
val f = n => n * n
f(5)
```
##### Results
```sql
25
```
### =>² (Scope and Session — Declarative)
*Description*: Define objects literally using JSON syntax
```sql
[{id: '7bd0b461-4eb9-400a-9b63-713af85a43d0', lastName: 'JONES', firstName: 'GARRY', airportCode: 'SNA'},
{id: '73a3fe49-df95-4a7a-9809-0bb4009f414b', lastName: 'JONES', firstName: 'DEBBIE', airportCode: 'SNA'},
{id: 'e015fc77-45bf-4a40-9721-f8f3248497a1', lastName: 'JONES', firstName: 'TAMERA', airportCode: 'SNA'},
{id: '33e31b53-b540-45e3-97d7-d2353a49f9c6', lastName: 'JONES', firstName: 'ERIC', airportCode: 'SNA'},
{id: 'e4dcba22-56d6-4e53-adbc-23fd84aece72', lastName: 'ADAMS', firstName: 'KAREN', airportCode: 'DTW'},
{id: '3879ba60-827e-4535-bf4e-246ca8807ba1', lastName: 'ADAMS', firstName: 'MIKE', airportCode: 'DTW'},
{id: '3d8dc7d8-cd86-48f4-b364-d2f40f1ae05b', lastName: 'JONES', firstName: 'SAMANTHA', airportCode: 'BUR'},
{id: '22d10aaa-32ac-4cd0-9bed-aa8e78a36d80', lastName: 'SHARMA', firstName: 'PANKAJ', airportCode: 'LAX'}
].toTable()
```
##### Results
```sql
|---------------------------------------------------------------------------|
| airportCode | lastName | firstName | id |
|---------------------------------------------------------------------------|
| SNA | JONES | GARRY | 7bd0b461-4eb9-400a-9b63-713af85a43d0 |
| SNA | JONES | DEBBIE | 73a3fe49-df95-4a7a-9809-0bb4009f414b |
| SNA | JONES | TAMERA | e015fc77-45bf-4a40-9721-f8f3248497a1 |
| SNA | JONES | ERIC | 33e31b53-b540-45e3-97d7-d2353a49f9c6 |
| DTW | ADAMS | KAREN | e4dcba22-56d6-4e53-adbc-23fd84aece72 |
| DTW | ADAMS | MIKE | 3879ba60-827e-4535-bf4e-246ca8807ba1 |
| BUR | JONES | SAMANTHA | 3d8dc7d8-cd86-48f4-b364-d2f40f1ae05b |
| LAX | SHARMA | PANKAJ | 22d10aaa-32ac-4cd0-9bed-aa8e78a36d80 |
|---------------------------------------------------------------------------|
```
### @ (Scope and Session — Declarative)
*Description*: used to disambiguate a table variable from a field or other identifiers
```sql
r = select value: 1
@r
```
##### Results
```sql
|-------|
| value |
|-------|
| 1 |
|-------|
```
### as (Scope and Session — Declarative)
*Description*: Applies an alias to an expression or query
```sql
stocks =
|---------------------------------------------------------|
| exchange | symbol | lastSale | lastSaleTime |
|---------------------------------------------------------|
| NASDAQ | RY | 68.6234 | 2023-09-28T22:25:55.559Z |
| OTCBB | OUSVN | 0.7195 | 2023-09-28T22:25:59.404Z |
| NYSE | FTR | 40.7124 | 2023-09-28T22:26:21.811Z |
| OTCBB | TWVD | 0.0401 | 2023-09-28T22:26:10.017Z |
| OTCBB | GVHMN | 0.9648 | 2023-09-28T22:25:57.608Z |
| NASDAQ | DS | 155.021 | 2023-09-28T22:25:59.213Z |
|---------------------------------------------------------|
select count(*) as total,
avg(lastSale) as avgLastSale,
max(lastSale) as maxLastSale,
min(lastSale) as minLastSale,
sum(lastSale) as sumLastSale
from @stocks
```
##### Results
```sql
|----------------------------------------------------------------------------|
| total | avgLastSale | maxLastSale | minLastSale | sumLastSale |
|----------------------------------------------------------------------------|
| 6 | 44.34686666666666 | 155.021 | 0.0401 | 266.08119999999997 |
|----------------------------------------------------------------------------|
```
### destroy (Scope and Session — Procedural)
*Description*: Removes a variable from the active scope
```sql
destroy stocks
```
##### Results
### let (Scope and Session — Functional)
*Description*: Creates a variable that automatically applies a CODEC function when mutated.
```sql
base64 = (value: String) => value.getBytes().base64()
let b64 : base64 = "Hello"
b64
```
##### Results
```sql
SGVsbG8=
```
### namespace (Scope and Session — Declarative)
*Description*: Sets the active database
```sql
namespace 'stocks_demo'
__namespace__
```
##### Results
```sql
stocks_demo.public
```
### package (Scope and Session — Declarative)
*Description*: Declares the default JVM package namespace
```sql
package "com.acme.skunkworks"
__package__
```
##### Results
```sql
com.acme.skunkworks
```
### reset (Scope and Session — Procedural)
*Description*: Resets the scope; wiping out all state
```sql
reset
```
##### Results
### set (Scope and Session — Declarative)
*Description*: Sets the value of a variable
```sql
set x = { a: { b: { c : 98 } } }
x.a.b.c
```
##### Results
```sql
98
```
### this (Scope and Session — Declarative)
*Description*: Table representation of the current scope
```sql
this
```
##### Results
```sql
|---------------------------------------------------------------|
| name | kind | value |
|---------------------------------------------------------------|
| Random | Random$ | lollypop.lang.Random |
| WebSockets | WebSockets$ | lollypop.io.WebSockets$@63485d7 |
| stdout | PrintStream | java.io.PrintStream@23ea8830 |
| stdin | BufferedReader | java.io.BufferedReader@790ac3e0 |
| stderr | PrintStream | java.io.PrintStream@5bb2fb2b |
| OS | OS | lollypop.lang.OS |
| π | Double | 3.141592653589793 |
| Nodes | Nodes | lollypop.io.Nodes@2cee5365 |
|---------------------------------------------------------------|
```
### val (Scope and Session — Procedural)
*Description*: Creates a read-only variable
```sql
val greeting: String = 'Hello World'
```
##### Results
### var (Scope and Session — Procedural)
*Description*: Creates a variable
```sql
var customer_id: Int = 5
```
##### Results
## System Tools Examples
### classPath (System Tools — Functional)
*Description*: Searches the classpath via a class name pattern.
```sql
transpose(classPath("akka[.]dispatch[.](.*)D(.*)M(.*)S(.*)"))
```
##### Results
```sql
|--------------------------------------------------------|
| classPath |
|--------------------------------------------------------|
| akka.dispatch.BoundedDequeBasedMessageQueueSemantics |
| akka.dispatch.DequeBasedMessageQueueSemantics |
| akka.dispatch.UnboundedDequeBasedMessageQueueSemantics |
|--------------------------------------------------------|
```
### DateTime (System Tools — Procedural)
*Description*: Creates new date instance
```sql
DateTime()
```
##### Results
```sql
2025-10-30T02:15:11.268Z
```
### help¹ (System Tools — Declarative)
*Description*: Provides offline manual pages for instructions.
Additionally, it's an internal database containing information about every loaded instruction.
```sql
help 's(.*)'
```
##### Results
```sql
|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | category | paradigm | description | example |
|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| scaleTo | Transformation | Functional | Returns the the numeric expression truncated after `scale` decimal places. | scaleTo(0.567, 2) |
| scenario | Testing - Unit/Integration | Declarative | scenario-based test declaration | feature "State Inheritance" { scenario 'Create a contest' { val contest_id = "40d1857b-474c-4400-8f0 ... |
| select | Dataframe I/O | Declarative | Returns row(s) of data based on the expression and options | select symbol: 'GMTQ', exchange: 'OTCBB', lastSale: 0.1111, lastSaleTime: DateTime() |
| set | Scope and Session | Declarative | Sets the value of a variable | set x = { a: { b: { c : 98 } } } x.a.b.c |
| subtract | Dataframe I/O | Declarative | Computes the subtraction of two queries | from ( |------------------------------| | symbol | exchange | lastSale | |-------------------------- ... |
| sum | Aggregation and Sorting | Functional | Returns the sum of a numeric expression. | stocks = ( |-------------------| | symbol | lastSale | |-------------------| | VHLH | 153.2553 | | ... |
| sum | Aggregation and Sorting | Functional | Returns the sum of a numeric expression. | select total: sum(lastSale) from ( |-------------------| | symbol | lastSale | |-------------------| ... |
| superClassesOf | JVM and Reflection | Object-Oriented | Returns the super-classes extended by a class or instance | superClassesOf(classOf('java.util.ArrayList')) |
| switch | Transformation | Functional | Scala-inspired switch-case statement | value = 5.7 switch value case n => n < 5.0 then 'Yes - {{n}}' case n => n >= 5.0 and n <= 6.0 then ' ... |
| switch | Transformation | Functional | Scala-inspired switch-case statement | class StockQ(symbol: String, exchange: String, lastSale: Double) switch new StockQ("ABC", "AMEX", 78 ... |
| switch | Transformation | Functional | Scala-inspired switch-case statement | class StockQ(symbol: String, exchange: String, lastSale: Double) switch new StockQ('YORKIE', 'NYSE', ... |
| synchronized | System Tools | Procedural | Synchronizes access to an object; providing an exclusive read/write lock over it | bag = { message: null } synchronized(bag) { bag.message = 'Hello' } bag |
|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### help² (System Tools — Declarative)
*Description*: Provides offline manual pages for instructions.
Additionally, it's an internal database containing information about every loaded instruction.
```sql
help 'select'
```
##### Results
```sql
|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | category | paradigm | description | example |
|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| select | Dataframe I/O | Declarative | Returns row(s) of data based on the expression and options | select symbol: 'GMTQ', exchange: 'OTCBB', lastSale: 0.1111, lastSaleTime: DateTime() |
|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### help³ (System Tools — Declarative)
*Description*: Provides offline manual pages for instructions.
Additionally, it's an internal database containing information about every loaded instruction.
```sql
transpose(help('select'))
```
##### Results
```sql
|----------------------------------------------------------------------------------------------------|
| name | value |
|----------------------------------------------------------------------------------------------------|
| name | select |
| category | Dataframe I/O |
| paradigm | Declarative |
| description | Returns row(s) of data based on the expression and options |
| example | select symbol: 'GMTQ', exchange: 'OTCBB', lastSale: 0.1111, lastSaleTime: DateTime() |
|----------------------------------------------------------------------------------------------------|
```
### help⁴ (System Tools — Declarative)
*Description*: Provides offline manual pages for instructions.
Additionally, it's an internal database containing information about every loaded instruction.
```sql
select category, total: count(*)
from (help)
group by category
order by category
```
##### Results
```sql
|------------------------------------|
| category | total |
|------------------------------------|
| Aggregation and Sorting | 28 |
| Concurrency | 10 |
| Control Flow | 21 |
| Dataframe I/O | 25 |
| Dataframe Management | 14 |
| Filtering and Matching | 25 |
| JVM and Reflection | 14 |
| Machine Learning | 2 |
| REPL Tools | 32 |
| Scope and Session | 23 |
| System Tools | 17 |
| Testing - Unit/Integration | 5 |
| Transformation | 9 |
|------------------------------------|
```
### help⁵ (System Tools — Declarative)
*Description*: Provides offline manual pages for instructions.
Additionally, it's an internal database containing information about every loaded instruction.
```sql
chart = { shape: "ring", title: "Help By Category" }
graph chart from (
select category, total: count(*)
from (help)
group by category
)
```
##### Results
### help⁶ (System Tools — Declarative)
*Description*: Provides offline manual pages for instructions.
Additionally, it's an internal database containing information about every loaded instruction.
```sql
chart = { shape: "pie3d", title: "Help By Paradigm" }
graph chart from (
select paradigm, total: count(*)
from (help)
group by paradigm
)
```
##### Results
### import (System Tools — Object-Oriented)
*Description*: Imports a JVM class
```sql
import 'java.util.Date'
```
##### Results
```sql
java.util.Date
```
### include (System Tools — Declarative)
*Description*: incorporates the contents of an external file into current scope
```sql
include('./app/examples/src/main/lollypop/Stocks.sql')
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
Sampling 5 quotes:
----------------------------------------------------------|
exchange | symbol | lastSale | lastSaleTime |
----------------------------------------------------------|
OTHER_OTC | DHXXO | 0.1029 | 2025-10-30T02:14:37.712Z |
OTHER_OTC | NGWU | 0.191 | 2025-10-30T02:14:27.222Z |
NYSE | CCUJ | 30.7794 | 2025-10-30T02:14:28.643Z |
NASDAQ | QR | 81.6851 | 2025-10-30T02:14:16.148Z |
OTCBB | FKVY | 0.7459 | 2025-10-30T02:14:16.124Z |
----------------------------------------------------------|
```
### lollypopComponents (System Tools — Declarative)
*Description*: installs a collection of components from a source.
```sql
lollypopComponents("com.lollypop.repl.gnu.Ls$")
ls "./app/examples/"
```
##### Results
```sql
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| name | canonicalPath | lastModified | length | isDirectory | isFile | isHidden |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
| .DS_Store | /Users/ldaniels/GitHub/lollypop/app/examples/.DS_Store | 2024-07-31T01:17:55.022Z | 6148 | false | true | true |
| stocks-100k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-100k.csv | 2023-11-12T07:50:27.490Z | 4990190 | false | true | false |
| target | /Users/ldaniels/GitHub/lollypop/app/examples/target | 2023-07-05T21:57:46.435Z | 192 | true | false | false |
| companylist | /Users/ldaniels/GitHub/lollypop/app/examples/companylist | 2023-11-12T07:50:27.476Z | 128 | true | false | false |
| stocks-5k.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks-5k.csv | 2023-11-12T07:50:27.491Z | 249566 | false | true | false |
| src | /Users/ldaniels/GitHub/lollypop/app/examples/src | 2023-07-05T21:52:11.441Z | 160 | true | false | false |
| stocks.csv | /Users/ldaniels/GitHub/lollypop/app/examples/stocks.csv | 2023-11-12T07:50:27.492Z | 336324 | false | true | false |
|-------------------------------------------------------------------------------------------------------------------------------------------------------|
```
### ns (System Tools — Functional)
*Description*: Returns a persistent object (e.g. table, view, et al) from disk via a namespace
```sql
from ns('lollypop.public.Stocks') limit 5
```
```scala
com.lollypop.runtime.errors.DurableObjectNotFound: Durable object 'lollypop.public.Stocks' does not exist
at com.lollypop.runtime.DatabaseObjectNS$.readConfig(DatabaseObjectNS.scala:89)
at com.lollypop.runtime.DatabaseObjectNS.$anonfun$getConfig$1(DatabaseObjectNS.scala:53)
at scala.collection.concurrent.TrieMap.getOrElseUpdate(TrieMap.scala:960)
at com.lollypop.runtime.DatabaseObjectNS.getConfig(DatabaseObjectNS.scala:53)
at com.lollypop.language.LollypopUniverse.$anonfun$getReferencedEntity$1(LollypopUniverse.scala:86)
at com.lollypop.runtime.ResourceManager$.$anonfun$getResourceOrElseUpdate$1(ResourceManager.scala:45)
at scala.collection.concurrent.TrieMap.getOrElseUpdate(TrieMap.scala:960)
at com.lollypop.runtime.ResourceManager$.getResourceOrElseUpdate(ResourceManager.scala:43)
at com.lollypop.language.LollypopUniverse.getReferencedEntity(LollypopUniverse.scala:86)
at com.lollypop.runtime.instructions.functions.NS.execute(NS.scala:28)
at com.lollypop.runtime.LollypopVM$.liftedTree1$1(LollypopVM.scala:34)
at com.lollypop.runtime.LollypopVM$.execute(LollypopVM.scala:33)
at com.lollypop.runtime.package$LollypopVMAddOns$.search$extension(package.scala:982)
at com.lollypop.runtime.instructions.queryables.Limit.execute(Limit.scala:14)
at com.lollypop.runtime.LollypopVM$.liftedTree1$1(LollypopVM.scala:34)
at com.lollypop.runtime.LollypopVM$.execute(LollypopVM.scala:33)
at com.lollypop.runtime.package$LollypopVMAddOns$.execute$extension(package.scala:973)
at com.lollypop.runtime.instructions.queryables.From.execute(From.scala:26)
at com.lollypop.runtime.LollypopVM$.liftedTree1$1(LollypopVM.scala:34)
at com.lollypop.runtime.LollypopVM$.execute(LollypopVM.scala:33)
at com.lollypop.runtime.LollypopVM$.executeSQL(LollypopVM.scala:66)
at com.lollypop.docs.DocumentGeneratorFunSpec.$anonfun$invoke$6(DocumentGeneratorFunSpec.scala:70)
at scala.util.Try$.apply(Try.scala:217)
at com.lollypop.docs.DocumentGeneratorFunSpec.invoke(DocumentGeneratorFunSpec.scala:70)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$5(ReadMeTest.scala:97)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$5$adapted(ReadMeTest.scala:92)
at scala.collection.immutable.List.foreach(List.scala:334)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$4(ReadMeTest.scala:92)
at com.lollypop.docs.ReadMeTest.$anonfun$processCategory$4$adapted(ReadMeTest.scala:90)
at scala.collection.immutable.List.foreach(List.scala:334)
at com.lollypop.docs.ReadMeTest.processCategory(ReadMeTest.scala:90)
at com.lollypop.docs.ReadMeTest.$anonfun$new$15(ReadMeTest.scala:72)
at com.lollypop.docs.ReadMeTest.$anonfun$new$15$adapted(ReadMeTest.scala:71)
at scala.collection.IterableOnceOps.foreach(IterableOnce.scala:619)
at scala.collection.IterableOnceOps.foreach$(IterableOnce.scala:617)
at scala.collection.AbstractIterable.foreach(Iterable.scala:935)
at scala.collection.IterableOps$WithFilter.foreach(Iterable.scala:905)
at com.lollypop.docs.ReadMeTest.$anonfun$new$5(ReadMeTest.scala:71)
at com.lollypop.docs.ReadMeTest.$anonfun$new$5$adapted(ReadMeTest.scala:22)
at com.lollypop.runtime.package$AutoClose$.use$extension(package.scala:126)
at com.lollypop.docs.ReadMeTest.$anonfun$new$2(ReadMeTest.scala:22)
at org.scalatest.OutcomeOf.outcomeOf(OutcomeOf.scala:85)
at org.scalatest.OutcomeOf.outcomeOf$(OutcomeOf.scala:83)
at org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)
at org.scalatest.Transformer.apply(Transformer.scala:22)
at org.scalatest.Transformer.apply(Transformer.scala:20)
at org.scalatest.funspec.AnyFunSpecLike$$anon$1.apply(AnyFunSpecLike.scala:457)
at org.scalatest.TestSuite.withFixture(TestSuite.scala:196)
at org.scalatest.TestSuite.withFixture$(TestSuite.scala:195)
at org.scalatest.funspec.AnyFunSpec.withFixture(AnyFunSpec.scala:1631)
at org.scalatest.funspec.AnyFunSpecLike.invokeWithFixture$1(AnyFunSpecLike.scala:455)
at org.scalatest.funspec.AnyFunSpecLike.$anonfun$runTest$1(AnyFunSpecLike.scala:467)
at org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)
at org.scalatest.funspec.AnyFunSpecLike.runTest(AnyFunSpecLike.scala:467)
at org.scalatest.funspec.AnyFunSpecLike.runTest$(AnyFunSpecLike.scala:449)
at org.scalatest.funspec.AnyFunSpec.runTest(AnyFunSpec.scala:1631)
at org.scalatest.funspec.AnyFunSpecLike.$anonfun$runTests$1(AnyFunSpecLike.scala:500)
at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:413)
at scala.collection.immutable.List.foreach(List.scala:334)
at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:390)
at org.scalatest.SuperEngine.$anonfun$runTestsInBranch$1(Engine.scala:427)
at scala.collection.immutable.List.foreach(List.scala:334)
at org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)
at org.scalatest.SuperEngine.runTestsInBranch(Engine.scala:396)
at org.scalatest.SuperEngine.runTestsImpl(Engine.scala:475)
at org.scalatest.funspec.AnyFunSpecLike.runTests(AnyFunSpecLike.scala:500)
at org.scalatest.funspec.AnyFunSpecLike.runTests$(AnyFunSpecLike.scala:499)
at org.scalatest.funspec.AnyFunSpec.runTests(AnyFunSpec.scala:1631)
at org.scalatest.Suite.run(Suite.scala:1112)
at org.scalatest.Suite.run$(Suite.scala:1094)
at org.scalatest.funspec.AnyFunSpec.org$scalatest$funspec$AnyFunSpecLike$$super$run(AnyFunSpec.scala:1631)
at org.scalatest.funspec.AnyFunSpecLike.$anonfun$run$1(AnyFunSpecLike.scala:504)
at org.scalatest.SuperEngine.runImpl(Engine.scala:535)
at org.scalatest.funspec.AnyFunSpecLike.run(AnyFunSpecLike.scala:504)
at org.scalatest.funspec.AnyFunSpecLike.run$(AnyFunSpecLike.scala:503)
at org.scalatest.funspec.AnyFunSpec.run(AnyFunSpec.scala:1631)
at org.scalatest.tools.SuiteRunner.run(SuiteRunner.scala:45)
at org.scalatest.tools.Runner$.$anonfun$doRunRunRunDaDoRunRun$13(Runner.scala:1320)
at org.scalatest.tools.Runner$.$anonfun$doRunRunRunDaDoRunRun$13$adapted(Runner.scala:1314)
at scala.collection.immutable.List.foreach(List.scala:334)
at org.scalatest.tools.Runner$.doRunRunRunDaDoRunRun(Runner.scala:1314)
at org.scalatest.tools.Runner$.$anonfun$runOptionallyWithPassFailReporter$24(Runner.scala:993)
at org.scalatest.tools.Runner$.$anonfun$runOptionallyWithPassFailReporter$24$adapted(Runner.scala:971)
at org.scalatest.tools.Runner$.withClassLoaderAndDispatchReporter(Runner.scala:1480)
at org.scalatest.tools.Runner$.runOptionallyWithPassFailReporter(Runner.scala:971)
at org.scalatest.tools.Runner$.run(Runner.scala:798)
at org.scalatest.tools.Runner.run(Runner.scala)
at org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner.runScalaTest2or3(ScalaTestRunner.java:43)
at org.jetbrains.plugins.scala.testingSupport.scalaTest.ScalaTestRunner.main(ScalaTestRunner.java:26)
```
### require (System Tools — Object-Oriented)
*Description*: Downloads a JVM dependency (jar) from a repository
```sql
require ['org.apache.spark:spark-core_2.13:3.3.0']
```
##### Results
### synchronized (System Tools — Procedural)
*Description*: Synchronizes access to an object; providing an exclusive read/write lock over it
```sql
bag = { message: null }
synchronized(bag) {
bag.message = 'Hello'
}
bag
```
##### Results
```sql
{"message": "Hello"}
```
### trace (System Tools — Functional)
*Description*: Executes an instruction
```sql
trace set x = 1
```
##### Results
## Testing - Unit/Integration Examples
### assert¹ (Testing - Unit/Integration — Procedural)
*Description*: Assertion: if the expression evaluates to false, an exception is thrown.
```sql
total = 99
assert(total < 100, 'total must be less than 100')
```
##### Results
```sql
true
```
##### Console Error
```
[0.000291ms] AnyLiteral 1 ~> 1
[0.329292ms] SetAnyVariable set x = 1 ~> null
```
### assert² (Testing - Unit/Integration — Procedural)
*Description*: Assertion: if the expression evaluates to false, an exception is thrown.
```sql
total = 101
try
assert(total < 100, 'total must be less than 100')
catch e =>
stderr <=== e.getMessage()
```
##### Results
```sql
java.io.PrintStream@5bb2fb2b
```
##### Console Error
```
total must be less than 100 on line 3 at 23
```
### feature (Testing - Unit/Integration — Declarative)
*Description*: Feature-based test declaration
```sql
namespace 'temp.examples'
// startup a listener node
node = Nodes.start()
port = node.server.port()
// create a table
drop if exists Travelers
create table Travelers (id: UUID, lastName: String(32), firstName: String(32), destAirportCode: String(3))
insert into Travelers (id, lastName, firstName, destAirportCode)
|-------------------------------------------------------------------------------|
| id | lastName | firstName | destAirportCode |
|-------------------------------------------------------------------------------|
| 7bd0b461-4eb9-400a-9b63-713af85a43d0 | JONES | GARRY | SNA |
| 73a3fe49-df95-4a7a-9809-0bb4009f414b | JONES | DEBBIE | SNA |
| e015fc77-45bf-4a40-9721-f8f3248497a1 | JONES | TAMERA | SNA |
| 33e31b53-b540-45e3-97d7-d2353a49f9c6 | JONES | ERIC | SNA |
| e4dcba22-56d6-4e53-adbc-23fd84aece72 | ADAMS | KAREN | DTW |
| 3879ba60-827e-4535-bf4e-246ca8807ba1 | ADAMS | MIKE | DTW |
| 3d8dc7d8-cd86-48f4-b364-d2f40f1ae05b | JONES | SAMANTHA | BUR |
| 22d10aaa-32ac-4cd0-9bed-aa8e78a36d80 | SHARMA | PANKAJ | LAX |
|-------------------------------------------------------------------------------|
// create the webservice that reads from the table
node.api('/api/temp/examples', {
post: (id: UUID, firstName: String, lastName: String, destAirportCode: String) => {
insert into Travelers (id, firstName, lastName, destAirportCode)
values ($id, $firstName, $lastName, $destAirportCode)
},
get: (firstName: String, lastName: String) => {
select * from Travelers where firstName is $firstName and lastName is $lastName
},
put: (id: Long, name: String) => {
update subscriptions set name = $name where id is $id
},
delete: (id: UUID) => {
delete from Travelers where id is $id
}
})
// test the service
feature "Traveler information service" {
set __AUTO_EXPAND__ = true // Product classes are automatically expanded within the scope
scenario "Testing that DELETE requests produce the correct result" {
www delete "http://0.0.0.0:{{port}}/api/temp/examples"
<~ { id: '3879ba60-827e-4535-bf4e-246ca8807ba1' }
verify statusCode is 200
}
scenario "Testing that GET response contains specific field" {
www get "http://0.0.0.0:{{port}}/api/temp/examples?firstName=GARRY&lastName=JONES"
verify statusCode is 200
and body.size() >= 0
and body[0].id is '7bd0b461-4eb9-400a-9b63-713af85a43d0'
}
scenario "Testing that POST creates a new record" {
www post "http://0.0.0.0:{{port}}/api/temp/examples"
<~ { id: "119ff8a6-b569-4d54-80c6-03eb1c7f795d", firstName: "CHRIS", lastName: "DANIELS", destAirportCode: "DTW" }
verify statusCode is 200
}
scenario "Testing that we GET the record we previously created" {
www get "http://0.0.0.0:{{port}}/api/temp/examples?firstName=CHRIS&lastName=DANIELS"
verify statusCode is 200
and body matches [{
id: "119ff8a6-b569-4d54-80c6-03eb1c7f795d",
firstName: "CHRIS",
lastName: "DANIELS",
destAirportCode: "DTW"
}]
}
scenario "Testing what happens when a response does not match the expected value" {
www get "http://0.0.0.0:{{port}}/api/temp/examples?firstName=SAMANTHA&lastName=JONES"
verify statusCode is 200
and body.size() >= 0
and body[0].id is "7bd0b461-4eb9-400a-9b63-713af85a43d1"
and body[0].firstName is "SAMANTHA"
and body[0].lastName is "JONES"
and body[0].destAirportCode is "BUR"
}
}
```
##### Results
```sql
{"passed": 4, "failed": 1}
```
##### Console Output
```
Feature: Traveler information service
Passed: Testing that DELETE requests produce the correct result
[x] statusCode is 200
Passed: Testing that GET response contains specific field
[x] statusCode is 200
[x] (body.size()) >= 0
[x] ((body[0]).id) is "7bd0b461-4eb9-400a-9b63-713af85a43d0"
Passed: Testing that POST creates a new record
[x] statusCode is 200
Passed: Testing that we GET the record we previously created
[x] statusCode is 200
[x] body matches [{ id: "119ff8a6-b569-4d54-80c6-03eb1c7f795d", firstName: "CHRIS", lastName: "DANIELS", destAirportCode: "DTW" }]
Failed: Testing what happens when a response does not match the expected value
[x] statusCode is 200
[x] (body.size()) >= 0
[ ] ((body[0]).id) is "7bd0b461-4eb9-400a-9b63-713af85a43d1"
[x] ((body[0]).firstName) is "SAMANTHA"
[x] ((body[0]).lastName) is "JONES"
[x] ((body[0]).destAirportCode) is "BUR"
completed: passed: 4, failed: 1
```
### scenario (Testing - Unit/Integration — Declarative)
*Description*: scenario-based test declaration
```sql
feature "State Inheritance" {
scenario 'Create a contest' {
val contest_id = "40d1857b-474c-4400-8f07-5e04cbacc021"
var counter = 1
stderr <=== "contest_id = {{contest_id}}, counter = {{counter}}\n"
verify contest_id is "40d1857b-474c-4400-8f07-5e04cbacc021"
and counter is 1
}
scenario 'Create a member' {
val member_id = "4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1"
stderr <=== "member_id = {{member_id}}\n"
verify member_id is "4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1"
}
scenario 'Inherit contest state' extends 'Create a contest' {
counter = counter + 1
stderr <=== "contest_id = {{contest_id}}, counter = {{counter}}\n"
verify contest_id is "40d1857b-474c-4400-8f07-5e04cbacc021"
and counter is 2
}
scenario 'Inherit contest and member state' extends ['Create a contest', 'Create a member'] {
counter = counter + 1
stderr <=== "contest_id = {{contest_id}}, member_id = {{member_id}}, counter = {{counter}}\n"
verify contest_id is "40d1857b-474c-4400-8f07-5e04cbacc021"
and member_id is "4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1"
and counter is 3
}
}
```
##### Results
```sql
{"passed": 4, "failed": 0}
```
##### Console Output
```
Feature: State Inheritance
Passed: Create a contest
[x] contest_id is "40d1857b-474c-4400-8f07-5e04cbacc021"
[x] counter is 1
Passed: Create a member
[x] member_id is "4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1"
Passed: Inherit contest state
[x] contest_id is "40d1857b-474c-4400-8f07-5e04cbacc021"
[x] counter is 2
Passed: Inherit contest and member state
[x] contest_id is "40d1857b-474c-4400-8f07-5e04cbacc021"
[x] member_id is "4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1"
[x] counter is 3
completed: passed: 4, failed: 0
```
##### Console Error
```
contest_id = 40d1857b-474c-4400-8f07-5e04cbacc021, counter = 1
member_id = 4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1
contest_id = 40d1857b-474c-4400-8f07-5e04cbacc021, counter = 2
contest_id = 40d1857b-474c-4400-8f07-5e04cbacc021, member_id = 4264f8a5-6fa3-4a38-b3bb-30e2e0b826d1, counter = 3
```
### verify (Testing - Unit/Integration — Procedural)
*Description*: Verifies the current state of the scope
```sql
response = { id: 357 }
verify response.id is 357
^^^ 'Success!'
```
##### Results
```sql
true
```
## Transformation Examples
### <=== (Transformation — Declarative)
*Description*: A declarative way to write to OutputStream or Writer resources
```sql
import "java.io.File"
f = new File("./test1.json")
f <=== "Hello World\n"
f ===> stdout
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
Hello World
```
### ===> (Transformation — Declarative)
*Description*: A declarative way to write to OutputStream or Writer resources
```sql
import "java.io.File"
f = new File("app/core/src/test/resources/log4j.properties")
f ===> stdout
```
##### Results
```sql
java.io.PrintStream@23ea8830
```
##### Console Output
```
# Root logger option
log4j.rootLogger=INFO, stdout
# Direct log messages to stdout
log4j.appender.stdout=org.apache.log4j.ConsoleAppender
log4j.appender.stdout.Target=System.out
log4j.appender.stdout.layout=org.apache.log4j.PatternLayout
log4j.appender.stdout.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %-5p %c{1}:%L - %m%n
```
### =>>¹ (Transformation — Functional)
*Description*: Monadic comprehension
```sql
import "scala.util.Success"
a = Success(75)
b = Success(25)
c = a =>> i => i * 2
c
```
##### Results
```sql
Success(value=150)
```
### =>>² (Transformation — Functional)
*Description*: Monadic comprehension
```sql
import "scala.util.Success"
a = Success(75)
b = Success(25)
c = a =>> i =>
b =>> j => i + j
c
```
##### Results
```sql
Success(value=Success(value=100))
```
### scaleTo (Transformation — Functional)
*Description*: Returns the the numeric expression truncated after `scale` decimal places.
```sql
scaleTo(0.567, 2)
```
##### Results
```sql
0.56
```
### switch¹ (Transformation — Functional)
*Description*: Scala-inspired switch-case statement
```sql
value = 5.7
switch value
case n => n < 5.0 then 'Yes - {{n}}'
case n => n >= 5.0 and n <= 6.0 then 'Maybe - {{n}}'
case n then 'No - {{n}}'
```
##### Results
```sql
Maybe - 5.7
```
### switch² (Transformation — Functional)
*Description*: Scala-inspired switch-case statement
```sql
class StockQ(symbol: String, exchange: String, lastSale: Double)
switch new StockQ("ABC", "AMEX", 78.23)
case p => p matches StockQ("ABC", "AMEX", _ => true) ~> p.lastSale
case _ ~> 0.0
```
##### Results
```sql
78.23
```
### switch³ (Transformation — Functional)
*Description*: Scala-inspired switch-case statement
```sql
class StockQ(symbol: String, exchange: String, lastSale: Double)
switch new StockQ('YORKIE', 'NYSE', 999.99)
case p => p matches StockQ(_ => true, "OTCBB", _ => true) ~> 'OT'
case p => p matches StockQ(_ => true, "OTHER_OTC", _ => true) ~> 'OT'
case p => p matches StockQ(_ => true, "AMEX", _ => true) ~> 'AM'
case p => p matches StockQ(_ => true, "NASDAQ", _ => true) ~> 'ND'
case p => p matches StockQ(_ => true, "NYSE", _ => true) ~> 'NY'
case _ ~> 'NA'
```
##### Results
```sql
NY
```