Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/adriens/odata-eaux-baignade-noumea
Experience Open Data de la qualité des eaux de baignade à Nouméa, Nouvelle-calédonie
https://github.com/adriens/odata-eaux-baignade-noumea
csv csv-files datascience duckdb kaggle newcaledonia noumea nouvelle-caledonie opendata python
Last synced: 10 days ago
JSON representation
Experience Open Data de la qualité des eaux de baignade à Nouméa, Nouvelle-calédonie
- Host: GitHub
- URL: https://github.com/adriens/odata-eaux-baignade-noumea
- Owner: adriens
- Created: 2023-03-09T02:35:51.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2023-06-20T02:04:29.000Z (over 1 year ago)
- Last Synced: 2024-01-27T03:08:37.785Z (11 months ago)
- Topics: csv, csv-files, datascience, duckdb, kaggle, newcaledonia, noumea, nouvelle-caledonie, opendata, python
- Homepage: https://dev.to/adriens/noumeas-beach-water-quality-data-as-git-revisions-in-duckdb-38hp
- Size: 51.8 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# ❔ About
See https://www.kaggle.com/code/adriensales/la-qualit-des-eaux-de-baignade-noum-a
# ⚡ For impatients
Just run the following script in any shell and enjoy:
```shell
#!/bin/sh
# Diplay latest flags
sh <(curl https://tea.xyz) +duckdb.org \
duckdb << EOF
INSTALL httpfs;
LOAD httpfs;
select plage,
flag_color,
case
when (flag_color = 'BLUE') THEN '🟦'
when (flag_color = 'YELLOW') THEN '🟨'
when (flag_color = 'RED') THEN '🟥'
end as flag_color
from read_csv_auto('https://bit.ly/3ZCJ1X5') as latest;
EOF
```
# 🦆 `DuckDb` hacks
First, install duckdb (`brew install duckdb`) or [`install_duckdb.sh`](https://gist.github.com/adriens/74a2fd8adc6fd508d970bc1cb2419395)
```sql
INSTALL httpfs;
LOAD httpfs;
.prompt "🦆 🏖️ > "
select *
from 'https://raw.githubusercontent.com/adriens/odata-eaux-baignade-noumea/main/data/latest.csv';
```
```sql
INSTALL httpfs;
LOAD httpfs;
.prompt "🦆 🏖️ > "
select *
from 'https://raw.githubusercontent.com/adriens/odata-eaux-baignade-noumea/main/data/historic.csv';
```
You can also use (nicer) short urls :
```shell
duckdb << EOF
-- historic
INSTALL httpfs;
LOAD httpfs;
select *
from
read_csv_auto('https://bit.ly/3mAUIPr') as historic;
EOF
```
```shell
duckdb << EOF
-- historic
INSTALL httpfs;
LOAD httpfs;
select *
from read_csv_auto('https://bit.ly/3ZCJ1X5') as latest;
EOF
```
## Tasks
Below some [`xc`](https://xcfile.dev/) ready tasks.
Just type `xc`.
### latest
Print the latest status of all beaches
```shell
#!/bin/sh
# Diplay latest flags
sh <(curl https://tea.xyz) +duckdb.org \
duckdb << EOF
INSTALL httpfs;
LOAD httpfs;
select plage,
flag_color,
case
when (flag_color = 'BLUE') THEN '🟦'
when (flag_color = 'YELLOW') THEN '🟨'
when (flag_color = 'RED') THEN '🟥'
end as flag_color
from read_csv_auto('https://bit.ly/3ZCJ1X5') as latest;
EOF
```
### last-20
Print the 20 last status of all beaches
```shell
#!/bin/sh
# Print the 20 last status of all beaches
sh <(curl https://tea.xyz) +duckdb.org \
duckdb << EOF
INSTALL httpfs;
LOAD httpfs;
select date, plage,
case
when (flag_color = 'BLUE') THEN '🟦'
when (flag_color = 'YELLOW') THEN '🟨'
when (flag_color = 'RED') THEN '🟥'
end as flag
from
read_csv_auto('https://bit.ly/3mAUIPr')
order by date desc
limit 10;
EOF
```
### baignade-autorisee
cf [Dates d'interdiction d'activités nautiques à Nouméa](https://www.nouvellecaledonie.travel/interdiction-activites-nautiques-noumea/)
```shell
#!/bin/sh
sh <(curl https://tea.xyz) +duckdb.org \
duckdb << EOF
INSTALL httpfs;
LOAD httpfs;
select
case
when count(*) > 0 then '👎'
else '👍'
end is_baignade_autorisee
from read_csv_auto('https://bit.ly/3JJCZhJ')
where
current_date >= date_debut and
current_date <= date_fin;
EOF
```