Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/lb-lewisham/amazing-insight-and-delivery

an "awesome list" of insight and delivery
https://github.com/lb-lewisham/amazing-insight-and-delivery

List: amazing-insight-and-delivery

awesome-list open-data

Last synced: about 1 month ago
JSON representation

an "awesome list" of insight and delivery

Awesome Lists containing this project

README 

        
## amazing insight and delivery



### accessibility

  * [understanding wcag](https://www.gov.uk/service-manual/helping-people-to-use-your-service/understanding-wcag) - this article explains the P.O.U.R principle really well

* [empathy prompts](https://empathyprompts.net) - a curious site that tries to put you in different shoes



### behavioural science

* [when nudges backfire](https://www.science.org/doi/10.1126/science.abm3427) - according to this study, using nudge techniques can sometimes have undesired effects

* Behavioural Insight Team. (2010) [EAST: Four Simple Ways to Apply Behavioural Insights](https://www.bi.team/wp-content/uploads/2015/07/BIT-Publication-EAST_FA_WEB.pdf)

* [behavioural nudges for ctax arrears in barking and dagenham](https://www.local.gov.uk/bi-podcast-transcription-barking-and-dagenham-2021) - an example of the EAST framework in use



### benchmarking

* [ifs local](https://ifs.org.uk/research/local-dashboard)

* [lginform](https://lginform.local.gov.uk/reports/view/lga-research/lga-research-report-headline-report-bar-charts?mod-area=E09000023&mod-group=AllBoroughInRegion_London&mod-type=namedComparisonGroup)



### cartography

* [principles and algorithms](https://cartography-playground.gitlab.io/) - some approachs to mapping data 

* [multivariate dot density mapping](http://andrewgaidus.com/Dot_Density_County_Maps/) - showing many groups at once

* [cartography guide](https://www.axismaps.com/guide) - insights and tips for designing maps

* [backofyourhand](https://backofyourhand.com/51.44523,-0.01957/EMUSLX) - test your street knowledge



### chatbots

* [council chatbots](https://futr.ai/ai-in-local-government-3-fascinating-examples/?hss_channel=tw-992422381699371013)



### cleaning

* [data cleaning 101](https://github.com/kjam/data-cleaning-101)



### coding

* [snippet generator](https://snippet-generator.app/?description=anchor+href+and+link+to+ToC&tabtrigger=anchorHref&snippet=%3Ca+class%3D%22anchor%22+id%3D%22%241%22%3E%3C%2Fa%3E+%5B%E2%AC%86%5D%28%23%24%7B2%3Atoc%7D%29&mode=vscode) - works for sublime, code, and atom

* [testing notebooks](https://gist.github.com/SergiyKolesnikov/f94d91b947051ab5d2ba1aa30e25f050#file-test_and_debug-ipynb) - the doctest pattern is interesting as it embeds good practice in relation to documentation as well as testing



### csv

* [csvlint](https://csvlint.io/) - validation and linting suggestions

* [data-curator](https://github.com/qcif/data-curator) - desktop csv editor and validator suitable for preparing open data

* [xl-to-csv](https://gist.github.com/tonyerskine/77250575b166bec997f33a679a0dfbe4) - windows script to batch convert xl to csv



### dashboards

* [imd](https://app.powerbi.com/view?r=eyJrIjoiOTdjYzIyNTMtMTcxNi00YmQ2LWI1YzgtMTUyYzMxOWQ3NzQ2IiwidCI6ImJmMzQ2ODEwLTljN2QtNDNkZS1hODcyLTI0YTJlZjM5OTVhOCJ9)



### data architecture

* [pattern analysis](https://medium.com/swlh/the-5-data-store-patterns-data-lakes-data-hubs-data-virtualization-data-federation-data-27fd75486e2c) - 5-data-store-patterns-data-lakes-data-hubs-data-virtualization-data-federation-data

* https://miktysh.com.au/data-lake-vs-data-warehouse-vs-data-hub-whats-the-difference/ - data-lake-vs-data-warehouse-vs-data-hub-whats-the-difference

* https://www.semarchy.com/blog/how-to-differentiate-a-data-hub-a-data-lake-and-a-data-warehouse/ - how-to-differentiate-a-data-hub-a-data-lake-and-a-data-warehouse



### datasets (open data)

* [commonplaces](https://duckduckgo.com/?q=site%3A+commonplace.is+lewisham&t=ffab&atb=v265-1&ia=web) - collection of commonplac.es consultations for lewisham

* [fixymystreet](https://www.fixmystreet.com/open311/) - open api to envirocrime reporting

* [lovecleanstreets](https://api.mediaklik.com/reports/livereports2/?age=1&authorityid=241) - envirocrime reporting service

* [londonair](https://api.erg.ic.ac.uk/AirQuality/help) - near-realtime air-sensor data

* [datastore](https://data.london.gov.uk/dataset?tag=lewisham&q=) - gla datasets tagged with lewisham

* [council tax QRC4](https://www.gov.uk/government/statistics/collection-rates-for-council-tax-and-non-domestic-rates-in-england-2015-to-2016)

* [epc data](https://epc.opendatacommunities.org/) - registration required

* [imd](https://data.london.gov.uk/dataset/indices-of-deprivation) - cut for london (also see [analysis](https://data.london.gov.uk/blog/indices-of-deprivation-2019-initial-analysis/))

* [hesa](https://www.hesa.ac.uk/data-and-analysis) - higher education data



### ethics

* [camden data charter](https://www.camden.gov.uk/data-charter) - a clear approach to linked data projects

* [haunted by data](https://idlewords.com/talks/haunted_by_data.htm) - the ethical implications of the longevity of data, ceglowski shows parallels between data and nuclear waste

* [catalog of bias](https://catalogofbias.org)



### geojson

* [geojson tools](https://geojson.tools/)

* [geojsonlint](https://geojsonlint.com/)

* [conversion](https://ogre.adc4gis.com/) - a handy utility for converting between geospatial formats

* [csv2geojson](https://odileeds.github.io/CSV2GeoJSON/)



### geospatial analysis

* [reconciling statistical and administrative geometries](https://www.ons.gov.uk/peoplepopulationandcommunity/populationandmigration/populationestimates/methodologies/methodologynoteonproductionofsmallareapopulationestimatesoctober2017#methods)

* [mapshaper](https://mapshaper.org/) - a wide range of geometry tools

* [turf.js](https://turfjs.org/) - analysis tools

* [zoomstack basemaps on qgis](https://github.com/maptiler/qgis-maptiler-plugin#feature--usage) - ordnance survey vector basemaps are free

* [adding glow to features](https://gis.stackexchange.com/questions/321795/qgis-3-how-to-create-glow-on-layer-with-gradient-symbology) - if you want features to pop off the basemap, try making them glow

* [geomob podcasts](https://thegeomob.com/podcast/) - paul ramsey (postgis), ilya zyerev (openstreetmap), tom macwright (openstreetmap, mapbox, observable) and many of the greats



### git



* [oh-my-zsh on git bash](https://gist.github.com/fworks/af4c896c9de47d827d4caa6fd7154b6b?permalink_comment_id=4129435) - oh-my-zsh has a great [git plugin](https://github.com/ohmyzsh/ohmyzsh/blob/master/plugins/git/git.plugin.zsh) as standard

* [daff](http://paulfitz.github.io/daff/) - data diff in git

* [git-xl](https://www.xltrail.com/git-xl) - diff spreadsheets

* [dvc](https://github.com/iterative/dvc) - versioning data and models

* [flat data](https://next.github.com/projects/flat-data) - scraping and flattening data for inclusion in tables (also a good way to learn a bit of deno)

* [simon willison's gitscraping posts](https://simonwillison.net/tags/gitscraping/) - simon has provided great examples of using git for data



### graph databases

* [graph commons](https://graphcommons.com/graphs/406e9195-962e-42e6-abf7-8ed2739655c3) - some shared graphs



### json

* [flattening with jq](https://til.simonwillison.net/jq/flatten-nested-json-objects-jq)

* [jq playground](https://www.jqkungfu.com/)

* [jsonlint](https://jsonlint.com/)



### management of data

* [example of documents](https://www.octopai.com/data-dictionary-vs-business-glossary/)

* [glossary/dictionary/catalogue](https://03cd0a8.netsolhost.com/wordpress/?p=303)

* [https://lb-lewisham.github.io/data-governance/]()



### open standards

* [the great deverticalisation](https://www.computerweekly.com/opinion/The-great-deverticalisation-part-1-the-street) - the case for decentralised, horizontal integration by use of data standards



### openstreetmap

* [overpass turbo](https://overpass-turbo.eu/) - feature query tool

* [node/way/relation history](http://osm.mapki.com/history/) - prior changesets for a given feature

* [tagfinder](https://tagfinder.herokuapp.com/) - exploring tag uses

* [taginfo](https://taginfo.openstreetmap.org/) - exploring tag uses

* [adding council data](https://blog.openstreetmap.org/2020/07/22/providing-data-to-openstreetmap-a-new-guide-for-data-owners/)

* [conflation for councils](https://github.com/systemed/conflation) - tool for manually merging third party datasets

* [mapcomplete](https://mapcomplete.osm.be/cafes_and_pubs.html?z=13&lat=51.45357&lon=-0.01175&language=en) - thematic mapping (pubs/cafes example)



### projects

* [guesstimate](https://www.getguesstimate.com) - can be used to estimate the impact of a project (e.g. on saving money)

* [nesta's four point project plan](https://www.nesta.org.uk/blog/public-sector-data-analytics-four-steps/)



### python

* [black](https://github.com/psf/black) - blackened code makes for the smallest possible diffs

* [cookiecutter](https://github.com/cookiecutter/cookiecutter) - templating project files, the [datascience](https://drivendata.github.io/cookiecutter-data-science/) one is good for having a common ground when working jointly 

* [sharepoint/365 client](https://github.com/vgrem/Office365-REST-Python-Client) - make sure your credentials go in a non-versioned file!

* [pyjanitor](https://pyjanitor-devs.github.io/pyjanitor/) - adopt neat data standards

* [fuzzywuzzy](https://github.com/seatgeek/fuzzywuzzy) - levenshtein distance join options



### reading

* [data science handbook](https://app.gumroad.com/d/e3a17ca0214ad4c24f9a40be70234376) - interviews with the people who defined the field of data science



### research

* Vogl, T. (2021) [Artificial Intelligence in Local Government: Enabling Artificial Intelligence for Good Governance in UK Local Authorities](http://dx.doi.org/10.2139/ssrn.3840222).

* Vogl, T.M., Seidelin, C., Ganesh, B. and Bright, J. (2020) [Smart technology and the emergence of algorithmic bureaucracy: artificial intelligence in UK local authorities](http://dx.doi.org/10.1111/puar.13286)

* Ng, Andrew, (2020) [AI Transformation Playbook](https://landing.ai/ai-transformation-playbook/)

* Bright, J., Ganesh, B., Seidelin, C. and Vogl, T.M. (2019) [Data Science for Local Government](http://dx.doi.org/10.2139/ssrn.3370217), SSRN Electronic Journal.

* Bright, J.M., Lee, S.M., MARGETTS, H., Wang, N. and Hale, S. (2019) [Explaining Download Patterns in Open Government Data: Citizen participation or private enterprise?](http://dx.doi.org/10.1504/ijeg.2019.101499)

* Policy in Practice. (2020) [Council Tax debt collection and low-income Londoners

](https://policyinpractice.co.uk/wp-content/uploads/Council-Tax-debt-collection-and-low-income-Londoners_GLA_pub.pdf)

* [A comparison of machine learning methods for

predicting recurrence and death after curative-intent

radiotherapy](https://www.thelancet.com/action/showPdf?pii=S2352-3964%2822%2900095-0)



### service design

* [list of local government services](https://standards.esd.org.uk/?uri=list%2FenglishAndWelshServices)

* starting out in stockport [part 1](https://www.digitalstockport.info/my-journey-into-service-design-in-local-government-part-1-learning-points/) / [part 2](https://www.digitalstockport.info/my-journey-into-service-design-in-local-government-part-2-new-opportunities/)

* [design methods for designing services](https://www.designcouncil.org.uk/sites/default/files/asset/document/Design%20methods%20for%20developing%20services.pdf) - how to use the double diamond and associated tools

* [service design tools](https://servicedesigntools.org/)

* [emergency housing design](https://www.designcouncil.org.uk/resources/case-study/lewisham-council) - case study of the design council housing work for lewisham

* [A beginner’s guide to what service design is not](https://medium.com/@Howard_C/a-beginners-guide-to-what-service-design-is-not-40884a856fd)

* [“So, like, what is service design?”](https://medium.com/@shahrsays/so-what-actually-is-service-design-e0ed602b77a9)

* [Comparing service design and business analysis](https://medium.com/leading-service-design/comparing-service-design-and-business-analysis-aed52d8ea8fb) - Differences and similarities between service design and business analysis

* [Good services](https://loudowne.com/2018/06/14/15-principles-of-good-service-design/) - 15 principles of good service design

* [Full Stack Service Design](http://sarah-drummond.com/full-stack-service-design/) - A model that helps people to break services down into parts

* [Design methods for developing services](https://www.designcouncil.org.uk/sites/default/files/asset/document/Design%20methods%20for%20developing%20services.pdf)

* [data and design](https://medium.com/design-council/going-hand-in-hand-data-and-design-386f9294d36f)

* [improving council tax collection in north lincolnshire](https://drive.google.com/file/d/1HKM9_RhF7t0STKpOUasu3MwuAxQ4g62I/view)



### sharing

* [send.vis.ee](https://send.vis.ee/) - community fork of mozilla send's safe sharing

* [wormhole](wormhole.app/) - webtorrent based safe sharing by feross



### sonification

* [loud numbers](https://www.loudnumbers.net) - musical tracks based on data



### sparql

* [yaqui](https://github.com/TriplyDB/Yasgui) - a neat triple-store query tool



### sqlite

* [datasette](https://datasette.io/) - an open source multi-tool for exploring and publishing data



### strategy

* [dwp principles](https://dataingovernment.blog.gov.uk/2021/10/19/developing-a-data-strategy-and-delivering-it/)

* [adult social care](https://www.gov.uk/government/publications/data-saves-lives-reshaping-health-and-social-care-with-data-draft/data-saves-lives-reshaping-health-and-social-care-with-data-draft#improving-data-for-adult-social-care)

* [esd data maturity assessment](https://datamaturity.esd.org.uk/)

* [better use of data](https://www.local.gov.uk/our-support/research-and-data/data-and-transparency/better-use-data)

* [data orchard framework](https://static1.squarespace.com/static/5d514d1775e9c90001345670/t/5d9f402df0b6312eb6c55f69/1570717742668/Data+Orchard+Data+Maturity+Framework+NFP+Sector+2019.pdf)

* [gloucestershire data management strategy](https://www.gloucestershire.gov.uk/media/2088939/2019-info-data-management-strategy-v1-0.pdf)

* [centralgov data quality](https://www.gov.uk/government/publications/the-government-data-quality-framework/the-government-data-quality-framework-guidance#communicating-data-quality-to-users)

* [loti data quality](https://docs.google.com/presentation/d/13XRUEENu7qySmwJOG_MKOnYwGDka7w0fk4YZsLpI2ho/edit#slide=id.gf1d15e10aa_0_72)

* [national data strategy](https://www.gov.uk/government/publications/uk-national-data-strategy/national-data-strategy#the-pillars) - description of the key elements underpinning effective use of data



### visualisation

* [data-to-viz](https://www.data-to-viz.com/)

* [litvis](https://www.gicentre.net/litvis)

* [ft visual vocabulary](https://ft-interactive.github.io/visual-vocabulary/)

* [visualization curriculum](https://uwdata.github.io/visualization-curriculum/intro.html)

* [color brewer](https://colorbrewer2.org/)

* [i want hue](https://medialab.github.io/iwanthue)

* [viz-palette](https://projects.susielu.com/viz-palette)

* [chromajs palette generator](https://gka.github.io/palettes/#/9|s|00429d,96ffea,ffffe0|ffffe0,ff005e,93003a|1|1)

* [coolors 1 colour palette](https://coolors.co/00b7eb)

* [coolors 2 colour palette](https://coolors.co/gradient-palette/00b7eb-fee05c?number=6)

* [infogram](https://infogram.com/) - as used by [wandsworth](https://www.datawand.info/indices-of-deprivation-2019/)

* [wcag in relation to vega-lite](https://github.com/vega/vega-lite/issues/6603)

* [data vis](https://www.betterment.com/design/accessible-data-visualization)

* [scrollytelling ecosystem](https://www.theguardian.com/environment/ng-interactive/2021/oct/14/climate-change-happening-now-stats-graphs-maps-cop26)

* [scrollytelling deprivation](https://www.ons.gov.uk/visualisations/dvc1371/#/E09000030)

* [scrollytelling cost of living](https://www.theguardian.com/business/ng-interactive/2022/jun/21/cost-of-living-crisis-uk-households-charts-inflation)

* [scrollytelling covid](https://ig.ft.com/china-covid-economy/) - may be paywalled

* [color universal design (cud)](https://jfly.uni-koeln.de/color/)