Browse Source

update qa tutorial

master
Olivier Courtin 4 months ago
parent
commit
8b5a66aeca
1 changed files with 9 additions and 3 deletions
  1. +9
    -3
      docs/qa.md

+ 9
- 3
docs/qa.md View File

@@ -56,6 +56,7 @@ Retrieve Imagery
```bash
neo download --rate 20 --type WMS --url "https://download.data.grandlyon.com/wms/grandlyon?SERVICE=WMS&REQUEST=GetMap&VERSION=1.3.0&LAYERS=Ortho2015_vue_ensemble_16cm_CC46&WIDTH=512&HEIGHT=512&CRS=EPSG:3857&BBOX={xmin},{ymin},{xmax},{ymax}&FORMAT=image/jpeg" --cover gl/cover.csv --out gl/images
```
<a href="https://datapink.net/neo/qa/images/"><img src="https://datapink.io/datapink/neat-EO/raw/branch/master/docs/img/qa/images.png" /></a>

Retrieve and generate labels
----------------------------
@@ -64,6 +65,7 @@ wget -nc -O gl/lyon_roofprint.json "https://download.data.grandlyon.com/wfs/gran

neo rasterize --type Building --geojson gl/lyon_roofprint.json --cover gl/cover.csv --out gl/labels
```
<a href="https://datapink.net/neo/qa/labels/"><img src="https://datapink.io/datapink/neat-EO/raw/branch/master/docs/img/qa/labels.png" /></a>

Train a model, check metrics and perform prediction
----------------------------------------------------
@@ -73,6 +75,7 @@ neo eval --checkpoint gl/model/checkpoint-00003.pth --dataset gl
neo predict --metatiles --checkpoint gl/model/checkpoint-00003.pth --dataset gl --out gl/masks
neo cover --dir gl/masks --out gl/cover.csv
```
<a href="https://datapink.net/neo/qa/masks/"><img src="https://datapink.io/datapink/neat-EO/raw/branch/master/docs/img/qa/masks.png" /></a>

Quality Analysis compare between model prediction and so-called GroundTruth
---------------------------------------------------------------------------
@@ -80,18 +83,20 @@ Quality Analysis compare between model prediction and so-called GroundTruth
neo compare --cover cover.csv --mode stack --images gl/images gl/labels gl/masks --out gl/compare
neo compare --cover cover.csv --mode list --labels gl/labels --masks gl/masks --max Building QoD 0.80 --out gl/outliers.cover.csv
neo cover --cover gl/outliers.cover.csv --type geojson --out gl/compare/tiles.geojson
neo compare --cover gl/outliers.cover.csv --mode side --images gl/images gl/compare --out gl/compare_outliers
```
<a href="https://datapink.net/neo/qa/compare/"><img src="https://datapink.io/datapink/neat-EO/raw/branch/master/docs/img/qa/compare.png" /></a>

Filter training DataSet by removing unwanted outliers
-----------------------------------------------------
Filter training DataSet by selecting then removing unwanted outliers
--------------------------------------------------------------------
```bash
neo compare --cover gl/outliers.cover.csv --mode side --images gl/images gl/compare --out gl/compare_outliers
wget -O gl/remove.cover.csv https://datapink.net/neo/gl/remove.cover.csv
neo subset --dir gl/images --cover gl/cover.csv --out gl/filter/images
neo subset --dir gl/labels --cover gl/cover.csv --out gl/filter/labels
neo subset --dir gl/filter/images --delete --cover gl/remove.cover.csv
neo subset --dir gl/filter/labels --delete --cover gl/remove.cover.csv
```
<a href="https://datapink.net/neo/qa/compare_outliers/"><img src="https://datapink.io/datapink/neat-EO/raw/branch/master/docs/img/qa/compare_outliers.png" /></a>

Relaunch a train on a filtered DataSet and display QA results
-------------------------------------------------------------
@@ -102,3 +107,4 @@ neo predict --metatiles --checkpoint gl/filter/model/checkpoint-00025.pth --data
neo compare --cover gl/cover.csv --mode stack --images gl/images gl/labels gl/filter/masks --out gl/filter/compare
neo compare --cover gl/cover.csv --mode list --labels gl/labels --masks gl/filter/masks --max Building QoD 0.80 --geojson --out gl/filter/compare/tiles.json
```
<a href="https://datapink.net/neo/qa/filter/compare/"><img src="https://datapink.io/datapink/neat-EO/raw/branch/master/docs/img/qa/compare_filtered.png" /></a>

Loading…
Cancel
Save