add figures for quantitative results
This commit is contained in:
parent
41ce7d1ac1
commit
350d5b049c
61
README.md
61
README.md
@ -189,10 +189,7 @@ docs/frame0038.jpg \
|
|||||||
--output_types front bird --show_all \
|
--output_types front bird --show_all \
|
||||||
--model data/models/monoloco_pp-201203-1424.pkl -o <output directory>
|
--model data/models/monoloco_pp-201203-1424.pkl -o <output directory>
|
||||||
```
|
```
|
||||||
<img src="docs/out_frame0038.jpg.front.jpg" width="400"/>
|
<img src="docs/out_frame0038.jpg.front_bird.jpg" width="700"/>
|
||||||
|
|
||||||
|
|
||||||
<img src="docs/out_frame0038.jpg.bird.jpg" width="400"/>
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
@ -354,35 +351,35 @@ and save them into `data/kitti/monodepth`
|
|||||||
* **Geometrical Baseline and MonoLoco**:
|
* **Geometrical Baseline and MonoLoco**:
|
||||||
To include also geometric baselines and MonoLoco, add the flag ``--baselines`` to the evaluation command
|
To include also geometric baselines and MonoLoco, add the flag ``--baselines`` to the evaluation command
|
||||||
```
|
```
|
||||||
python -m monstereo.run eval
|
python -m monoloco.run eval \
|
||||||
--dir_ann <annotation directory>
|
--dir_ann <annotation directory> \
|
||||||
--model <model path>
|
--model <model path> \
|
||||||
--net monoloco_pp
|
--net monoloco_pp \
|
||||||
--generate
|
--generate \
|
||||||
|
--save \
|
||||||
````
|
````
|
||||||
|
|
||||||
### Relative Average Precision Localization (RALP-5%)
|
#TODO add white table for monocular
|
||||||
|
|
||||||
|
<img src="docs/results_monoloco_pp." width="550"/>
|
||||||
|
By changing the net and the model, the same command evaluates MonStereo model.
|
||||||
|
|
||||||
|
#TODO Add white table for stereo
|
||||||
|
<img src="docs/results_stereo.jpg" width="550"/>
|
||||||
|
|
||||||
|
|
||||||
|
### Relative Average Precision Localization: RALP-5% (MonStereo)
|
||||||
|
|
||||||
We modified the original C++ evaluation of KITTI to make it relative to distance. We use **cmake**.
|
We modified the original C++ evaluation of KITTI to make it relative to distance. We use **cmake**.
|
||||||
To run the evaluation, first generate the txt files with:
|
To run the evaluation, first generate the txt file with the standard command for evaluation (above).
|
||||||
|
|
||||||
`python -m monstereo.run eval --dir_ann <directory of pifpaf annotations> --model data/models/ms-200710-1511.pkl --generate`
|
|
||||||
|
|
||||||
Then follow the instructions of this [repository](https://github.com/cguindel/eval_kitti)
|
Then follow the instructions of this [repository](https://github.com/cguindel/eval_kitti)
|
||||||
to prepare the folders accordingly (or follow kitti guidelines) and run evaluation.
|
to prepare the folders accordingly (or follow kitti guidelines) and run evaluation.
|
||||||
The modified file is called *evaluate_object.cpp* and runs exactly as the original kitti evaluation.
|
The modified file is called *evaluate_object.cpp* and runs exactly as the original kitti evaluation.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
<img src="docs/quantitative_mono.png" width="550"/>
|
|
||||||
|
|
||||||
Adding the argument `save`, a few plots will be added including 3D localization error as a function of distance:
|
|
||||||
<img src="docs/results.png" width="600"/>
|
|
||||||
|
|
||||||
### Activity Estimation (Talking)
|
### Activity Estimation (Talking)
|
||||||
Please follow preprocessing steps for Collective activity dataset and run pifpaf over the dataset images.
|
Please follow preprocessing steps for Collective activity dataset and run pifpaf over the dataset images.
|
||||||
Evaluation on this dataset is done with models trained on either KITTI or nuScenes.
|
Evaluation on this dataset is done with models trained on either KITTI or nuScenes.
|
||||||
For optimal performances, we suggest the model trained on nuScenes teaser (TODO add link)
|
For optimal performances, we suggest the model trained on nuScenes teaser (#TODO add link)
|
||||||
```
|
```
|
||||||
python -m monstereo.run eval
|
python -m monstereo.run eval
|
||||||
--activity
|
--activity
|
||||||
@ -393,24 +390,6 @@ python -m monstereo.run eval
|
|||||||
```
|
```
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
### Data structure
|
|
||||||
|
|
||||||
Data
|
|
||||||
├── arrays
|
|
||||||
├── models
|
|
||||||
├── kitti
|
|
||||||
├── figures
|
|
||||||
├── logs
|
|
||||||
|
|
||||||
|
|
||||||
Run the following to create the folders:
|
|
||||||
```
|
|
||||||
mkdir data
|
|
||||||
cd data
|
|
||||||
mkdir arrays models kitti figures logs
|
|
||||||
```
|
|
||||||
|
|
||||||
## Citation
|
## Citation
|
||||||
When using this library in your research, we will be happy if you cite us!
|
When using this library in your research, we will be happy if you cite us!
|
||||||
|
|
||||||
@ -423,7 +402,6 @@ When using this library in your research, we will be happy if you cite us!
|
|||||||
}
|
}
|
||||||
```
|
```
|
||||||
|
|
||||||
|
|
||||||
```
|
```
|
||||||
@ARTICLE{bertoni_2021_its,
|
@ARTICLE{bertoni_2021_its,
|
||||||
author = {Bertoni, Lorenzo and Kreiss, Sven and Alahi, Alexandre},
|
author = {Bertoni, Lorenzo and Kreiss, Sven and Alahi, Alexandre},
|
||||||
@ -432,7 +410,6 @@ When using this library in your research, we will be happy if you cite us!
|
|||||||
year={2021},
|
year={2021},
|
||||||
```
|
```
|
||||||
|
|
||||||
|
|
||||||
```
|
```
|
||||||
@InProceedings{bertoni_2019_iccv,
|
@InProceedings{bertoni_2019_iccv,
|
||||||
author = {Bertoni, Lorenzo and Kreiss, Sven and Alahi, Alexandre},
|
author = {Bertoni, Lorenzo and Kreiss, Sven and Alahi, Alexandre},
|
||||||
|
|||||||
Binary file not shown.
|
Before Width: | Height: | Size: 34 KiB |
Binary file not shown.
|
Before Width: | Height: | Size: 52 KiB |
BIN
docs/out_frame0038.jpg.front_bird.jpg
Normal file
BIN
docs/out_frame0038.jpg.front_bird.jpg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 125 KiB |
BIN
docs/results.png
BIN
docs/results.png
Binary file not shown.
|
Before Width: | Height: | Size: 56 KiB |
BIN
docs/results_monoloco_pp.jpg
Normal file
BIN
docs/results_monoloco_pp.jpg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 385 KiB |
BIN
docs/results_stereo.jpg
Normal file
BIN
docs/results_stereo.jpg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 368 KiB |
Loading…
Reference in New Issue
Block a user