SUES-200-Benchmark

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #go #android #deep-learning #linux #macos #java #windows #awesome #pytorch #security

SUES-200-Benchmark

(★ 90)

SUES-200: A Multi-height Multi-scene Cross-view Image Benchmark Across Drone and Satellite

SUES-200-Benchmark Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# SUES-200: A Multi-height Multi-scene Cross-view Image Matching Benchmark Across UAV and Satellite

This paper has been accepted by IEEE Transactions on Circuits and Systems for Video Technology.

arXiv Link: https://arxiv.org/abs/2204.10704

## Datasets

Download SUES-200 dataset. **Notices**: SUES-200 is **ONLY  available to academic research**.

Google Drive Link: https://drive.google.com/file/d/1UyVyFJ_pRaJHIr_eBY2HL7gkS5y9UxqI/view?usp=share_link

百度网盘：
https://pan.baidu.com/s/1mrd-7ADm57_OchAvO1XmNw
提取码：p836

天翼网盘（不限速）：
https://cloud.189.cn/t/yMnaEnR322Yj
提取码：veh7

My email : rzzhu24@m.fudan.edu.cn

## Pre-trained Weight

链接: https://pan.baidu.com/s/1aq51FLfg3bPG4xoNW1Usxw?pwd=rbnu 提取码: rbnu

## Quickly Start

### Installation

- Install Pytorch Torchvision https://pytorch.org/get-started/locally/
- install other libs

```
pip install timm pyyaml pytorch-metric-learning scipy pandas opencv-python grad-cam einops imgaug
```

### Config File

default: settings.yaml

```yaml
# dateset path
dataset_path: /media/data1/Datasets
weight_save_path: /media/data1/save_model_weight

# intial parameters
fp16 : 0  # apex
classes : 120 # 200*0.6=120
image_size: 384

# choose model
model : resnet

# super parameters
batch_size : 32
num_epochs : 80
drop_rate : 0.2
weight_decay : 0.0005
lr : 0.005

# test and evaluate

# if LPN
block : 4

# if SUES-200
height : 150

```

### Split Dataset

```bash
python script/split_dataset.py --path your_path 
mkdir your_path/Dataset
mv your_path/Training your_path/Dataset
mv your_path/Testing your_path/Dataset
```

### Train

```bash
python train.py --cfg settings.yaml
```

### Test & Evaluate

#### Test basic model
```bash
python test_and_evaluate.py --cfg settings.yaml --name resnet_150_2022-04-25-10:26:34 --seq 3
```
#### Test Robustness to uncertainties
```bash
python test_and_evaluate_uncertainties.py --cfg settings.yaml --types ["snow", "fog"] --heights [150, 200]
```

### Ablation Experiments

#### Test Distance Measurement Algorithm
```bash
python test_and_evaluate.py --dist Eu
```
#### Test Ensemble Strategies in Multiply Queries
```bash
# Max Pooling
python multi_test_and_evaluate_pooling.py --type max
# Voting
python multi_test_and_evaluate_voting.py
```

## Citation
```text
@ARTICLE{zhu2023sues,
  author={Zhu, Runzhe and Yin, Ling and Yang, Mingze and Wu, Fei and Yang, Yuncheng and Hu, Wenbo},
  journal={IEEE Transactions on Circuits and Systems for Video Technology}, 
  title={SUES-200: A Multi-height Multi-scene Cross-view Image Benchmark Across Drone and Satellite}, 
  year={2023},
  volume={},
  number={},
  pages={1-1},
  doi={10.1109/TCSVT.2023.3249204}}

```

## TO-DO List

- [ ] Improve README.md (ing...)
  - [X] Evaluation methods
  - [X] Visualization
  - [X] Multiqueries
  - [X] Draw heat map
  - [ ] ...

- [ ] Support University-1652 (ing....)
- [ ] ...

## Chinese Version

### 双分支卷积网络训练和测试：

1. 配置文件：settings.yaml

该配置文件配置了

- 数据集地址 dataset_path
   - 权重文件保存地址 weight_save_path
   - 选取不同高度的数据 height
   - 训练时选用的特征提取模型 model
   - 训练时的学习率 lr
   - 训练轮数 num_epoch
   - 模型中的drop out  drop_rate
   - 训练时的批次大小 batch_size

2. 开始训练：执行 train.py 会根据上面配置好的参数进行训练，比较好的模型权重会保存在权重文件保存地址下的save_model_weight文件夹中（训练时会自动创建该文件夹）

3. 开始测试：执行 test_and_evaluate.py 会开始测试并输出测试结果，最后的结果会保存在save_model_weight中

基于网格搜素的自动调参数文件：AutoTuning.py

定义特征提取算法的文件：model_.py

CBAM_ResNet 算法模型定义：senet/cbam_resnet.py

### 数据集预处理，和其它一些算法在本数据集上的复现

数据集预处理文件夹：script

VLAD 复现代码：VLAD文件夹

NetVLAD 复现代码：NetVLAD文件夹，train_NetVLAD.py test_NetVlAD.py

SUES-200-Benchmark

SUES-200-Benchmark Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

SUES-200-Benchmark

SUES-200-Benchmark Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README