# RCF

**Repository Path**: mrprogram/RCF

## Basic Information

- **Project Name**: RCF
- **Description**: No description available
- **Primary Language**: Python
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-09-02
- **Last Updated**: 2024-09-02

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## [Richer Convolutional Features for Edge Detection](http://mmcheng.net/rcfedge/)

We have released the code and data for plotting the edge PR curves of many existing edge detectors [here](https://github.com/yun-liu/plot-edge-pr-curves).

### Citation

If you are using the code/model/data provided here in a publication, please consider citing:

    @article{liu2019richer,
      title={Richer Convolutional Features for Edge Detection},
      author={Liu, Yun and Cheng, Ming-Ming and Hu, Xiaowei and Bian, Jia-Wang and Zhang, Le and Bai, Xiang and Tang, Jinhui},
      journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
      volume={41},
      number={8},
      pages={1939--1946},
      year={2019},
      publisher={IEEE}
    }

### PyTorch version of RCF

For the PyTorch implementation of RCF, please refer to this repository: [yun-liu/RCF-PyTorch](https://github.com/yun-liu/RCF-PyTorch) (a clean version of [balajiselvaraj1601/RCF_Pytorch_Updated](https://github.com/balajiselvaraj1601/RCF_Pytorch_Updated)). Thanks for Balaji's contribution! This PyTorch implementation can reproduce the accuracy of the Caffe version.

### Jittor version of RCF

For the Jittor implementation of RCF, please refer to this repository: [yun-liu/RCF-Jittor](https://github.com/yun-liu/RCF-Jittor).

### Evaluation results

Evaluation results on the BSDS500 and NYUD datasets are available [here](http://mftp.mmcheng.net/liuyun/rcf/eval.tar).

### Precomputed results

The precomputed edge maps for BSDS500 dataset are available [here](https://drive.google.com/drive/folders/1jFRGTY9QtSYcM3fC6U86KWO1OmeSZCgZ?usp=sharing).

The precomputed segmentation results (UCM2, generated by RCF+COB) for BSDS500 and NYUD datasets are available [here](https://drive.google.com/file/d/1U8h13loijfq_VaCbJiAWk0s3XXXxIyEM/view?usp=sharing).

### Pretrained models

RCF model for BSDS500 dataset is available [here](http://mftp.mmcheng.net/liuyun/rcf/model/rcf_pretrained_bsds.caffemodel).

RCF model for NYUD dataset is available here ([Depth](http://mftp.mmcheng.net/liuyun/rcf/model/rcf_pretrained_nyud_depth.caffemodel) and [Image](http://mftp.mmcheng.net/liuyun/rcf/model/rcf_pretrained_nyud_image.caffemodel)).

### Testing RCF

1. Clone the RCF repository
    ```
    git clone https://github.com/yun-liu/rcf.git
    ```

2. Download pretrained models, and put them into the `$ROOT_DIR/examples/rcf/` folder.

3. Download the datasets you need as below, and extract these datasets to the `$ROOT_DIR/data/` folder.

    ```
    wget http://mftp.mmcheng.net/liuyun/rcf/data/bsds_pascal_train_pair.lst
    wget http://mftp.mmcheng.net/liuyun/rcf/data/HED-BSDS.tar.gz
    wget http://mftp.mmcheng.net/liuyun/rcf/data/PASCAL.tar.gz
    wget http://mftp.mmcheng.net/liuyun/rcf/data/NYUD.tar.gz
    ```

4. Build Caffe.

5. Go into the folder `$ROOT_DIR/examples/rcf/`. Then, you can run RCF-singlescale.ipynb to test single-scale RCF on the BSDS500 dataset, or run RCF-multiscale.ipynb to test multiscale RCF on the BSDS500 dataset, or run RCF-singlescale-NYUD.ipynb to test single-scale RCF on the NYUD dataset.

Note: Before evaluating the predicted edges, you should do the standard non-maximum suppression (NMS) and edge thinning. We used the Piotr's Structured Forest matlab toolbox available [here](https://github.com/pdollar/edges).

### Training RCF

1. Download the datasets you need.

2. Download the pretrained vgg16 model [here](http://mftp.mmcheng.net/liuyun/rcf/model/5stage-vgg.caffemodel).

3. Start training process by running the following commands:

    ```
    cd $ROOT_DIR/examples/rcf/
    ./train.sh
    ```

### ResNet version of RCF

The code for the ResNet version of RCF has been released. The pretrained ImageNet and BSDS500 models are available [here](https://drive.google.com/drive/folders/18X4vDHUTRjmyfDIC0Bbr2gDsQR2KEi7d). Some discussion can be found under the [issue #89](https://github.com/yun-liu/rcf/issues/89).

### What is the "AutoCrop" layer?

The "AutoCrop" layer in RCF can caculate the crop offset automatically, and the recent version of Caffe doesn't support this. In fact, we can calculate the crop offset by ourselves, so we can replace the "AutoCrop" layer with the standard Crop layer in Caffe by setting the offsets to 1, 2, 4, and 0 for conv2, conv3, conv4, and conv5, respectively. More details can be found under the [issue #24](https://github.com/yun-liu/rcf/issues/24).

### Acknowledgments

This code is based on HED ([s9xie/hed](https://github.com/s9xie/hed)). Thanks to the contributors of HED.