# ner_experiment

**Repository Path**: shen_xiaoping/ner_experiment

## Basic Information

- **Project Name**: ner_experiment
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2020-12-28
- **Last Updated**: 2021-11-03

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

搭自己的bert pipeline  
要用到  
fastnlp0.5.0  
# 数据总览
In total 3 datasets:  
        train has 360 instances.  
        dev has 20 instances.  
        test has 39 instances.  
In total 2 vocabs:  
        chars has 1524 entries.  
        target has 9 entries.  
# 运行 
## 普通
python main.py
## 分布式运行
>>CORES=`lscpu | grep Core(s) | awk '{print $4}'`  
export OMP_NUM_THREADS=$CORES  
python -m torch.distributed.launch --nproc_per_node=2 main.py --dist