Advanced Computing Platform for Theoretical Physics

README.md 439 Bytes
Newer Older
telestellar's avatar
new  
telestellar committed
1
2
# rnn compression
  using mpo to compress rnn
Pengfei Zhou's avatar
Pengfei Zhou committed
3
4


Pengfei Zhou's avatar
Pengfei Zhou committed
5
  main.py is old, which only can use gru model
Pengfei Zhou's avatar
Pengfei Zhou committed
6
7


Pengfei Zhou's avatar
Pengfei Zhou committed
8
  main_all.py can use gru,my transformer, pytorch transformer on random pattern and tang poem dataset 
Pengfei Zhou's avatar
Pengfei Zhou committed
9
10


Pengfei Zhou's avatar
Pengfei Zhou committed
11
  main_pyt.py can use gru, my transformer, pytorch transformer on wikitext .
Pengfei Zhou's avatar
Pengfei Zhou committed
12
13

  
Pengfei Zhou's avatar
Pengfei Zhou committed
14
15
16
  for example:

  python main_pyt.py   --epoch 200  --model_type mytransf  --lr 5 --optimizer sgd   --N 2  --batch_size 20 --d_model 200 --d_ff 200 --h 2