Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature]: MAE official #221

Merged
merged 151 commits into from
Mar 3, 2022
Merged

[Feature]: MAE official #221

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
151 commits
Select commit Hold shift + click to select a range
bd2832c
[Feature]: MAE single image pre-training
YuanLiuuuuuu Dec 17, 2021
a4abe91
[Fix]: Fix config
Dec 18, 2021
3bdaee7
[Fix]: Fix dataset link
YuanLiuuuuuu Dec 19, 2021
9fa79de
[Feature]: Add run
YuanLiuuuuuu Dec 19, 2021
ff5eb75
[Refactor]: Delete spot
YuanLiuuuuuu Dec 19, 2021
7635f8d
[Feature]: ignore nohup output file
YuanLiuuuuuu Dec 20, 2021
249c67e
[Feature]: Add auto script to generate run cmd
YuanLiuuuuuu Dec 20, 2021
85456a0
[Refactor]: Refactor mae config file
YuanLiuuuuuu Dec 20, 2021
00a3ccd
[Feature]: sz20 settings
YuanLiuuuuuu Dec 20, 2021
54ef7de
[Feature]: Add auto resume
YuanLiuuuuuu Dec 20, 2021
69ba6cd
[Fix]: Fix lint
YuanLiuuuuuu Dec 20, 2021
df01dc3
[Feature]: Make git ignore txt
YuanLiuuuuuu Dec 20, 2021
a81aedd
[Refactor]: Delete gpus in script
YuanLiuuuuuu Dec 20, 2021
bcf24dc
[Fix]: Make generate_cmd to add --async
YuanLiuuuuuu Dec 20, 2021
e32845a
[Feature]: Initial version of Vit fine-tune
YuanLiuuuuuu Dec 23, 2021
cddc03e
[Fix]: Add 1424 specific settings
YuanLiuuuuuu Dec 20, 2021
d147286
[Fix]: Fix missing file client bug for 1424
YuanLiuuuuuu Dec 21, 2021
d543567
[Feature]: 1424 customized settings
YuanLiuuuuuu Dec 24, 2021
e4fbbac
[Fix]: Make drop in eval to False
YuanLiuuuuuu Dec 25, 2021
f34e1a4
[Feature]: Change the finetune and pre-training settings
YuanLiuuuuuu Dec 27, 2021
0ff72bd
[Feature]: Add debug setting
YuanLiuuuuuu Dec 27, 2021
c5d08c6
[Refactor]: Refactor the model
YuanLiuuuuuu Dec 28, 2021
d07ba7b
[Feature]: Customized settings
YuanLiuuuuuu Dec 29, 2021
cc12ab6
[Feature]: Add A100 settings
YuanLiuuuuuu Dec 31, 2021
35c590a
[Fix]: Change mae to imagenet
YuanLiuuuuuu Dec 31, 2021
0fda414
[Feature]: Change mae pretrain num workers to 32
YuanLiuuuuuu Dec 31, 2021
f4e24f4
[Feature]: Change num workers to 16
YuanLiuuuuuu Jan 4, 2022
3b21c8b
[Feature]: Add A100 setting for pre_release ft version
YuanLiuuuuuu Jan 5, 2022
02eaeb4
[Feature]: Add img_norm_cfg
YuanLiuuuuuu Jan 5, 2022
6e7f077
[Fix]: Fix mae cls test missing logits bug
YuanLiuuuuuu Jan 5, 2022
735b118
[Fix]: Fix mae cls head bias initialize to zero
YuanLiuuuuuu Jan 6, 2022
daf29b5
[Feature]: Rename mae config name
YuanLiuuuuuu Jan 6, 2022
964a46e
[Feature]: Add MAE README.md
YuanLiuuuuuu Jan 7, 2022
53f3cef
[Fix]: Fix lint
YuanLiuuuuuu Jan 7, 2022
18037f5
[Feature]: Fix typo
YuanLiuuuuuu Jan 7, 2022
0cc25ea
[Fix]: Fix typo
YuanLiuuuuuu Jan 7, 2022
54ac07d
[Feature]: Fix invalid link
YuanLiuuuuuu Jan 7, 2022
2250554
[Fix]: Fix finetune config file name
YuanLiuuuuuu Jan 7, 2022
bbb792a
[Feature]: Official pretrain v1
YuanLiuuuuuu Jan 8, 2022
6cddae6
[Feature]: Change log interval to 100
YuanLiuuuuuu Jan 8, 2022
d4ac05e
[Feature]: pretrain 1600 epochs
YuanLiuuuuuu Jan 8, 2022
f65083b
[Fix]: Change encoder num head to 12
YuanLiuuuuuu Jan 10, 2022
0356ac1
[Feature]: Mix precision
YuanLiuuuuuu Jan 10, 2022
951ae49
[Feature]: Add default value to random masking
YuanLiuuuuuu Jan 10, 2022
dec4e12
[Feature]: Official MAE finetune
YuanLiuuuuuu Jan 10, 2022
c67a398
[Feature]: Finetune img per gpu 32
YuanLiuuuuuu Jan 10, 2022
e1509b8
[Feature]: Add multi machine training for lincls
YuanLiuuuuuu Jan 10, 2022
850afeb
[Fix]: Fix lincls master port master addr
YuanLiuuuuuu Jan 10, 2022
8faf83b
[Feature]: Change img per gpu to 128
YuanLiuuuuuu Jan 10, 2022
230e30e
[Feature]: Add linear eval and Refactor
YuanLiuuuuuu Jan 11, 2022
6f000f4
[Fix]: Fix debug mode
YuanLiuuuuuu Jan 11, 2022
ecf499b
[Fix]: Delete MAE dataset in __init__.py
YuanLiuuuuuu Jan 11, 2022
df106df
[Feature]: normalize pixel for mae
YuanLiuuuuuu Jan 11, 2022
a79dbd2
[Fix]: Fix lint
YuanLiuuuuuu Jan 13, 2022
d8cf7f7
[Feature]: LARS for linear eval
YuanLiuuuuuu Jan 13, 2022
f27b98b
[Feature]: Add lars for mae linear eval
YuanLiuuuuuu Jan 13, 2022
f85888e
[Feature]: Change mae linear lars num workers to 32
YuanLiuuuuuu Jan 13, 2022
ce96371
[Feature]: Change mae linear lars num workers to 8
YuanLiuuuuuu Jan 13, 2022
7a458c0
[Feature]: log every 25 iter for mae linear eval lars
YuanLiuuuuuu Jan 13, 2022
c29c969
[Feature]: Add 1600 epoch and 800 epoch pretraining
YuanLiuuuuuu Jan 13, 2022
f38b023
[Fix]: Change linear eval to 902
YuanLiuuuuuu Jan 14, 2022
8b265f5
[Fix]: Add random flip to linear eval
YuanLiuuuuuu Jan 14, 2022
05b5d1a
[Fix]: delete fp16 in mae
YuanLiuuuuuu Jan 17, 2022
1a0c391
[Refactor]: Change backbone to mmcls
YuanLiuuuuuu Jan 18, 2022
4cc9675
[Fix]: Align finetune settings
YuanLiuuuuuu Jan 18, 2022
8e5224f
[Fix]: replace timm trunc_normal with mmcv trunc_normal
YuanLiuuuuuu Jan 18, 2022
3007827
[Fix]: Change finetune layer_decay to 0.65
YuanLiuuuuuu Jan 18, 2022
fa993d4
[Fix]: Delete pretrain last norm when global_pooling
YuanLiuuuuuu Jan 20, 2022
e41873a
[Fix]: set requires_grad of norm1 to False
YuanLiuuuuuu Jan 20, 2022
a93bf4d
[Fix]: delete norm1
YuanLiuuuuuu Jan 20, 2022
e2b5a46
[Fix]: Fix docstring bug
YuanLiuuuuuu Jan 20, 2022
bfcede7
[Fix]: Fix lint
YuanLiuuuuuu Jan 20, 2022
2292097
[Fix]: Add external link
YuanLiuuuuuu Jan 20, 2022
06eb87f
[Fix]: Delete auto_resume and reformat config readme.
YuanLiuuuuuu Jan 20, 2022
92cb93a
[Fix]: Fix pytest bug
YuanLiuuuuuu Jan 20, 2022
eb1f1e7
[Fix]: Fix lint
YuanLiuuuuuu Jan 20, 2022
0e0b329
[Refactor]: Rename filename
YuanLiuuuuuu Jan 21, 2022
a6bcb17
[Feature]: Add docstring
YuanLiuuuuuu Jan 21, 2022
819d757
[Fix]: Rename config file name
YuanLiuuuuuu Jan 24, 2022
4daf8ea
[Fix]: Fix name inconsistency bug
YuanLiuuuuuu Jan 24, 2022
4431e22
[Fix]: Change the default value of persistent_worker in builder to True
YuanLiuuuuuu Jan 24, 2022
3da7da1
[Fix]: Change the default value of CPUS_PER_TASK to 5
YuanLiuuuuuu Jan 24, 2022
740aaa3
[Fix]: Add a blank line to line136 in tools/train.py
YuanLiuuuuuu Jan 24, 2022
ad0a0cd
[Fix]: Fix MAE algorithm docstring format and add paper name and url
YuanLiuuuuuu Jan 24, 2022
32c3034
[Feature]: Add MAE paper name and link, and store mae teaser on github
YuanLiuuuuuu Jan 24, 2022
8546415
[Refactor]: Delete mae.png
YuanLiuuuuuu Jan 24, 2022
431837c
[Fix]: Fix config file name”
YuanLiuuuuuu Jan 24, 2022
9bffe84
[Fix]: Fix name bug
YuanLiuuuuuu Jan 24, 2022
67fbd40
[Refactor]: Change default GPUS to 8
YuanLiuuuuuu Jan 24, 2022
ebbe995
[Fix]: Abandon change to drop_last
YuanLiuuuuuu Jan 24, 2022
7b81385
[Fix]: Fix docstring in mae algorithm
YuanLiuuuuuu Jan 24, 2022
c37c9a3
[Fix]: Fix lint
YuanLiuuuuuu Jan 24, 2022
43f2e8b
[Fix]: Fix lint
YuanLiuuuuuu Jan 24, 2022
f895c79
[Fix]: Fix mae finetune algo type bug
YuanLiuuuuuu Jan 24, 2022
0d8a008
[Feature]: Add unit test for algorithm
YuanLiuuuuuu Jan 24, 2022
145772a
[Feature]: Add unit test for remaining parts
YuanLiuuuuuu Jan 25, 2022
2668560
[Fix]: Fix lint
YuanLiuuuuuu Jan 25, 2022
e1a18a5
[Fix]: Fix typo
YuanLiuuuuuu Jan 25, 2022
967666b
[Fix]: Delete some unnecessary modification in gitignore
YuanLiuuuuuu Jan 26, 2022
9f48a8b
[Feature]: Change finetune setting in mae algo to mixup setting
YuanLiuuuuuu Jan 26, 2022
8c70139
[Fix]: Change norm_pix_loss to norm_pix in pretrain head
YuanLiuuuuuu Jan 26, 2022
f672434
[Fix]: Delete modification in dist_train_linear.sh
YuanLiuuuuuu Jan 26, 2022
e817133
[Refactor]: Delete global pool in mae_cls_vit.py
YuanLiuuuuuu Jan 26, 2022
cd72bed
[Fix]: Change finetune param to mixup in test_mae_classification
YuanLiuuuuuu Jan 26, 2022
aa49693
[Fix]: Change norm_pix_loss to norm_pix of mae_pretrain_head in unit …
YuanLiuuuuuu Jan 26, 2022
6e7f4a4
[Fix]: Change norm_pix_loss to norm_pix in unit test
YuanLiuuuuuu Jan 26, 2022
bebf727
[Refactor]: Create init_weights for mae_finetune_head and mae_linprob…
YuanLiuuuuuu Jan 26, 2022
b3a2401
[Refactor]: Construct 2d sin-cosine position embedding using torch
YuanLiuuuuuu Jan 27, 2022
7b80971
[Refactor]: Using classification and using mixup from mmcls
YuanLiuuuuuu Jan 27, 2022
6d764cc
[Fix]: Fix lint
YuanLiuuuuuu Jan 27, 2022
7664df6
[Fix]: Add False to finetune mae linprobe‘
YuanLiuuuuuu Jan 27, 2022
9ae1536
[Fix]: Set drop_last to False
YuanLiuuuuuu Jan 28, 2022
7643e24
[Fix]: Fix MAE finetune layerwise lr bug
YuanLiuuuuuu Feb 7, 2022
89096de
[Refactor]: Delete redundant MAE when registering MAE
YuanLiuuuuuu Feb 7, 2022
b76ce88
[Refactor]: Split initialize_weights in MAE to submodules
YuanLiuuuuuu Feb 7, 2022
771682d
[Fix]: Change the min_lr of mae pretrain to 0.0
YuanLiuuuuuu Feb 7, 2022
a1f1bc0
[Refactor]: Delete unused _init_weights in mae_cls_vit
YuanLiuuuuuu Feb 8, 2022
ec36e4b
[Refactor]: Change MAE cls vit to a more general name
YuanLiuuuuuu Feb 8, 2022
9dbd6ef
[Feature]: Add Epoch Fix cosine annealing lr updater
YuanLiuuuuuu Feb 8, 2022
b686452
[Fix]: Fix lint
YuanLiuuuuuu Feb 8, 2022
95091a7
[Feature]: Add layer wise lr decay in optimizer constructor
YuanLiuuuuuu Feb 8, 2022
4120bd2
[Fix]: Fix lint
YuanLiuuuuuu Feb 8, 2022
5e00b4e
[Fix]: Fix set layer wise lr decay bug
YuanLiuuuuuu Feb 8, 2022
dca3e1f
[Fix]: Fix UT for MAE
YuanLiuuuuuu Feb 9, 2022
74f33d9
[Fix]: Fix lint
YuanLiuuuuuu Feb 9, 2022
f844b16
[Fix]: update algorithm readme format for MAE
YuanLiuuuuuu Feb 9, 2022
cd36793
[Fix]: Fix isort
YuanLiuuuuuu Feb 9, 2022
97d5410
[Fix]: Add Returns inmae_pretrain_vit
YuanLiuuuuuu Feb 9, 2022
722354a
[Fix]: Change bgr to rgb
YuanLiuuuuuu Feb 9, 2022
f7796a9
[Fix]: Change norm pix to True
YuanLiuuuuuu Feb 9, 2022
102be55
[Fix]: Use cls_token to linear prob
YuanLiuuuuuu Feb 17, 2022
6d06091
[Fix]: Delete mixup.py
YuanLiuuuuuu Feb 23, 2022
e9c5ec3
[Fix]: Fix MAE readme
YuanLiuuuuuu Feb 23, 2022
35b6767
[Feature]: Delete linprobe
YuanLiuuuuuu Feb 23, 2022
78c877b
[Refactor]: Merge MAE head into one file
YuanLiuuuuuu Feb 24, 2022
7d80bdc
[Fix]: Fix lint
YuanLiuuuuuu Feb 24, 2022
1042cd8
[Fix]: rename mae_pretrain_head to mae_head
YuanLiuuuuuu Feb 24, 2022
439834b
[Fix]: Fix import error in __init__.py
YuanLiuuuuuu Feb 24, 2022
880b423
[Feature]: skip MAE algo UT when running on windows
YuanLiuuuuuu Feb 24, 2022
03c6a73
[Fix]: Fix UT bug
YuanLiuuuuuu Feb 24, 2022
7a17ac0
[Feature]: Update model_zoo
YuanLiuuuuuu Feb 24, 2022
92d5b38
[Fix]: Rename MAE pretrain model name
YuanLiuuuuuu Feb 24, 2022
7e6c0e4
[Fix]: Delete mae ft prefix
YuanLiuuuuuu Feb 25, 2022
9e285fc
[Feature]: Change b to base
YuanLiuuuuuu Feb 25, 2022
337de6e
[Refactor]: Change b in MAE pt config to base
YuanLiuuuuuu Feb 25, 2022
e3323b5
[Fix]: Fix typo in docstring
YuanLiuuuuuu Feb 25, 2022
29521cd
[Fix]: Fix name bug
YuanLiuuuuuu Feb 25, 2022
e084a43
[Feature]: Add new constructor for MAE finetune
YuanLiuuuuuu Feb 25, 2022
3f1f8b8
[Fix]: Fix model_zoo link
YuanLiuuuuuu Mar 2, 2022
c8c8560
[Fix]: Skip UT for MAE
YuanLiuuuuuu Mar 2, 2022
cfb3bca
[Fix]: Change fixed channel order to param
YuanLiuuuuuu Mar 2, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[Fix]: Rename MAE pretrain model name
  • Loading branch information
@YuanLiuuuuuu
YuanLiuuuuuu committed Mar 2, 2022
commit 92d5b38b4ed7ea4d2fc567e851fe635bd72407a0
0 configs/selfsup/_base_/models/mae.py → ...selfsup/_base_/models/mae_vit-base-p16.py
View file
Open in desktop
File renamed without changes.
2 changes: 1 addition & 1 deletion configs/selfsup/mae/mae_vit-b-p16_8xb512-coslr-400e_in1k.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
_base_ = [
'../_base_/models/mae.py',
'../_base_/models/mae_vit-base-p16.py',
'../_base_/datasets/imagenet_mae.py',
'../_base_/schedules/adamw_coslr-200e_in1k.py',
'../_base_/default_runtime.py',
Expand Down