Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add MoCo v3 #194

Merged
merged 33 commits into from
Jan 31, 2022
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
8cae453
[Feature] add position embedding function
fangyixiao18 Jan 26, 2022
8669087
[Fature] modify nonlinear neck for vit backbone
fangyixiao18 Jan 26, 2022
15dc0b9
[Feature] add mocov3 head
fangyixiao18 Jan 26, 2022
2c32ff3
[Feature] modify cls_head for vit backbone
fangyixiao18 Jan 26, 2022
d8e5dc9
[Feature] add ViT backbone
fangyixiao18 Jan 26, 2022
8f192cb
[Feature] add mocov3 algorithm
fangyixiao18 Jan 26, 2022
0fcbf29
[Docs] revise BYOL hook docstring
fangyixiao18 Jan 26, 2022
d542569
[Feature] add mocov3 vit small config files
fangyixiao18 Jan 26, 2022
4848f54
[Feature] add mocov3 vit small linear eval config files
fangyixiao18 Jan 26, 2022
4f6dedc
[Fix] solve conflict
fangyixiao18 Jan 26, 2022
1d823e0
[Fix] add mmcls
fangyixiao18 Jan 26, 2022
70c80c8
[Fix] fix docstring format
fangyixiao18 Jan 26, 2022
410828f
[Fix] fix isort
fangyixiao18 Jan 26, 2022
8eaa961
[Fix] add mmcls to runtime requirements
fangyixiao18 Jan 26, 2022
8396a75
[Feature] remove duplicated codes
fangyixiao18 Jan 26, 2022
d0e9419
[Feature] add mocov3 related unit test
fangyixiao18 Jan 27, 2022
4e9385e
[Feature] revise position embedding function
fangyixiao18 Jan 27, 2022
0edfbda
[Feature] add UT codes
fangyixiao18 Jan 27, 2022
2f87933
[Docs] add README.md
fangyixiao18 Jan 27, 2022
9638ec2
[Docs] add model links and results to model zoo
fangyixiao18 Jan 27, 2022
cff154c
[Docs] fix model links
fangyixiao18 Jan 27, 2022
be81a8c
[Docs] add metafile
fangyixiao18 Jan 27, 2022
86c290e
[Docs] modify install.md and add mmcls requirements
fangyixiao18 Jan 28, 2022
a4a022e
[Docs] modify description
fangyixiao18 Jan 28, 2022
632eec7
[Fix] using specific arch name `mocov3-small` rather than general ar…
fangyixiao18 Jan 28, 2022
3c220eb
[Fix] add mmcls
fangyixiao18 Jan 28, 2022
d330777
[Fix] fix arch name
fangyixiao18 Jan 28, 2022
55926b7
[Feature] change name to `MoCoV3`
fangyixiao18 Jan 28, 2022
29d5075
[Fix] fix unit test bug
fangyixiao18 Jan 28, 2022
558dad0
[Feature] change `BYOLHook` name to `MomentumUpdateHook`
fangyixiao18 Jan 28, 2022
faeae47
[Feature] change name to MoCoV3
fangyixiao18 Jan 29, 2022
246d923
[Docs] modify description
fangyixiao18 Jan 29, 2022
666ac0e
Merge branch 'dev_v0.6.0' into add-mocov3
fangyixiao18 Jan 31, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
[Fix] fix isort
  • Loading branch information
fangyixiao18 committed Jan 26, 2022
commit 410828f8efc8dbc3bd52d59b4a71f897defa6c2a
7 changes: 4 additions & 3 deletions mmselfsup/models/backbones/vision_transformer.py
Original file line number Diff line number Diff line change
@@ -1,14 +1,15 @@
# Copyright (c) OpenMMLab. All rights reserved.
import math
from functools import reduce
from operator import mul

import torch
import torch.nn as nn
from functools import reduce
from mmcls.models.backbones import VisionTransformer as _VisionTransformer
from mmcls.models.utils import PatchEmbed, to_2tuple
from mmselfsup.utils import build_2d_sincos_position_embedding
from operator import mul
from torch.nn.modules.batchnorm import _BatchNorm

from mmselfsup.utils import build_2d_sincos_position_embedding
from ..builder import BACKBONES


Expand Down
2 changes: 1 addition & 1 deletion mmselfsup/models/heads/mocov3_head.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,8 +3,8 @@
import torch.nn as nn
from mmcv.runner import BaseModule

from ..builder import HEADS, build_neck
from mmselfsup.utils import concat_all_gather
from ..builder import HEADS, build_neck


@HEADS.register_module()
Expand Down