Which tool/method you used to count flops?

[yushuinanrong]

No description provided.

[tb2-sy]

just google yourself

[yushuinanrong]

@tb2-sy
What does matter in my research (probably the same for many other researchers) is to make sure that I can reproduce the reported numbers. I'm aware of many flop counting tools and they often produce different results. That's why I bring this up in the issue. Hope you can understand my point and learn to mind your attitude next time when you post anything online.

[zeliu98]

The code can be found here:

Swin-Transformer/models/swin_transformer.py

Lines 578 to 585 in b05e621

	def flops(self):
	flops = 0
	flops += self.patch_embed.flops()
	for i, layer in enumerate(self.layers):
	flops += layer.flops()
	flops += self.num_features * self.patches_resolution[0] * self.patches_resolution[1] // (2 ** self.num_layers)
	flops += self.num_features * self.num_classes
	return flops

[bobopit]

The code can be found here:

Swin-Transformer/models/swin_transformer.py

Lines 578 to 585 in b05e621

	def flops(self):
	flops = 0
	flops += self.patch_embed.flops()
	for i, layer in enumerate(self.layers):
	flops += layer.flops()
	flops += self.num_features * self.patches_resolution[0] * self.patches_resolution[1] // (2 ** self.num_layers)
	flops += self.num_features * self.num_classes
	return flops

Hello, I have a question about FLOPs. On the ADE20K, the FLOPs of Swin-B are 1841G, but the backbone of Swin-B is only tens of G. Is it because of the large amount of calculation of the decoder?

[auniquesun]

The code can be found here:

Swin-Transformer/models/swin_transformer.py

Lines 578 to 585 in b05e621

	def flops(self):
	flops = 0
	flops += self.patch_embed.flops()
	for i, layer in enumerate(self.layers):
	flops += layer.flops()
	flops += self.num_features * self.patches_resolution[0] * self.patches_resolution[1] // (2 ** self.num_layers)
	flops += self.num_features * self.num_classes
	return flops

It seems this code snippet is for #Parameters calculation, not for FLOPs. Can you give more explanations? Thanks