Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clustering performance #96

Closed
XifengGuo opened this issue Dec 31, 2017 · 4 comments · Fixed by #97
Closed

Clustering performance #96

XifengGuo opened this issue Dec 31, 2017 · 4 comments · Fixed by #97
Assignees

Comments

@XifengGuo
Copy link

@hanxiao
I wonder what's the clustering performance of the state-of-the-art clustering algorithms on fashion-mnist.
I tested my algorithm and got an accuracy of 0.59 and NMI of 0.63.
Have you collected other clustering results?
Thanks.

@hanxiao
Copy link
Collaborator

hanxiao commented Jan 2, 2018

hello Xifeng, thanks for testing. unfortunately, I don't have other cluster benchmark for comparison. I may add a table if people start to benchmark clustering algorithms on this dataset. As for now, I can add your repo to the readme.md if you want.

@kashif
Copy link
Collaborator

kashif commented Jan 2, 2018

@XifengGuo indeed I think the best one I saw was https://github.com/lmcinnes/umap but again I do not have any numbers

@XifengGuo
Copy link
Author

@hanxiao
Thanks, I'll keep investigating the new results of clustering algorithms on Fashion-Mnist.
I believe it will benefit unsupervised learning community if results of state-of-the-art clustering algorithms are collected.
I'm looking forward to it.

For now, I only tested the most popular deep clustering algorithm Unsupervised Deep Embedding for Clustering Analysis (DEC).
If you think it is appropriate, you can add my result to the readme.md as a start. I'll appreciate it.

clustering model Preprocessing Fashion performance MNIST performance Submitter Code
DEC Normalization (just scale pixel values to [0,1]) ACC=0.618; NMI=0.651 ACC=0.912; NMI=0.869 XifengGuo https://github.com/XifengGuo/DEC-keras

@XifengGuo
Copy link
Author

@kashif Thanks for bring https://github.com/lmcinnes/umap to me, it looks really amazing.

@hanxiao hanxiao self-assigned this Jan 3, 2018
hanxiao pushed a commit that referenced this issue Jan 8, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants