Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The difference in accuracy of reproduction. #6

Open
ZziTaiLeo opened this issue Nov 30, 2023 · 3 comments
Open

The difference in accuracy of reproduction. #6

ZziTaiLeo opened this issue Nov 30, 2023 · 3 comments

Comments

@ZziTaiLeo
Copy link

image
Hi, I just download the data.zip from gaitgraph for casia-b_poses_train_valid.csv and casia-b_valid.csv, then use experiments/train.sh to train model, but the accuracy looks have a bit difference from paper. I have not adjusted any hyperparameters or network structure. How can I adjust it to reproduce this accuracy.
Looking forward to your early reply! Tks!

@exitudio
Copy link
Owner

Hi, Thank you for being interested in our work.
the variance we're seeing is likely because the CASIA-B dataset is relatively small, and the inclusion of bag (BG) and coat (CL) data adds some noise.
We ran the experiment 8 times and reported the best result. Note that, this pattern is not unique to our model—other methods, like GaitGraph, exhibit similar behavior.

@ZziTaiLeo
Copy link
Author

Thank you for your prompt reply! I only saw it now. Although you said you had the best results in eight experiments, I still cannot accept the current results and cannot find a corresponding solution to solve it. Are you downloading the processed skeleton dataset directly?

@exitudio
Copy link
Owner

exitudio commented Dec 6, 2023

Yes. We use the preprocessed data from GaitGraph.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants