-
Notifications
You must be signed in to change notification settings - Fork 260
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
initial data script #85
base: train_codes
Are you sure you want to change the base?
Conversation
Can you also show how should we modify |
Hi @czk32611 , @itechmusic , I have commited the changes needed to make training and inference(with finetuned model) work. |
@czk32611 , @itechmusic There is no way to compare validation loss with the training loss right now in the train.py script. Do you think we should add that? I can add it if needed. |
Can I ask what data you trained your model on? |
The training data was youtube videos |
Thanks for the quick reply! How many hours did your dataset have? |
Just 15 mins fo this one, I trined on 1 hr data for better results |
@shounakb1 I'm trying to use your code to train on multiple videos. When you have multiple files, the code won't work. Especially in this part, where the code will get a reference image. If you have more videos in the folder, It might get a reference frame from another video. |
@shounakb1 paulovasconcellos-hotmart is right, data from each video should be saved to individual folder. Could you modify this part? |
Yes thanks for pointing it out guys, I'll fix it, sorry for the delay, work schedule is a bit hectic right now. |
@czk32611 I've fixed the multiple video data preperation probem. Please let me know if anything else needs to be changed. |
I have made the data creation script, this is a dirty implementation though. The way I make it work is by running:
First update the test.yaml with the train video and corresponding audio. Then run:
python -m scripts.data --inference_config configs/inference/test.yaml --folder_name train
Again update the test.yaml with test video and audio and again running:
python -m scripts.data --inference_config configs/inference/test.yaml --folder_name test
This creates folders which contain the image frames and npy files.
I also need to modify the Dataloader.py in train_codes to make the training hapen.
I can make the necessary changes before you merge @czk32611 @itechmusic .
commit.mp4
Also attaching a sample to show the trained results, I cant upload more than 10MB so its small.
Just guide me on what changes to make and I'll do it. Thanks for this guys.