Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how can use the vlogger project to get the teddy_travel vlog in your github like the example https://youtu.be/ZRD1-jHbEGk? #17

Open
pzwstudy opened this issue May 13, 2024 · 8 comments

Comments

@pzwstudy
Copy link

No description provided.

@pzwstudy pzwstudy changed the title HOW how can use the vlogger project to get the teddy_travel vlog in your github like the example https://youtu.be/ZRD1-jHbEGk? May 13, 2024
@zhuangshaobin
Copy link
Collaborator

zhuangshaobin commented May 14, 2024

Firstly, run the following command to get script, actors and protagonist:
python sample_scripts/vlog_write_script.py
The generated scripts will be saved in results/vlog/$your_story_dir/script.
The generated reference images will be saved in results/vlog/$your_story_dir/img.
⚠️ Enter your openai key in the 7th line of the file vlogger/planning_utils/gpt4_utils.py

Secondly, run the following command to get the vlog:
python sample_scripts/vlog_read_script_sample.py
The generated scripts will be saved in results/vlog/$your_story_dir/video.

@pzwstudy
Copy link
Author

thanks!
pil_image = Image.open(args.reference_image_path[reference_lists[i][0] - 1])results an error "list index out of range"
屏幕截图 2024-05-20 205144

`File "C:\Users\HIT\Desktop\vlogger\Vlogger\sample_scripts\vlog_read_script_sample.py", line 190, in main
pil_image = Image.open(args.reference_image_path[reference_lists[i][0] - 1])
File "C:\Users\HIT\Desktop\vlogger\Vlogger\sample_scripts\vlog_read_script_sample.py", line 307, in
main(omega_conf)
omegaconf.errors.ConfigIndexError: list index out of range
full_key: reference_image_path[1]
object_type=list
屏幕截图 2024-05-20 204748
this shows the default reference_image_path: ["results/vlog/teddy_travel/ref_img/teddy.jpg"] only has an element,
how can l adjust my code?

@zhuangshaobin
Copy link
Collaborator

zhuangshaobin commented May 21, 2024

This is because the output of LLM may sometimes make mistakes. You can add a line of code to slightly correct it.
You can modify the error code in the picture as follows:
if reference_lists[i][0] > len(args.reference_image_path):
reference_lists[i][0] = 0 # you can set the 0 or len(args.reference_image_path)
pil_image = Image.open(args.reference_image_path[reference_lists[i][0] - 1])
Hope the above information can help you!

@pzwstudy
Copy link
Author

Thanks,it's normal now!

@pzwstudy
Copy link
Author

屏幕截图 2024-05-22 102434
File "D:\anaconda\envs\vlog\lib\site-packages\moviepy\video\io\ffmpeg_writer.py", line 88, in __init__ '-r', '%.02f' % fps, TypeError: must be real number, not NoneType lt likes the fps has no init

@pzwstudy
Copy link
Author

1.How to eval the FVD score ?
Can you offer a script?
屏幕截图 2024-07-15 172900

@zhuangshaobin
Copy link
Collaborator

As we mentioned in the paper, the code we used to test fvd in the paper is based on the codebase of stylegan-v, follow this link below:
https://github.com/universome/stylegan-v

@pzwstudy
Copy link
Author

OK,thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants