View vbench on Snyk Open Source Advisor

Package Health Score

70 / 100

security
Security review needed
popularity
Small
maintenance
Healthy
community
Sustainable

Explore Similar Packages

Popularity

Small

GitHub Stars: 513
Forks: 26
Contributors: 20

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package vbench, we found that it has been starred 513 times.

Security

Security review needed

Security and license risk for latest version

Release Date: Aug 27, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
14
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

Apache-2.0

Security Policy

We found a way for you to contribute to the project! Looks like vbench is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Healthy

Commit Frequency

Open Issues: 22
Open PR: 1
Last Release: 2 months ago
Last Commit: 25 days ago

Further analysis of the maintenance status of vbench based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that vbench demonstrates a positive version release cadence with at least one new version released in the past 3 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Community

Sustainable

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 20
Funding: No

With more than 10 contributors for the vbench repository, this is possibly a sign for a growing and inviting community.

We found a way for you to contribute to the project! Looks like vbench is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: Unspecified

Age: 10 months
Latest Release: 2 months ago
Dependencies: 20 Direct / 97 Total
Versions: 5
Maintainers: 2
Wheels: OS Independent

Readme

vbench_logo

VBench is a comprehensive benchmark suite for video generative models. You can use VBench to evaluate video generation models from 16 different ability aspects.

This project is the PyPI implementation of the following research: > VBench: Comprehensive Benchmark Suite for Video Generative Models
> Ziqi Huang^∗, Yinan He^∗, Jiashuo Yu^∗, Fan Zhang^∗, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, Yaohui Wang, Xinyuan Chen, Limin Wang, Dahua Lin⁺, Yu Qiao⁺, Ziwei Liu⁺

Installation

pip install vbench

To evaluate some video generation ability aspects, you need to install detectron2 via:

pip install detectron2@git+https://github.com/facebookresearch/detectron2.git

If there is an error during detectron2 installation, see here.

Usage

Evaluate Your Own Videos

We support evaluating any video. Simply provide the path to the video file, or the path to the folder that contains your videos. There is no requirement on the videos' names.

Note: We support customized videos / prompts for the following dimensions: 'subject_consistency', 'background_consistency', 'motion_smoothness', 'dynamic_degree', 'aesthetic_quality', 'imaging_quality'

To evaluate videos with customed input prompt, run our script with --mode=custom_input:

python evaluate.py \
    --dimension $DIMENSION \
    --videos_path /path/to/folder_or_video/ \
    --mode=custom_input

alternatively you can use our command:

vbench evaluate \
    --dimension $DIMENSION \
    --videos_path /path/to/folder_or_video/ \
    --mode=custom_input

Evaluation on the Standard Prompt Suite of VBench

command line

    vbench evaluate --videos_path $VIDEO_PATH --dimension $DIMENSION

For example:

    vbench evaluate --videos_path "sampled_videos/lavie/human_action" --dimension "human_action"

python

    from vbench import VBench
    my_VBench = VBench(device,

vbench dependencies

boto3 cython decord easydict fvcore lvis matplotlib omegaconf openai-clip opencv-python pillow pycocoevalcap pyyaml requests scikit-image scikit-learn scipy tensorboard urllib3 wheel

FAQs

What is vbench?

Video generation benchmark. Visit Snyk Advisor to see a full health score report for vbench, including popularity, security, maintenance & community analysis.

Is vbench popular?

The python package vbench receives a total of 51 weekly downloads. As such, vbench popularity was classified as small. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is vbench well maintained?

We found that vbench demonstrated a healthy version release cadence and project activity. It has a community of 20 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is vbench safe to use?

While scanning the latest version of vbench, we found that a security review is needed. A total of 0 vulnerabilities or license issues were detected. See the full security scan results.

Last updated on 31 October-2024, at 15:57 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

vbench

Video generation benchmark For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Explore Similar Packages

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Readme

Installation

Usage

Evaluate Your Own Videos

Evaluation on the Standard Prompt Suite of VBench

command line

python

vbench dependencies

FAQs

What is vbench?

Is vbench popular?

Is vbench well maintained?

Is vbench safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Explore Similar Packages

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

Installation

Usage

Evaluate Your Own Videos

Evaluation on the Standard Prompt Suite of VBench

command line

python

vbench dependencies

FAQs

What is vbench?

Is vbench popular?

Is vbench well maintained?

Is vbench safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues