@mlc-ai/web-tokenizers

v0.1.5

| [NPM Package](https://www.npmjs.com/package/@mlc-ai/web-tokenizers) | [WebLLM](https://github.com/mlc-ai/web-llm) | For more information about how to use this package see README

Latest version published 3 months ago

License: Apache-2.0

NPM

GitHub

Package Health Score

73 / 100

security
No known security issues
popularity
Limited
maintenance
Healthy
community
Sustainable

Explore Similar Packages

Security

No known security issues

All security vulnerabilities belong to production dependencies of direct and indirect packages.

Security and license risk for significant versions

All Versions

Version				Vulnerabilities	License Risk
0.1.5	\|	08/2024	Popular	0 C 0 H 0 M 0 L	0 H 0 M 0 L
0.1.0	\|	05/2023		0 C 0 H 0 M 0 L	0 H 0 M 0 L

License

Apache-2.0

Security Policy

Is your project affected by vulnerabilities?

Scan your projects for vulnerabilities. Fix quickly with automated fixes. Get started with Snyk for free.

Get started free

Popularity

Limited

Weekly Downloads (165)

GitHub Stars: 273
Forks: 65
Contributors: 20

Direct Usage Popularity

The npm package @mlc-ai/web-tokenizers receives a total of 165 downloads a week. As such, we scored @mlc-ai/web-tokenizers popularity level to be Limited.

Based on project statistics from the GitHub repository for the npm package @mlc-ai/web-tokenizers, we found that it has been starred 273 times.

Downloads are calculated as moving averages for a period of the last 12 months, excluding weekends and known missing data points.

Community

Sustainable

Readme.md: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 20
Funding: No

With more than 10 contributors for the @mlc-ai/web-tokenizers repository, this is possibly a sign for a growing and inviting community.

We found a way for you to contribute to the project! Looks like @mlc-ai/web-tokenizers is missing a Code of Conduct.

Embed Package Health Score Badge

Maintenance

Healthy

Commit Frequency

Open Issues: 7
Open PR: 1
Last Release: 3 months ago
Last Commit: 3 months ago

Further analysis of the maintenance status of @mlc-ai/web-tokenizers based on released npm versions cadence, the repository activity, and other data points determined that its maintenance is Healthy.

We found that @mlc-ai/web-tokenizers demonstrates a positive version release cadence with at least one new version released in the past 12 months.

As a healthy sign for on-going project maintenance, we found that the GitHub repository had at least 1 pull request or issue interacted with by the community.

Keep your project healthy

Check your package.json

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Node.js Compatibility: not defined

Age: 1 year
Dependencies: 0 Direct
Versions: 6
Install Size: 7.85 MB
Dist-tags: 1
# of Files: 8
Maintainers: 6
TS Typings: No

@mlc-ai/web-tokenizers has more than a single and default latest tag published for the npm package. This means, there may be other tags available for this package, such as next to indicate future releases, or stable to indicate stable releases.

Readme

WebTokenizers

| NPM Package | WebLLM |

WebTokenizers is a javascript binding library that can be universally deployed. It wraps and binds the HuggingFace tokenizers library and sentencepiece and provides a minimum common interface in havascript.

Build from Srouce

source /path/to/emsdk_env.sh
npm install
npm run build

To try out the test webpage

cd tests
npm start

@mlc-ai/web-tokenizers development dependencies

tslib eslint rollup typescript @rollup/plugin-wasm @rollup/plugin-commonjs @typescript-eslint/parser rollup-plugin-typescript2 @rollup/plugin-node-resolve @typescript-eslint/eslint-plugin

FAQs

What is @mlc-ai/web-tokenizers?

| [NPM Package](https://www.npmjs.com/package/@mlc-ai/web-tokenizers) | [WebLLM](https://github.com/mlc-ai/web-llm) |. Visit Snyk Advisor to see a full health score report for @mlc-ai/web-tokenizers, including popularity, security, maintenance & community analysis.

Is @mlc-ai/web-tokenizers popular?

The npm package @mlc-ai/web-tokenizers receives a total of 165 weekly downloads. As such, @mlc-ai/web-tokenizers popularity was classified as limited. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is @mlc-ai/web-tokenizers well maintained?

We found that @mlc-ai/web-tokenizers demonstrated a healthy version release cadence and project activity. It has a community of 20 open source contributors collaborating on the project. See the full package health analysis to learn more about the package maintenance status.

Is @mlc-ai/web-tokenizers safe to use?

The npm package @mlc-ai/web-tokenizers was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 12 November-2024, at 20:48 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP