Skip to content

Commit db3f72c

Browse files
authored
[Web] Bump web-tokenizer to 0.1.6 (#67)
This PR bumps web-tokenizer to 0.1.6 to reflect the latest HEAD changes. Without bumping this, WebLLM would run into RUST-related error (thread '<unnamed>' panicked at src/lib.rs:26:50:), likely due to the newly compiled weights and tokenizer files in mlc-ai's HF repo are not matching with the web-tokenizer package. Unrelatedly, we also upstream package-lock.json
1 parent dc7ea3a commit db3f72c

File tree

4 files changed

+2092
-2
lines changed

4 files changed

+2092
-2
lines changed

.gitignore

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,5 @@ build
3333
*.out
3434
*.app
3535
Cargo.lock
36-
package-lock.json
3736
rust/target
3837
.vscode

0 commit comments

Comments
 (0)