Debanjan Basu

d3banjan's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in RWKV/RWKV7-Goose-World3-2.9B-HF 4 months ago

Add Rust-backed fast tokenizer (54x speedup + bug fixes)

2

#2 opened 4 months ago by

d3banjan

Fix 3 bugs in Python tokenizer: phantom token, broken greedy match, decode mojibake

2

#3 opened 4 months ago by

d3banjan

Fix 3 bugs in Python tokenizer: phantom token, broken greedy match, decode mojibake

2

#3 opened 4 months ago by

d3banjan

Add Rust-backed fast tokenizer (54x speedup + bug fixes)

2

#2 opened 4 months ago by

d3banjan

Fix 3 bugs in Python tokenizer: phantom token, broken greedy match, decode mojibake

2

#3 opened 4 months ago by

d3banjan

Add Rust-backed fast tokenizer (54x speedup + bug fixes)

2

#2 opened 4 months ago by

d3banjan