Is it fair to say...
...that this model is kind of... very bad? :) Like not realistically usable? Just checking my sanity here.
python3 run_inference.py -m models/bitnet-large/model.gguf -p "The capital of France is" 2>/dev/null
The capital of France is Paris, which is the most popular city in France and one of the most visited cities in Europe. It is located in the south east part of France and is the most popular place of visit in France. It is one of the most popular cities for tourists in France.
Paris is the capital and most populated city of France. It is one of the biggest cities in Europe and one of the most visited cities in the world. The French capital is famous for its beautiful architecture, its magnificent monuments and the beautiful streetscapes. The capital is also famous for its restaurants, fashion shops, cafes and famous
I did convert to gguf so maybe I did something wrong?