AttributeError: 'DynamicCache' object has no attribute 'seen_tokens'
#58
by
andreaskaratzas
- opened
On vLLM, we have the following test to check integrity of this model tests/models/language/generation/test_phimoe.py::test_models[5-64-bfloat16-microsoft/Phi-3.5-MoE-instruct]. The test asserts with error: AttributeError: 'DynamicCache' object has no attribute 'seen_tokens'". I think that the codebase of this model needs an update.