Max input tokens
#3
by yunsxie - opened
Hello, thank you for the great work. I'm wondering what is the maximum input token number does this model support? Evidentially, according to https://huggingface.co/01-ai/Yi-34B the baseline model is able to support 32K token input. Have you happened to test it?
The base model only support 4K token input
facat changed discussion status to closed