What is 4bit-128g? How does it affect quality or speed?

What does it mean for the model to be 4bit-128g? I’m looking at different models you can get and some of them are just “name of the model” and some are “name of the model 4bit-128g” which one is better? Example: MPT-7B-StoryWriter-65k+ has both “normal” and 4bit-128g version

submitted by /u/jase_LV
[link] [comments]


Posted

in

by

Tags: