Where other models use 8-bit integer (INT8) quantization, TinyModel uses log8 — an 8-bit logarithmic scale. This preserves dynamic range for 29 separate decision boundaries without requiring 16-bit operations.
Independent tests on the Seeed Studio XIAO ESP32S3 (a popular 160MHz microcontroller) revealed the following: TinyModel Sugar Sets 21-29 Hit
In comparison, a standard MobileNetV2 quantized to 8-bit required 210 KB more memory, ran at 87ms, and only achieved an 87% accuracy on a reduced 15-class subset. Where other models use 8-bit integer (INT8) quantization,
Standard TinyModel Sugar Set runs are 10,000 units per set. The “Hit” run is estimated at just 120–150 units per set (1,200 total across nine sets). Set 24 (Candy Apple Cart) is believed to have only 89 Hit units in existence. In comparison, a standard MobileNetV2 quantized to 8-bit
If this technology hits the market (the team has open-sourced the first 5 Sugar Sets under a non-commercial license), three industries will transform immediately: