hi,
I developed a classification network model and performed 8-bit quantization using tflite. However, after deploying it on the chip, I cannot obtain correct classification results. I used the nntool to examine the output of each layer and found that nntool can produce correct results! Here's the specific situation:
In nntool, I discovered that 'adjust' and 'fusions --scale8' commands have no effect on the softmax layer output. Simply loading the model and applying 'set input_norm_func "x: x/255"' or 'imageformat input_1 bw8 shift_int8' can yield correct classification results. However, when deployed on the actual chip, the results are completely different.
I found a way to get the same incorrect softmax output in both environments: after applying 'adjust', 'fusions --scale8', and 'imageformat input_1 bw8 offset_int8', both environments produce the same incorrect softmax values. I've tried various approaches but still cannot obtain the correct softmax values.
Can anyone help me with this issue?
The following are the same inputs


hi,
I developed a classification network model and performed 8-bit quantization using tflite. However, after deploying it on the chip, I cannot obtain correct classification results. I used the nntool to examine the output of each layer and found that nntool can produce correct results! Here's the specific situation:
In nntool, I discovered that 'adjust' and 'fusions --scale8' commands have no effect on the softmax layer output. Simply loading the model and applying 'set input_norm_func "x: x/255"' or 'imageformat input_1 bw8 shift_int8' can yield correct classification results. However, when deployed on the actual chip, the results are completely different.
I found a way to get the same incorrect softmax output in both environments: after applying 'adjust', 'fusions --scale8', and 'imageformat input_1 bw8 offset_int8', both environments produce the same incorrect softmax values. I've tried various approaches but still cannot obtain the correct softmax values.
Can anyone help me with this issue?
The following are the same inputs