EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
09
EmbeddedLLM/Phi-3-mini-128k-instruct-onnx-cpu-int4-rtn-block-32-acc-level-4
Performance Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
CPU-INT4-RTN-BLOCK-32-ACC-LEVEL-4
We measured the performance of CPU-INT4-RTN-BLOCK-32-ACC-LEVEL-4 on AMD Ryzen 9 7940HS /w Radeon 78