PrepareQuantizeCalibrateExportSplitCompileVerifyPackage
Recipe configuration
- Model
- EXAONE 4.0 1.2B
- Context length
- 4,096
- Calibration
- Customer dataset · 128
- Strategy
- lpbq_seqmse
Mixed precision allocation
LayerW4W8FP16
embed_tokensW8
self_attn.q_projW4
self_attn.k_projW4
mlp.up_projW8
rms_normFP16
Target builds
Qualcomm Snapdragon NPUQNN · DLC / context
binaryCompiled ✓
Apple Neural EngineCore ML ·
mlpackageCompiled ✓
▣ Test
vectorspipeline_config.jsonexceptions.jsonRun log · 1,248
lines