Benchmarks 2024 11 21 TVM GCC O3 spike_rv32_min

Setup

Simulator

Spike (riscv-isa-sim ) (ISS, CPI=1)
- Spike : 0bc176b3fca43560b9e8586cdbc41cfde073e17a
- Spike PK : 7e9b671c0415dfd7b562ac934feb9380075d4aa2

Toolchains

RISC-V GCC:
- Scalar: riscv32-unknown-elf-gcc (gc891d8dc23e) 13.2.0
- Vector: riscv32-unknown-elf-gcc (gc891d8dc23e) 13.2.0
- Packed: Self compiled using patches found in https://github.com/riscv-collab/riscv-gcc/pull/258 and https://github.com/riscvarchive/riscv-binutils-gdb/pull/257

Models

MLPerfTiny Benchmark
TODO: others!

Frameworks

MLonMCU : develop
TVM : Nightly Pre-Build

Miscellaneous

Used -Os flag for compilation.
Benchmarks generated using MLonMCU deployment tool with minimal efforts.
Memory metrics are reported in Bytes

Results (Framework: tvm, Backend: tvmaot, Toolchain: gcc, Flags: -O3, Target: spike_rv32_min )

Audio Wake Words (`aww`)

Cycles (Speedup)	Total ROM (rel.)	Total RAM (rel.)	VLEN	Layout	Kernels	Mode	Arch	Auto-Vectorization
`14198814` ( 1.1x )	`169392` ( 1.282 )	`59524` ( 3.097 )	0	NCHW	TVM	Fallback	RV32IM	-
`21367144` ( 0.8x )	`135956` ( 1.029 )	`59524` ( 3.097 )	0	NHWC	TVM	Fallback	RV32IM	-
`14218670` ( 1.1x )	`165024` ( 1.249 )	`59524` ( 3.097 )	128	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`14218670` ( 1.1x )	`165024` ( 1.249 )	`59524` ( 3.097 )	256	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`14218670` ( 1.1x )	`165024` ( 1.249 )	`59524` ( 3.097 )	512	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`14218670` ( 1.1x )	`165024` ( 1.249 )	`59524` ( 3.097 )	1024	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`14218670` ( 1.1x )	`165024` ( 1.249 )	`59524` ( 3.097 )	2048	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`14218670` ( 1.1x )	`165024` ( 1.249 )	`59524` ( 3.097 )	4096	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`21291543` ( 0.8x )	`136064` ( 1.03 )	`59524` ( 3.097 )	128	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`21291543` ( 0.8x )	`136064` ( 1.03 )	`59524` ( 3.097 )	256	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`21291543` ( 0.8x )	`136064` ( 1.03 )	`59524` ( 3.097 )	512	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`21291543` ( 0.8x )	`136064` ( 1.03 )	`59524` ( 3.097 )	1024	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`21291543` ( 0.8x )	`136064` ( 1.03 )	`59524` ( 3.097 )	2048	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`21291543` ( 0.8x )	`136064` ( 1.03 )	`59524` ( 3.097 )	4096	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`16190019` ( Base )	`132144` ( Base )	`19220` ( Base )	0	NHWC	muRISCV-NN	Scalar	RV32IM	-
`15536019` ( 1.0x )	`127856` ( 0.968 )	`23684` ( 1.232 )	0	NHWC	muRISCV-NN	Vector (Portable)	RV32IM	-
`16190023` ( 1.0x )	`132140` ( 1.0 )	`19220` ( 1.0 )	128	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`16190022` ( 1.0x )	`132136` ( 1.0 )	`19220` ( 1.0 )	256	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`16190023` ( 1.0x )	`132140` ( 1.0 )	`19220` ( 1.0 )	512	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`16190023` ( 1.0x )	`132140` ( 1.0 )	`19220` ( 1.0 )	1024	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`16190022` ( 1.0x )	`132136` ( 1.0 )	`19220` ( 1.0 )	2048	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`16190023` ( 1.0x )	`132140` ( 1.0 )	`19220` ( 1.0 )	4096	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`8457692` ( 1.9x )	`134700` ( 1.019 )	`23684` ( 1.232 )	128	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`6564346` ( 2.5x )	`134700` ( 1.019 )	`23684` ( 1.232 )	256	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`5401652` ( 3.0x )	`134700` ( 1.019 )	`23684` ( 1.232 )	512	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`5364057` ( 3.0x )	`134688` ( 1.019 )	`23684` ( 1.232 )	1024	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`5367447` ( 3.0x )	`134692` ( 1.019 )	`23684` ( 1.232 )	2048	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`5370835` ( 3.0x )	`134688` ( 1.019 )	`23684` ( 1.232 )	4096	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`15536024` ( 1.0x )	`127856` ( 0.968 )	`23684` ( 1.232 )	128	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`15536024` ( 1.0x )	`127856` ( 0.968 )	`23684` ( 1.232 )	256	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`15536021` ( 1.0x )	`127844` ( 0.967 )	`23684` ( 1.232 )	512	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`15536021` ( 1.0x )	`127844` ( 0.967 )	`23684` ( 1.232 )	1024	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`15536021` ( 1.0x )	`127844` ( 0.967 )	`23684` ( 1.232 )	2048	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`15536023` ( 1.0x )	`127852` ( 0.968 )	`23684` ( 1.232 )	4096	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP

Image Classification (`resnet`)

Cycles (Speedup)	Total ROM (rel.)	Total RAM (rel.)	VLEN	Layout	Kernels	Mode	Arch	Auto-Vectorization
`57402601` ( 1.0x )	`268784` ( 1.545 )	`108436` ( 1.953 )	0	NCHW	TVM	Fallback	RV32IM	-
`82399340` ( 0.7x )	`244108` ( 1.404 )	`108436` ( 1.953 )	0	NHWC	TVM	Fallback	RV32IM	-
`57383701` ( 1.0x )	`266836` ( 1.534 )	`108436` ( 1.953 )	128	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`57383701` ( 1.0x )	`266836` ( 1.534 )	`108436` ( 1.953 )	256	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`57383701` ( 1.0x )	`266836` ( 1.534 )	`108436` ( 1.953 )	512	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`57383701` ( 1.0x )	`266836` ( 1.534 )	`108436` ( 1.953 )	1024	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`57383701` ( 1.0x )	`266836` ( 1.534 )	`108436` ( 1.953 )	2048	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`57383701` ( 1.0x )	`266836` ( 1.534 )	`108436` ( 1.953 )	4096	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`82425544` ( 0.7x )	`244920` ( 1.408 )	`108436` ( 1.953 )	128	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`82425544` ( 0.7x )	`244920` ( 1.408 )	`108436` ( 1.953 )	256	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`82425544` ( 0.7x )	`244920` ( 1.408 )	`108436` ( 1.953 )	512	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`82425544` ( 0.7x )	`244920` ( 1.408 )	`108436` ( 1.953 )	1024	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`82425544` ( 0.7x )	`244920` ( 1.408 )	`108436` ( 1.953 )	2048	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`82425544` ( 0.7x )	`244920` ( 1.408 )	`108436` ( 1.953 )	4096	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`54541475` ( Base )	`173916` ( Base )	`55524` ( Base )	0	NHWC	muRISCV-NN	Scalar	RV32IM	-
`72587442` ( 0.8x )	`172912` ( 0.994 )	`55524` ( 1.0 )	0	NHWC	muRISCV-NN	Vector (Portable)	RV32IM	-
`54660130` ( 1.0x )	`173916` ( 1.0 )	`55524` ( 1.0 )	128	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`54660127` ( 1.0x )	`173904` ( 1.0 )	`55524` ( 1.0 )	256	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`54660130` ( 1.0x )	`173916` ( 1.0 )	`55524` ( 1.0 )	512	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`54660126` ( 1.0x )	`173900` ( 1.0 )	`55524` ( 1.0 )	1024	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`54660130` ( 1.0x )	`173916` ( 1.0 )	`55524` ( 1.0 )	2048	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`54660129` ( 1.0x )	`173912` ( 1.0 )	`55524` ( 1.0 )	4096	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`27870986` ( 2.0x )	`181892` ( 1.046 )	`55524` ( 1.0 )	128	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`17603680` ( 3.1x )	`181900` ( 1.046 )	`55524` ( 1.0 )	256	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`12988170` ( 4.2x )	`181900` ( 1.046 )	`55524` ( 1.0 )	512	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`10736361` ( 5.1x )	`181896` ( 1.046 )	`55524` ( 1.0 )	1024	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`8769048` ( 6.2x )	`181904` ( 1.046 )	`55524` ( 1.0 )	2048	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`8235085` ( 6.6x )	`181904` ( 1.046 )	`55524` ( 1.0 )	4096	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`72706098` ( 0.8x )	`172916` ( 0.994 )	`55524` ( 1.0 )	128	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`72706101` ( 0.8x )	`172928` ( 0.994 )	`55524` ( 1.0 )	256	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`72706097` ( 0.8x )	`172912` ( 0.994 )	`55524` ( 1.0 )	512	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`72706101` ( 0.8x )	`172928` ( 0.994 )	`55524` ( 1.0 )	1024	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`72706097` ( 0.8x )	`172912` ( 0.994 )	`55524` ( 1.0 )	2048	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`72706096` ( 0.8x )	`172908` ( 0.994 )	`55524` ( 1.0 )	4096	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP

Anomaly Detection (`toycar`)

Cycles (Speedup)	Total ROM (rel.)	Total RAM (rel.)	VLEN	Layout	Kernels	Mode	Arch	Auto-Vectorization
`1643358` ( 1.0x )	`613196` ( 1.8 )	`5548` ( 1.168 )	0	NCHW	TVM	Fallback	RV32IM	-
`1643358` ( 1.0x )	`613196` ( 1.8 )	`5548` ( 1.168 )	0	NHWC	TVM	Fallback	RV32IM	-
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	128	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	256	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	512	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	1024	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	2048	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	4096	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	128	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	256	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	512	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	1024	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	2048	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1643360` ( 1.0x )	`613312` ( 1.8 )	`5548` ( 1.168 )	4096	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`1680491` ( Base )	`340676` ( Base )	`4748` ( Base )	0	NHWC	muRISCV-NN	Scalar	RV32IM	-
`1680491` ( 1.0x )	`340676` ( 1.0 )	`4748` ( 1.0 )	0	NHWC	muRISCV-NN	Vector (Portable)	RV32IM	-
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	128	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	256	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	512	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	1024	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	2048	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	4096	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`896519` ( 1.9x )	`343632` ( 1.009 )	`4748` ( 1.0 )	128	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`668799` ( 2.5x )	`343632` ( 1.009 )	`4748` ( 1.0 )	256	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`554939` ( 3.0x )	`343632` ( 1.009 )	`4748` ( 1.0 )	512	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`498525` ( 3.4x )	`343632` ( 1.009 )	`4748` ( 1.0 )	1024	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`494835` ( 3.4x )	`343632` ( 1.009 )	`4748` ( 1.0 )	2048	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`494620` ( 3.4x )	`343632` ( 1.009 )	`4748` ( 1.0 )	4096	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	128	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	256	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	512	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	1024	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	2048	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`1679544` ( 1.0x )	`340844` ( 1.0 )	`4748` ( 1.0 )	4096	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP

Visual Wake Words (`vww`)

Cycles (Speedup)	Total ROM (rel.)	Total RAM (rel.)	VLEN	Layout	Kernels	Mode	Arch	Auto-Vectorization
`41779597` ( 1.1x )	`653748` ( 1.781 )	`181032` ( 2.113 )	0	NCHW	TVM	Fallback	RV32IM	-
`60699273` ( 0.8x )	`566344` ( 1.543 )	`181032` ( 2.113 )	0	NHWC	TVM	Fallback	RV32IM	-
`41695560` ( 1.1x )	`634768` ( 1.729 )	`181032` ( 2.113 )	128	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`41695560` ( 1.1x )	`634768` ( 1.729 )	`181032` ( 2.113 )	256	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`41695560` ( 1.1x )	`634768` ( 1.729 )	`181032` ( 2.113 )	512	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`41695560` ( 1.1x )	`634768` ( 1.729 )	`181032` ( 2.113 )	1024	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`41695560` ( 1.1x )	`634768` ( 1.729 )	`181032` ( 2.113 )	2048	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`41695560` ( 1.1x )	`634768` ( 1.729 )	`181032` ( 2.113 )	4096	NCHW	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`60391213` ( 0.8x )	`568244` ( 1.548 )	`181032` ( 2.113 )	128	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`60391213` ( 0.8x )	`568244` ( 1.548 )	`181032` ( 2.113 )	256	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`60391213` ( 0.8x )	`568244` ( 1.548 )	`181032` ( 2.113 )	512	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`60391213` ( 0.8x )	`568244` ( 1.548 )	`181032` ( 2.113 )	1024	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`60391213` ( 0.8x )	`568244` ( 1.548 )	`181032` ( 2.113 )	2048	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`60391213` ( 0.8x )	`568244` ( 1.548 )	`181032` ( 2.113 )	4096	NHWC	TVM	Fallback	RV32IM_ZVE64X	Loop+SLP
`46457649` ( Base )	`367104` ( Base )	`85656` ( Base )	0	NHWC	muRISCV-NN	Scalar	RV32IM	-
`46026182` ( 1.0x )	`363032` ( 0.989 )	`85656` ( 1.0 )	0	NHWC	muRISCV-NN	Vector (Portable)	RV32IM	-
`46457653` ( 1.0x )	`367100` ( 1.0 )	`85656` ( 1.0 )	128	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`46457655` ( 1.0x )	`367108` ( 1.0 )	`85656` ( 1.0 )	256	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`46457658` ( 1.0x )	`367120` ( 1.0 )	`85656` ( 1.0 )	512	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`46457654` ( 1.0x )	`367104` ( 1.0 )	`85656` ( 1.0 )	1024	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`46457653` ( 1.0x )	`367100` ( 1.0 )	`85656` ( 1.0 )	2048	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`46457657` ( 1.0x )	`367116` ( 1.0 )	`85656` ( 1.0 )	4096	NHWC	muRISCV-NN	Scalar	RV32IM_ZVE64X	Loop+SLP
`23379450` ( 2.0x )	`369868` ( 1.008 )	`85656` ( 1.0 )	128	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`17463073` ( 2.7x )	`369880` ( 1.008 )	`85656` ( 1.0 )	256	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`15218759` ( 3.1x )	`369864` ( 1.008 )	`85656` ( 1.0 )	512	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`14190780` ( 3.3x )	`369872` ( 1.008 )	`85656` ( 1.0 )	1024	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`14108387` ( 3.3x )	`369864` ( 1.008 )	`85656` ( 1.0 )	2048	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`14111777` ( 3.3x )	`369868` ( 1.008 )	`85656` ( 1.0 )	4096	NHWC	muRISCV-NN	Vector	RV32IM_ZVE64X	-
`46026185` ( 1.0x )	`363024` ( 0.989 )	`85656` ( 1.0 )	128	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`46026185` ( 1.0x )	`363024` ( 0.989 )	`85656` ( 1.0 )	256	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`46026185` ( 1.0x )	`363024` ( 0.989 )	`85656` ( 1.0 )	512	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`46026182` ( 1.0x )	`363012` ( 0.989 )	`85656` ( 1.0 )	1024	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`46026184` ( 1.0x )	`363020` ( 0.989 )	`85656` ( 1.0 )	2048	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP
`46026182` ( 1.0x )	`363012` ( 0.989 )	`85656` ( 1.0 )	4096	NHWC	muRISCV-NN	Vector (Portable)	RV32IM_ZVE64X	Loop+SLP

Original data

Click here to download the raw files for this benchmark.

2024-11-26

TFLM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

TVM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

2024-11-21

TFLM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

TVM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

2024-11-19

TFLM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

TVM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

2024-11-18

TFLM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

TVM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

2024-07-12

TFLM

GCC

Os

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV64) (spike_rv64)

TVM

GCC

Os

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV64) (spike_rv64)

2024-06-29

TFLM

GCC

Os

SpikeRV32

LLVM

Os

SpikeRV32

TVM

GCC

Os

SpikeRV32

LLVM

Os

SpikeRV32

2024-03-02

TFLM

GCC

O3

SpikeRV32

Os

SpikeRV32

LLVM

O3

SpikeRV32

Os

SpikeRV32

TVM

GCC

O3

SpikeRV32

Os

SpikeRV32

LLVM

O3

SpikeRV32

Os

SpikeRV32

2024-02-26

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-23

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-22

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-20

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-11

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2023-12-22

TFLM

GCC

s

SpikeRV32

TVM

GCC

s

SpikeRV32

2024-11-26

TFLM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

TVM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

2024-11-21

TFLM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

TVM

GCC

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

LLVM

O3

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

Os

Spike (RV32) (spike_rv32)

Spike (RV32, Embedded) (spike_rv32_min)

Spike (RV64) (spike_rv64)

2024-11-19

TFLM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

TVM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

2024-11-18

TFLM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

TVM

GCC

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV32) (spike_rv32)

Spike (RV64) (spike_rv64)

2024-07-12

TFLM

GCC

Os

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV64) (spike_rv64)

TVM

GCC

Os

Spike (RV64) (spike_rv64)

LLVM

Os

Spike (RV64) (spike_rv64)

2024-06-29

TFLM

GCC

Os

SpikeRV32

LLVM

Os

SpikeRV32

TVM

GCC

Os

SpikeRV32

LLVM

Os

SpikeRV32

2024-03-02

TFLM

GCC

O3

SpikeRV32

Os

SpikeRV32

LLVM

O3

SpikeRV32

Os

SpikeRV32

TVM

GCC

O3

SpikeRV32

Os

SpikeRV32

LLVM

O3

SpikeRV32

Os

SpikeRV32

2024-02-26

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-23

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-22

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-20

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2024-02-11

TFLM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

TVM

GCC

s

SpikeRV32

LLVM

s

SpikeRV32

2023-12-22

TFLM

GCC

s

SpikeRV32

TVM

GCC

s

SpikeRV32

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Benchmarks 2024 11 21 TVM GCC O3 spike_rv32_min

Setup

Simulator

Toolchains

Models

Frameworks

Miscellaneous

Results (Framework: tvm, Backend: tvmaot, Toolchain: gcc, Flags: -O3, Target: spike_rv32_min )

Audio Wake Words (`aww`)

Image Classification (`resnet`)

Anomaly Detection (`toycar`)

Visual Wake Words (`vww`)

Original data

Clone this wiki locally

Benchmarks 2024 11 21 TVM GCC O3 spike_rv32_min

Setup

Simulator

Toolchains

Models

Frameworks

Miscellaneous

Results (Framework: tvm, Backend: tvmaot, Toolchain: gcc, Flags: -O3, Target: spike_rv32_min )

Audio Wake Words (aww)

Image Classification (resnet)

Anomaly Detection (toycar)

Visual Wake Words (vww)

Original data

Clone this wiki locally

Audio Wake Words (`aww`)

Image Classification (`resnet`)

Anomaly Detection (`toycar`)

Visual Wake Words (`vww`)