Refactor numpy serializer #451

Job	Run time
Build Linux x86_64 wheel (3.9)	43s
Build Linux wheel (3.9, linux/arm64, aarch64-unknown-linux-gnu)	1m 13s
Build macOS universal wheel (3.9)	1s
Build Linux x86_64 wheel (3.10)	43s
Build Linux wheel (3.9, linux/arm/v7, armv7-unknown-linux-gnueabihf, --no-default-features)	1m 13s
Build macOS universal wheel (3.10)	25s
Build sdist	20s
Build Linux x86_64 wheel (3.11)	45s
Build Linux wheel (3.10, linux/arm64, aarch64-unknown-linux-gnu)	1m 14s
Build macOS universal wheel (3.11)	22s
Build Linux x86_64 wheel (3.12)	42s
Build Linux wheel (3.10, linux/arm/v7, armv7-unknown-linux-gnueabihf, --no-default-features)	1m 13s
Build macOS universal wheel (3.12)	24s
Build Linux x86_64 wheel (3.13)	43s
Build Linux wheel (3.11, linux/arm64, aarch64-unknown-linux-gnu)	1m 12s
Build macOS universal wheel (3.13)	24s
Build Windows wheel (3.9)	40s
Build Linux wheel (3.11, linux/arm/v7, armv7-unknown-linux-gnueabihf, --no-default-features)	1m 14s
Build Windows wheel (3.10)	56s
Build Linux wheel (3.12, linux/arm64, aarch64-unknown-linux-gnu)	1m 15s
Build Windows wheel (3.11)	45s
Build Linux wheel (3.12, linux/arm/v7, armv7-unknown-linux-gnueabihf, --no-default-features)	1m 14s
Build Windows wheel (3.12)	45s
Build Linux wheel (3.13, linux/arm64, aarch64-unknown-linux-gnu)	1m 13s
Build Windows wheel (3.13)	34s
Build Linux wheel (3.13, linux/arm/v7, armv7-unknown-linux-gnueabihf, --no-default-features)	1m 14s
Release	0s
	21m 27s

Provide feedback