Use concrete SeriesBuffer<f64> when possible

[ferranbt]

No description provided.

[codspeed-hq]

Merging this PR will not alter performance

✅ 15 untouched benchmarks
⏩ 64 skipped benchmarks¹

---

_{Comparing use-f64-series (ad82218) with main (92a2e9c)}

Footnotes

1. 64 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩