Really impressive speedups. Curious how much of the gain comes from the runtime optimizations vs the few-step distillation in real-world robotics workloads.
Runtime optimizations alone provide a 2–7× speedup with bitwise-exact outputs. SFew-step distillation provides another 4–5× speedup
ayy cool! i spoke to you at yc sus this year :)
ayyy was great to meet you :)
500 Code(3)
Error: Code(3)
Really impressive speedups. Curious how much of the gain comes from the runtime optimizations vs the few-step distillation in real-world robotics workloads.
Runtime optimizations alone provide a 2–7× speedup with bitwise-exact outputs. SFew-step distillation provides another 4–5× speedup
ayy cool! i spoke to you at yc sus this year :)
ayyy was great to meet you :)