Cool! You might like our paper/demo on ray-tracing 1 TB-geometry scenes using thousands of AWS Lambda workers spun up just for the job: https://r2e2.dev/
This is really neat! Especially the global illumination that passes ray data between nodes, much fancier than what we've done here. You could imagine each component as an actor that receives messages via async channels (though perhaps it's more deterministic than that?).
I think bursting on serverless for massively parallelizable problems is a really interesting use-case. We were partially inspired for this demo by one of our users doing energy simulations at massive scale, who built a library called Scythe for this purpose: https://github.com/szvsw/scythe
I love Hatchet! A serverless render farm is such a silly idea, results coming in felt really cool though, I'd love to see this scaled up to frames of an animation.
Unfortunately GPUs are also expensive. This is more so an exploration of the idea--there's a lot more performance that could be squeezed out of the actual rendering itself. Hatchet does let you use serverless operators with essentially anything that can serve two REST endpoints, though, so modifying this to use GPUs to render would be relatively trivial.
Cool! You might like our paper/demo on ray-tracing 1 TB-geometry scenes using thousands of AWS Lambda workers spun up just for the job: https://r2e2.dev/
This was led by my former PhD student Sadjad Fouladi who did a lot of creative work involving swarms of short-lived serverless functions for video encoding and distributed LLM inference (https://www.usenix.org/conference/nsdi17/technical-sessions/...) and software compilation (https://github.com/stanfordsnr/gg).
(I work on Hatchet)
This is really neat! Especially the global illumination that passes ray data between nodes, much fancier than what we've done here. You could imagine each component as an actor that receives messages via async channels (though perhaps it's more deterministic than that?).
I think bursting on serverless for massively parallelizable problems is a really interesting use-case. We were partially inspired for this demo by one of our users doing energy simulations at massive scale, who built a library called Scythe for this purpose: https://github.com/szvsw/scythe
Some more resources on signed distance fields (SDFs), which I didn't know about until this demo:
- https://iquilezles.org/articles/distfunctions/
- The 2D version: https://iquilezles.org/articles/distfunctions2d/ (discussed here: https://news.ycombinator.com/item?id=46380054)
- How Zed uses (used?) SDFs to render their editor: https://zed.dev/blog/videogame (discussed at the time: https://news.ycombinator.com/item?id=35078464)
I love Hatchet! A serverless render farm is such a silly idea, results coming in felt really cool though, I'd love to see this scaled up to frames of an animation.
Some much needed innovation! Well done, old boy.
Isn't exposing something like this to the web asking for huge cloudflare bills?
Yes, we have a lot of various infra credits that we are using to serve this. Cloudflare workers are pretty cheap, though.
Does it pass the pelican on a bicycle test?
I'm not sure if "pass" is the right word, but it does _something_: https://imgur.com/a/WSYUh89
Yeah.. Or you could just use a gpu?
Unfortunately GPUs are also expensive. This is more so an exploration of the idea--there's a lot more performance that could be squeezed out of the actual rendering itself. Hatchet does let you use serverless operators with essentially anything that can serve two REST endpoints, though, so modifying this to use GPUs to render would be relatively trivial.