within a report, Groq says its LPUs are scalable and may be joined with each other applying optical interconnect across 264 chips. It can additional be scaled using switches, but it's going to insert to latency. https://www.sincerefans.com/blog/groq-funding-and-products