Scaling quantum computers to reach sizes that are relevant for truly transformational applications is no easy task. Much like classical supercomputing consists of developing highly-parallelized infrastructure, achieving this ambitious goal with quantum is likely to require modularity and networking of many individual quantum processors. This requires innovation in quantum networking technology, hardware and software.