
Easy cluster parallelization with ZeroMQ
TL;DR: I design short wrapper scripts to send batch jobs to a cluster. The first architecture (ventilator-worker-sink) is suboptimal, therefore I consider another pattern to dispatch the jobs efficiently. Recently I had to make a big chunk of computations…