Online usage of deep learning methods

Hi @sreck @dguderian and @tgal,

I wanted to ask you if deep learning algorithms such as GNNs and CNNs developed in OrcaNet are able to directly work online. For online I mean event by event.

Specifically, up to know we have this scheme:

offline file -> h5extractor -> h5_file -> OrcaSong -> h5_file with nodes/bins etc -> OrcaNet -> h5_file with scores included

so my question is, suppose that now we have:

online event packet -> ?

how could this scheme continue? Maybe it is very straightforward to make it work but I would like to understand if you have an idea on how this could work.