When I wrote my last post, I was not aware of research avenues that link Neural Networks (specially, the "deep" ones) to "iterative" algorithms used in signal and image processing.
I just found by chance the following paper by Prof. Vishal Monga, Yuelong Li and Prof. Yonina Eldar:
1) "Algorithm Unrolling: Interpretable, Efficient Deep Learning for Signal and Image Processing"
Vishal Monga, Yuelong Li, Yonina C. Eldar
https://arxiv.org/abs/1912.10557
Good news when I read the word "interpretable" close to the words "Neural Networks"...
