Hi, I have experience in dockerizing GPU applications on Ubuntu 18.04 LTS. To answer your question:
1. To be able to use GPU inside docker containers, nvidia-docker-tookit will be used, some information is needed from your side before we can further decide what library can be used.
a. What are the model used in your system, if is it a tensorflow model, we can use the tensorflow-serving to serve the model to your application code.
b. if it is some CPU codes, they might need to be re-written into cuda/tensorflow code before able to be executed on GPU.
2. Need more information before I can make a better estimation.
3. Need more information before I can make a better estimation.
Hopefully I have the opportunity to work with you on this project. Thank you.