Multi Model Server is a tool for serving neural net models for inference
pip install multi-model-server