Hello Pal,
As you said, dictionaries and classes would used to make an elegant and readable solution, but dict could make it heavy, depending on size of datasets, list could be a workaround in some cases, but that depends on the type of data to retrieve,
My plan is to extract the datasets to a json file, if new data arrives, get just the new chunk and proccess it, so the load phase should be "heavy" the first run only, then we can manipulate it as you want, even on web with a Flask solution,
What do you say?, contact me through chat to discuss further details,
Rafael Aguilar