/
DS7: Where do I store predictions?

DS7: Where do I store predictions?

The storage of inference or of predictions is very often coming up in our discussion with data scientists who wish to make a model widely accessible in the organization or who want to monitor the performance of the model at scale.

 

  • Predictions are data and any solution in place to store predictions should follow the key FAIR principles

  • There two ‘extreme’ approaches that can be taken to store predictions for ML models deployed in an organization

    • Have a centralized store where predictions generated by ML models are stored and made available to other products or applications

    • A distributed storage of the predictions in different expert systems that are adding value to key business activities (similar to a data mesh approach)

  • It is important to think about the metadata associated with each prediction (date, model id and version used to generate them…etc). This can be particularly critical for cases where a full traceability is required for regulatory purposes

  • As for every modern data or software solutions, Identity and Access Management are important considerations when storing predictions

  • Performance of the systems are also very critical to make sure that data can be moved at scale

Related content

MS1: How should I manage data?
MS1: How should I manage data?
More like this
MS3: How do I make sure the model produces sensible answers?
MS3: How do I make sure the model produces sensible answers?
More like this
A2: How should I manage the data?
A2: How should I manage the data?
More like this
Points Made by the Pistoia Alliance Panel in the Discussion on April 5th 2023
Points Made by the Pistoia Alliance Panel in the Discussion on April 5th 2023
More like this
DS6: How should I acquire and manage data?
DS6: How should I acquire and manage data?
More like this
Boston 2019 Summary and Materials
Boston 2019 Summary and Materials
More like this