Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In some situations, it may be desirable to load some models into memory during the Runtime startup, especially when the model is large and takes a long time to load. An example is when you have a runtime cluster and use auto scaling you don't want the first request to a fresh new server to take a lot of time, because the model is not yet loaded.

Since Blueriq 13.8, you can control which models get preloaded during Runtime startup with properties described in Model Preloading Properties.

Considerations

Preloading models will remove the load time from the first request, but the load time will be added to the Runtime startup, so runtime startup will take longer.

...