The most important part is a difference between "forzen" and "best effort" attempts where we allow the model to specialize on the task as it goes through the evaluation dataset. Clearly showcasing the power of continual learning regime simply unavailable for any other typical LLM. Full code of the project, weights and more information about it avialable in the repo: https://github.com/volotat/mini-AGI   submitted by   /u/Another__one [link]   [comments]