Loading e.g. a Task that was generated with an old mlr3-version using readRDS() will give errors like this: mb706/autoxgboost3#2 (comment) . Maybe there is a way to make these kinds of errors more obvious to the user.