Running Prediction$filter(row_ids) filters the truth and response values, but doesn't filter the distributions when doing distributional regression. Looks like the distributions are just ignored in filter_prediction_data.PredictionDataRegr.