List view

Method to compute actions from observations

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

Status: Merged (completed).

thu-ml/tianshounumber 991

#991 In thu-ml/tianshou;

· by MischaPanch was closed on Nov 16, 2023

Inconsistent <code>__iter__</code> in batch

Batch and BufferImprovements in internal data structures, temporary labelImprovements in internal data structures, temporary label

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#922 In thu-ml/tianshou;

· by MischaPanch was closed on Apr 12, 2024

Create high level interfaces for config and experiments

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

good first issueGood for newcomersGood for newcomers

majorLarge changes that cannot or should not be broken down into smaller onesLarge changes that cannot or should not be broken down into smaller ones

Status: Closed (completed).

#938 In thu-ml/tianshou;

· by MischaPanch was closed on Sep 8, 2024

Turn tutorials into notebooks that are then executed in CI

build/test

Status: Closed (completed).

#916 In thu-ml/tianshou;

· by MischaPanch was closed on Dec 6, 2023

Make tests and examples pass mypy

good first issueGood for newcomersGood for newcomers

refactoringNo change to functionalityNo change to functionality

typingMainly improving types, no or very few functional changesMainly improving types, no or very few functional changes

Status: Closed (completed).

#952 In thu-ml/tianshou;

· by MischaPanch was closed on Apr 3, 2024

Better default for batch_size in examples

minorRequires small changes to be fixedRequires small changes to be fixed

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#986 In thu-ml/tianshou;

· by MischaPanch was closed on Nov 24, 2023

Use nbqa on notebooks

documentation

minorRequires small changes to be fixedRequires small changes to be fixed

typingMainly improving types, no or very few functional changesMainly improving types, no or very few functional changes

Status: Closed (completed).

#1004 In thu-ml/tianshou;

· by MischaPanch was closed on Feb 7, 2024

Rename logits to <code>model_output</code>

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

minorRequires small changes to be fixedRequires small changes to be fixed

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#917 In thu-ml/tianshou;

· by MischaPanch was closed on Apr 1, 2024

some problem about the render in examples/inverse/irl_gail.py

documentation

Status: Closed (completed).

#928 In thu-ml/tianshou;

· by lzl60109 was closed on Sep 26, 2023

Roadmap towards 1.0.0 Release

Status: Closed (completed).

#929 In thu-ml/tianshou;

· by MischaPanch was closed on Mar 20, 2024

Remove kwargs in policies init

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#947 In thu-ml/tianshou;

· by MischaPanch was closed on Oct 8, 2023

Cover tests, notebooks and examples by mypy

build/test

Status: Closed (completed).

#934 In thu-ml/tianshou;

· by MischaPanch was closed on Jan 24, 2024

Replace dicts by dataclasses in methods that return info

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

good first issueGood for newcomersGood for newcomers

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#933 In thu-ml/tianshou;

· by MischaPanch was closed on Dec 30, 2023

Fix: ReplayBuffer.prev(self, index) does not allow list of indexes as input

bugSomething isn't workingSomething isn't working

minorRequires small changes to be fixedRequires small changes to be fixed

Status: Closed (completed).

#974 In thu-ml/tianshou;

· by carlocagnetta was closed on Jan 17, 2024

Bug in BCQ discrete algorithm.

bugSomething isn't workingSomething isn't working

minorRequires small changes to be fixedRequires small changes to be fixed

Status: Closed (completed).

#963 In thu-ml/tianshou;

· by ivanappliedai was closed on Nov 24, 2023

Don't pass optimizers to policies

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

refactoringNo change to functionalityNo change to functionality

tentativeUp to discussion, may be dismissedUp to discussion, may be dismissed

Status: Closed (completed).

#959 In thu-ml/tianshou;

· by MischaPanch was closed on Jul 15, 2025

Basepolicy requires replay buffer restricting modularity.

discussionDiscussion of a typical issueDiscussion of a typical issue

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#898 In thu-ml/tianshou;

· by llewynS was closed on Jul 15, 2025

Change all signatures for policy.process_fn and policy.post_process_fn from BatchProtocol to RolloutBatchProtocol

minorRequires small changes to be fixedRequires small changes to be fixed

typingMainly improving types, no or very few functional changesMainly improving types, no or very few functional changes

Status: Closed (completed).

#919 In thu-ml/tianshou;

· by MischaPanch was closed on Jul 15, 2025

Remove kwargs in learn and update

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

majorLarge changes that cannot or should not be broken down into smaller onesLarge changes that cannot or should not be broken down into smaller ones

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#949 In thu-ml/tianshou;

· by MischaPanch was closed on Jul 15, 2025

Remove kwargs in policies' forward

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

majorLarge changes that cannot or should not be broken down into smaller onesLarge changes that cannot or should not be broken down into smaller ones

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#948 In thu-ml/tianshou;

· by MischaPanch was closed on Jul 15, 2025

Refactoring: make Trainer more flexible

refactoringNo change to functionalityNo change to functionality

Status: Closed (completed).

#1204 In thu-ml/tianshou;

· by MischaPanch was closed on Jul 15, 2025

"test_reward" KeyError in epoch_stat["test_reward"] when saving checkpint through trainer information

bugSomething isn't workingSomething isn't working

not reproduced yetNot yet tested or reproduced by a reviewerNot yet tested or reproduced by a reviewer

Status: Closed (completed).

#913 In thu-ml/tianshou;

· by 127161782 was closed on Jul 15, 2025

Fix handling of torch "device" association

bugSomething isn't workingSomething isn't working

good first issueGood for newcomersGood for newcomers

Status: Closed (completed).

#810 In thu-ml/tianshou;

· by jamartinh was closed on Jul 15, 2025