List view

Replace d4rl by minari

blockedCan't be worked on for nowCan't be worked on for now

dependenciesPull requests that update a dependency filePull requests that update a dependency file

Status: Open.

#932 In thu-ml/tianshou;

· MischaPanch opened on Sep 6, 2023

Extend and fix reward/return normalizations

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

good first issueGood for newcomersGood for newcomers

Status: Open.

#927 In thu-ml/tianshou;

· MischaPanch opened on Aug 29, 2023

Comprehensive Functionality table update ?

discussionDiscussion of a typical issueDiscussion of a typical issue

documentation

Status: Open.

#924 In thu-ml/tianshou;

· yiwiz-sai opened on Aug 25, 2023

CI: wandb login fails in forks

build/test

Status: Open.

#923 In thu-ml/tianshou;

· MischaPanch opened on Aug 24, 2023

doubt in compute_nstep_return in policy

bugSomething isn't workingSomething isn't working

not reproduced yetNot yet tested or reproduced by a reviewerNot yet tested or reproduced by a reviewer

questionFurther information is requestedFurther information is requested

Status: Open.

#893 In thu-ml/tianshou;

· wobure123 opened on Jun 28, 2023

Need a flexible method to record training data in TensorBoard

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

good first issueGood for newcomersGood for newcomers

Status: Open.

#895 In thu-ml/tianshou;

· Xiong5Heng opened on Jun 29, 2023

Allow finding the corresponding episode from a sample in reply buffer

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

good first issueGood for newcomersGood for newcomers

RNNTemporary label to group all things RNNTemporary label to group all things RNN

Status: Open.

#881 In thu-ml/tianshou;

· Moirai7 opened on Jun 1, 2023

Extend and update benchmarking

build/test

Status: Open.

#935 In thu-ml/tianshou;

· MischaPanch opened on Sep 7, 2023

Docs and examples on how to report performance issues

documentation

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

Status: Open.

#936 In thu-ml/tianshou;

· MischaPanch opened on Sep 7, 2023

<code>compute_episodic_return</code> bug when <code>v_s=None</code>

performance issuesSlow execution or poor-quality resultsSlow execution or poor-quality results

refactoringNo change to functionalityNo change to functionality

RNNTemporary label to group all things RNNTemporary label to group all things RNN

Status: Open.

#886 In thu-ml/tianshou;

· spacegoing opened on Jun 8, 2023

Support episodes of different lengths and running times

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

Status: Open.

#946 In thu-ml/tianshou;

· whxru opened on Sep 21, 2023

Support for Loading Minari Datasets

dependenciesPull requests that update a dependency filePull requests that update a dependency file

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

Status: Open.

#956 In thu-ml/tianshou;

· ivanappliedai opened on Oct 2, 2023

Plotting more metrics for PPO

blockedCan't be worked on for nowCan't be worked on for now

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

Status: Open.

#842 In thu-ml/tianshou;

· arvganesh opened on Mar 31, 2023

Getting started example causes TypeError: object of type 'TimeLimit' has no len()

bugSomething isn't workingSomething isn't working

not reproduced yetNot yet tested or reproduced by a reviewerNot yet tested or reproduced by a reviewer

Status: Open.

#819 In thu-ml/tianshou;

· SorenSc opened on Mar 6, 2023

Remove symlinks in repo

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

minorRequires small changes to be fixedRequires small changes to be fixed

on holdWon't be worked on for now, but maybe laterWon't be worked on for now, but maybe later

Status: Open.

#944 In thu-ml/tianshou;

· opcode81 opened on Sep 20, 2023

Remove replayBuffer var done

minorRequires small changes to be fixedRequires small changes to be fixed

Status: Open.

#975 In thu-ml/tianshou;

· carlocagnetta opened on Oct 20, 2023

The agent_id should not be of type 'int' but a string such as "player_1".

minorRequires small changes to be fixedRequires small changes to be fixed

not reproduced yetNot yet tested or reproduced by a reviewerNot yet tested or reproduced by a reviewer

typingMainly improving types, no or very few functional changesMainly improving types, no or very few functional changes

Status: Open.

#971 In thu-ml/tianshou;

· wyz2368 opened on Oct 17, 2023

Clean up handling of output_dim

refactoringNo change to functionalityNo change to functionality

Status: Open.

#1024 In thu-ml/tianshou;

· opcode81 opened on Jan 16, 2024

Is it possible to customize the logger to record some specific parameters?

enhancementFeature that is not a new algorithm or an algorithm enhancementFeature that is not a new algorithm or an algorithm enhancement

minorRequires small changes to be fixedRequires small changes to be fixed

Status: Open.

#977 In thu-ml/tianshou;

· zichunxx opened on Oct 24, 2023

Clearer separation between the trainer and the algorithm and refactoring of policy classes

blockedCan't be worked on for nowCan't be worked on for now

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

majorLarge changes that cannot or should not be broken down into smaller onesLarge changes that cannot or should not be broken down into smaller ones

refactoringNo change to functionalityNo change to functionality

tentativeUp to discussion, may be dismissedUp to discussion, may be dismissed

Status: Open.

#1034 In thu-ml/tianshou;

· maxhuettenrauch opened on Jan 24, 2024

Rename state_shape to obs_shape

breaking changesChanges in public interfaces. Includes small changes or changes in keysChanges in public interfaces. Includes small changes or changes in keys

good first issueGood for newcomersGood for newcomers

minorRequires small changes to be fixedRequires small changes to be fixed

refactoringNo change to functionalityNo change to functionality

Status: Open.

#1036 In thu-ml/tianshou;

· MischaPanch opened on Jan 26, 2024

Revisit and maybe optimize Collectors

optimizationPerformance optimization (throughout, memory, processing speed)Performance optimization (throughout, memory, processing speed)

tentativeUp to discussion, may be dismissedUp to discussion, may be dismissed

Status: Open.

#1069 In thu-ml/tianshou;

· MischaPanch opened on Mar 4, 2024

Towards Roadmap

majorLarge changes that cannot or should not be broken down into smaller onesLarge changes that cannot or should not be broken down into smaller ones

Status: Open.

#1215 In thu-ml/tianshou;

· MischaPanch opened on Sep 8, 2024

Support custom scores for Trainer in high-level interfaces

high-level-apiMainly affects tianshou.highlevelMainly affects tianshou.highlevel

Status: Open.

#1205 In thu-ml/tianshou;

· MischaPanch opened on Aug 14, 2024

MPO Implementation

new algorithmAdding a new RL algorithmAdding a new RL algorithm

Status: Open.

#1165 In thu-ml/tianshou;

· ziqiao30 opened on Jul 4, 2024