Description

Pipeline the computing tasks to make full use of computing resources.
The limit number of concurrent encoding sessions for GTX 1650 is 3, which will make sure the VRAM security even sometimes the render task will be slower than the whisper asr.

Using pipeline can save at least 25% time. (The whisper rate is around 5x, while the render rate is 13x)

Related Issues

fix #110

Changes Proposed

• add pipeline mode.

Who Can Review?

@timerring

Checklist

• Code has been reviewed
• Code complies with the project's code standards and best practices
• Code has passed all tests
• Code does not affect the normal use of existing features
• Code has been commented properly
• Documentation has been updated (if applicable)
• Demo/checkpoint has been attached (if applicable)