feat: Embed on-instance Whisper model for audio/mp4 transcribing #449
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
collector/processSingleFile/convert/asAudio.jsIt would be beneficial to add more detailed error handling and logging in the asAudio function. This would make it easier to debug issues and understand the flow of the function. try {
const transcriber = await whisper.client();
const audioData = await convertToWavAudioData(fullFilePath);
const { text: content } = await transcriber(audioData, {
chunk_length_s: 30,
stride_length_s: 5,
});
} catch (error) {
console.error(`Error while transcribing ${filename}: ${error.message}`);
trashFile(fullFilePath);
return { success: false, reason: `Error while transcribing ${filename}: ${error.message}` };
}Instead of reading the entire file into memory with fs.readFileSync, consider using a stream to read the file. This would reduce the memory footprint of the function and improve performance for large files. const readStream = fs.createReadStream(sourcePath);
let chunks = [];
for await (let chunk of readStream) {
chunks.push(chunk);
}
buffer = Buffer.concat(chunks);collector/utils/WhisperProviders/localWhisper.jsConsider adding comments to the LocalWhisper class to explain what it does and how it works. This would make the code easier to understand for other developers. // The LocalWhisper class is responsible for ...
class LocalWhisper {
constructor() {
// ...
}
// The client method is used to ...
async client() {
// ...
}
} |
Add cleanup of hotdir and tmp on collector boot to prevent hanging files split loading of model and file conversion into concurrency
cabwds
pushed a commit
to cabwds/anything-llm
that referenced
this pull request
Jul 3, 2025
…tplex-Labs#449) * feat: Embed on-instance Whisper model for audio/mp4 transcribing resolves Mintplex-Labs#329 * additional logging * add placeholder for tmp folder in collector storage Add cleanup of hotdir and tmp on collector boot to prevent hanging files split loading of model and file conversion into concurrency * update README * update model size * update supported filetypes
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
resolves #329