+

CN114554349B - Volume control method, device, multimedia playback device and readable storage medium - Google Patents

Volume control method, device, multimedia playback device and readable storage medium Download PDF

Info

Publication number
CN114554349B
CN114554349B CN202011297958.3A CN202011297958A CN114554349B CN 114554349 B CN114554349 B CN 114554349B CN 202011297958 A CN202011297958 A CN 202011297958A CN 114554349 B CN114554349 B CN 114554349B
Authority
CN
China
Prior art keywords
user
audio playing
volume control
playing device
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011297958.3A
Other languages
Chinese (zh)
Other versions
CN114554349A (en
Inventor
普罗申齐德·班纳吉
万加拉·纳文·雷迪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Oneplus Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oneplus Technology Shenzhen Co Ltd filed Critical Oneplus Technology Shenzhen Co Ltd
Priority to CN202011297958.3A priority Critical patent/CN114554349B/en
Publication of CN114554349A publication Critical patent/CN114554349A/en
Application granted granted Critical
Publication of CN114554349B publication Critical patent/CN114554349B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

本申请公开一种音频播放设备的音量控制方法、装置、多媒体播放设备、可读存储介质,可以降低针对某用户调整音量时对其他用户的影响,该音量控制方法包括:若检测到至少两个用户,获取各个用户与所述音频播放设备的距离,以及与所述各个用户对应的音量控制参数;根据所述各个用户与所述音频播放设备的距离和对应所述各个用户对应的各个音量控制参数,控制所述音频播放设备的音量。

The present application discloses a volume control method, device, multimedia playback device, and readable storage medium for an audio playback device, which can reduce the impact of adjusting the volume for a certain user on other users. The volume control method includes: if at least two users are detected, obtaining the distance between each user and the audio playback device and the volume control parameters corresponding to each user; and controlling the volume of the audio playback device according to the distance between each user and the audio playback device and the volume control parameters corresponding to each user.

Description

Volume control method, volume control device, multimedia playing equipment and readable storage medium
Technical Field
The application relates to the technical field of electronic equipment, in particular to a volume control method and device, multimedia playing equipment and a readable storage medium.
Background
Multimedia playback devices typically utilize audio playback devices, such as speakers, to play audio, and audio management is a challenge in scenarios where at least 2 users use the same multimedia playback device. Because different users choose different locations to listen to audio when using the same multimedia playing device, the user adjusts the audio volume according to their own preferences, but the volume adjusted for a certain user may affect the auditory experience of other users.
Disclosure of Invention
In order to solve the above problems, the present application provides an audio volume control method, an audio volume control device, a multimedia playing device, and a readable storage medium, which can reduce the influence on other users when adjusting the volume for a user.
In a first aspect, the present application provides an audio volume control method, the method comprising:
if at least two users are detected, the distance between each user and the audio playing equipment and the volume control parameter of each user to the audio playing equipment are obtained;
And controlling the audio playing equipment to adjust the volume according to the distance between each user and the audio playing equipment and the volume control parameter.
According to the volume control method, the volume of the audio playing device is adjusted according to the distance between each user and the audio playing device and the volume control parameter, each user can be considered, and the influence on the hearing feeling of other users when the volume is adjusted for a certain user is reduced.
In a second aspect, the present application proposes a volume control device comprising:
The volume control parameter and distance acquisition module is used for acquiring the distance between each user and the audio playing device and the volume control parameter of each user to the audio playing device if at least two users are detected;
And the volume control module is used for controlling the audio playing equipment to adjust the volume according to the distance between each user and the audio playing equipment and the volume control parameter.
In a third aspect, the present application proposes a multimedia playing device, comprising a memory, a processor, at least one audio playing device and at least one user positioning and identifying device, wherein the processor is respectively in communication connection with the memory, the audio playing device and the user positioning and identifying device, the audio playing device is used for playing audio of the multimedia playing device, and adjusting volume in response to control of the processor, and the user positioning and identifying device is used for identifying a user and detecting distance between the user and the audio playing device;
The memory stores a computer program which, when executed by the processor, causes the processor to perform the steps of the volume control method as described in any of the embodiments above.
In a fourth aspect, the present application proposes one or more non-volatile readable storage media storing computer readable instructions, characterized in that the computer readable instructions, when executed by one or more processors, cause the one or more processors to perform the steps of the method as described in any of the embodiments above.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of an application environment of a volume control method according to an embodiment of the application;
Fig. 2 is a flow chart of a volume control method according to an embodiment of the application;
fig. 3 is a flow chart of a volume control method according to another embodiment of the application;
FIG. 4 is a flow chart of a regression fit equation according to an embodiment of the present application;
FIG. 5 is a diagram illustrating input of user volume control parameters according to an embodiment of the present application;
FIG. 6 is a flowchart of an embodiment of the present application for updating audio setting information;
FIG. 7 is a schematic flow chart of constructing a pre-training model according to an embodiment of the present application;
fig. 8 is a flowchart illustrating a setting of a reference viewpoint of a multimedia presentation environment according to an embodiment of the present application;
Fig. 9 is a schematic structural diagram of a multimedia playing device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made in detail and with reference to the accompanying drawings, wherein it is apparent that the embodiments described are only some, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application. The various embodiments described below and their technical features can be combined with each other without conflict.
As described in the background, when the same multimedia playing device is used, different users can choose different positions to listen to the audio, and the users can adjust the audio volume according to their own preference for the audio volume, but the volume adjusted for a certain user may affect the auditory experience of other users.
Based on this, the embodiment of the application provides a volume control method of audio playing equipment, which can be applied to multimedia playing equipment and can reduce the influence on other users when adjusting the volume for a certain user.
Fig. 1 is a schematic view of an application environment of a volume control method of an audio playing device in one embodiment. As shown in fig. 1, the application environment includes a multimedia playing device 100, an audio playing device 200, a user locating and identifying device 300, and a user 400. The user locating and identifying device 300 is used for detecting the user 400 and the multimedia playing device 100 is used for controlling the volume of the audio playing device 200 according to the distance between the user and the audio playing device 200 according to the volume control method in any of the following embodiments. The multimedia playing device 100 may be an electronic device capable of playing audio, such as a television, a radio, a mobile phone, a tablet computer, a notebook computer, a palm computer, etc. The audio playback device 200 may be a loudspeaker device of the multimedia playback device 100. The user locating and identifying device 300 may comprise both a user identifying device and a distance detecting device or may be a device having both ranging and user identifying functions, such as a video camera.
Fig. 2 is a flow chart illustrating a volume control method of an audio playing device according to an embodiment of the present application. Referring to fig. 2, the volume control method of the audio playing device includes S10, if at least two users are detected, obtaining distances between each user and the audio playing device and volume control parameters corresponding to each user, and S11, controlling the volume of the audio playing device according to the distances between each user and the audio playing device and the volume control parameters corresponding to each user.
According to the volume control method, the volume of the audio playing device is adjusted according to the distance between each user and the audio playing device and the volume control parameter, each user can be considered, and the influence on the hearing feeling of other users when the volume is adjusted for a certain user is reduced.
Fig. 3 is a flow chart of a volume control method of an audio playing device according to another embodiment of the application. Referring to fig. 4, the volume control method of the audio playing device includes a step 102 of detecting a user. Step 104, it is determined whether the number of users is greater than zero. If at least two users are detected, steps 106 to 108 are performed. If a user is detected, steps 202 to 204 are performed. If no user is detected, the process returns to step 102. Step 106, obtaining the distance between each user and the audio playing device and the volume control parameter of each user to the audio playing device. And step 108, controlling the audio playing device to adjust the volume according to the distance between the user and the audio playing device and the volume control parameter.
The volume control parameter of each user on the audio playing device in the embodiment of the application can refer to the preset volume of each user on the audio playing device, and the preset volume can be the volume when the input user hearing sense is optimal. When different users have the same distance from the audio playing device, the preset volume may be different, for example, the preset volumes of the user a, the user B, and the user C on the audio playing device are respectively 70 db, 75 db, and 80 db. When the same user is at the same distance from the audio playing device, the preset sound volumes may be different, for example, the preset sound volumes when the user a is 1 meter, 2 meters and 3 meters of the audio playing device are respectively 70 db, 75 db and 80 db.
In particular implementations, embodiments of the present application generally detect users within a multimedia presentation environment. The multimedia presentation environment may be a range of areas that the multimedia playback device faces, for example, a room. The multimedia presentation environment may also be a sound coverage of audio played by the multimedia playing device, for example, in a range of 10 meters radius with a sound source as an origin.
In some embodiments, the audio playing devices are at least 2, and the method includes acquiring the distance between each user and the same audio playing device and each audio control parameter corresponding to each user if at least two users are detected and the audio playing device closest to each user is the same, and controlling the volume of the same audio playing device according to the distance between each user and the same audio playing device and each volume control parameter.
The step of controlling the volume of the same audio playing device according to the distance between each user and the same audio playing device and the volume control parameters further comprises the step of controlling the power supply of the same audio playing device nearest to each user to be in a working state, and the other audio playing devices to be in a closing state, so that the power consumption can be reduced, and the crosstalk of the other audio playing devices farther away to the nearest audio playing device can be reduced.
In other embodiments, if there is one audio playing device, the audio playing device closest to each user is the one audio playing device, the distance between each user and the same audio playing device and each audio control parameter corresponding to each user are obtained. And controlling the volume of the same audio playing device according to the distance between each user and the same audio playing device and the volume control parameters.
Specifically, the volume of the same audio playing device is controlled according to the distance between each user and the same audio playing device and the volume control parameters, and the volume is determined by the following formula:
Wherein V OUT is the adjusted volume control parameter, i is the number of users, di is the distance between each user and the audio playing device, vi is the volume control parameter corresponding to each user, and the volume control parameter corresponding to each user is related to the distance between the audio playing device. The distance is the weight of each volume control parameter, the more the distance is, the larger the corresponding volume control parameter weight is, but because the volume control parameters of the users close to the audio playing equipment are also configured with weights, the remote users and the close users are simultaneously considered when the volume is adjusted.
In the above formula, V OUT may be an adjusted audio control parameter obtained by performing a weighting operation on each audio control parameter, or may be an adjusted volume value obtained by performing a weighting operation on each volume value.
In some embodiments, the number of audio playing devices is at least 2, and if at least two users are detected and the audio playing devices closest to each user are different, and the distance between the users is greater than the preset distance, the volume adjustment of each closest audio playing device is controlled according to the volume control parameter of each user to each closest audio playing device. In these embodiments, if the audio playing devices closest to each user are different and the intervals between users are larger, the audio playing devices closest to each user can be controlled to adjust the volume according to the volume control parameter, and the volume of the audio playing device closest to a certain user has little influence on the hearing of other users.
In some embodiments, the audio playing devices are at least 2, and if a user is detected, the volume control method further includes step 202 of obtaining a distance between the user and each audio playing device, and obtaining a corresponding volume control parameter according to a distance between the user and a nearest audio playing device. And step 204, controlling the volume of the nearest audio playing device according to the volume control parameter. If the position of the user is detected to change, the audio playing device nearest to the user and/or the distance between the user and the nearest audio playing device may also change, and the corresponding volume control parameter changes accordingly, so that the volume can be adjusted along with the change of the position of the user. In order to reduce power consumption, specifically, when a user is detected, the power supply of the audio playing device nearest to the user is controlled to be in a working state, and the power supplies of other audio playing devices are controlled to be in a closing state.
In some embodiments, referring to fig. 3, if no user is detected, the process returns to step 102. In other embodiments, if no user is detected, the power supply of each audio playing device may be controlled to enter the off state. Specifically, if no user is detected and the user is still not detected or the audio playing device is detected to be in a closed playing state for a preset time, controlling the power supply of each audio playing device to enter the closed state, and ending the volume control method.
In some embodiments, as shown in fig. 4, the volume control method further establishes a regression fit equation of a distance-volume of each user in advance, and the step specifically includes step 302 of detecting different distances between each user and a corresponding audio playing device, and acquiring respective audio control parameters adapted to the different distances, which are input by the user. And step 304, performing regression fit according to the different distances and the audio control parameters corresponding to the distances to obtain a regression fit equation of the distances and the volume control parameters.
Through the steps, the volume control parameters of the users at different distances are tested, recorded and stored, so that a regression fit equation of the distance-volume of each user is obtained. Thus, the volume control parameter is related to the distance of the user from the audio playback device, and the volume control parameters for different distances are different. The volume control parameters may be different for different users, at the same distance. In particular, the volume control parameters of the user can be obtained according to the distance between the user and the audio playing device and the regression fit equation of the user. The audio playing device in this embodiment may refer to an audio playing device that each user corresponds to the closest audio playing device.
For example, as shown in fig. 5, when the user 610 and the audio playing device 620 are tested at different distances, the volume of the audio playing device 620 is adjusted, the user stops adjusting when hearing feeling is optimal at the corresponding distance, and the volume at this time is used as the volume control parameter of the user at the distance. And obtaining the relation between the different distances of the user aiming at the audio playing equipment and the corresponding volume control parameters, and carrying out regression fitting to obtain a regression fitting equation of the user aiming at the different distances of the audio playing equipment and the corresponding volume control parameters.
For the regression fit described in this embodiment, the method specifically may include connecting points on a plane using a smooth curve using a least squares method or the like based on each discrete distance data and a corresponding volume control parameter, where the fitted curve may be represented by a function that may be used as a "distance-volume" regression fit equation for the user. And when a user is detected later, extracting a 'distance-volume' regression fitting equation of the user, and inputting the distance between the user and the nearest audio playing equipment, so that the corresponding volume control parameters can be obtained.
Specifically, but not limited to, each volume control parameter input by the user through a remote control manner such as voice or a remote controller can be obtained. For example, when the user 610 is 5 meters away from the audio playing device 620, the user cannot directly contact the audio playing device, and the volume control parameter can be input by a remote control manner.
Specifically, as shown in fig. 5, the user location and identification device 630 may be utilized to identify the identity of the user, and the identity of the user and its regression fit equation may be stored in a processor or server of the multimedia playback device.
In some embodiments, as shown in fig. 6, the method further includes a step of updating audio setting information in advance, specifically including a step 402 of identifying an identity of a user, a step 404 of obtaining a distance between the user and an audio playing device, a step 406 of obtaining an audio device closest to the user, and updating audio setting information of the user, where the audio setting information includes user identity information, a distance, and a volume control parameter, the volume control parameter has a corresponding relationship with the user identity information and a distance between the volume control parameter and the audio playing device closest to the user, and the audio setting information may be stored in a memory or a server of the multimedia playing device. Step 408, detecting the location of the user, and if the location of the user is updated, returning to step 402 of identifying the identity of the user. The step of obtaining the volume control parameters comprises the steps of identifying the identity of the user when the user is detected, and obtaining the corresponding volume control parameters according to the identity verification information of the user and the distance between the user and the nearest audio playing equipment.
In step 406, after updating the user audio setting information, updating a regression fit equation of "distance-volume" of the user, where the regression fit equation of "distance-volume" of the user may reflect a correspondence between the distance of the user and the nearest audio playing device, and the step of obtaining the volume control parameter may first perform identity verification on the user, obtain the regression fit equation of the user according to the user identity verification information, and then obtain the corresponding volume control parameter according to the distance between the user and the audio playing device and the regression fit equation of the user.
In one embodiment, the step of identifying the identity of the user includes obtaining biometric information of the user and then identifying the identity of the user using a pre-trained model based on the biometric information. Specifically, the biometric data includes, but is not limited to, at least one of user gait data, face data.
Specifically, in one embodiment, as shown in FIG. 7, the step of using the pre-trained model to identify the identity of the user based on the biometric identification information includes the step 502 of calibrating the biometric data of the user. At step 504, positioning data is obtained from calibration data using the pre-training model, the positioning data comprising bounding box region data on a three-dimensional or two-dimensional user image contour. And step 506, extracting features of the positioning data by using the pre-training model. Step 508, inputting the feature extraction data into the pre-training model, using the pre-training model to classify the users into known users and unknown users, classifying the known users according to the identity information of the users, adding the known users to the sample if the known users are new users and the volume setting is needed, and removing the known users from the sample library if the known users are users not needed.
The calibration process may be a pre-processing of the biometric data of the sample user. The biological characteristic data can be user image data, in particular three-dimensional or two-dimensional user image data, and the preprocessing corresponds to preprocessing such as clipping, scaling, brightness adjustment and the like. By preprocessing, the image quality can be improved, and the user can be identified from the preprocessed image later. The bounding box region data may refer to contour data of the user image, and may specifically be three-dimensional or two-dimensional user image contour data, for example, data such as a user face contour, a five-sense organ contour, and the like.
The pre-training model can be a face detection and recognition model, and in the specific implementation process of recognizing the identity of the user, the face detection and recognition model is utilized to acquire the face positioning data of the user, then the feature extraction is carried out on the face positioning data of the user, the face features of the five sense organs and the like in the face image of the user can be extracted, then the face recognition is carried out, and the identity of the user is recognized.
In this embodiment, the data in the sample library and the pre-trained model may both be stored in a local processor in the server or in the multimedia playback device. The training process of the pre-training model and the identification process of identifying the identity of the user using the pre-training model may also be performed at the server or at a local processor of the multimedia playback device.
In some embodiments, referring to fig. 8, the volume control method further includes the following steps:
At step 602, scan data is obtained for individual user positioning and identification devices at different locations in a multimedia presentation environment. Step 604, merging the scanning data, and obtaining a three-dimensional space model of the multimedia presentation environment according to the merged scanning data. Step 606, the combined scan data is calibrated to the actual coverage of the multimedia presentation environment. Step 608, if the calibration is passed, updating the position of the multimedia playing device in the three-dimensional space model to be the reference viewpoint in the multimedia presentation environment. The step of obtaining the distance between the user and the audio playing device includes obtaining the positions of the user and the audio playing device relative to the reference viewpoint, and then calculating the distance between the user and the audio playing device. In other embodiments, the calibration in step 606 checks whether the scan data of the respective user location and identification device has been combined successfully, and also calibrates whether the relative positions of the respective audio playback device and the multimedia playback device are correct.
In particular, each user positioning and identification device may be a camera and the scan data may be image data. The user positioning and identifying devices are uniformly distributed at different positions in the multimedia presentation environment, which is beneficial to merging the scanning data of the devices. For example, the multimedia presentation environment is a room and the individual user positioning and identification devices may be evenly distributed on the walls and ceiling of the room.
If the scanning data are not image data, the merging mode can be image synthesis, namely, the images acquired by the user positioning and identifying equipment are synthesized into one image, and a three-dimensional space model is formed.
Specifically, after step 608, positioning information of each audio playing device and the user positioning and identifying device relative to the multimedia playing device may also be obtained, and serial number information may be configured for each audio playing device and the user positioning and identifying device. The distance between the audio playing device and the user can be calculated only by acquiring the positioning information of the user, so that the calculation time is saved.
In summary, according to the volume control method in the embodiment of the application, the volume of the audio playing device is adjusted according to the distance between each user and the audio playing device and the volume control parameter, so that each user can be considered, and the influence on the hearing feeling of other users when the volume is adjusted for a certain user is reduced.
It should be understood that, although the steps in the respective flowcharts of the audio control method in the embodiment of the present application are sequentially shown as indicated by arrows, the steps are not necessarily sequentially performed in the order indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor does the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of other steps or other steps.
The embodiment of the application also provides a volume control device, which comprises:
The volume control parameter and distance acquisition module is used for acquiring the distance between each user and the audio playing equipment and the volume control parameter corresponding to each user if at least two users are detected;
And the volume control module is used for controlling the volume of the audio playing device according to the distance between each user and the audio playing device and each volume control parameter corresponding to each user.
In one embodiment, the audio playing device is at least 2, and the volume control device further includes:
the first volume control parameter and distance acquisition module is used for acquiring the distance between each user and the same audio playing device and the audio control parameters corresponding to each user if at least two users are detected and if the audio playing devices closest to each user are detected to be the same;
And the first volume control module is used for controlling the volume of the same audio playing device according to the distance between each user and the same audio playing device and the volume control parameters.
In one embodiment, the first volume control module includes a weighted volume control module, configured to control the same audio playing device to adjust volume according to the following weighted volume control formula, according to the distance between each user and the audio playing device and the volume control parameter of each user to the audio playing device:
Wherein V OUT is the adjusted volume control parameter, i is the number of users, di is the distance between each user and the audio playing device, and Vi is the volume control parameter corresponding to each user.
In one embodiment, the first volume control module is specifically configured to control, if at least two users are detected and the audio playing devices closest to each user are different, and the distance between each user is greater than a preset distance, the volume of each closest audio playing device to be adjusted according to the volume control parameter of each user to each closest audio playing device.
In one embodiment, the volume control device includes a second volume control module, configured to, if a user is detected, obtain a distance between the user and each audio playing device, obtain a corresponding volume control parameter according to a distance between the user and a nearest audio playing device, and control the nearest audio playing device according to the volume control parameter to adjust a volume.
In one embodiment, the second volume control module includes a power control module, configured to control, if a user is detected, a power of an audio playing device nearest to the user to be in a working state, and control power of other audio playing devices to be in a turned-off state.
In one embodiment, the volume control device includes a third volume control module, configured to control, if the user is not detected, and the user is not detected or the audio playing devices are detected to be in a closed playing state within a preset duration, to control the power supply of the audio playing devices to enter the closed state.
In one embodiment, the volume control device further includes the following audio setting information pre-updating module, specifically including:
the user identity recognition module is used for recognizing the identity of the user;
The distance acquisition module is used for acquiring the distance between the user and the audio playing equipment;
The audio setting information updating module is used for acquiring audio equipment closest to the user and updating the audio setting information of the user, wherein the audio setting information comprises user identity information, distance and volume control parameters, and the volume control parameters have corresponding relations with the user identity information and the distance from the audio playing equipment closest to the user;
The user position detection module is used for detecting the position of the user, and if the position of the user is updated, the step of identifying the identity of the user is returned;
The volume control parameter acquisition module comprises a fourth volume control parameter acquisition module, and is used for identifying the identity of the user when the user is detected, and acquiring corresponding volume control parameters according to the identity verification information of the user and the distance between the user and the nearest audio playing equipment.
In one embodiment, the volume control device further includes a regression fit equation pre-establishment module for the following distance and volume control parameters, specifically including:
The volume control parameter input module is used for detecting different distances between a user and the audio playing equipment and acquiring various volume control parameters which are input in a remote control mode of the user and are suitable for different distances;
The regression fit equation acquisition module is used for carrying out regression fit according to different distances and volume control parameters corresponding to the distances to obtain a regression fit equation of the distances and the corresponding volume control parameters;
the obtaining of the volume control parameters includes a fifth volume control parameter obtaining module, configured to obtain the volume control parameters corresponding to each user according to the distance between each user and the corresponding audio playing device and the regression fit equation corresponding to each user.
In one embodiment, the user identification module comprises:
the biological characteristic data acquisition module is used for acquiring biological characteristic data of a user;
And the user identity recognition module is used for recognizing the identity of the user by utilizing a pre-training model according to the biological characteristic data.
In one embodiment, the volume control device includes the pre-training model construction module for identifying the user, specifically including:
the calibration module is used for acquiring the calibrated biological characteristic data of the user;
The positioning data acquisition module is used for acquiring positioning data from the calibration data by utilizing the pre-training model, wherein the positioning data comprises boundary box area data on the outline of the three-dimensional or two-dimensional user image;
the feature extraction module is used for carrying out feature extraction on the positioning data by utilizing the pre-training model;
The transfer learning and model fine tuning module is used for inputting the feature extraction data into a pre-training model for identifying a user to perform transfer learning and model fine tuning;
The classification module is used for classifying the users by using the pre-training model for identifying the users, classifying the users into known users and unknown users, classifying the known users according to the identity information of the users, adding the known users into a sample library if the known users are new users and the volume setting is needed, and removing the users from the sample library if the known users do not need to be volume set.
In one embodiment, the volume control device comprises,
The scanning data acquisition module is used for acquiring scanning data of each user positioning and identifying device at different positions in the multimedia presentation environment;
The three-dimensional space model acquisition module is used for merging all the scanning data and acquiring a three-dimensional space model of the multimedia presentation environment according to the merged scanning data;
The data calibration module is used for calibrating the combined scanning data and the sound coverage range of the multimedia presentation environment;
If the calibration is passed, updating the position of the multimedia playing device in the three-dimensional space model to be a reference viewpoint in the multimedia presentation environment;
The distance acquisition module comprises a fourth distance acquisition module which is used for acquiring the positions of the user and the audio playing device relative to the reference viewpoint and calculating the distance between the user and the audio playing device.
The division of the various modules in the volume control device is for illustration only, and in other embodiments, the volume control device may be divided into different modules as needed to perform all or part of the functions of the volume control device.
For specific limitations of the volume control device, reference may be made to the above limitations of the volume control method, and no further description is given here. The various modules in the volume control device described above may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
The implementation of each module in the volume control device provided in the embodiment of the present application may be in the form of a computer program. The computer program may run on a terminal or a server. Program modules of the computer program may be stored in the memory of the terminal or server. Which when executed by a processor, performs the steps of the method described in the embodiments of the application.
The embodiment of the application provides a multimedia playing device, which comprises a memory, a processor, at least one audio playing device and at least one user positioning and identifying device, wherein the processor is respectively in communication connection with the memory, the audio playing device and the user positioning and identifying device;
the memory has stored therein a computer program which, when executed by the processor, causes the processor to perform the steps of the volume control method as described in any of the embodiments above.
As shown in fig. 9, the processor may be a processor of the multimedia playing device body 710 or a processor of a server. The memory may be the memory of the multimedia playing device body 710 or the memory of a server. When the audio playing device is a processor of the server, the server sends the execution result to the processor of the multimedia playing device body, and the processor of the multimedia playing device relays and controls the audio playing device 720 to adjust the volume and the like.
The multimedia playing device body 710 may be an electronic device capable of playing audio, such as a television, a radio, a mobile phone, a tablet computer, a notebook computer, a palm computer, etc. The audio playback device may be a speaker. The audio playing device may be built in the multimedia playing device body, or may be independent of the multimedia playing device body as shown in fig. 9, and may be used as a sound amplifying device of the multimedia playing device body. When being independent of the multimedia playing device body, the audio playing device can establish wired communication connection or wireless communication connection with the multimedia playing device body, and the wireless mode can be Bluetooth or the like.
As shown in fig. 9, the multimedia playing device body 710 includes a processor, a memory, and a network interface connected through a system bus. Wherein the processor is configured to provide computing and control capabilities to support operation of the entire electronic device. The memory is used for storing data, programs and the like, and at least one computer program is stored on the memory and can be executed by the processor to realize the volume control method suitable for the multimedia playing device. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program is executable by a processor for implementing a volume control method provided by the above embodiments. The internal memory provides a cached operating environment for operating system computer programs in the non-volatile storage medium. The network interface may be an ethernet card or a wireless network card, etc. for communicating with an external electronic device, such as a server.
In some embodiments, one audio playing device 720 is correspondingly configured with at least one user positioning and identifying device 730, which is located at a distance from the audio playing device that is less than a preset value, and the scanning direction of the user positioning and identifying device may be consistent with the orientation of the audio playing device, e.g., both are oriented towards the user. In this way, the user locating and identifying device is convenient for detecting the user nearby the audio playing device.
The user positioning and identifying device 300 may include a user identifying device and a distance detecting device, or may be a device having both ranging and user identifying functions, such as a camera, capable of capturing images, and also capable of capturing depth information of a user, transmitting the information to a multimedia playing device body to identify the identity of the user, and calculating the distance between the user and the audio playing device. The user locating and recognition device 730 may be a built-in user locating and recognition device for a multimedia playing device, such as a built-in camera of a cell phone. Specifically, when the number of the user positioning and identifying devices 730 is plural, the user positioning and identifying device can be used as a sensor network to position and identify the user, and the positioning information and the identifying information can be sent to the multimedia playing device body.
In some embodiments, the multimedia playing device further includes a remote control device, configured to remotely control playing of the multimedia playing device body, and further configured to receive triggering of the user, and input volume control parameters, user identity information, and the like of the user in the multimedia playing device body.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform steps of a volume control method.
A computer program product comprising instructions that, when run on a computer, cause the computer to perform a volume control method.
Any reference to memory, storage, database, or other medium used in the present application may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (SYNCHLINK) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
The foregoing examples illustrate only a few embodiments of the application and are described in detail herein without thereby limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of protection of the present application is to be determined by the appended claims.

Claims (13)

1. A method for controlling the volume of an audio playback device, the method comprising:
if at least two users are detected, obtaining the distance between each user and the audio playing device and the volume control parameters corresponding to each user, wherein the number of the audio playing devices is at least 2;
If the audio playing device closest to each user is the same, controlling the volume of the audio playing device according to the distance between each user and the audio playing device closest to the user and each volume control parameter corresponding to each user, wherein the adjusted volume control parameter is obtained by weighting each volume control parameter corresponding to each user through the weight of each volume control parameter corresponding to each user, the adjusted volume control parameter is used for controlling the volume of the audio playing device, and the distance between the user and the audio playing device closest to the user is the weight of each volume control parameter corresponding to each user, and the further the distance is, the greater the weight of the volume control parameter is;
And if the audio playing devices closest to the users are different from each other and the distance between the users is larger than the preset distance, controlling the volume of the audio playing devices closest to the users according to the audio control parameters of the users on the audio playing devices closest to the users.
2. The method of claim 1, wherein the controlling the volume of the closest audio playback device based on the distance of the respective user from the closest audio playback device and the respective volume control parameter is determined by the following formula:
Wherein V OUT is the adjusted volume control parameter, i is the number of users, di is the distance between each user and the audio playing device, and Vi is the volume control parameter of the audio playing device corresponding to each user.
3. The method according to claim 1, wherein the number of audio playing devices is at least 2, and if a user is detected, the distance between the user and each audio playing device is obtained, a corresponding volume control parameter is obtained according to the distance between the user and the audio playing device closest to the user, and the volume of the audio playing device closest to the user is controlled according to the volume control parameter.
4. A method according to claim 3, wherein if a user is detected, the power supply of the audio playing device closest to the user is controlled to be in an active state, and the power supplies of the other audio playing devices are controlled to be in an off state.
5. A method according to claim 3, wherein if no user is detected and no user is detected or the audio playing devices are detected to be in the off playing state for a preset time, controlling the power supply of the audio playing devices to be in the off state.
6. The method according to claim 1, wherein the method further comprises:
Identifying the identity of the user;
Acquiring the distance between a user and the audio playing equipment;
acquiring audio equipment closest to the user, and updating audio setting information of the user, wherein the audio setting information comprises user identity information, a distance and a volume control parameter, and the volume control parameter has a corresponding relation with the user identity information and the distance from the audio playing equipment closest to the user;
Detecting the position of the user, and returning to the step of identifying the identity of the user if the position of the user is updated;
The step of obtaining the volume control parameters comprises the steps of identifying the identity of the user when the user is detected, and obtaining the corresponding volume control parameters according to the identity verification information of the user and the distance between the user and the nearest audio playing equipment.
7. The method of claim 1, further comprising the step of:
detecting different distances between each user and each corresponding audio playing device, and acquiring each audio control parameter which is input in a user remote control mode and is adaptive to the different distances;
performing regression fitting according to the different distances and the audio control parameters corresponding to the distances to obtain a regression fitting equation of the distances and the volume control parameters;
The obtaining the volume control parameters corresponding to the users comprises obtaining the volume control parameters corresponding to the users according to the distances between the users and the corresponding audio playing devices and the regression fit equation corresponding to the users.
8. The method of claim 6, wherein the step of identifying the identity of the user comprises:
Acquiring biological characteristic data of a user;
And identifying the identity of the user by utilizing a pre-training model according to the biological characteristic data.
9. The method of claim 8, wherein said identifying the identity of the user using the pre-trained model based on the biometric data comprises:
Calibrating biometric data of the user;
Obtaining positioning data from calibration data by using the pre-training model, wherein the positioning data comprises boundary box area data on a three-dimensional or two-dimensional user image contour;
extracting features of the positioning data by utilizing the pre-training model;
inputting the feature extraction data into the pre-training model, classifying the users by using the pre-training model, classifying the users into known users and unknown users, classifying the known users according to the identity information of the users, adding the known users into a sample library if the known users are new users and the volume setting is needed, and removing the known users from the sample library if the known users do not need to be volume set.
10. The method according to claim 1, characterized in that the method further comprises the steps of:
Acquiring scanning data of the user positioning and identifying devices at different positions in a multimedia presentation environment;
Merging the scanning data, and acquiring a three-dimensional space model of the multimedia presentation environment according to the merged scanning data;
calibrating the combined scan data to a sound coverage of the multimedia presentation environment;
If the calibration is passed, updating the position of the multimedia playing device in the three-dimensional space model to be a reference viewpoint in the multimedia presentation environment;
The step of obtaining the distance between each user and the audio playing device comprises the step of obtaining the positions of each user and the audio playing device relative to the reference viewpoint and calculating the distance between each user and the audio playing device.
11. A volume control device, comprising:
the system comprises an expected volume and distance acquisition module, a control module and a control module, wherein the expected volume and distance acquisition module is used for acquiring the distance between each user and audio playing equipment and volume control parameters corresponding to each user if at least two users are detected, and the number of the audio playing equipment is at least 2;
And the volume control module is used for controlling the volume of the audio playing device according to the distance between each user and the audio playing device closest to each user and the corresponding volume control parameter of each user if the audio playing device closest to each user is the same, wherein the volume control module is used for carrying out weighted operation on the corresponding volume control parameter of each user through the weight of the corresponding volume control parameter of each user to obtain an adjusted volume control parameter, the adjusted volume control parameter is used for controlling the volume of the audio playing device, the distance between the user and the audio playing device closest to each user is the weight of the corresponding volume control parameter of each user, the further the distance is, the greater the weight of the volume control parameter is, and the volume of the audio playing device closest to each user is controlled according to the audio control parameter of each user corresponding to each audio playing device closest to each user if the distance between the user is different from the audio playing device closest to each user and the distance between the users is greater than a preset distance.
12. A multimedia playing device, comprising a memory, a processor, at least one audio playing device and at least one user positioning and identifying device, wherein the processor is respectively in communication connection with the memory, the audio playing device and the user positioning and identifying device, the audio playing device is used for playing the audio of the multimedia playing device, the volume is adjusted in response to the control of the processor, and the user positioning and identifying device is used for identifying a user and detecting the distance between the user and the audio playing device;
The memory has stored therein a computer program which, when executed by the processor, causes the processor to perform the steps of the volume control method according to any one of claims 1 to 10.
13. A non-transitory readable storage medium storing one or more computer readable instructions which, when executed by one or more processors, cause the one or more processors to perform the steps of the method of any of claims 1 to 10.
CN202011297958.3A 2020-11-18 2020-11-18 Volume control method, device, multimedia playback device and readable storage medium Active CN114554349B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011297958.3A CN114554349B (en) 2020-11-18 2020-11-18 Volume control method, device, multimedia playback device and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011297958.3A CN114554349B (en) 2020-11-18 2020-11-18 Volume control method, device, multimedia playback device and readable storage medium

Publications (2)

Publication Number Publication Date
CN114554349A CN114554349A (en) 2022-05-27
CN114554349B true CN114554349B (en) 2024-12-10

Family

ID=81659985

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011297958.3A Active CN114554349B (en) 2020-11-18 2020-11-18 Volume control method, device, multimedia playback device and readable storage medium

Country Status (1)

Country Link
CN (1) CN114554349B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115361632A (en) * 2022-08-08 2022-11-18 深圳感臻智能股份有限公司 Method and device for intelligently adjusting volume

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618796A (en) * 2015-02-13 2015-05-13 京东方科技集团股份有限公司 Volume adjusting method and display equipment
CN110248021A (en) * 2019-05-10 2019-09-17 百度在线网络技术(北京)有限公司 A kind of smart machine method for controlling volume and system
CN111694433A (en) * 2020-06-11 2020-09-22 北京百度网讯科技有限公司 Voice interaction method and device, electronic equipment and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9047054B1 (en) * 2012-12-20 2015-06-02 Audible, Inc. User location-based management of content presentation
CN108429562B (en) * 2018-03-16 2020-03-06 英华达(上海)科技有限公司 Multimedia equipment playing control method and multimedia system
CN108513207B (en) * 2018-03-30 2019-08-09 百度在线网络技术(北京)有限公司 Speaker control method, device, equipment and computer-readable medium
CN110049404B (en) * 2019-04-23 2021-08-06 深圳慧安康科技有限公司 Intelligent device and volume control method thereof
CN111930336A (en) * 2020-07-29 2020-11-13 歌尔科技有限公司 Volume adjusting method and device of audio device and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104618796A (en) * 2015-02-13 2015-05-13 京东方科技集团股份有限公司 Volume adjusting method and display equipment
CN110248021A (en) * 2019-05-10 2019-09-17 百度在线网络技术(北京)有限公司 A kind of smart machine method for controlling volume and system
CN111694433A (en) * 2020-06-11 2020-09-22 北京百度网讯科技有限公司 Voice interaction method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN114554349A (en) 2022-05-27

Similar Documents

Publication Publication Date Title
US11172122B2 (en) User identification based on voice and face
US9514751B2 (en) Speech recognition device and the operation method thereof
CN108846340B (en) Face recognition method, device and classification model training method, device, storage medium and computer equipment
US9412361B1 (en) Configuring system operation using image data
JP6397158B1 (en) Collaborative audio processing
CN105426867A (en) Face identification verification method and apparatus
US11605179B2 (en) System for determining anatomical feature orientation
CN113269149B (en) Method and device for detecting living body face image, computer equipment and storage medium
EP3444809A1 (en) Personalized speech recognition method, and user terminal performing the method
CN111930336A (en) Volume adjusting method and device of audio device and storage medium
US9955253B1 (en) Systems and methods for directional loudspeaker control with facial detection
JP2018533051A (en) Collaborative audio processing
TWI711942B (en) Adjustment method of hearing auxiliary device
US11877124B2 (en) Systems and methods for hearing assessment and audio adjustment
WO2022082401A1 (en) Noseprint recognition method and apparatus for pet, computer device, and storage medium
CN111931617A (en) Human eye image recognition method and device based on image processing and self-service terminal
WO2022228432A1 (en) Machine learning based hearing assistance system
CN113823301A (en) Training method and device of voice enhancement model and voice enhancement method and device
KR20190119521A (en) Electronic apparatus and operation method thereof
CN114554349B (en) Volume control method, device, multimedia playback device and readable storage medium
CN110322893B (en) Voice data processing method and device, computer equipment and storage medium
JP2017120609A (en) Emotion estimation device, emotion estimation method and program
CN112559794A (en) Song quality identification method, device, equipment and storage medium
CN107450882B (en) Method and device for adjusting sound loudness and storage medium
CN110827834B (en) Voiceprint registration method, system and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20250205

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Country or region after: China

Address before: 518000 Room 201, building A, 1 front Bay Road, Shenzhen Qianhai cooperation zone, Shenzhen, Guangdong

Patentee before: ONEPLUS TECHNOLOGY (SHENZHEN) Co.,Ltd.

Country or region before: China

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载