WO2018133569A1 - Neuron information processing method and system having deep time windowing - Google Patents

Abstract

A neuron information processing method and system having deep time windowing. The method comprises: receiving front-end pulse neuron output information, wherein the front-end pulse neuron output information comprises pulse tip information output by a front-end pulse neuron (S100); reading first current pulse neuron information, the first current pulse neuron information comprising a pulse tip information historical sequence in the current time window (S200); acquiring a pulse tip information updated sequence in the current time window according to the pulse tip information output by the front-end pulse neuron and the pulse tip information historical sequence in the current time window (S300); determining second current pulse neuron information according to the pulse tip information updated sequence in the current time window (S400); calculating the current pulse neuron output information according to the front-end pulse neuron information and the second current pulse neuron information (S500); and outputting the current pulse neuron output information (S600). The method breaks through the restriction of only adjacent time steps being interrelated, can flexibly set historical activity information to cache a larger time depth according to requirements, and is closer to a biological neuron in the aspect of the time domain depth effect.

Description

Neuron information processing method and system with deep time windowing

Related application

The present application claims priority to Chinese Patent Application No. JP-A No. No. No. No. No. No. No. No. No. No .

Technical field

The present invention relates to the field of artificial neural network technology, and in particular to a neuron information processing method and system with deep time windowing.

Background technique

Most of today's artificial neural network research is still implemented in von Neumann computer software and with the high-performance GPGPU (General Purpose Graphic Processing Units) platform, the hardware overhead, energy consumption and information of the whole process. Processing speed is not optimistic. To this end, in recent years, the field of neuromorphic computing has developed rapidly, that is, the use of hardware circuits to directly construct neural networks to simulate the function of the brain, trying to achieve a massively parallel, low-energy, computing platform that can support complex mode learning.

However, in the traditional pulse neuron information processing method, the output information of the current pulsed neuron can only affect the pulse neurons connected to the back end in the next time step, ignoring the time domain depth effect between the biological neurons.

Summary of the invention

Based on this, it is necessary to analyze the output information of the current pulsed neurons only in the next time step to the pulse neurons connected to the back end, ignoring the problem of the time domain depth effect between biological neurons, providing a depth time A windowed neuron information processing method and system, wherein the method comprises:

Receiving front end pulse neuron output information, the front end pulse neuron output information including pulse tip information output by the front end pulse neuron;

Reading first current pulse neuron information, the first current pulse neuron information including a pulse tip information history sequence in a current time window;

Obtaining, according to the pulse tip information outputted by the front-end pulse neuron, and the pulse-tip information history sequence in the current time window, acquiring a pulse tip information update sequence in the current time window according to the pulse tip information update sequence in the current time window, and determining Second current pulsed neuron information;

Calculating current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information;

Outputting the current pulse neuron output information.

In one embodiment, the pulse sequence information history sequence in the current time window includes: a sequence consisting of output information of each front-end pulse neuron received by N time steps before the current time step, stored in time step order, The pulse tip information of the first time step in the history sequence of the pulse tip information in the current time window is the front end pulse neuron output information received at the first time step before the current time step, the current time window The pulse tip information of the Nth time step in the history sequence of the internal pulse tip information is the front end pulse neuron output information received at the Nth time step before the current time step, where N is a natural number;

And acquiring, according to the front-end pulse neuron output information, and the pulse-tip information history sequence in the current time window, the pulse tip information update sequence in the current time window, including:

Deleting the pulse tip information of the Nth time step in the pulse tip information history sequence in the current time window, and changing the pulse tip information of the first time step to the N-1th time step to the second Pulse tip information from time step to Nth time step;

Setting the front-end pulse neuron output information received by the current time step as pulse tip information of the first time step in the pulse tip information history sequence in the current time window;

The pulsed tip information of the updated first time step to the Nth time step constitutes a pulse tip information update sequence in the current time window.

In one embodiment, the front-end pulse neuron outputs information, and further includes: a connection weight index of the front-end neuron and the current neuron;

The current pulsed neuron information further includes: a current time window width, historical membrane potential information, and membrane potential leakage information;

The calculating, according to the front-end pulse neuron information and the second current pulse neuron information, the current pulse neuron output information, including:

Reading a connection weight of the front-end neuron and the current neuron according to the connection weight index of the front-end neuron and the current neuron;

And calculating, according to the current time window width, the pulse tip information update sequence in the current time window, the front end pulse neuron input information by using an attenuation function;

Calculating the current pulsed nerve by using a pulse neuron calculation model according to the front end pulse neuron input information, the connection weight of the front end pulse neuron and the current pulse neuron, the historical membrane potential information, and the membrane potential leakage information Meta output information.

In one embodiment, after the step of calculating current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information, the current pulse nerve is output at the Before the step of outputting information, the method further includes:

Obtaining a threshold potential;

Comparing the current pulsed neuron output information with the threshold potential, and determining the issuance triggering flag information according to the comparison result, where the issuing triggering flag information includes: issuing a trigger or issuing a non-trigger; and when the issuing triggering flag information is issued When triggered,

The refractory period timer is reset, and the historical membrane potential information is updated to a preset reset membrane potential information.

In one embodiment, the method further includes:

When the issue trigger flag information is not triggered by the issue, the current time step of the refractory period width and the refractory period timer is read;

Determining whether the current time is within the refractory period according to the refractory period width and the current time step of the refractory period timer, and if the current time is within the refractory period, accumulating the refractory period timer Timing a time step without updating the historical membrane potential information;

If the current time is not within the due period, the refractory period timer is cumulatively counted for one time step, and the historical membrane potential information is updated to be the current pulsed neuron output information.

In one embodiment, the obtaining a threshold potential includes:

Reading a random threshold mask potential, a threshold offset, and a random threshold;

Performing a bitwise AND operation on the random threshold and the random threshold mask potential to obtain a threshold random superposition amount;

The threshold potential is determined based on the threshold random amount and the threshold offset.

In one embodiment, the outputting the current pulse neuron output information comprises:

Reading an issue enable identifier, where the issue enable identifier includes allowing data to be issued or not allowing data to be issued; when the issue enable identifier is allowed to issue data,

Reading the issue trigger flag information, when the issue trigger flag information is an issue trigger;

Outputting the current pulse neuron output information.

The neuron information processing method with deep time windowing provided by the present invention obtains the pulse tip information update sequence in the current time window according to the front end pulse neuron output information and the current tip window pulse tip information history sequence, and is used for current The output information of the pulsed neurons is calculated such that the output information of the current pulsed neuron is correlated with the pulse tip information history sequence in the current time window and the front-end pulse neuron output information received at the current time step. Breaking through the limitation that only the front and back time steps are related to each other, the historical activity information of the cached larger time depth can be flexibly set according to the need, and the biological neuron is closer to the depth effect in the time domain.

In one embodiment, the front-end pulse neuron output information received in the first N time steps is stored according to the time step sequence, and the information sequence in the historical sequence is sequenced after receiving the front-end pulse neuron output information of the current time step. Move one bit backward, fill the pulse information received by the current time step into the first place, and obtain the updated pulse tip information sequence for the calculation of the current pulse neuron output information. Slide according to time, history pulse tip information and current time step The combination of the pulse tip information enables the output information of the received front-end pulse neurons to be flexibly set according to the required time depth, and the sliding method according to the chronological order is more in line with the biological neuron time depth effect.

In one of these embodiments, the threshold potential is determined by reading a random threshold mask potential and a threshold bias and receiving a configuration value given by a configuration register such that the neuron issues pulse tip information with a probability of randomness.

In one embodiment, the current pulse neuron output information is determined by setting the release enable identifier and the issue trigger flag, so that the output of the pulse neuron is more controllable, and the release enable flag can be configured with neurons that are not configured. It is allowed to issue data, but only as an intermediate auxiliary computing neuron, which is necessary for some functions that require multiple neurons to work together.

The invention also provides a neuron information processing system with deep time windowing, comprising:

a front-end pulse neuron output information receiving module, configured to receive front-end pulse neuron output information, where the front-end pulse neuron output information includes pulse tip information output by the front-end pulse neuron;

a first current pulse neuron information reading module, configured to read first current pulse neuron information, where the first current pulse neuron information includes a pulse tip information history sequence in a current time window;

a current time window in-time pulse tip information update sequence acquisition module, configured to acquire a pulse tip information update sequence in a current time window according to pulse tip information output by the front end pulse neuron and a pulse tip information history sequence in the current time window ;

a second current pulse neuron information determining module, configured to determine second current pulse neuron information according to the current time window intrapulse information update sequence;

The current pulse neuron output information calculation module is configured to calculate current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information;

The current pulse neuron output information output module is configured to output the current pulse neuron output information.

In one embodiment, the pulse sequence information history sequence in the current time window includes: a sequence consisting of output information of each front-end pulse neuron received by N time steps before the current time step, stored in time step order, The pulse tip information of the first time step in the history sequence of the pulse tip information in the current time window is the front end pulse neuron output information received at the first time step before the current time step, the current time window The pulse tip information of the Nth time step in the history sequence of the internal pulse tip information is the front end pulse neuron output information received at the Nth time step before the current time step, where N is a natural number;

Then, the pulse tip information update sequence acquisition module in the current time window is used to:

Deleting the pulse tip information of the Nth time step in the pulse tip information history sequence in the current time window, and changing the pulse tip information of the first time step to the N-1th time step to the second Pulse tip information from time step to Nth time step;

Setting the front end pulse neuron output information received at the current time step as a pulse tip in the current time window Pulse tip information of the first time step in the sequence of information history;

The pulsed tip information of the updated first time step to the Nth time step constitutes a pulse tip information update sequence in the current time window.

In one embodiment, the front-end pulse neuron outputs information, and further includes: a connection weight index of the front-end neuron and the current neuron;

The current pulsed neuron information further includes: a current time window width, historical membrane potential information, and membrane potential leakage information;

The current pulse neuron output information calculation module includes:

a pulsed neuron connection weight reading unit, configured to read a connection weight of the front end neuron and the current neuron according to a connection weight index of the front end neuron and the current neuron;

a front-end pulse neuron input information calculation unit, configured to calculate front-end pulse neuron input information by using an attenuation function according to the current time window width, the pulse tip information update sequence in the current time window;

a current pulse neuron output information calculation unit, configured to input, according to the front end pulse neuron input information, a connection weight of the front end pulse neuron and a current pulse neuron, the historical membrane potential information, and the membrane potential leakage information, The current pulsed neuron output information is calculated by a pulsed neuron calculation model.

In one embodiment, the method further includes:

a threshold potential acquisition module, configured to acquire a threshold potential;

The issuance triggering flag information determining module is configured to compare the current pulsed neuron output information with the threshold potential, and determine the issuance triggering flag information according to the comparison result, where the issuing triggering flag information includes: issuing a trigger or issuing a trigger; When the issuing trigger flag information is an issue trigger,

The refractory timer reset module is configured to reset the refractory period timer and update the historical membrane potential information to a preset reset membrane potential information.

In one embodiment, the method further includes:

When the issue trigger flag information is not triggered by the issue,

The refractory timer reading module is used to read the current time step of the refractory width and the refractory period timer;

The refractory period determining module is configured to determine whether the current time is within the refractory period according to the refractory period width and the current time step of the refractory period timer, and if the current time is within the refractory period, The refractory period timer accumulates a time step, does not update the historical membrane potential information; if the current time is not within the due period, accumulates the refractory period timer for one time step, and updates the historical film The potential information is the current pulse neuron output information.

In one embodiment, the threshold potential acquisition module includes:

a threshold information reading unit, configured to read a random threshold mask potential, a threshold offset, and a random threshold;

a random superposition amount acquiring unit, configured to perform bitwise AND operation on the random threshold and the random threshold mask potential, Obtain a threshold random stack amount;

And a threshold potential determining unit configured to determine the threshold potential according to the threshold random amount and the threshold offset.

In one embodiment, the current pulse neuron information output module includes:

The identification identifier reading unit is configured to read an issue enable identifier, where the release enable identifier includes allowing data to be released or not allowing data to be issued; and when the issue enable identifier is allowed to issue data,

And issuing a trigger flag information reading unit, configured to read the issue trigger flag information, when the issue trigger flag information is an issue trigger;

The current pulse neuron information output unit is configured to output the current pulse neuron output information.

The neuron information processing system with deep time windowing provided by the present invention acquires the pulse tip information update sequence in the current time window according to the front end pulse neuron output information and the current time window pulse tip information history sequence, and is used for current The output information of the pulsed neurons is calculated such that the output information of the current pulsed neuron is correlated with the pulse tip information history sequence in the current time window and the front-end pulse neuron output information received at the current time step. Breaking through the limitation that only the front and back time steps are related to each other, the historical activity information of the cached larger time depth can be flexibly set according to the need, and the biological neuron is closer to the depth effect in the time domain.

In one embodiment, the front-end pulse neuron output information received in the first N time steps is stored according to the time step sequence, and the information sequence in the historical sequence is sequenced after receiving the front-end pulse neuron output information of the current time step. Move one bit backward, fill the pulse information received by the current time step into the first place, and obtain the updated pulse tip information sequence for the calculation of the current pulse neuron output information. Sliding according to time, combining the historical pulse tip information with the pulse tip information of the current time step, so that the output information of the received front-end pulse neurons can be flexibly set according to requirements, and the sliding is performed according to the time sequence. The method is more in line with the biological neuron time depth effect.

In one of these embodiments, the threshold potential is determined by reading a random threshold mask potential and a threshold bias and receiving a configuration value given by a configuration register such that the neuron issues pulse tip information with a probability of randomness.

In one embodiment, the current pulse neuron output information is determined by setting the release enable identifier and the issue trigger flag, so that the output of the pulse neuron is more controllable, and the release enable flag can be configured with neurons that are not configured. It is allowed to issue data, but only as an intermediate auxiliary computing neuron, which is necessary for some functions that require multiple neurons to work together.

DRAWINGS

1 is a schematic flow chart of an adaptive leakage value neural network information processing method according to an embodiment;

2 is a schematic flow chart of an adaptive leak value neural network information processing method according to another embodiment;

3 is a schematic flow chart of an adaptive leakage value neural network information processing method according to still another embodiment;

4 is a schematic flow chart of an adaptive leakage value neural network information processing method according to still another embodiment;

5 is a schematic structural diagram of a pulse tip information history sequence in a current time window in an adaptive leakage value neural network information processing method according to an embodiment;

6 is a schematic structural diagram of an adaptive leakage value neural network information processing system according to another embodiment;

7 is a schematic structural diagram of an adaptive leakage value neural network information processing system according to still another embodiment;

FIG. 8 is a schematic structural diagram of an adaptive leakage value neural network information processing system according to still another embodiment.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

FIG. 1 is a schematic flowchart of an adaptive leakage value neural network information processing method according to an embodiment, and the adaptive leakage value neural network information processing method shown in FIG. 1 includes:

Step S100: Receive front end pulse neuron output information, where the front end pulse neuron output information includes pulse tip information output by the front end pulse neuron.

Specifically, the pulse tip information output by the front end pulse neuron is pulse tip information output by the pulse neuron of the front end of the connection with the current pulse neuron.

Step S200, reading first current pulse neuron information, the first current pulse neuron information including a pulse tip information history sequence in a current time window.

Specifically, the pulse tip information history sequence in the current time window refers to a sequence of information in which the pulse tip information received in a time range within a certain range in the current time window width is sequentially cached in time series. .

Step S300, acquiring a pulse tip information update sequence in the current time window according to the pulse tip information output by the front end pulse neuron and the pulse tip information history sequence in the current time window.

Specifically, the pulse tip information received at the current time step and the pulse tip information received at the time step in the past range are integrated into a new current time window pulse tip information update sequence to be received in the past. The pulse tip information is still involved in the calculation of the pulse neuron output information for the current time step.

Step S400, determining second current pulse neuron information according to the pulse tip information update sequence in the current time window.

Specifically, since the current pulse neuron information further includes other information, the pulse tip information update sequence in the pre-time window acquired after the update is replaced, and the second current pulse neuron is acquired after replacing the pulse tip information history sequence in the current time window. information.

Step S500, calculating current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information.

Specifically, the front-end pulse neuron information further includes other information, such as a connection weight index of the front-end pulse neuron and the current pulse neuron, and the front-end pulse neuron information and the second current pulse neuron information are calculated. The current pulse neuron output information is obtained.

Step S600, outputting the current pulse neuron output information.

The neuron information processing method with deep time windowing provided by the present invention obtains the pulse tip information update sequence in the current time window according to the front end pulse neuron output information and the current tip window pulse tip information history sequence, and is used for current The output information of the pulsed neurons is calculated such that the output information of the current pulsed neuron is correlated with the pulse tip information history sequence in the current time window and the front-end pulse neuron output information received at the current time step. Breaking through the limitation that only the front and back time steps are related to each other, the historical activity information of the cached larger time depth can be flexibly set according to the need, and the biological neuron is closer to the depth effect in the time domain.

2 is a schematic flowchart of an adaptive leakage value neural network information processing method according to another embodiment. The adaptive leakage value neural network information processing method shown in FIG. 2 is a detailed step of step S300 in FIG. 1, and includes:

Step S310, deleting the pulse tip information of the Nth time step in the history sequence of the pulse tip information in the current time window, and changing the pulse tip information of the first time step to the N-1 time step to the sequence Pulse tip information from the second time step to the Nth time step.

Specifically, the pulse tip information history sequence in the current time window includes: a sequence consisting of outputting information of each front-end pulse neuron received by N time steps before the current time step, stored in a time step order, wherein The pulse tip information of the first time step in the history sequence of the pulse tip information in the current time window is the front end pulse neuron output information received at the first time step before the current time step, and the pulse tip information in the current time window The pulse tip information of the Nth time step in the history sequence is the front end pulse neuron output information received at the Nth time step before the current time step.

As shown in FIG. 5, the pulse tip information history sequence in the current time window stores, from the right hand to the left, the output information of each front-end pulse neuron received by the 15 time steps before the current time step in time step order, since each Each front-end pulse neuron information received by the time step includes a plurality of front-end pulse neuron information according to actual conditions, and is represented by a vertical column in FIG. 5, wherein each circle represents a single front-end pulse neuron output. Pulse tip information.

In the current time step, the pulse tip information of the 15th column on the leftmost side in FIG. 5 is deleted, and the pulse tip information of the 1st to 14th columns is sequentially changed to the pulse tip information of the 2nd to 15th columns.

Step S320, setting the front end pulse neuron output information received by the current time step as the pulse tip information of the first time step in the pulse tip information history sequence in the current time window.

Specifically, the front end pulse tip information received at the current time step is placed in the first column of FIG.

Step S330, the pulse tip information of the updated first time step to the Nth time step is formed into a pulse tip information update sequence in the current time window.

Specifically, the new pulse tip information of the first to the 15th time steps is the pulse tip in the updated current time window. Information update sequence.

In actual use, the shift register array can be used to store the pulse tip sequence, or it can be implemented by a common memory. Since the memory can only be read and written according to the address, it cannot be automatically shifted according to the clock signal like the shift register. The bit operation can only be completed through the series of “read→data splicing→writing”. The principle of data splicing is: based on the history information and the latest release information currently read, and then intercept the lower 15 bits of the historical release information. The latest release information is spliced and sent to the subsequent calculation module (the input produces the adder) and rewritten back into the spike cache RAM. The row address and write enable signals of the memory are given by the system's read/write control module. Through this splicing method, the operation of the time domain sliding window can be realized by shifting the shift register.

In this embodiment, the front-end pulse neuron output information received in the first N time steps is stored according to the time step sequence, and after the front-end pulse neuron output information of the current time step is received, the information in the historical sequence is sequentially sequenced. After moving one bit, the pulse information received at the current time step is filled in the first place, and the updated pulse tip information sequence is obtained for the calculation of the current pulse neuron output information. Sliding according to time, combining the historical pulse tip information with the pulse tip information of the current time step, so that the output information of the received front-end pulse neurons can be flexibly set according to requirements, and the sliding is performed according to the time sequence. The method is more in line with the biological neuron time depth effect.

FIG. 3 is a schematic flowchart diagram of an adaptive leakage value neural network information processing method according to still another embodiment, and the adaptive leakage value neural network information processing method shown in FIG. 3 includes:

Step S100b: Receive pulse tip information output by the front end pulse neuron, and a connection weight index of the front end pulse neuron and the current pulse neuron.

Specifically, the connection weight index of the front-end pulse neuron and the current pulse neuron is a weight index sent by the front-end neuron together with the output information of the front-end pulse neuron, and is used to indicate the extraction of the current neuron weight. The pulse tip information output by the front end pulse neuron is a pulse tip signal sent by the front end pulse neuron.

Step S200b, reading the current time window width, the pulse tip information update sequence in the current time window, the historical membrane potential information, and the membrane potential leakage information.

Specifically, in addition to the pulse tip information update sequence in the current time window, the current time window width, the historical film potential information, and the membrane potential leakage information are information in the first current pulse neuron information.

Step S300b: The connection weight of the front-end neuron and the current neuron is read according to the connection weight index of the front-end neuron and the current neuron.

Specifically, the connection weight index of the front-end pulse neuron and the current pulse neuron is an address information, and the current neuron is indexed according to the received connection weight of the front-end pulse neuron and the current pulse neuron. In the memory in the element, the connection weight of the front-end pulse neuron and the current pulse neuron is read, and according to the connection weight information, the output information of the front-end neuron can be used in the calculation process of participating in the current neuron output information. More accurately reflects the weight of the output information of the front-end neurons, carrying more abundant information.

Step S400b, calculating front-end pulse neuron input information by using an attenuation function according to the current time window width and the current time window intra-pulse tip information update sequence.

Specifically, the pulse tip information update sequence in the current time window includes historical pulse tip information of N time steps before the current time step, and uses an attenuation factor K _i in the calculation of the current pulse neuron output information. The closer the column is to the current time step, the greater the attenuation factor, ie the greater the effect of its input on the back-end neurons; conversely, the smaller.

In order to ensure that each row adds and subtracts all the attenuation factors in the entire time window, that is, the spike input at each point of the row is 1, it is necessary to normalize all K _i on the original time decay curve:

Step S500b, calculating, according to the front-end pulse neuron input information, the connection weight of the front-end pulse neuron and the current pulse neuron, the historical membrane potential information, and the membrane potential leakage information, by calculating a pulse neuron calculation model Current pulsed neuron output information.

Specifically, the calculation of the input information of the front-end pulse neuron is represented by the following formula:

Where W _ij is the connection weight of the front-end pulse neuron j and the current pulse neuron i, T _w is the time window width, and δ _j is the front-end neuron j after the spike is issued in the current time window, at the current The time step within the time window of the pulse tip information update sequence. t is the current time, K(Δt) is an attenuation function that decreases rapidly as Δt increases. The basic model at the cell body can be simplified to:

V _SNN =f(V+V _input +V _leak )

The release model and the reset model are unchanged, where V is the historical membrane potential information stored in the memory, and V _input is the _input of the current beat accumulation, equivalent to the above

V _leak is the membrane potential leakage value information.

In this embodiment, the front end pulse neuron input is calculated by the attenuation function according to the current time window pulse tip information update sequence, the current time window width, the connection weight of the front end pulse neuron and the current pulse neuron, and the attenuation function. The information can support the spatio-temporal pulse neural network model with time depth. Compared with the neural network technology scheme with only one time depth, the spatio-temporal information coding ability of the pulse neural network can be greatly improved, and the application space of the pulse neural network is enriched.

4 is a schematic flowchart of an adaptive leakage value neural network information processing method according to still another embodiment, and the adaptive leakage value neural network information processing method shown in FIG. 4 includes:

In step S100c, the current pulse neuron output information and the threshold potential are calculated.

In step S200c, it is determined whether the current pulse neuron output information is greater than or equal to the threshold potential, and the issuing trigger flag information is determined according to the comparison result, where the issuing trigger flag information includes issuing a trigger or issuing a non-trigger, if When the triggering flag information is issued, the process proceeds to step S300c. When it is determined that the issuance trigger flag information is not triggered, the process proceeds to step S400c.

Specifically, the threshold pulse potential is compared with the current pulse neuron output information, and the issue trigger flag information is determined according to the comparison result. The current pulse neuron output information is transmitted only when the current pulse neuron output information is greater than the threshold potential.

Step S300c, resetting the refractory period timer, and updating the historical membrane potential information to a preset reset membrane potential information.

Specifically, when the issue trigger flag information is an issue trigger, the current pulse neuron output information is sent, and after the refractory period timer is reset, the refractory period is recalculated, and the historical membrane potential information is updated. The preset membrane potential information, and the historical membrane potential information is updated, selectively resetting the membrane potential to the current membrane potential, the current membrane potential and the threshold potential difference, or a fixed reset voltage according to the configured reset type.

Step S400c, reading the current time step of the refractory period width and the refractory period timer.

Specifically, when the issuing trigger flag information is not triggered by the issuance, the current pulse neuron output information is not sent, and further determining whether the current period is within the refractory period. The refractory period width is a range of durations of the refractory period, and the refractory period timer is timed by means of a time step.

Step S500c, determining whether the current time is within the refractory period according to the refractory period width and the current time step of the refractory period timer. If the current time is within the refractory period, proceeding to step S600c, otherwise jumping Go to step S700c.

Specifically, according to the cumulative calculation of the current time step of the refractory period timer, it can be determined whether the current time step is still in the refractory period.

Step S600c, accumulating the refractory period timer for one time step, and not updating the historical film potential information.

Specifically, if the current time is within the refractory period, according to the biomimetic characteristics of the pulsed neural network, no response is made to the pulsed nerve output information, and the historical membrane potential information is not updated, and the historical membrane potential information is the next The pulsed neurons of the time step need to read the information, that is, during the refractory period, the pulsed neuron output information calculated this time does not participate in the calculation of the next time step.

Step S700c, accumulating the refractory period timer for one time step, and updating the historical membrane potential information as the current pulse neuron output information.

Specifically, if the refractory period is outside, the historical membrane potential information is the current pulse neuron output information, and participates in the calculation of the next time step.

In this embodiment, by setting a threshold potential, current pulse neuron output information smaller than the threshold potential cannot be output, and the output of the current pulse neuron output information can be controlled, and at the same time, the refractory period is set, and the pulse is also The output of neurons is closer to the response of biological neurons. Through the above control mechanism of the output information of the current pulsed neurons, the information processing control of the pulsed neural network is strengthened, so that it is closer to the working mechanism of the biological neurons.

In one embodiment, the obtaining a threshold potential comprises: reading a random threshold mask potential, a threshold offset, and a random threshold; performing a bitwise AND operation on the random threshold and the random threshold mask potential to obtain a threshold random superposition amount; determining the threshold potential according to the threshold random superimposition amount and the threshold offset.

Specifically, the pseudo random number generator generates a random threshold V _rand , and uses the random threshold and the preset random threshold mask potential V _{mask to perform a} bitwise sum operation to generate a threshold random superposition amount, and then randomly superimpose the threshold value. The amount is added to the preset threshold offset _{Vth0 to} produce a true threshold potential _Vth . Wherein, the initial seed of the pseudo random number generator is given by the configuration register V _seed . The mask potential V _{mask is} used to limit the range of threshold increments: if V _mask =0, the threshold random superposition amount is also 0, the release mode degenerates to a fixed threshold release, and the fixed threshold is V _th0 ; if V _mask ≠ 0, then The issuance mode is a partial probability threshold issue. When the extreme case V _th0 =0, the issuance mode is a full probability threshold issuance.

In the present embodiment, the threshold potential is determined by reading the random threshold mask potential and the threshold offset and receiving the configuration value given by the configuration register, so that the neuron issues the pulse tip information with a certain probability of randomness.

In one embodiment, the outputting the current pulse neuron output information comprises: reading an issue enable identifier, wherein the issue enable identifier includes allowing data to be issued or not allowing data to be issued; When the data is allowed to be issued, the issuing trigger flag information is read, and when the issuing trigger flag information is an issue trigger, the current pulse neuron output information is output.

In this embodiment, by setting the release enable identifier and the issue trigger flag, the current pulse neuron output information is determined, so that the output of the pulse neuron is more controllable, and the release enable flag can be configured with neurons that are not allowed. Issuing data, but only as an intermediate auxiliary computing neuron, is necessary for some functions that require multiple neurons to work together.

6 is a schematic structural diagram of an adaptive leakage value neural network information processing system according to another embodiment. The adaptive leakage value neural network information processing system shown in FIG. 6 includes:

The front-end pulse neuron output information receiving module 100 is configured to receive front-end pulse neuron output information, where the front-end pulse neuron output information includes pulse tip information output by the front-end pulse neuron; and the front-end pulse neuron output information includes : The weight of the connection between the front-end neuron and the current neuron.

The first current pulse neuron information reading module 200 is configured to read first current pulse neuron information, where the first current pulse neuron information includes a pulse tip information history sequence in a current time window; and the current time window a sequence of pulse tip information history, comprising: a sequence consisting of output information of each front-end pulse neuron received by N time steps before the current time step stored in a time step sequence, wherein the pulse tip information history sequence in the current time window The pulse tip information of the first time step in the first time step is the front end pulse neuron output information received at the first time step before the current time step, and the Nth time step in the history sequence of the pulse tip information in the current time window The pulse tip information is the front-end pulse neuron output information received at the Nth time step before the current time step; the current pulse neuron information further includes: a current time window width, a historical membrane potential information, and a membrane potential leakage information. .

The current time window pulse tip information update sequence acquisition module 300 is configured to acquire a pulse tip in the current time window according to the pulse tip information output by the front end pulse neuron and the pulse tip information history sequence in the current time window. An information update sequence; for deleting pulse tip information of the Nth time step in the history sequence of pulse tip information in the current time window, and cutting the pulse tip information from the first time step to the N-1th time step, The sequence is changed to the pulse tip information of the second time step to the Nth time step; the front end pulse neuron output information received by the current time step is set as the first in the history sequence of the pulse tip information in the current time window The pulse tip information of the time step; the pulse tip information of the updated first time step to the Nth time step constitutes a pulse tip information update sequence in the current time window.

The second current pulse neuron information determining module 400 is configured to determine second current pulse neuron information according to the current time window intrapulse information update sequence;

The current pulse neuron output information calculation module 500 is configured to calculate current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information;

The current pulse neuron output information output module 600 is configured to output the current pulse neuron output information. The method includes: an enable identifier reading unit, configured to read an issue enable identifier, where the issue enable identifier includes allowing data to be issued or not allowed to be issued; and when the issue enable identifier is allowed to issue data, issuing a trigger flag The information reading unit is configured to read the issue trigger flag information, and when the issue trigger flag information is an issue trigger, the current pulse neuron information output unit is configured to output the current pulse neuron output information.

The neuron information processing system with deep time windowing provided by the present invention acquires the pulse tip information update sequence in the current time window according to the front end pulse neuron output information and the current time window pulse tip information history sequence, and is used for current The output information of the pulsed neurons is calculated such that the output information of the current pulsed neuron is correlated with the pulse tip information history sequence in the current time window and the front-end pulse neuron output information received at the current time step. Breaking through the limitation that only the front and back time steps are related to each other, the historical activity information of the cached larger time depth can be flexibly set according to the need, and the biological neuron is closer to the depth effect in the time domain.

7 is a schematic structural diagram of an adaptive leakage value neural network information processing system according to still another embodiment, and an embodiment of the adaptive leakage value neural network information processing system shown in FIG. 7 is the current pulse neuron output in FIG. The information calculation module 500 includes:

The pulse neuron connection weight reading unit 100b is configured to read the connection weight of the front end neuron and the current neuron according to the connection weight index of the front end neuron and the current neuron.

The front end pulse neuron input information calculation unit 200b is configured to calculate front end pulse neuron input information by using an attenuation function according to the current time window width and the current time window intrapulse information update sequence.

The current pulse neuron output information calculation unit 300b is configured to input information according to the front end pulse neuron, a connection weight of the front end pulse neuron and the current pulse neuron, the historical membrane potential information, and the membrane potential leakage information. The current pulsed neuron output information is calculated by a pulsed neuron calculation model.

In this embodiment, according to the current time window, the pulse tip information update sequence, the current time window width, the connection weight of the front-end pulse neuron and the current pulse neuron, and the front-end pulse neuron input information are calculated by the attenuation function. It can support the spatio-temporal pulse neural network model with time depth. Compared with the neural network technology scheme with only one time depth, it can greatly improve the spatio-temporal information coding ability of the pulse neural network and enrich the application space of the pulse neural network.

FIG. 8 is a schematic structural diagram of an adaptive leakage value neural network information processing system according to still another embodiment. The adaptive leakage value neural network information processing system shown in FIG. 8 includes:

The threshold potential acquisition module 700 is configured to acquire a threshold potential, and includes: a threshold information reading unit, configured to read a random threshold mask potential, a threshold offset, and a random threshold; and a random superposition amount acquiring unit configured to use the random threshold And performing a bitwise AND operation with the random threshold mask potential to obtain a threshold random superposition amount; and a threshold potential determining unit configured to determine the threshold potential according to the threshold random superposition amount and the threshold offset.

The issue trigger flag information determining module 800 is configured to compare the current pulse neuron output information with the threshold potential, and determine the issue trigger flag information according to the comparison result, where the issue trigger flag information includes: issuing a trigger or issuing a trigger When the issue trigger flag information is an issue trigger.

The refractory timer reset module 900 is configured to reset the refractory period timer and update the historical membrane potential information to a preset reset membrane potential information.

When the issue trigger flag information is not triggered by the issue,

The refractory timer reads module 1000 for reading the current time step of the refractory period width and the refractory period timer.

The refractory period determining module 1100 is configured to determine, according to the refractory period width and the current time step of the refractory period timer, whether the current time is within the refractory period, and if the current time is within the refractory period, And accumulating the refractory period timer for one time step, not updating the historical membrane potential information; if the current time is not within the due period, accumulating the refractory period timer for one time step, and updating the history The membrane potential information is the current pulsed neuron output information.

In the present embodiment, the threshold potential is determined by reading the random threshold mask potential and the threshold offset and receiving the configuration value given by the configuration register, so that the neuron issues the pulse tip information with a certain probability of randomness. By setting the release enable flag and issuing the trigger flag, the current pulse neuron output information is determined, so that the output of the pulse neuron is more controllable, and the release enable flag can be configured to allow the neuron to not issue data, but only As an intermediate aided computational neuron, this is necessary for some functions that require multiple neurons to work together.

The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.

Based on the same inventive concept, an embodiment of the present invention further provides a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer The steps of the method mentioned in the above embodiments are implemented at the time of the program.

A person skilled in the art can understand that all or part of the process of implementing the above embodiment method can be completed by a computer program or instruction related hardware, and the program can be stored in a computer readable storage medium. The sequence, when executed, may include the flow of an embodiment of the methods as described above. Any reference to a memory, storage, database or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of formats, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization chain. Synchlink DRAM (SLDRAM), Memory Bus (Rambus) Direct RAM (RDRAM), Direct Memory Bus Dynamic RAM (DRDRAM), and Memory Bus Dynamic RAM (RDRAM).

The above-mentioned embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims (14)

1. A neuron information processing method with deep time windowing, wherein the method comprises:

   Receiving front end pulse neuron output information, the front end pulse neuron output information including pulse tip information output by the front end pulse neuron;

   Reading first current pulse neuron information, the first current pulse neuron information including a pulse tip information history sequence in a current time window;

   Obtaining a pulse tip information update sequence in a current time window according to the pulse tip information output by the front end pulse neuron and the pulse tip information history sequence in the current time window;

   Determining a second current pulse neuron information according to the pulse tip information update sequence in the current time window;

   Calculating current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information;

   Outputting the current pulse neuron output information.
2. The method for processing neuron information with depth time windowing according to claim 1, wherein:

   The sequence of pulse tip information history in the current time window includes: a sequence consisting of output information of each front-end pulse neuron received by N time steps before the current time step stored in a time step sequence, wherein the current time window The pulse tip information of the first time step in the history sequence of the internal pulse tip information is the front end pulse neuron output information received at the first time step before the current time step, and the pulse tip information history sequence in the current time window The pulse tip information of the Nth time step is the front end pulse neuron output information received at the Nth time step before the current time step, where N is a natural number;

   And acquiring, according to the front-end pulse neuron output information, and the pulse-tip information history sequence in the current time window, the pulse tip information update sequence in the current time window, including:

   Deleting the pulse tip information of the Nth time step in the pulse tip information history sequence in the current time window, and changing the pulse tip information of the first time step to the N-1th time step to the second Pulse tip information from time step to Nth time step;

   Setting the front-end pulse neuron output information received by the current time step as pulse tip information of the first time step in the pulse tip information history sequence in the current time window;

   The pulsed tip information of the updated first time step to the Nth time step constitutes a pulse tip information update sequence in the current time window.
3. The method for processing neuron information with depth time windowing according to claim 2, wherein:

   The front-end pulse neuron output information further includes: a connection weight index of the front-end neuron and the current neuron;

   The current pulsed neuron information further includes: a current time window width, historical membrane potential information, and membrane potential leakage information;

   The calculating, according to the front-end pulse neuron information and the second current pulse neuron information, the current pulse neuron output information, including:

   Reading a connection weight of the front-end neuron and the current neuron according to the connection weight index of the front-end neuron and the current neuron;

   And calculating, according to the current time window width, the pulse tip information update sequence in the current time window, the front end pulse neuron input information by using an attenuation function;

   Calculating the current pulsed nerve by using a pulse neuron calculation model according to the front end pulse neuron input information, the connection weight of the front end pulse neuron and the current pulse neuron, the historical membrane potential information, and the membrane potential leakage information Meta output information.
4. The method for processing neuron information with deep time windowing according to claim 1, wherein the current pulsed neuron is calculated based on the front end pulse neuron information and the second current pulse neuron information After the step of outputting the information, before the step of outputting the current pulse neuron output information, the method further includes:

   Obtaining a threshold potential;

   Comparing the current pulsed neuron output information with the threshold potential, and determining, according to the comparison result, the issue trigger flag information, where the issue trigger flag information includes: issuing a trigger or issuing a trigger;

   When the issue trigger flag information is an issue trigger, the refractory period timer is reset, and the historical film potential information is updated to preset reset film potential information.
5. The method of processing a neuron information with a deep time window according to claim 4, further comprising:

   When the issue trigger flag information is not triggered by the issue, the current time step of the refractory period width and the refractory period timer is read;

   Determining whether the current time is within the refractory period according to the refractory period width and the current time step of the refractory period timer, and if the current time is within the refractory period, accumulating the refractory period timer Timing a time step without updating the historical membrane potential information;

   If the current time is not within the due period, the refractory period timer is cumulatively counted for one time step, and the historical membrane potential information is updated to be the current pulsed neuron output information.
6. The method for processing a neuron information with a deep time window according to claim 4, wherein the obtaining the threshold potential comprises:

   Reading a random threshold mask potential, a threshold offset, and a random threshold;

   Performing a bitwise AND operation on the random threshold and the random threshold mask potential to obtain a threshold random superposition amount;

   The threshold potential is determined based on the threshold random amount and the threshold offset.
7. The method for processing neuron information with deep time windowing according to claim 4, wherein the outputting the current pulse neuron output information comprises:

   Reading an issue enable identifier, where the issue enable identifier includes allowing data to be issued or not allowing data to be issued; when the issue enable identifier is allowed to issue data,

   Reading the issue trigger flag information, when the issue trigger flag information is an issue trigger;

   Outputting the current pulse neuron output information.
8. A neuron information processing system with deep time windowing, comprising:

   a front-end pulse neuron output information receiving module, configured to receive front-end pulse neuron output information, where the front-end pulse neuron output information includes pulse tip information output by the front-end pulse neuron;

   a first current pulse neuron information reading module, configured to read first current pulse neuron information, where the first current pulse neuron information includes a pulse tip information history sequence in a current time window;

   a current time window in-time pulse tip information update sequence acquisition module, configured to acquire a pulse tip information update sequence in a current time window according to pulse tip information output by the front end pulse neuron and a pulse tip information history sequence in the current time window ;

   a second current pulse neuron information determining module, configured to determine second current pulse neuron information according to the current time window intrapulse information update sequence;

   The current pulse neuron output information calculation module is configured to calculate current pulse neuron output information according to the front end pulse neuron information and the second current pulse neuron information;

   The current pulse neuron output information output module is configured to output the current pulse neuron output information.
9. The neuron information processing system with deep time windowing according to claim 8, wherein:

   The sequence of pulse tip information history in the current time window includes: a sequence consisting of output information of each front-end pulse neuron received by N time steps before the current time step stored in a time step sequence, wherein the current time window The pulse tip information of the first time step in the history sequence of the internal pulse tip information is the front end pulse neuron output information received at the first time step before the current time step, and the pulse tip information history sequence in the current time window The pulse tip information of the Nth time step is the front end pulse neuron output information received at the Nth time step before the current time step, where N is a natural number;

   Then, the pulse tip information update sequence acquisition module in the current time window is used to:

   Deleting the pulse tip information of the Nth time step in the pulse tip information history sequence in the current time window, and changing the pulse tip information of the first time step to the N-1th time step to the second Pulse tip information from time step to Nth time step;

   Setting the front-end pulse neuron output information received by the current time step as pulse tip information of the first time step in the pulse tip information history sequence in the current time window;

   The pulsed tip information of the updated first time step to the Nth time step constitutes a pulse tip information update sequence in the current time window.
10. A neuron information processing system with deep time windowing according to claim 9, wherein:

    The front-end pulse neuron output information further includes: a connection weight index of the front-end neuron and the current neuron;

    The current pulsed neuron information further includes: a current time window width, historical membrane potential information, and membrane potential leakage information;

    The current pulse neuron output information calculation module includes:

    a pulsed neuron connection weight reading unit, configured to read a connection weight of the front end neuron and the current neuron according to a connection weight index of the front end neuron and the current neuron;

    a front-end pulse neuron input information calculation unit, configured to calculate front-end pulse neuron input information by using an attenuation function according to the current time window width, the pulse tip information update sequence in the current time window;

    a current pulse neuron output information calculation unit, configured to input, according to the front end pulse neuron input information, a connection weight of the front end pulse neuron and a current pulse neuron, the historical membrane potential information, and the membrane potential leakage information, The current pulsed neuron output information is calculated by a pulsed neuron calculation model.
11. The neuron information processing system with deep time windowing according to claim 8, further comprising:

    a threshold potential acquisition module, configured to acquire a threshold potential;

    The issuance triggering flag information determining module is configured to compare the current pulsed neuron output information with the threshold potential, and determine the issuance triggering flag information according to the comparison result, where the issuing triggering flag information includes: issuing a trigger or issuing a trigger; When the issuing trigger flag information is an issue trigger,

    The refractory timer reset module is configured to reset the refractory period timer and update the historical membrane potential information to a preset reset membrane potential information.
12. The system of claim 11, further comprising:

    When the issue trigger flag information is not triggered by the issue,

    The refractory timer reading module is used to read the current time step of the refractory width and the refractory period timer;

    The refractory period determining module is configured to determine whether the current time is within the refractory period according to the refractory period width and the current time step of the refractory period timer, and if the current time is within the refractory period, The refractory period timer accumulates a time step, does not update the historical membrane potential information; if the current time is not within the due period, accumulates the refractory period timer for one time step, and updates the historical film The potential information is the current pulse neuron output information.
13. The apparatus for processing a threshold value according to claim 11, wherein the threshold potential acquisition module comprises:

    a threshold information reading unit, configured to read a random threshold mask potential, a threshold offset, and a random threshold;

    a random superposition amount acquiring unit, configured to perform a bitwise AND operation on the random threshold and the random threshold mask potential to obtain a threshold random superposition amount;

    And a threshold potential determining unit configured to determine the threshold potential according to the threshold random amount and the threshold offset.
14. The neuron information processing system with a deep time windowing according to claim 11, wherein the current pulse neuron information output module comprises:

    The identification identifier reading unit is configured to read an issue enable identifier, where the release enable identifier includes allowing data to be released or not allowing data to be issued; and when the issue enable identifier is allowed to issue data,

    And issuing a trigger flag information reading unit, configured to read the issue trigger flag information, when the issue trigger flag information When the interest is triggered by the release;

    The current pulse neuron information output unit is configured to output the current pulse neuron output information.

Images