USRE34562E - Amplitude-adaptive vector quantization system - Google Patents
Amplitude-adaptive vector quantization system Download PDFInfo
- Publication number
- USRE34562E USRE34562E US07/761,501 US76150191A USRE34562E US RE34562 E USRE34562 E US RE34562E US 76150191 A US76150191 A US 76150191A US RE34562 E USRE34562 E US RE34562E
- Authority
- US
- United States
- Prior art keywords
- vector
- amplitude
- quantization
- stage
- tree
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Images
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/3082—Vector coding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
- G06T9/008—Vector quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/94—Vector quantisation
Definitions
- This invention relates to a high-efficiency signal coding and decoding system and, particularly, to an amplitude-adaptive vector quantization system.
- FIGS. 3 and 4 are block diagrams showing the coding and decoding sections, respectively, of a vector quantization system which uses the inner product for the computation of distortion.
- 1 is the input signal vector derived from a series of input signals divided into blocks in K-samples
- 2 is a mean value separation circuit
- 11 is the separated mean value
- 13 is the mean separated input vector
- 3 is a mean value DPCM (Differential PCM) quantizer
- 29 is a vector quantizer
- 31 is the amplitude gain produced through coding by the vector quantizer
- 7 is an amplitude-gain DPCM quantizer
- 33 is the output vector index produced from the code of the vector quantizer.
- DPCM decoder 4
- 20 is an amplitude-gain DPCM decoder
- 24 is the DPCM-decoded mean value
- 36 is the DPCM-decoded amplitude gain
- 35 is a vector quantizing decoder
- 38 is the decoded mean value separation vector
- 23 is a mean value adding circuit
- 39 is the output signal vector.
- the input signal vector 1 which is a series of input signals provided in the form of blocks is received by the mean value separation circuit 2 which separates the mean separated input vector 13 from the intra-vector mean value 11.
- the separated mean value 11 is subjected to predictive differential quantization (DPCM quantization) by the mean value DPCM quantizer 3, and information of the separated mean value 11 is reduced.
- the mean separated input vector 13 is subjected to inner product computation by the vector quantizer 29 with the output vector read out of a code book which is a set of output vectors prepared in advance in a statistical manner so that an output vector yielding a maximum inner product is selected.
- the vector quantizer 29 produces the output vector index 33 for the input mean separated input vector and also the inner product value as the amplitude gain 31 of the input mean separated input vector 13.
- yi 1 are assumed.
- the vector distortion computation is reduced to the form of a product-sum which is easier for execution with a DSP (digital signal processor), and the amplitude component can be obtained at the same time.
- the amplitude gain 31 produced by the vector quantizer 29 is subjected to DPCM quantization by the DPCM quantizer 7 in the same way as for the mean value 11.
- the DPCM-quantized mean value 12, amplitude gain 32 and output vector index 33 obtained as described above are coded and then transmitted or recorded.
- the decoding section of FIG. 4 implements decoding for the three components, namely, the DPCM-quantized mean value 12, DPCM-quantized amplitude gain 32 and output vector index 33 provided by the coding section.
- the DPCM-quantized mean value 12 is DPCM-decoded by the DPCM decoder 19, which yields the decoded mean value 24.
- the DPCM-quantized amplitude gain 32 is DPCM-decoded by the amplitude gain DPCM decoder 20, which yields the decoded amplitude gain 36.
- the vector quantization decoder 35 outputs the normalized output vector 37 by decoding the output vector index 33, the amplitude reproduction circuit 22 reproduces the amplitude of the vector as output vector 38 from the decoded amplitude gain 36, the mean value adding circuit 23 adds the decoded mean value 24 to the decoded mean separated output vector 38, and the output signal vector 39 is reproduced.
- the amplitude component is obtained after vector quantization, and therefore the vector quantization index information cannot be reduced by varying the quantization stages of the tree-searched code book by the amplitude component or switching code books. If the use of inner product computation is eliminated for implementing the above-mentioned adaptive control by the amplitude component, it becomes difficult for the DSP (digital signal processor) to reduce the duty of hardware.
- DSP digital signal processor
- the present invention is intended to solve the foregoing problems, and its object is to provide a vector quantization system which is capable of reducing the volume of information of the vector quantization index by varying the quantization stage of a tree-searched code book depending on the vector amplitude component and also is capable of reducing the duty of hardware by means of DSP, while using the vector inner product for the computation of distortion.
- the inventive vector quantization system adopts tree search for the vector quantizer, and is equipped with a calculator for the amplitude component of the mean separated input vector and an amplitude vs. quantization stage correspondence table for determining the quantization stage which meets the magnitude of the evaluated amplitude component.
- the tree-search vector quantizer is designed to produce the amplitude gain based on the result of quantization by the given quantization stage, and it includes an amplitude gain DPCM quantizer for DPCM-quantizing the evaluated amplitude gain, a second amplitude vs. quantization stage table for selecting the number of the quantization stage by producing indices depending on the DPCM-decoded amplitude gain, and a selector for selecting an index.
- the amplitude component calculator evaluates the amplitude component of the vector
- the tree-search vector quantizer produces an amplitude gain based on a deep or shallow quantization stage, in accordance with the amplitude vs. quantization stage table, in response to the magnitude of the amplitude component.
- the amplitude gain is entered to the second amplitude vs. quantization stage table, which re-evaluates the quantization stage on the basis of the quantized amplitude gain and selects an output vector index depending on the quantization stage.
- the decoding section by having a second amplitude vs. quantization stage correspondence table, determines the quantization stage from the DPCM-decoded amplitude gain, and the output vector index can be decoded.
- the output vector is searched by tree search of n's notation system, and the assignment of variable length (will be termed "code") to the output vector is made to express the code of output vector at the node of the tree selected during the search of output vector at the last stage, by truncating the lowest position (will be termed "LSB") of the code of output vector at the last stage of tree structure.
- the stage of tree structure of the vector to be outputted is determined from the amplitude gain derived from the amplitude gain of the last stage output vector with respect to the input vector through DPCM quantization and DPCM decoding, the code of output vector obtained accordingly at the last stage is truncated from LSB.
- the inventive vector quantization system first implements vector quantization up to the last stage by tree search of n's notation system for the mean value separation vector, and the amplitude gain resulting from the last quantization stage is assumed to be the amplitude gain of the output vector selected during the search up to the last stage.
- the amplitude gain at the last stage is subjected to DPCM quantization/decoding, an output vector of a shallow stage of tree structure or deep stage of tree structure depending on a large or small value of the resulting amplitude gain is selected through the truncating operation from LSB for the code of output vector obtained at the last stage.
- FIG. 1 is a block diagram of the coding section of the amplitude-adapted vector quantization system according to an embodiment of this invention
- FIG. 2 is a block diagram of the decoding section
- FIG. 3 is a block diagram of the coding section of the conventional vector quantization system
- FIG. 4 is a block diagram of the decoding section
- FIG. 5 is a block diagram of the tree-search vector quantizer
- FIG. 6 is a block diagram of the quantizer at each stage of the tree-search vector quantizer
- FIG. 7 shows the coding section of the vector quantization system according to another embodiment of this invention.
- FIG. 8 is a block diagram of the decoding section
- FIG. 9 is a block diagram of the tree-search vector quantizer
- FIG. 10 is a detailed block diagram of the vector quantizer using the inner product for the computation of distortion
- FIGS. 11a and 11b are diagrams explaining the relation between the tree-search and index code according to an embodiment of this invention.
- FIG. 12 is a diagram explaining the relation between the tree-search and index code according to another embodiment of this invention.
- FIGS. 1 and 2 are block diagrams of the coding section and decoding section, respectively, of the vector quantization system according to this invention.
- 1 is the input signal vector
- 2 is a mean value separating circuit
- 11 is the separated mean value
- 3 is a mean value DPCM quantizer
- 12 is a DPCM-quantized mean value
- 13 is the input vector which has the mean value
- removed 4 is an amplitude component calculation circuit for the input vector
- 5 is a first amplitude vs.
- quantization stage correspondence table for determining the stage of the tree-search vector quantizer from the magnitude of the calculated amplitude component
- 6 is a tree-search vector quantizer which uses the inner product of the mean separated input vector for the distortion computation in vector quantization and produces the amplitude gain 14 with the stage number depending on the output of the first amplitude vs. quantization stage correspondence table 5
- 7 is an amplitude gain DPCM quantizer
- 15 is the DPCM-quantized amplitude gain
- 16 is the DPCM-decoded amplitude gain
- 8 is a second amplitude vs.
- quantization stage correspondence table for determining the stage of quantization for the output vector in accordance with the value of DPCM-decoded amplitude gain
- 9 is an index buffer which fetches the output vector index at each quantization stage of the tree-search vector quantizer
- 10 is an output vector index selector which selects a vector index to be outputted from the index buffer 9 in response to the signal 17 indicating the output vector stage number from the second amplitude vs. quantization stage correspondence table 8
- 18 is the output vector index.
- FIG. 2 shows the decoding section of the vector quantizer according to this invention, in which indicated by 19 is a mean value DPCM decoder, 24 is the DPCM-decoded mean value, 20 is an amplitude gain DPCM decoder, 25 is the DPCM-decoded amplitude gain, 26 is the decoded output vector, 27 is the amplitude-reproduced output vector, and 28 is the output signal vector.
- 19 is a mean value DPCM decoder
- 24 is the DPCM-decoded mean value
- 20 is an amplitude gain DPCM decoder
- 25 is the DPCM-decoded amplitude gain
- 26 is the decoded output vector
- 27 is the amplitude-reproduced output vector
- 28 is the output signal vector.
- FIG. 5 is a block diagram of the tree-search vector quantizer 6 shown in FIG. 1.
- Indicated by 40 are vector quantizers which use the inner product of vectors at stages for the distortion computation, 41 are code books including normalized output vectors at the stages, 42 are the output vector indices as the results of quantization at the stages, and 43 are the amplitude gains as the result of quantization at the stages.
- FIG. 6 is a block diagram showing the operation of the vector quantizer which uses the inner product at each stage for the distortion computation.
- Indicated by 44 is the output vector index as a result of quantization by the vector quantizer at the preceding stage
- 45 is an address counter which determines an output vector to be read out of the code book in accordance with the index of the preceding stage and produces the code book readout addresses 46 sequentially
- 47 is the output vector read from code book 41 which is subjected to vector computation with the input vector 13
- 48 are multipliers
- 49 is an adder
- 50 is the inner product value signal for the input vector and output vector
- 51 is a maximum inner product detector which produces a strobe 52 upon detecting the maximum inner product value
- 53 is an amplitude gain latch which holds the input inner product value signal 50 as the amplitude gain only upon receiving the strobe 52 from the maximum inner product detector 51
- 54 is an index latch which holds the readout address 46 of the entered code book only upon receiving the strobe 52 from the maximum inner product detector
- the input signal vector 1 to be coded is separated into the mean value 11 and mean separated input vector 13 by the mean value separation circuit 2.
- the mean value 11 is quantized by the DPCM quantizer 3, and the mean separated input vector 13 is subjected to computation of the magnitude of amplitude component by the amplitude component calculating circuit 4.
- the amplitude of absolute value may be used as shown in the following.
- a mean-value separation vector X input signal vector S and mean value ⁇
- the amplitude ⁇ is given as follows.
- the tree-search vector quantizer 6 implements tree-search quantization for the mean separated input vector 13, delivers the output vector index at each quantization stage to the index buffer 9, and provides the amplitude gain 14 based on the quantization result of quantizers with the quantization stage number which has been selected on the basis of the magnitude of the amplitude component by the amplitude vs. quantization stage correspondence table 5.
- the amplitude vs. quantization search stage correspondence table is designed such that it provides a shallow quantization stage in response to a small amplitude component and provides a deep search stage as the amplitude component becomes larger.
- the amplitude gain 14 evaluated by the tree-search vector quantizer 6, is quantized by the DPCM quantizer 7 to have the DPCM quantized amplitude gain 15, and the DPCM-decoded amplitude gain 16 is entered to the second amplitude vs. quantization stage correspondence table 8.
- the second amplitude vs. quantization stage correspondence table 8 revises the quantization stage number of the output vector index 18 which is finally outputted on the basis of the DPCM-decoded amplitude gain 16, and the index selector 10 makes selection from among the indices at quantization stages held in the index buffer 9 in accordance with the signal 17 indicating the output vector stage number. Consequently, the DPCM-quantized mean value 12, DPCM-quantized amplitude gain 15 and output vector index 18 are obtained as a coding output.
- the decoding section of FIG. 2 receives the mean value 12, amplitude gain 15 and output vector index 18 which have been DPCM-quantized by the coding section.
- the mean value DPCM decoder 19 and amplitude gain DPCM decoder 20 implement decoding for the mean value 24 and amplitude gain 25.
- the amplitude vs. quantization stage correspondence table 8 produces from the amplitude gain 25 the quantization stage signal which indicates the same quantization stage number of the vector quantizer in the coding section, and sends it to the vector quantization decoder 21.
- the vector quantization decoder 21 decodes the output vector index 18 in accordance with the quantization stage number provided by the second amplitude vs. quantization stage correspondence table 8, and the normalized output vector 26 is obtained.
- the amplitude reproduction circuit 22 multiplies the decoded amplitude value 25 and adds the mean value 24 which has been decoded by the mean value adding circuit 23 to produce the output signal vector 28 as a decoded output.
- each vector quantizer 40 which uses the inner product for the distortion computation determines an output vector providing a maximum inner product from among output vectors selected in each code book 41 on the basis of the vector quantization output vector index of the previous stage, sends the output vector index 42 to the quantizer of the next stage, and outputs the output vector index 42 and the amplitude gain 43 which is then inner product calculation result, as a quantization result of that stage.
- FIG. 6 shows in more detail the vector quantizer of each stage, in which the address counter 45, upon receiving the previous stage vector quantizer output vector index 44, provides an output vector address to be compared with the input vector 13 in accordance with the tree-structure output vector.
- the output vector 47 is read out of the code book 41, it is subjected to product-sum with the input vector 13.
- the maximum inner product detector 51 issues a strobe, by which the amplitude gain latch 53 holds the inner product value 50 and the index latch 54 holds the output vector address 46.
- the address counter 45 has outputted all output vector addresses 46 for the input vector 13, the values held in the amplitude gain latch and index latch are outputted as an amplitude gain 43 and output vector index 42 of that stage.
- the inner product calculation is used for the distortion computation section of the vector quantizer, the quantization stage number of the tree-search vector quantizer is controlled by the magnitude of the vector amplitude component, and the final quantization stage number is determined from the quantization decoding result for the obtained amplitude gain, whereby the duty of the hardware can be reduced by using a DSP (digital signal processor) and it becomes possible to reduce the volume of information of the vector quantization index.
- DSP digital signal processor
- FIGS. 7-10 Another embodiment of this invention will be described referring to FIGS. 7-10.
- 61 is the input vector which is a series of input signals made into blocks of K-piece units
- 62 is a mean value separation circuit for the vector
- 63 is the separated mean value
- 64 is the mean separated input vector
- 65 is a vector quantizer implementing the amplitude-adapted tree search
- 66 is the code of output vector index in the last stage quantization
- 67 is the amplitude gain for the input vector of the output vector in the last stage quantization
- 68 is a mean value DPCM quantizer
- 69 is an amplitude gain DPCM quantizer
- 71 is the DPCM-quantized mean value
- 72 is the DPCM-quantized amplitude gain
- 73 is the DPCM-decoded amplitude gain
- 70 is an index bit length control circuit which truncates from LSB the code 66 of output vector index in the final quantization in accordance with the DPCM-decoded amplitude gain 73
- 74 is the index code of the final output vector produced
- a mean value DPCM decoder In the decoding section of FIG. 8, indicated by 75 is a mean value DPCM decoder, 76 is an amplitude gain DPCM decoder, 77 is the DPCM-decoded mean value, 78 is the DPCM-decoded amplitude gain, 79 is a vector quantization decoder which decodes the index code 74 of the output vector which has been coded by the coding section using the DPCM-decoded amplitude gain 78, 80 is the decoded normalization output vector, 81 is an amplitude reproduction circuit, 82 is the amplitude-reproduced output vector, 83 is a mean value adding circuit, and 84 is the output signal vector.
- DPCM decoder In the decoding section of FIG. 8, indicated by 75 is a mean value DPCM decoder, 76 is an amplitude gain DPCM decoder, 77 is the DPCM-decoded mean value, 78 is the DPCM-decoded
- FIG. 9 is a block diagram of the tree-search vector quantizer, showing the quantization operation by the quantizer 96 of each stage between the output vector read out of the code book 97 of each stage and the input vector 64, while making reference to the output vector index 98 of the previous-stage quantizer.
- FIG. 10 is a detailed block diagram of the vector quantizer which uses the inner product for the distortion computation.
- Indicated by 100 is an address counter which produces the readout address 103 sequentially while mapping the output vector address in accordance with the output vector index 98 of the previous-stage quantizer, 101 is a multiplier, 102 is an adder, 104 is the inner product value of input/output vectors, 105 is a maximum inner product detector which issues a strobe upon detecting a maximum inner product value, 106 is an index latch which holds the code book address and outputs it as the index, and 107 is an amplitude gain latch which holds the inner product value as an amplitude gain.
- the input signal vector 61 received as blocks derived from a series of input signals is subjected to separation of the intra vector mean value 63, and it provides the mean value separation vector 64.
- the separated mean value 63 is subjected to DPCM quantization by the mean value DPCM quantizer 68.
- the mean separated input vector 64 is subjected to quantization by the vector quantizer 65 as follows. It is assumed that the output vector is tree search of n's notation system (n is a power of 2).
- FIG. 1 shows part of a binary tree and quad tree, as examples.
- the code of 50 index appended to the output vector of each node of tree structure is determined as shown in FIG. 11 for examples.
- the quad tree of FIG. 11(b) has its codes indicated in binary notation at the upper position and in quad notation at the lower position.
- the code increases by log 2 n bits (one bit in n's notation system) at each increment of the stage number, and nodes of the tree structure can be traced from lower toward upper stage of the tree structure by truncating log 2 n bits from LSB at a time.
- the mean-value separation input vector is rendered vectorial quantization using the inner product for the distortion computation.
- the tree search vector quantizer is expressed as a connection of vector quantizers as shown in FIG. 9, and the vector quantizer of the m-th stage is expressed by the block diagram of FIG. 10.
- the address counter 100 upon receiving the output vector index 98 of the vector quantizer of the (m-l)th stage, the address counter 100 produces the address of the output vector to be compared with the input vector 64 on the basis of the tree structure output vector of n's notation system. After the output vector has been read out of the code book 97, it is subjected to the product-sum operation with the input vector 64.
- the maximum inner product detector 104 issues a strobe, causing the amplitude gain latch 107 and index latch 106 to hold the inner product 104 and output vector address 103, respectively, and at the time point when the address counter 100 has outputted all output vector addresses 103 for the input vector 64, the value held in the index latch is outputted as an output vector index 108 of the m-th stage. If the m-th stage is the last stage, the value of the amplitude gain latch 107 is also outputted.
- the index code 66 of the last-stage output vector and the amplitude gain 67 for the input vector 64 of the last-stage output vector are outputted, and the amplitude gain DPCM quantizer 69 provides the DPCM-quantized amplitude gain 72 and amplitude gain 73 which is the DPCM-decoded version of 72.
- the amplitude gain which is the inner product of vector indicates the amplitude component of input vector, in case of implementation of proper vectorial quantization, and therefore mapping is conducted for the tree search quantization stage on the basis of the DPCM-decoded amplitude gain 73 so that an output vector of a shallow stage of tree structure is selected for a small amplitude gain or an output vector of a deep stage is selected for a large amplitude gain.
- the index bit length control circuit 70 implements the truncation operation for the index code of the last-stage output vector from LSB by log 2 n bits at a time for the stage determined depending on the amplitude gain 73.
- predetermined ones are stored in advance for both the coding side and decoding side. In this way, the output vector in the midst of the tree structure is also selected in accordance with the amplitude gain, and a shorter bit length results in more efficient quantization.
- the mean value and amplitude gain DPCM decoders 75 and 76 implement DPCM decoding, and the DPCM-decoded amplitude gain 78 is used by the vector quantization decoder 79 in mapping for determining which stage the output vector index code 74 is located in the tree structure, the normalized output vector 80 decoded by the vector quantization decoder is subjected to amplitude reproduction by the amplitude reproducing circuit 81 and mean value addition by the mean value adding circuit 83, and the final output signal vector 84 is decoded.
- n's notation system is assumed to be part of a binary tree structure and the code is truncated in 1-bit units from LSB. In this case, the following precaution must be taken.
- FIG. 12 showing a binary tree collection of nodes with underlined codes makes a quad tree. Namely, any tree structure of n's notation system (n is a power of 2) can be assumed to be the result of pull-off of stages of a binary tree in accordance with the rule.
- the output vector code book of the vector quantizer is configured in the tree search structure of n's notation system
- tree search vector quantization is implemented up to the last stage by truncating the index code from the low-order bit in accordance with the rule and by outputting the output vector of nodes in the midst of tree search
- the tree-search quantization stage is determined from the decoded amplitude gain obtained by DPCM coding/decoding the amplitude gain obtained by quantization of the last stage thereby to obtain the index code of the above-mentioned node, whereby it becomes possible to reduce the volume of information of the index in a sense of adaptation to the amplitude component of vector without incurring the complexity of vector quantizer used for the inner product calculation which allows the reduction of duty of the hardware by using a DSP or the like.
- index information is truncated in accordance with the detected vector amplitude component, thereby reducing the volume of information transmitted, whereby the hardware can be made smaller to reduce its duty through the use of DSP or the like.
Abstract
An amplitude-adaptive vector quantization system intended for efficient signal coding and decoding. A mean value separation circuit (2) separates the mean value from an input signal which has been divided into blocks, and a tree-search vector quantizer (6) implements tree-search inner product vector quantization so that index information is truncated depending on the detected vector amplitude, thereby reducing the volume of information for transmission.
Description
1. Field of the Art
This invention relates to a high-efficiency signal coding and decoding system and, particularly, to an amplitude-adaptive vector quantization system.
2. Background Technology
FIGS. 3 and 4 are block diagrams showing the coding and decoding sections, respectively, of a vector quantization system which uses the inner product for the computation of distortion. In FIG. 3, indicated by 1 is the input signal vector derived from a series of input signals divided into blocks in K-samples, 2 is a mean value separation circuit, 11 is the separated mean value, 13 is the mean separated input vector, 3 is a mean value DPCM (Differential PCM) quantizer, 29 is a vector quantizer, 31 is the amplitude gain produced through coding by the vector quantizer, 7 is an amplitude-gain DPCM quantizer, and 33 is the output vector index produced from the code of the vector quantizer. In FIG. 4, indicated by 19 is a mean value DPCM decoder, 20 is an amplitude-gain DPCM decoder, 24 is the DPCM-decoded mean value, 36 is the DPCM-decoded amplitude gain, 35 is a vector quantizing decoder, 38 is the decoded mean value separation vector, 23 is a mean value adding circuit, and 39 is the output signal vector.
Next, the operation wil be described. In the coding section of FIG. 3, the input signal vector 1 which is a series of input signals provided in the form of blocks is received by the mean value separation circuit 2 which separates the mean separated input vector 13 from the intra-vector mean value 11. The separated mean value 11 is subjected to predictive differential quantization (DPCM quantization) by the mean value DPCM quantizer 3, and information of the separated mean value 11 is reduced. The mean separated input vector 13 is subjected to inner product computation by the vector quantizer 29 with the output vector read out of a code book which is a set of output vectors prepared in advance in a statistical manner so that an output vector yielding a maximum inner product is selected. The vector quantizer 29 produces the output vector index 33 for the input mean separated input vector and also the inner product value as the amplitude gain 31 of the input mean separated input vector 13.
Vector quantization is expressed in terms of input signal vectors 13 S=S1 S2, . . . , SK, mean value μ, amplitude gain σ*, and output vectors yi =[yi1, yi2, . . . , yik ], as follows. ##EQU1## where σ=|S-μ.UU| and |yi=1 are assumed.
Using the inner product, the vector distortion computation is reduced to the form of a product-sum which is easier for execution with a DSP (digital signal processor), and the amplitude component can be obtained at the same time. The amplitude gain 31 produced by the vector quantizer 29 is subjected to DPCM quantization by the DPCM quantizer 7 in the same way as for the mean value 11.
The DPCM-quantized mean value 12, amplitude gain 32 and output vector index 33 obtained as described above are coded and then transmitted or recorded.
The decoding section of FIG. 4 implements decoding for the three components, namely, the DPCM-quantized mean value 12, DPCM-quantized amplitude gain 32 and output vector index 33 provided by the coding section. The DPCM-quantized mean value 12 is DPCM-decoded by the DPCM decoder 19, which yields the decoded mean value 24. Similarly, the DPCM-quantized amplitude gain 32 is DPCM-decoded by the amplitude gain DPCM decoder 20, which yields the decoded amplitude gain 36.
The vector quantization decoder 35 outputs the normalized output vector 37 by decoding the output vector index 33, the amplitude reproduction circuit 22 reproduces the amplitude of the vector as output vector 38 from the decoded amplitude gain 36, the mean value adding circuit 23 adds the decoded mean value 24 to the decoded mean separated output vector 38, and the output signal vector 39 is reproduced.
In the conventional vector quantization system using the inner product for the computation of distortion, the amplitude component is obtained after vector quantization, and therefore the vector quantization index information cannot be reduced by varying the quantization stages of the tree-searched code book by the amplitude component or switching code books. If the use of inner product computation is eliminated for implementing the above-mentioned adaptive control by the amplitude component, it becomes difficult for the DSP (digital signal processor) to reduce the duty of hardware.
The present invention is intended to solve the foregoing problems, and its object is to provide a vector quantization system which is capable of reducing the volume of information of the vector quantization index by varying the quantization stage of a tree-searched code book depending on the vector amplitude component and also is capable of reducing the duty of hardware by means of DSP, while using the vector inner product for the computation of distortion.
The inventive vector quantization system adopts tree search for the vector quantizer, and is equipped with a calculator for the amplitude component of the mean separated input vector and an amplitude vs. quantization stage correspondence table for determining the quantization stage which meets the magnitude of the evaluated amplitude component. The tree-search vector quantizer is designed to produce the amplitude gain based on the result of quantization by the given quantization stage, and it includes an amplitude gain DPCM quantizer for DPCM-quantizing the evaluated amplitude gain, a second amplitude vs. quantization stage table for selecting the number of the quantization stage by producing indices depending on the DPCM-decoded amplitude gain, and a selector for selecting an index.
In the vector quantization system of this invention, the amplitude component calculator evaluates the amplitude component of the vector, and the tree-search vector quantizer produces an amplitude gain based on a deep or shallow quantization stage, in accordance with the amplitude vs. quantization stage table, in response to the magnitude of the amplitude component. After DPCM quantization and DPCM decoding, the amplitude gain is entered to the second amplitude vs. quantization stage table, which re-evaluates the quantization stage on the basis of the quantized amplitude gain and selects an output vector index depending on the quantization stage. The decoding section, by having a second amplitude vs. quantization stage correspondence table, determines the quantization stage from the DPCM-decoded amplitude gain, and the output vector index can be decoded.
According to another vector quantization system of this invention, the output vector is searched by tree search of n's notation system, and the assignment of variable length (will be termed "code") to the output vector is made to express the code of output vector at the node of the tree selected during the search of output vector at the last stage, by truncating the lowest position (will be termed "LSB") of the code of output vector at the last stage of tree structure. In addition, the stage of tree structure of the vector to be outputted is determined from the amplitude gain derived from the amplitude gain of the last stage output vector with respect to the input vector through DPCM quantization and DPCM decoding, the code of output vector obtained accordingly at the last stage is truncated from LSB.
The inventive vector quantization system first implements vector quantization up to the last stage by tree search of n's notation system for the mean value separation vector, and the amplitude gain resulting from the last quantization stage is assumed to be the amplitude gain of the output vector selected during the search up to the last stage. The amplitude gain at the last stage is subjected to DPCM quantization/decoding, an output vector of a shallow stage of tree structure or deep stage of tree structure depending on a large or small value of the resulting amplitude gain is selected through the truncating operation from LSB for the code of output vector obtained at the last stage.
FIG. 1 is a block diagram of the coding section of the amplitude-adapted vector quantization system according to an embodiment of this invention;
FIG. 2 is a block diagram of the decoding section;
FIG. 3 is a block diagram of the coding section of the conventional vector quantization system;
FIG. 4 is a block diagram of the decoding section;
FIG. 5 is a block diagram of the tree-search vector quantizer;
FIG. 6 is a block diagram of the quantizer at each stage of the tree-search vector quantizer;
FIG. 7 shows the coding section of the vector quantization system according to another embodiment of this invention;
FIG. 8 is a block diagram of the decoding section;
FIG. 9 is a block diagram of the tree-search vector quantizer;
FIG. 10 is a detailed block diagram of the vector quantizer using the inner product for the computation of distortion;
FIGS. 11a and 11b are diagrams explaining the relation between the tree-search and index code according to an embodiment of this invention; and
FIG. 12 is a diagram explaining the relation between the tree-search and index code according to another embodiment of this invention.
An embodiment of this invention will be described with reference to the drawings, FIGS. 1 and 2 are block diagrams of the coding section and decoding section, respectively, of the vector quantization system according to this invention. In FIG. 1, indicated by 1 is the input signal vector, 2 is a mean value separating circuit, 11 is the separated mean value, 3 is a mean value DPCM quantizer, 12 is a DPCM-quantized mean value, 13 is the input vector which has the mean value, removed 4 is an amplitude component calculation circuit for the input vector, 5 is a first amplitude vs. quantization stage correspondence table for determining the stage of the tree-search vector quantizer from the magnitude of the calculated amplitude component, 6 is a tree-search vector quantizer which uses the inner product of the mean separated input vector for the distortion computation in vector quantization and produces the amplitude gain 14 with the stage number depending on the output of the first amplitude vs. quantization stage correspondence table 5, 7 is an amplitude gain DPCM quantizer, 15 is the DPCM-quantized amplitude gain, 16 is the DPCM-decoded amplitude gain, 8 is a second amplitude vs. quantization stage correspondence table for determining the stage of quantization for the output vector in accordance with the value of DPCM-decoded amplitude gain, 9 is an index buffer which fetches the output vector index at each quantization stage of the tree-search vector quantizer, 10 is an output vector index selector which selects a vector index to be outputted from the index buffer 9 in response to the signal 17 indicating the output vector stage number from the second amplitude vs. quantization stage correspondence table 8, and 18 is the output vector index.
FIG. 2 shows the decoding section of the vector quantizer according to this invention, in which indicated by 19 is a mean value DPCM decoder, 24 is the DPCM-decoded mean value, 20 is an amplitude gain DPCM decoder, 25 is the DPCM-decoded amplitude gain, 26 is the decoded output vector, 27 is the amplitude-reproduced output vector, and 28 is the output signal vector.
FIG. 5 is a block diagram of the tree-search vector quantizer 6 shown in FIG. 1. Indicated by 40 are vector quantizers which use the inner product of vectors at stages for the distortion computation, 41 are code books including normalized output vectors at the stages, 42 are the output vector indices as the results of quantization at the stages, and 43 are the amplitude gains as the result of quantization at the stages.
FIG. 6 is a block diagram showing the operation of the vector quantizer which uses the inner product at each stage for the distortion computation. Indicated by 44 is the output vector index as a result of quantization by the vector quantizer at the preceding stage, 45 is an address counter which determines an output vector to be read out of the code book in accordance with the index of the preceding stage and produces the code book readout addresses 46 sequentially, 47 is the output vector read from code book 41 which is subjected to vector computation with the input vector 13, 48 are multipliers, 49 is an adder, 50 is the inner product value signal for the input vector and output vector, 51 is a maximum inner product detector which produces a strobe 52 upon detecting the maximum inner product value, 53 is an amplitude gain latch which holds the input inner product value signal 50 as the amplitude gain only upon receiving the strobe 52 from the maximum inner product detector 51, and 54 is an index latch which holds the readout address 46 of the entered code book only upon receiving the strobe 52 from the maximum inner product detector.
Next, the operation will be described.
In the coding section of FIG. 1, the input signal vector 1 to be coded is separated into the mean value 11 and mean separated input vector 13 by the mean value separation circuit 2. The mean value 11 is quantized by the DPCM quantizer 3, and the mean separated input vector 13 is subjected to computation of the magnitude of amplitude component by the amplitude component calculating circuit 4. In order to avoid an intricate computation, the amplitude of absolute value may be used as shown in the following. For a mean-value separation vector X, input signal vector S and mean value μ, the amplitude σ is given as follows. ##EQU2## The tree-search vector quantizer 6 implements tree-search quantization for the mean separated input vector 13, delivers the output vector index at each quantization stage to the index buffer 9, and provides the amplitude gain 14 based on the quantization result of quantizers with the quantization stage number which has been selected on the basis of the magnitude of the amplitude component by the amplitude vs. quantization stage correspondence table 5.
The amplitude vs. quantization search stage correspondence table is designed such that it provides a shallow quantization stage in response to a small amplitude component and provides a deep search stage as the amplitude component becomes larger.
The amplitude gain 14 evaluated by the tree-search vector quantizer 6, is quantized by the DPCM quantizer 7 to have the DPCM quantized amplitude gain 15, and the DPCM-decoded amplitude gain 16 is entered to the second amplitude vs. quantization stage correspondence table 8. The second amplitude vs. quantization stage correspondence table 8 revises the quantization stage number of the output vector index 18 which is finally outputted on the basis of the DPCM-decoded amplitude gain 16, and the index selector 10 makes selection from among the indices at quantization stages held in the index buffer 9 in accordance with the signal 17 indicating the output vector stage number. Consequently, the DPCM-quantized mean value 12, DPCM-quantized amplitude gain 15 and output vector index 18 are obtained as a coding output.
The decoding section of FIG. 2 receives the mean value 12, amplitude gain 15 and output vector index 18 which have been DPCM-quantized by the coding section. The mean value DPCM decoder 19 and amplitude gain DPCM decoder 20 implement decoding for the mean value 24 and amplitude gain 25. The amplitude vs. quantization stage correspondence table 8 produces from the amplitude gain 25 the quantization stage signal which indicates the same quantization stage number of the vector quantizer in the coding section, and sends it to the vector quantization decoder 21. The vector quantization decoder 21 decodes the output vector index 18 in accordance with the quantization stage number provided by the second amplitude vs. quantization stage correspondence table 8, and the normalized output vector 26 is obtained. The amplitude reproduction circuit 22 multiplies the decoded amplitude value 25 and adds the mean value 24 which has been decoded by the mean value adding circuit 23 to produce the output signal vector 28 as a decoded output.
In the tree-search vector quantizer of FIG. 5, each vector quantizer 40 which uses the inner product for the distortion computation determines an output vector providing a maximum inner product from among output vectors selected in each code book 41 on the basis of the vector quantization output vector index of the previous stage, sends the output vector index 42 to the quantizer of the next stage, and outputs the output vector index 42 and the amplitude gain 43 which is then inner product calculation result, as a quantization result of that stage.
FIG. 6 shows in more detail the vector quantizer of each stage, in which the address counter 45, upon receiving the previous stage vector quantizer output vector index 44, provides an output vector address to be compared with the input vector 13 in accordance with the tree-structure output vector. When the output vector 47 is read out of the code book 41, it is subjected to product-sum with the input vector 13. When the obtained inner product value 50 of vector has become maximum with respect to the input vector, the maximum inner product detector 51 issues a strobe, by which the amplitude gain latch 53 holds the inner product value 50 and the index latch 54 holds the output vector address 46. At the time point when the address counter 45 has outputted all output vector addresses 46 for the input vector 13, the values held in the amplitude gain latch and index latch are outputted as an amplitude gain 43 and output vector index 42 of that stage.
According to this embodiment, as described above, the inner product calculation is used for the distortion computation section of the vector quantizer, the quantization stage number of the tree-search vector quantizer is controlled by the magnitude of the vector amplitude component, and the final quantization stage number is determined from the quantization decoding result for the obtained amplitude gain, whereby the duty of the hardware can be reduced by using a DSP (digital signal processor) and it becomes possible to reduce the volume of information of the vector quantization index.
Another embodiment of this invention will be described referring to FIGS. 7-10.
In the coding section of FIG. 7, indicated by 61 is the input vector which is a series of input signals made into blocks of K-piece units, 62 is a mean value separation circuit for the vector, 63 is the separated mean value, 64 is the mean separated input vector, 65 is a vector quantizer implementing the amplitude-adapted tree search, 66 is the code of output vector index in the last stage quantization, 67 is the amplitude gain for the input vector of the output vector in the last stage quantization, 68 is a mean value DPCM quantizer, 69 is an amplitude gain DPCM quantizer, 71 is the DPCM-quantized mean value, 72 is the DPCM-quantized amplitude gain, 73 is the DPCM-decoded amplitude gain, 70 is an index bit length control circuit which truncates from LSB the code 66 of output vector index in the final quantization in accordance with the DPCM-decoded amplitude gain 73, and 74 is the index code of the final output vector produced by truncation from LSB for the code 66 of the last stage output vector index in accordance with the amplitude gain 73.
In the decoding section of FIG. 8, indicated by 75 is a mean value DPCM decoder, 76 is an amplitude gain DPCM decoder, 77 is the DPCM-decoded mean value, 78 is the DPCM-decoded amplitude gain, 79 is a vector quantization decoder which decodes the index code 74 of the output vector which has been coded by the coding section using the DPCM-decoded amplitude gain 78, 80 is the decoded normalization output vector, 81 is an amplitude reproduction circuit, 82 is the amplitude-reproduced output vector, 83 is a mean value adding circuit, and 84 is the output signal vector.
FIG. 9 is a block diagram of the tree-search vector quantizer, showing the quantization operation by the quantizer 96 of each stage between the output vector read out of the code book 97 of each stage and the input vector 64, while making reference to the output vector index 98 of the previous-stage quantizer.
FIG. 10 is a detailed block diagram of the vector quantizer which uses the inner product for the distortion computation. Indicated by 100 is an address counter which produces the readout address 103 sequentially while mapping the output vector address in accordance with the output vector index 98 of the previous-stage quantizer, 101 is a multiplier, 102 is an adder, 104 is the inner product value of input/output vectors, 105 is a maximum inner product detector which issues a strobe upon detecting a maximum inner product value, 106 is an index latch which holds the code book address and outputs it as the index, and 107 is an amplitude gain latch which holds the inner product value as an amplitude gain.
Next, the operation will be described.
In the coding section of FIG. 7, the input signal vector 61 received as blocks derived from a series of input signals is subjected to separation of the intra vector mean value 63, and it provides the mean value separation vector 64. The separated mean value 63 is subjected to DPCM quantization by the mean value DPCM quantizer 68.
The mean separated input vector 64 is subjected to quantization by the vector quantizer 65 as follows. It is assumed that the output vector is tree search of n's notation system (n is a power of 2). FIG. 1 shows part of a binary tree and quad tree, as examples. The code of 50 index appended to the output vector of each node of tree structure is determined as shown in FIG. 11 for examples. The quad tree of FIG. 11(b) has its codes indicated in binary notation at the upper position and in quad notation at the lower position. As will be appreciated from the figure, the code increases by log2 n bits (one bit in n's notation system) at each increment of the stage number, and nodes of the tree structure can be traced from lower toward upper stage of the tree structure by truncating log2 n bits from LSB at a time.
By implementing tree search up to the last stage for the output vector code book, the mean-value separation input vector is rendered vectorial quantization using the inner product for the distortion computation. The tree search vector quantizer is expressed as a connection of vector quantizers as shown in FIG. 9, and the vector quantizer of the m-th stage is expressed by the block diagram of FIG. 10. In FIG. 10, upon receiving the output vector index 98 of the vector quantizer of the (m-l)th stage, the address counter 100 produces the address of the output vector to be compared with the input vector 64 on the basis of the tree structure output vector of n's notation system. After the output vector has been read out of the code book 97, it is subjected to the product-sum operation with the input vector 64. When the resulting vector inner product value 104 becomes maximum with respect to the input vector, the maximum inner product detector 104 issues a strobe, causing the amplitude gain latch 107 and index latch 106 to hold the inner product 104 and output vector address 103, respectively, and at the time point when the address counter 100 has outputted all output vector addresses 103 for the input vector 64, the value held in the index latch is outputted as an output vector index 108 of the m-th stage. If the m-th stage is the last stage, the value of the amplitude gain latch 107 is also outputted.
In FIG. 7, as a result of tree-search vector quantization up to the last stage for the mean value separation vector 64 entered in the tree-search vector quantizer 65, the index code 66 of the last-stage output vector and the amplitude gain 67 for the input vector 64 of the last-stage output vector are outputted, and the amplitude gain DPCM quantizer 69 provides the DPCM-quantized amplitude gain 72 and amplitude gain 73 which is the DPCM-decoded version of 72. The amplitude gain which is the inner product of vector indicates the amplitude component of input vector, in case of implementation of proper vectorial quantization, and therefore mapping is conducted for the tree search quantization stage on the basis of the DPCM-decoded amplitude gain 73 so that an output vector of a shallow stage of tree structure is selected for a small amplitude gain or an output vector of a deep stage is selected for a large amplitude gain. As has been mentioned on FIG. 11, in order to obtain the index code of the output vector selected in the search process, the index bit length control circuit 70 implements the truncation operation for the index code of the last-stage output vector from LSB by log2 n bits at a time for the stage determined depending on the amplitude gain 73. For the mapping of the DPCM-decoded amplitude gain 73 to the search stage number, predetermined ones are stored in advance for both the coding side and decoding side. In this way, the output vector in the midst of the tree structure is also selected in accordance with the amplitude gain, and a shorter bit length results in more efficient quantization.
In the decoding section of FIG. 8, the mean value and amplitude gain DPCM decoders 75 and 76 implement DPCM decoding, and the DPCM-decoded amplitude gain 78 is used by the vector quantization decoder 79 in mapping for determining which stage the output vector index code 74 is located in the tree structure, the normalized output vector 80 decoded by the vector quantization decoder is subjected to amplitude reproduction by the amplitude reproducing circuit 81 and mean value addition by the mean value adding circuit 83, and the final output signal vector 84 is decoded.
Although shown in the foregoing embodiment is the method of truncating from LSB in units of log2 n bits for the last-stage index in the tree structure of n's notation system in correspondence to the DPCM-decoded amplitude gain, another possible method is that a tree structure of n's notation system is assumed to be part of a binary tree structure and the code is truncated in 1-bit units from LSB. In this case, the following precaution must be taken. In FIG. 12 showing a binary tree, collection of nodes with underlined codes makes a quad tree. Namely, any tree structure of n's notation system (n is a power of 2) can be assumed to be the result of pull-off of stages of a binary tree in accordance with the rule. In the case of a quad tree, for example, although the output vector exists only at nodes with underlined codes in FIG. 12 as a code book, when a vector which is the average output vector of two underlined nodes in much lower stage is outputted for nodes without underline, it becomes possible to truncate the codes in one bit units. Consequently, the volume of information generation by the amplitude component can be controlled more precisely.
According to the other embodiment of this invention, as described, the output vector code book of the vector quantizer is configured in the tree search structure of n's notation system, tree search vector quantization is implemented up to the last stage by truncating the index code from the low-order bit in accordance with the rule and by outputting the output vector of nodes in the midst of tree search, and the tree-search quantization stage is determined from the decoded amplitude gain obtained by DPCM coding/decoding the amplitude gain obtained by quantization of the last stage thereby to obtain the index code of the above-mentioned node, whereby it becomes possible to reduce the volume of information of the index in a sense of adaptation to the amplitude component of vector without incurring the complexity of vector quantizer used for the inner product calculation which allows the reduction of duty of the hardware by using a DSP or the like.
According to this invention, as described, index information is truncated in accordance with the detected vector amplitude component, thereby reducing the volume of information transmitted, whereby the hardware can be made smaller to reduce its duty through the use of DSP or the like.
Claims (6)
1. An amplitude-adaptive vector quantization system comprising:
a mean value separating circuit which receives K-dimensional vectors derived from a continuous series of input signals divided into blocks of K-samples and separates out a mean value of said input signal vectors;
a predictive differential quantizer which implements DPCM quantization for said separated mean value;
an amplitude component calculation circuit which calculates the magnitude of amplitude components of mean separated input vectors;
a first amplitude vs. quantization stage correspondence table which determines a quantization .[.state.]. .Iadd.stage .Iaddend.of tree-search vector quantization in correspondence to the magnitude of said calculated amplitude components; and
a tree-search vector quantizer which calculates the inner product between each of said mean separated input vectors and normalized output vectors with zero mean arranged to have a tree structure, implements a tree-search for an output vector providing a maximum inner product sequentially up to a last stage, provides a maximum inner product at each stage as an amplitude gain at each stage along with an output vector index, and outputs selectively an amplitude gain of a quantization stage prescribed by said first amplitude vs. quantization stage correspondence table;
an index buffer which holds the output vector index of each quantization stage obtained during the quantization of said tree-search vector quantizer;
an amplitude gain DPCM quantizer which implements DPCM quantization for said output amplitude gain to provide a DPCM-quantized differential amplitude gain and implements DPCM decoding to provide a reproduction of DPCM-quantized amplitude gain;
a second amplitude vs. quantization stage correspondence table which provides a true quantization stage selection signal from said DPCM-decoded reproduction amplitude gain;
a coding section which has an index selector for selecting an output vector to be outputted finally from among output vector indices of all stages held in said index buffer, and transmits or records three elements, including said DPCM-quantized mean value, DPCM-quantized amplitude gain and selected output vector, as a coding output; and
a decoding section including a mean value DPCM decoder and amplitude gain DPCM decoder which implement DPCM decoding for the DPCM quantized mean value and amplitude gain coded by said coding section respectively, an amplitude vs. quantization stage correspondence table which has the same content as said second amplitude vs. quantization stage correspondence table to determine from the DPCM-decoded amplitude gain a quantization output of which stage of coding section is the output vector index decoded by a vector quantization decoder, said vector quantization decoder implementing decoding for said output vector index by switching output vectors adaptively in response to an output of said amplitude vs. quantization stage correspondence table, an amplitude reproducing circuit which implements amplitude reproduction of said decoded normalized output vector on the basis of said DPCM-decoded amplitude gain, and a mean value adding circuit which adds said DPCM-decoded mean value to said amplitude reproduced vector to produce an output signal vector.
2. An amplitude-adaptive vector quantization system according to claim 1, wherein each of said amplitude vs. quantization stage correspondence tables, in case of controlling the depth of tree of tree-search vector quantization adaptively in accordance with the amplitude gain, comprises an amplitude gain vs. quantization stage correspondence table which provides a quantization stage number n which is a depth of tree search, in terms of a dimension r of tree (n is an integer greater than one), amplitude gain σ, and constants a and b, as n=a.logr (σ/b).
3. An amplitude-adapted vector quantization system comprising:
a mean value separating circuit which receives K-dimensional vectors derived from a continuous series of input signals divided into blocks in K-samples units (K is an integer greater than one) and separates out a mean value of said input signal vectors;
a mean value predictive differential (will be termed "DPCM") quantizer which implements DPCM quantization for said separated mean value;
a tree-search vector quantizer of n's notation system (n is a power of 2) which receives the mean separated vectors provided by said mean value separation circuit as input vectors, calculates the inner product between each of the mean value separation vectors and normalized output vectors read out of a tree-search code book of n's notation system, implements tree-search for an output vector providing a maximum inner product sequentially up to a last-stage, and provides a then maximum inner product value as an amplitude gain along with an output vector index providing a maximum inner product at a last-stage quantization, and an amplitude gain DPCM quantizer which implements DPCM quantization for the last-stage quantization amplitude gain provided by said vector quantizer to produce a DPCM-quantized amplitude gain through DPCM quantization, implements DPCM decoding, and produces a DPCM-decoded amplitude gain;
a coding section including an index bit length control circuit which receives an index code of the last-stage quantization output vector provided by said vector quantizer and truncates the index code for a specified number of bits from the lowest bit position (will be termed "LSB") in correspondence to the magnitude of said decoded amplitude gain value, and tree-search code book of n's notation system constructed to express the index code of output vector at nodes of each stage selected during the search up to the last stage through truncation in log2 n bit units from LSB for the code of last-stage output vector index with the intention of use by said vector quantizer; and
a decoding section including a mean value DPCM decoder and amplitude gain DPCM decoder for respectively decoding the mean-value and amplitude gain coded by said coding section, a vector quantization decoder which recognizes the index code length of the output vector to be decoded from the amplitude gain decoded by said amplitude gain DPCM decoder, an amplitude reproduction circuit which multiplies the decoded amplitude gain to the decoded output vector and a mean value adding circuit which adds the DPCM decoded mean value to the multiplication result.
4. An amplitude-adapted vector quantization system according to claim 3, wherein said tree search code book of n's notation system (n≧4), in case one quantization stage has an index code length of 1 bit, is provided with an output vector having for the index a code with a length of 1-j bits (j<log2 n), said code book including, for all or part of 1 and j, an output vector that is a mean output vector, with its high-order (1-j) bits being coincident, among output vectors having 1-bit code, said index bit length control circuit being provided with a width for the control of truncating bits in accordance with the DPCM-decoded amplitude gain. .Iadd.
5. An amplitude-adaptive vector quantization encoding system, comprising:
an amplitude component calculation circuit which calculates the magnitude of amplitude components of input vectors derived from a continuous series of input signals;
an amplitude vs. quantization stage correspondence table which determines a tree-search vector quantization stage in correspondence to a calculated magnitude of amplitude components;
a tree-search vector quantizer which calculates, for each of said input vectors, the inner product between an input vector and normalized output vectors arranged in a tree structure, implements a tree search for an output vector providing a maximum inner product for each input vector at each stage of said tree structure up to a predetermined stage described by said amplitude vs. quantization stage correspondence table, provides a maximum inner product at each stage as an amplitude gain along with an output vector index, and outputs selectively an amplitude gain of said predetermined stage;
an index buffer which holds the output vector index of each quantization stage provided during the quantization operation of said tree-search vector quantizer; and
means for transmitting the output vector index held in said index buffer which corresponds to the output vector providing a maximum inner product at said predetermined stage. .Iaddend. .Iadd.6. An amplitude-adaptive vector quantization encoding system, comprising:
an amplitude component calculation circuit which calculates the magnitude of amplitude components of input vectors derived from a continuous series of input signals;
an amplitude vs. quantization stage correspondence table which determines a tree-search vector quantization stage in correspondence to a calculated magnitude of amplitude components;
a tree-search vector quantizer which calculates, for each of said input vectors, the amount of distortion between an input vector and normalized output vectors arranged in a tree structure, implements a tree search for an output vector providing a minimum amount of distortion for each input vector at each stage of said tree structure up to a predetermined stage prescribed by said amplitude vs. quantization stage correspondence table, provides a minimum distortion value at each stage as an amplitude gain along with an output vector index, and outputs selectively an amplitude gain of said predetermined stage;
an index buffer which holds the output vector index of each quantization stage provided during the quantization operation of said tree-search vector quantizer; and
means for transmitting the output vector index held in said index buffer which corresponds to the output vector providing a minimum distortion at said predetermined stage. .Iaddend. .Iadd.7. An amplitude-adaptive vector quantization decoding system, comprising:
means for receiving a continuous series of coded signals each including an amplitude gain and an output vector index, said amplitude gain representing an inner product of an input vector and an output vector represented by said output vector index;
an amplitude component decoding circuit which decodes said amplitude gain from said series of received coded signals;
an amplitude vs. quantization stage correspondence table which determines a tree-search vector quantization stage in correspondence to a decoded amplitude gain;
a vector quantization decoder which decodes said output vector index in correspondence with said determined tree-search vector quantization stage to obtain a normalized output vector; and
an amplitude reproducing circuit which implements amplitude reproduction of said normalized output vector in correspondence with said decoded
amplitude gain. .Iaddend. .Iadd.8. An amplitude-adaptive vector quantization decoding system, comprising:
means for receiving a continuous series of coded signals each including an amplitude gain and an output vector index, said amplitude gain representing an amount of distortion between an input vector and an output vector represented by said output vector index;
an amplitude component decoding circuit which decodes said amplitude gain from said series of received coded signals;
an amplitude vs. quantization stage correspondence table which determines a tree-search vector quantization stage in correspondence to said decoded amplitude gain;
a vector quantization decoder which decodes said output vector index in correspondence with said determined tree-search vector quantization stage to obtain a normalized output vector; and
an amplitude reproducing circuit which implements amplitude reproduction of said normalized output vector in correspondence with said decoded amplitude gain. .Iaddend. .Iadd.9. An amplitude-adaptive vector quantization encoding system, comprising:
a tree-search vector quantizer of n's notation system (wherein n is a power of 2) which receives input vectors derived from a continuous series of input signals, calculates, for each of said input vectors, the inner product between an input vector and normalized output vectors read out of a tree-search code book of n's notation system provided in stages, implements a tree search for an output vector providing a maximum inner product at each stage up to a predetermined stage, and provides a maximum inner product value as an amplitude gain along with an output vector index representing said output vector providing said maximum inner product value at said predetermined stage; and
a coding section including an index bit length control circuit which receives said output vector index provided by said tree-search vector quantizer and truncates said output vector index by a specified number of bits in correspondence with the magnitude of said amplitude gain, and said tree-search code book of n's notation system which is constructed to express the output vector index at each stage of said tree search up to said predetermined stage through truncation in log2 n bit units for use by said vector quantizer. .Iaddend. .Iadd.10. An amplitude-adaptive vector quantization encoding system, comprising:
a tree-search vector quantizer of n's notation system (wherein n is a power of 2) which receives input vectors derived from a continuous series of input signals, calculates, for each of said input vectors, the amount of distortion between an input vector and normalized output vectors read out of a tree-search code book of n's notation system provided in stages, implements a tree search for an output vector providing a minimum distortion at each stage up to a predetermined stage, and provides a minimum distortion value as an amplitude gain along with an output vector index representing said output vector providing said minimum value at said predetermined stage; and
a coding section including an index bit length control circuit which receives said output vector index provided by said tree-search vector quantizer and truncates said output vector index by a specified number of bits in correspondence with the magnitude of said amplitude gain, and said tree-search code book of n's notation system which is constructed to express the output vector index at each stage of said tree search up to said predetermined stage through truncation in log2 n bit units for use by said vector quantizer. .Iaddend.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US07/761,501 USRE34562E (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
Applications Claiming Priority (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP61246396A JPS63100888A (en) | 1986-10-16 | 1986-10-16 | Amplitude adaptive vector quantizer |
JP61-246396 | 1986-10-16 | ||
JP62010487A JPH0646805B2 (en) | 1987-01-20 | 1987-01-20 | Amplitude adaptive vector quantizer |
JP62-10487 | 1987-01-20 | ||
PCT/JP1987/000793 WO1988002975A1 (en) | 1986-10-16 | 1987-10-16 | Amplitude-adapted vector quantizer |
US07/207,155 US4878230A (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
US07/761,501 USRE34562E (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US07/207,155 Reissue US4878230A (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
Publications (1)
Publication Number | Publication Date |
---|---|
USRE34562E true USRE34562E (en) | 1994-03-15 |
Family
ID=26345770
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US07/207,155 Ceased US4878230A (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
US07/761,501 Expired - Lifetime USRE34562E (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US07/207,155 Ceased US4878230A (en) | 1986-10-16 | 1987-10-16 | Amplitude-adaptive vector quantization system |
Country Status (5)
Country | Link |
---|---|
US (2) | US4878230A (en) |
EP (1) | EP0287679B1 (en) |
AU (1) | AU592236B2 (en) |
DE (1) | DE3750221T2 (en) |
WO (1) | WO1988002975A1 (en) |
Cited By (153)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5734791A (en) * | 1992-12-31 | 1998-03-31 | Apple Computer, Inc. | Rapid tree-based method for vector quantization |
US6477203B1 (en) * | 1998-10-30 | 2002-11-05 | Agilent Technologies, Inc. | Signal processing distributed arithmetic architecture |
US6728413B2 (en) * | 1998-01-19 | 2004-04-27 | Canon Kabushiki Kaisha | Lattice vector quantization in image compression and decompression |
US20080129520A1 (en) * | 2006-12-01 | 2008-06-05 | Apple Computer, Inc. | Electronic device with enhanced audio feedback |
US20090164441A1 (en) * | 2007-12-20 | 2009-06-25 | Adam Cheyer | Method and apparatus for searching using an active ontology |
US20100312547A1 (en) * | 2009-06-05 | 2010-12-09 | Apple Inc. | Contextual voice commands |
US8583418B2 (en) | 2008-09-29 | 2013-11-12 | Apple Inc. | Systems and methods of detecting language and natural language strings for text to speech synthesis |
US8600743B2 (en) | 2010-01-06 | 2013-12-03 | Apple Inc. | Noise profile determination for voice-related feature |
US8614431B2 (en) | 2005-09-30 | 2013-12-24 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
US8620662B2 (en) | 2007-11-20 | 2013-12-31 | Apple Inc. | Context-aware unit selection |
US8645137B2 (en) | 2000-03-16 | 2014-02-04 | Apple Inc. | Fast, language-independent method for user authentication by voice |
US8660849B2 (en) | 2010-01-18 | 2014-02-25 | Apple Inc. | Prioritizing selection criteria by automated assistant |
US8670985B2 (en) | 2010-01-13 | 2014-03-11 | Apple Inc. | Devices and methods for identifying a prompt corresponding to a voice input in a sequence of prompts |
US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US8677377B2 (en) | 2005-09-08 | 2014-03-18 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US8682649B2 (en) | 2009-11-12 | 2014-03-25 | Apple Inc. | Sentiment prediction from textual data |
US8682667B2 (en) | 2010-02-25 | 2014-03-25 | Apple Inc. | User profiling for selecting user specific voice input processing information |
US8688446B2 (en) | 2008-02-22 | 2014-04-01 | Apple Inc. | Providing text input using speech data and non-speech data |
US8706472B2 (en) | 2011-08-11 | 2014-04-22 | Apple Inc. | Method for disambiguating multiple readings in language conversion |
US8713021B2 (en) | 2010-07-07 | 2014-04-29 | Apple Inc. | Unsupervised document clustering using latent semantic density analysis |
US8712776B2 (en) | 2008-09-29 | 2014-04-29 | Apple Inc. | Systems and methods for selective text to speech synthesis |
US8719006B2 (en) | 2010-08-27 | 2014-05-06 | Apple Inc. | Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesis |
US8718047B2 (en) | 2001-10-22 | 2014-05-06 | Apple Inc. | Text to speech conversion of text messages from mobile communication devices |
US8719014B2 (en) | 2010-09-27 | 2014-05-06 | Apple Inc. | Electronic device with text error correction based on voice recognition data |
US8751238B2 (en) | 2009-03-09 | 2014-06-10 | Apple Inc. | Systems and methods for determining the language to use for speech generated by a text to speech engine |
US8762156B2 (en) | 2011-09-28 | 2014-06-24 | Apple Inc. | Speech recognition repair using contextual information |
US8768702B2 (en) | 2008-09-05 | 2014-07-01 | Apple Inc. | Multi-tiered voice feedback in an electronic device |
US8775442B2 (en) | 2012-05-15 | 2014-07-08 | Apple Inc. | Semantic search using a single-source semantic model |
US8781836B2 (en) | 2011-02-22 | 2014-07-15 | Apple Inc. | Hearing assistance system for providing consistent human speech |
US8812294B2 (en) | 2011-06-21 | 2014-08-19 | Apple Inc. | Translating phrases from one language into another using an order-based set of declarative rules |
US8862252B2 (en) | 2009-01-30 | 2014-10-14 | Apple Inc. | Audio user interface for displayless electronic device |
US8898568B2 (en) | 2008-09-09 | 2014-11-25 | Apple Inc. | Audio user interface |
US8935167B2 (en) | 2012-09-25 | 2015-01-13 | Apple Inc. | Exemplar-based latent perceptual modeling for automatic speech recognition |
US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US8977584B2 (en) | 2010-01-25 | 2015-03-10 | Newvaluexchange Global Ai Llp | Apparatuses, methods and systems for a digital conversation management platform |
US8996376B2 (en) | 2008-04-05 | 2015-03-31 | Apple Inc. | Intelligent text-to-speech conversion |
US9053089B2 (en) | 2007-10-02 | 2015-06-09 | Apple Inc. | Part-of-speech tagging using latent analogy |
US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
US9280610B2 (en) | 2012-05-14 | 2016-03-08 | Apple Inc. | Crowd sourcing information to fulfill user requests |
US9300784B2 (en) | 2013-06-13 | 2016-03-29 | Apple Inc. | System and method for emergency calls initiated by voice command |
US9311043B2 (en) | 2010-01-13 | 2016-04-12 | Apple Inc. | Adaptive audio feedback system and method |
US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US9368114B2 (en) | 2013-03-14 | 2016-06-14 | Apple Inc. | Context-sensitive handling of interruptions |
US9430463B2 (en) | 2014-05-30 | 2016-08-30 | Apple Inc. | Exemplar-based natural language processing |
US9431006B2 (en) | 2009-07-02 | 2016-08-30 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
US9483461B2 (en) | 2012-03-06 | 2016-11-01 | Apple Inc. | Handling speech synthesis of content for multiple languages |
US9495129B2 (en) | 2012-06-29 | 2016-11-15 | Apple Inc. | Device, method, and user interface for voice-activated navigation and browsing of a document |
US9502031B2 (en) | 2014-05-27 | 2016-11-22 | Apple Inc. | Method for supporting dynamic grammars in WFST-based ASR |
US9535906B2 (en) | 2008-07-31 | 2017-01-03 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
US9547647B2 (en) | 2012-09-19 | 2017-01-17 | Apple Inc. | Voice-based media searching |
US9576574B2 (en) | 2012-09-10 | 2017-02-21 | Apple Inc. | Context-sensitive handling of interruptions by intelligent digital assistant |
US9582608B2 (en) | 2013-06-07 | 2017-02-28 | Apple Inc. | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
US9620105B2 (en) | 2014-05-15 | 2017-04-11 | Apple Inc. | Analyzing audio input for efficient speech and music recognition |
US9620104B2 (en) | 2013-06-07 | 2017-04-11 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
US9633004B2 (en) | 2014-05-30 | 2017-04-25 | Apple Inc. | Better resolution when referencing to concepts |
US9633674B2 (en) | 2013-06-07 | 2017-04-25 | Apple Inc. | System and method for detecting errors in interactions with a voice-based digital assistant |
US9646609B2 (en) | 2014-09-30 | 2017-05-09 | Apple Inc. | Caching apparatus for serving phonetic pronunciations |
US9668121B2 (en) | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
US9697820B2 (en) | 2015-09-24 | 2017-07-04 | Apple Inc. | Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks |
US9697822B1 (en) | 2013-03-15 | 2017-07-04 | Apple Inc. | System and method for updating an adaptive speech recognition model |
US9711141B2 (en) | 2014-12-09 | 2017-07-18 | Apple Inc. | Disambiguating heteronyms in speech synthesis |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
US9721563B2 (en) | 2012-06-08 | 2017-08-01 | Apple Inc. | Name recognition system |
US9734193B2 (en) | 2014-05-30 | 2017-08-15 | Apple Inc. | Determining domain salience ranking from ambiguous words in natural speech |
US9733821B2 (en) | 2013-03-14 | 2017-08-15 | Apple Inc. | Voice control to diagnose inadvertent activation of accessibility features |
US9760559B2 (en) | 2014-05-30 | 2017-09-12 | Apple Inc. | Predictive text input |
US9785630B2 (en) | 2014-05-30 | 2017-10-10 | Apple Inc. | Text prediction using combined word N-gram and unigram language models |
US9798393B2 (en) | 2011-08-29 | 2017-10-24 | Apple Inc. | Text correction processing |
US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US9842105B2 (en) | 2015-04-16 | 2017-12-12 | Apple Inc. | Parsimonious continuous-space phrase representations for natural language processing |
US9842101B2 (en) | 2014-05-30 | 2017-12-12 | Apple Inc. | Predictive conversion of language input |
US9858925B2 (en) | 2009-06-05 | 2018-01-02 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US9865280B2 (en) | 2015-03-06 | 2018-01-09 | Apple Inc. | Structured dictation using intelligent automated assistants |
US9886432B2 (en) | 2014-09-30 | 2018-02-06 | Apple Inc. | Parsimonious handling of word inflection via categorical stem + suffix N-gram language models |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US9899019B2 (en) | 2015-03-18 | 2018-02-20 | Apple Inc. | Systems and methods for structured stem and suffix language models |
US9922642B2 (en) | 2013-03-15 | 2018-03-20 | Apple Inc. | Training an at least partial voice command system |
US9934775B2 (en) | 2016-05-26 | 2018-04-03 | Apple Inc. | Unit-selection text-to-speech synthesis based on predicted concatenation parameters |
US9946706B2 (en) | 2008-06-07 | 2018-04-17 | Apple Inc. | Automatic language identification for dynamic text processing |
US9959870B2 (en) | 2008-12-11 | 2018-05-01 | Apple Inc. | Speech recognition involving a mobile device |
US9966068B2 (en) | 2013-06-08 | 2018-05-08 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
US9966065B2 (en) | 2014-05-30 | 2018-05-08 | Apple Inc. | Multi-command single utterance input method |
US9972304B2 (en) | 2016-06-03 | 2018-05-15 | Apple Inc. | Privacy preserving distributed evaluation framework for embedded personalized systems |
US9977779B2 (en) | 2013-03-14 | 2018-05-22 | Apple Inc. | Automatic supplementation of word correction dictionaries |
US10019994B2 (en) | 2012-06-08 | 2018-07-10 | Apple Inc. | Systems and methods for recognizing textual identifiers within a plurality of words |
US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
US10067938B2 (en) | 2016-06-10 | 2018-09-04 | Apple Inc. | Multilingual word prediction |
US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
US10078631B2 (en) | 2014-05-30 | 2018-09-18 | Apple Inc. | Entropy-guided text prediction using combined word and character n-gram language models |
US10078487B2 (en) | 2013-03-15 | 2018-09-18 | Apple Inc. | Context-sensitive handling of interruptions |
US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
US10089072B2 (en) | 2016-06-11 | 2018-10-02 | Apple Inc. | Intelligent device arbitration and control |
US10101822B2 (en) | 2015-06-05 | 2018-10-16 | Apple Inc. | Language input correction |
US10127220B2 (en) | 2015-06-04 | 2018-11-13 | Apple Inc. | Language identification from short strings |
US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
US10134385B2 (en) | 2012-03-02 | 2018-11-20 | Apple Inc. | Systems and methods for name pronunciation |
US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
US10186254B2 (en) | 2015-06-07 | 2019-01-22 | Apple Inc. | Context-based endpoint detection |
US10185542B2 (en) | 2013-06-09 | 2019-01-22 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US10192552B2 (en) | 2016-06-10 | 2019-01-29 | Apple Inc. | Digital assistant providing whispered speech |
US10199051B2 (en) | 2013-02-07 | 2019-02-05 | Apple Inc. | Voice trigger for a digital assistant |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US10241644B2 (en) | 2011-06-03 | 2019-03-26 | Apple Inc. | Actionable reminder entries |
US10241752B2 (en) | 2011-09-30 | 2019-03-26 | Apple Inc. | Interface for a virtual digital assistant |
US10249300B2 (en) | 2016-06-06 | 2019-04-02 | Apple Inc. | Intelligent list reading |
US10255566B2 (en) | 2011-06-03 | 2019-04-09 | Apple Inc. | Generating and processing task items that represent tasks to perform |
US10255907B2 (en) | 2015-06-07 | 2019-04-09 | Apple Inc. | Automatic accent detection using acoustic models |
US10269345B2 (en) | 2016-06-11 | 2019-04-23 | Apple Inc. | Intelligent task discovery |
US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
US10289433B2 (en) | 2014-05-30 | 2019-05-14 | Apple Inc. | Domain specific language for encoding assistant dialog |
US10297253B2 (en) | 2016-06-11 | 2019-05-21 | Apple Inc. | Application integration with a digital assistant |
US10296160B2 (en) | 2013-12-06 | 2019-05-21 | Apple Inc. | Method for extracting salient dialog usage from live data |
US10354011B2 (en) | 2016-06-09 | 2019-07-16 | Apple Inc. | Intelligent automated assistant in a home environment |
US10366158B2 (en) | 2015-09-29 | 2019-07-30 | Apple Inc. | Efficient word encoding for recurrent neural network language models |
US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
US10446141B2 (en) | 2014-08-28 | 2019-10-15 | Apple Inc. | Automatic speech recognition based on user feedback |
US10446143B2 (en) | 2016-03-14 | 2019-10-15 | Apple Inc. | Identification of voice inputs providing credentials |
US10490187B2 (en) | 2016-06-10 | 2019-11-26 | Apple Inc. | Digital assistant providing automated status report |
US10496753B2 (en) | 2010-01-18 | 2019-12-03 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10509862B2 (en) | 2016-06-10 | 2019-12-17 | Apple Inc. | Dynamic phrase expansion of language input |
US10515147B2 (en) | 2010-12-22 | 2019-12-24 | Apple Inc. | Using statistical language models for contextual lookup |
US10521466B2 (en) | 2016-06-11 | 2019-12-31 | Apple Inc. | Data driven natural language event detection and classification |
US10553209B2 (en) | 2010-01-18 | 2020-02-04 | Apple Inc. | Systems and methods for hands-free notification summaries |
US10552013B2 (en) | 2014-12-02 | 2020-02-04 | Apple Inc. | Data detection |
US10567477B2 (en) | 2015-03-08 | 2020-02-18 | Apple Inc. | Virtual assistant continuity |
US10572476B2 (en) | 2013-03-14 | 2020-02-25 | Apple Inc. | Refining a search based on schedule items |
US10592095B2 (en) | 2014-05-23 | 2020-03-17 | Apple Inc. | Instantaneous speaking of content on touch devices |
US10593346B2 (en) | 2016-12-22 | 2020-03-17 | Apple Inc. | Rank-reduced token representation for automatic speech recognition |
US10642574B2 (en) | 2013-03-14 | 2020-05-05 | Apple Inc. | Device, method, and graphical user interface for outputting captions |
US10652394B2 (en) | 2013-03-14 | 2020-05-12 | Apple Inc. | System and method for processing voicemail |
US10659851B2 (en) | 2014-06-30 | 2020-05-19 | Apple Inc. | Real-time digital assistant knowledge updates |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10672399B2 (en) | 2011-06-03 | 2020-06-02 | Apple Inc. | Switching between text data and audio data based on a mapping |
US10679605B2 (en) | 2010-01-18 | 2020-06-09 | Apple Inc. | Hands-free list-reading by intelligent automated assistant |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10705794B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10733993B2 (en) | 2016-06-10 | 2020-08-04 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US10748529B1 (en) | 2013-03-15 | 2020-08-18 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
US10762293B2 (en) | 2010-12-22 | 2020-09-01 | Apple Inc. | Using parts-of-speech tagging and named entity recognition for spelling correction |
US10789041B2 (en) | 2014-09-12 | 2020-09-29 | Apple Inc. | Dynamic thresholds for always listening speech trigger |
US10791176B2 (en) | 2017-05-12 | 2020-09-29 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US10791216B2 (en) | 2013-08-06 | 2020-09-29 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
US10810274B2 (en) | 2017-05-15 | 2020-10-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
US11010550B2 (en) | 2015-09-29 | 2021-05-18 | Apple Inc. | Unified language modeling framework for word prediction, auto-completion and auto-correction |
US11025565B2 (en) | 2015-06-07 | 2021-06-01 | Apple Inc. | Personalized prediction of responses for instant messaging |
US11151899B2 (en) | 2013-03-15 | 2021-10-19 | Apple Inc. | User training by intelligent digital assistant |
US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
Families Citing this family (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5130797A (en) * | 1989-02-27 | 1992-07-14 | Mitsubishi Denki Kabushiki Kaisha | Digital signal processing system for parallel processing of subsampled data |
KR930004311B1 (en) * | 1989-04-18 | 1993-05-22 | 미쯔비시덴끼 가부시끼가이샤 | Encoding/decoding system utilizing local properties |
US5481737A (en) * | 1989-05-30 | 1996-01-02 | Fujitsu Limited | Image data quantizing circuit with a memory for storing unquantized and quantized image data |
US5124791A (en) * | 1989-05-31 | 1992-06-23 | Utah State University Foundation | Frame-to-frame compression of vector quantized signals and other post-processing |
US5247357A (en) * | 1989-05-31 | 1993-09-21 | Scientific Atlanta, Inc. | Image compression method and apparatus employing distortion adaptive tree search vector quantization with avoidance of transmission of redundant image data |
US4958225A (en) * | 1989-06-09 | 1990-09-18 | Utah State University Foundation | Full-search-equivalent method for matching data and a vector quantizer utilizing such method |
WO1992009142A1 (en) * | 1989-06-13 | 1992-05-29 | Utah State University Foundation | Method and apparatus for data compression with reduced distortion |
JP2844695B2 (en) * | 1989-07-19 | 1999-01-06 | ソニー株式会社 | Signal encoding device |
CA2027705C (en) * | 1989-10-17 | 1994-02-15 | Masami Akamine | Speech coding system utilizing a recursive computation technique for improvement in processing speed |
US5502789A (en) * | 1990-03-07 | 1996-03-26 | Sony Corporation | Apparatus for encoding digital data with reduction of perceptible noise |
US5271089A (en) * | 1990-11-02 | 1993-12-14 | Nec Corporation | Speech parameter encoding method capable of transmitting a spectrum parameter at a reduced number of bits |
CA2054849C (en) * | 1990-11-02 | 1996-03-12 | Kazunori Ozawa | Speech parameter encoding method capable of transmitting a spectrum parameter at a reduced number of bits |
JP2835187B2 (en) * | 1991-01-07 | 1998-12-14 | 株式会社東芝 | Encoder / decoder and encoding / decoding method |
US5265180A (en) * | 1991-06-13 | 1993-11-23 | Intel Corporation | Method of encoding a sequence of images of a digital motion video signal |
JPH0766448B2 (en) * | 1991-06-25 | 1995-07-19 | 富士ゼロックス株式会社 | Image signal analyzer |
JPH05276500A (en) * | 1991-07-19 | 1993-10-22 | Sony Corp | Moving image coding and decoding device |
US5247348A (en) * | 1991-11-19 | 1993-09-21 | Scientific Atlanta, Inc. | Method for selecting reproduction quality of transmitted vector quantized data |
US5231485A (en) * | 1991-11-19 | 1993-07-27 | Scientific-Atlanta, Inc. | Method and apparatus for transforming between fixed-rate vector quantized data and variable rate vector quantized data |
US5235418A (en) * | 1991-11-19 | 1993-08-10 | Scientific-Atlanta, Inc. | Method and apparatus for low frequency removal in vector quantization |
US5172228A (en) * | 1991-11-19 | 1992-12-15 | Utah State University Foundation | Image compression method and apparatus employing distortion adaptive tree search vector quantization |
US5255090A (en) * | 1991-11-19 | 1993-10-19 | Scientific-Atlanta, Inc. | Progressive transmission of vector quantized data |
US5337085A (en) * | 1992-04-10 | 1994-08-09 | Comsat Corporation | Coding technique for high definition television signals |
US5481739A (en) * | 1993-06-23 | 1996-01-02 | Apple Computer, Inc. | Vector quantization using thresholds |
US5468069A (en) * | 1993-08-03 | 1995-11-21 | University Of So. California | Single chip design for fast image compression |
JPH07177502A (en) * | 1993-12-17 | 1995-07-14 | Sutajio Gen:Kk | Method for compressing picture information, compressed picture information recording medium, and compressed picture information reproducing device |
JP3224955B2 (en) * | 1994-05-27 | 2001-11-05 | 株式会社東芝 | Vector quantization apparatus and vector quantization method |
US5727089A (en) * | 1995-01-05 | 1998-03-10 | Eastman Kodak Company | Method and apparatus for multiple quality transaction card images |
JP3408924B2 (en) * | 1995-06-28 | 2003-05-19 | シャープ株式会社 | Image compression device |
JP4224370B2 (en) * | 2003-09-25 | 2009-02-12 | パナソニック株式会社 | Input control apparatus and input control method |
RU2630888C1 (en) * | 2013-11-14 | 2017-09-13 | ЭйджЭфАй Инновэйшн Инк. | Method of video coding using the prediction on the basis of the copy of the intra-cycle block |
CN111899746B (en) * | 2016-03-21 | 2022-10-18 | 华为技术有限公司 | Adaptive quantization of weighting matrix coefficients |
US20230035337A1 (en) * | 2021-07-13 | 2023-02-02 | Baidu Usa Llc | Norm adjusted proximity graph for fast inner product retrieval |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4558350A (en) * | 1982-06-11 | 1985-12-10 | Mitsubishi Denki Kabushiki Kaisha | Vector quantizer |
US4560799A (en) * | 1984-02-03 | 1985-12-24 | Ciba-Geigy Corporation | Tri- and Tetra-(substituted hydroxyphenylthio) alkane and cycloalkane stabilizers and stabilized compositions |
US4639778A (en) * | 1983-07-28 | 1987-01-27 | Kokusai Denshin Denwa Co., Ltd. | Embedding quantization system for vector signals |
US4670851A (en) * | 1984-01-09 | 1987-06-02 | Mitsubishi Denki Kabushiki Kaisha | Vector quantizer |
US4680797A (en) * | 1984-06-26 | 1987-07-14 | The United States Of America As Represented By The Secretary Of The Air Force | Secure digital speech communication |
US4710812A (en) * | 1985-02-28 | 1987-12-01 | Mitsubishi Denki Kabushiki Kaisha | Interframe adaptive vector quantization encoding apparatus and video encoding transmission apparatus |
US4724535A (en) * | 1984-04-17 | 1988-02-09 | Nec Corporation | Low bit-rate pattern coding with recursive orthogonal decision of parameters |
US4725885A (en) * | 1986-12-22 | 1988-02-16 | International Business Machines Corporation | Adaptive graylevel image compression system |
US4769826A (en) * | 1985-01-16 | 1988-09-06 | Mitsubishi Denki Kabushiki Kaisha | Video encoding apparatus |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0446968B1 (en) * | 1983-09-06 | 1995-07-05 | Mitsubishi Denki Kabushiki Kaisha | Vector quantizer |
JPS60158787A (en) * | 1984-01-30 | 1985-08-20 | Mitsubishi Electric Corp | Interframe vector encoder |
-
1987
- 1987-10-16 WO PCT/JP1987/000793 patent/WO1988002975A1/en active IP Right Grant
- 1987-10-16 US US07/207,155 patent/US4878230A/en not_active Ceased
- 1987-10-16 EP EP87906782A patent/EP0287679B1/en not_active Expired - Lifetime
- 1987-10-16 US US07/761,501 patent/USRE34562E/en not_active Expired - Lifetime
- 1987-10-16 AU AU80768/87A patent/AU592236B2/en not_active Ceased
- 1987-10-16 DE DE3750221T patent/DE3750221T2/en not_active Expired - Fee Related
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4558350A (en) * | 1982-06-11 | 1985-12-10 | Mitsubishi Denki Kabushiki Kaisha | Vector quantizer |
US4639778A (en) * | 1983-07-28 | 1987-01-27 | Kokusai Denshin Denwa Co., Ltd. | Embedding quantization system for vector signals |
US4670851A (en) * | 1984-01-09 | 1987-06-02 | Mitsubishi Denki Kabushiki Kaisha | Vector quantizer |
US4560799A (en) * | 1984-02-03 | 1985-12-24 | Ciba-Geigy Corporation | Tri- and Tetra-(substituted hydroxyphenylthio) alkane and cycloalkane stabilizers and stabilized compositions |
US4724535A (en) * | 1984-04-17 | 1988-02-09 | Nec Corporation | Low bit-rate pattern coding with recursive orthogonal decision of parameters |
US4680797A (en) * | 1984-06-26 | 1987-07-14 | The United States Of America As Represented By The Secretary Of The Air Force | Secure digital speech communication |
US4769826A (en) * | 1985-01-16 | 1988-09-06 | Mitsubishi Denki Kabushiki Kaisha | Video encoding apparatus |
US4710812A (en) * | 1985-02-28 | 1987-12-01 | Mitsubishi Denki Kabushiki Kaisha | Interframe adaptive vector quantization encoding apparatus and video encoding transmission apparatus |
US4725885A (en) * | 1986-12-22 | 1988-02-16 | International Business Machines Corporation | Adaptive graylevel image compression system |
Non-Patent Citations (6)
Title |
---|
Gray "Vector Quantization", IEEE ASSP Magazine, Apr. 1984 pp. 4-29. |
Gray Vector Quantization , IEEE ASSP Magazine, Apr. 1984 pp. 4 29. * |
Murakami et al "Dynamic Multistage Vector Quantization of Images" Electronics and Communications in Japan of Part 1, vol. 69 1986 pp. 93-101. |
Murakami et al "Vector Quantiser of Video Signals" Sep. 29, 1982 two pages. |
Murakami et al Dynamic Multistage Vector Quantization of Images Electronics and Communications in Japan of Part 1, vol. 69 1986 pp. 93 101. * |
Murakami et al Vector Quantiser of Video Signals Sep. 29, 1982 two pages. * |
Cited By (226)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5734791A (en) * | 1992-12-31 | 1998-03-31 | Apple Computer, Inc. | Rapid tree-based method for vector quantization |
US6728413B2 (en) * | 1998-01-19 | 2004-04-27 | Canon Kabushiki Kaisha | Lattice vector quantization in image compression and decompression |
US6477203B1 (en) * | 1998-10-30 | 2002-11-05 | Agilent Technologies, Inc. | Signal processing distributed arithmetic architecture |
US8645137B2 (en) | 2000-03-16 | 2014-02-04 | Apple Inc. | Fast, language-independent method for user authentication by voice |
US9646614B2 (en) | 2000-03-16 | 2017-05-09 | Apple Inc. | Fast, language-independent method for user authentication by voice |
US8718047B2 (en) | 2001-10-22 | 2014-05-06 | Apple Inc. | Text to speech conversion of text messages from mobile communication devices |
US9501741B2 (en) | 2005-09-08 | 2016-11-22 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US10318871B2 (en) | 2005-09-08 | 2019-06-11 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US8677377B2 (en) | 2005-09-08 | 2014-03-18 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US8614431B2 (en) | 2005-09-30 | 2013-12-24 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
US9958987B2 (en) | 2005-09-30 | 2018-05-01 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
US9389729B2 (en) | 2005-09-30 | 2016-07-12 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
US9619079B2 (en) | 2005-09-30 | 2017-04-11 | Apple Inc. | Automated response to and sensing of user activity in portable devices |
US9117447B2 (en) | 2006-09-08 | 2015-08-25 | Apple Inc. | Using event alert text as input to an automated assistant |
US8930191B2 (en) | 2006-09-08 | 2015-01-06 | Apple Inc. | Paraphrasing of user requests and results by automated digital assistant |
US8942986B2 (en) | 2006-09-08 | 2015-01-27 | Apple Inc. | Determining user intent based on ontologies of domains |
US20080129520A1 (en) * | 2006-12-01 | 2008-06-05 | Apple Computer, Inc. | Electronic device with enhanced audio feedback |
US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US10568032B2 (en) | 2007-04-03 | 2020-02-18 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US9053089B2 (en) | 2007-10-02 | 2015-06-09 | Apple Inc. | Part-of-speech tagging using latent analogy |
US8620662B2 (en) | 2007-11-20 | 2013-12-31 | Apple Inc. | Context-aware unit selection |
US10002189B2 (en) | 2007-12-20 | 2018-06-19 | Apple Inc. | Method and apparatus for searching using an active ontology |
US20090164441A1 (en) * | 2007-12-20 | 2009-06-25 | Adam Cheyer | Method and apparatus for searching using an active ontology |
US11023513B2 (en) | 2007-12-20 | 2021-06-01 | Apple Inc. | Method and apparatus for searching using an active ontology |
US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
US10381016B2 (en) | 2008-01-03 | 2019-08-13 | Apple Inc. | Methods and apparatus for altering audio output signals |
US9361886B2 (en) | 2008-02-22 | 2016-06-07 | Apple Inc. | Providing text input using speech data and non-speech data |
US8688446B2 (en) | 2008-02-22 | 2014-04-01 | Apple Inc. | Providing text input using speech data and non-speech data |
US9865248B2 (en) | 2008-04-05 | 2018-01-09 | Apple Inc. | Intelligent text-to-speech conversion |
US9626955B2 (en) | 2008-04-05 | 2017-04-18 | Apple Inc. | Intelligent text-to-speech conversion |
US8996376B2 (en) | 2008-04-05 | 2015-03-31 | Apple Inc. | Intelligent text-to-speech conversion |
US9946706B2 (en) | 2008-06-07 | 2018-04-17 | Apple Inc. | Automatic language identification for dynamic text processing |
US9535906B2 (en) | 2008-07-31 | 2017-01-03 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
US10108612B2 (en) | 2008-07-31 | 2018-10-23 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
US8768702B2 (en) | 2008-09-05 | 2014-07-01 | Apple Inc. | Multi-tiered voice feedback in an electronic device |
US9691383B2 (en) | 2008-09-05 | 2017-06-27 | Apple Inc. | Multi-tiered voice feedback in an electronic device |
US8898568B2 (en) | 2008-09-09 | 2014-11-25 | Apple Inc. | Audio user interface |
US8712776B2 (en) | 2008-09-29 | 2014-04-29 | Apple Inc. | Systems and methods for selective text to speech synthesis |
US8583418B2 (en) | 2008-09-29 | 2013-11-12 | Apple Inc. | Systems and methods of detecting language and natural language strings for text to speech synthesis |
US8762469B2 (en) | 2008-10-02 | 2014-06-24 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US9412392B2 (en) | 2008-10-02 | 2016-08-09 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US8713119B2 (en) | 2008-10-02 | 2014-04-29 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US10643611B2 (en) | 2008-10-02 | 2020-05-05 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US11348582B2 (en) | 2008-10-02 | 2022-05-31 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US9959870B2 (en) | 2008-12-11 | 2018-05-01 | Apple Inc. | Speech recognition involving a mobile device |
US8862252B2 (en) | 2009-01-30 | 2014-10-14 | Apple Inc. | Audio user interface for displayless electronic device |
US8751238B2 (en) | 2009-03-09 | 2014-06-10 | Apple Inc. | Systems and methods for determining the language to use for speech generated by a text to speech engine |
US10540976B2 (en) | 2009-06-05 | 2020-01-21 | Apple Inc. | Contextual voice commands |
US9858925B2 (en) | 2009-06-05 | 2018-01-02 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US10475446B2 (en) | 2009-06-05 | 2019-11-12 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US10795541B2 (en) | 2009-06-05 | 2020-10-06 | Apple Inc. | Intelligent organization of tasks items |
US20100312547A1 (en) * | 2009-06-05 | 2010-12-09 | Apple Inc. | Contextual voice commands |
US11080012B2 (en) | 2009-06-05 | 2021-08-03 | Apple Inc. | Interface for a virtual digital assistant |
US10283110B2 (en) | 2009-07-02 | 2019-05-07 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
US9431006B2 (en) | 2009-07-02 | 2016-08-30 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
US8682649B2 (en) | 2009-11-12 | 2014-03-25 | Apple Inc. | Sentiment prediction from textual data |
US8600743B2 (en) | 2010-01-06 | 2013-12-03 | Apple Inc. | Noise profile determination for voice-related feature |
US9311043B2 (en) | 2010-01-13 | 2016-04-12 | Apple Inc. | Adaptive audio feedback system and method |
US8670985B2 (en) | 2010-01-13 | 2014-03-11 | Apple Inc. | Devices and methods for identifying a prompt corresponding to a voice input in a sequence of prompts |
US10706841B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Task flow identification based on user intent |
US8903716B2 (en) | 2010-01-18 | 2014-12-02 | Apple Inc. | Personalized vocabulary for digital assistant |
US8660849B2 (en) | 2010-01-18 | 2014-02-25 | Apple Inc. | Prioritizing selection criteria by automated assistant |
US10679605B2 (en) | 2010-01-18 | 2020-06-09 | Apple Inc. | Hands-free list-reading by intelligent automated assistant |
US10705794B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10496753B2 (en) | 2010-01-18 | 2019-12-03 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US8706503B2 (en) | 2010-01-18 | 2014-04-22 | Apple Inc. | Intent deduction based on previous user interactions with voice assistant |
US10553209B2 (en) | 2010-01-18 | 2020-02-04 | Apple Inc. | Systems and methods for hands-free notification summaries |
US8799000B2 (en) | 2010-01-18 | 2014-08-05 | Apple Inc. | Disambiguation based on active input elicitation by intelligent automated assistant |
US8731942B2 (en) | 2010-01-18 | 2014-05-20 | Apple Inc. | Maintaining context information between user interactions with a voice assistant |
US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
US9548050B2 (en) | 2010-01-18 | 2017-01-17 | Apple Inc. | Intelligent automated assistant |
US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
US8670979B2 (en) | 2010-01-18 | 2014-03-11 | Apple Inc. | Active input elicitation by intelligent automated assistant |
US11423886B2 (en) | 2010-01-18 | 2022-08-23 | Apple Inc. | Task flow identification based on user intent |
US8892446B2 (en) | 2010-01-18 | 2014-11-18 | Apple Inc. | Service orchestration for intelligent automated assistant |
US9424861B2 (en) | 2010-01-25 | 2016-08-23 | Newvaluexchange Ltd | Apparatuses, methods and systems for a digital conversation management platform |
US9424862B2 (en) | 2010-01-25 | 2016-08-23 | Newvaluexchange Ltd | Apparatuses, methods and systems for a digital conversation management platform |
US9431028B2 (en) | 2010-01-25 | 2016-08-30 | Newvaluexchange Ltd | Apparatuses, methods and systems for a digital conversation management platform |
US8977584B2 (en) | 2010-01-25 | 2015-03-10 | Newvaluexchange Global Ai Llp | Apparatuses, methods and systems for a digital conversation management platform |
US10049675B2 (en) | 2010-02-25 | 2018-08-14 | Apple Inc. | User profiling for voice input processing |
US9190062B2 (en) | 2010-02-25 | 2015-11-17 | Apple Inc. | User profiling for voice input processing |
US8682667B2 (en) | 2010-02-25 | 2014-03-25 | Apple Inc. | User profiling for selecting user specific voice input processing information |
US9633660B2 (en) | 2010-02-25 | 2017-04-25 | Apple Inc. | User profiling for voice input processing |
US8713021B2 (en) | 2010-07-07 | 2014-04-29 | Apple Inc. | Unsupervised document clustering using latent semantic density analysis |
US8719006B2 (en) | 2010-08-27 | 2014-05-06 | Apple Inc. | Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesis |
US8719014B2 (en) | 2010-09-27 | 2014-05-06 | Apple Inc. | Electronic device with text error correction based on voice recognition data |
US9075783B2 (en) | 2010-09-27 | 2015-07-07 | Apple Inc. | Electronic device with text error correction based on voice recognition data |
US10515147B2 (en) | 2010-12-22 | 2019-12-24 | Apple Inc. | Using statistical language models for contextual lookup |
US10762293B2 (en) | 2010-12-22 | 2020-09-01 | Apple Inc. | Using parts-of-speech tagging and named entity recognition for spelling correction |
US8781836B2 (en) | 2011-02-22 | 2014-07-15 | Apple Inc. | Hearing assistance system for providing consistent human speech |
US10102359B2 (en) | 2011-03-21 | 2018-10-16 | Apple Inc. | Device access using voice authentication |
US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
US10672399B2 (en) | 2011-06-03 | 2020-06-02 | Apple Inc. | Switching between text data and audio data based on a mapping |
US10706373B2 (en) | 2011-06-03 | 2020-07-07 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US10255566B2 (en) | 2011-06-03 | 2019-04-09 | Apple Inc. | Generating and processing task items that represent tasks to perform |
US10241644B2 (en) | 2011-06-03 | 2019-03-26 | Apple Inc. | Actionable reminder entries |
US11120372B2 (en) | 2011-06-03 | 2021-09-14 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
US8812294B2 (en) | 2011-06-21 | 2014-08-19 | Apple Inc. | Translating phrases from one language into another using an order-based set of declarative rules |
US8706472B2 (en) | 2011-08-11 | 2014-04-22 | Apple Inc. | Method for disambiguating multiple readings in language conversion |
US9798393B2 (en) | 2011-08-29 | 2017-10-24 | Apple Inc. | Text correction processing |
US8762156B2 (en) | 2011-09-28 | 2014-06-24 | Apple Inc. | Speech recognition repair using contextual information |
US10241752B2 (en) | 2011-09-30 | 2019-03-26 | Apple Inc. | Interface for a virtual digital assistant |
US10134385B2 (en) | 2012-03-02 | 2018-11-20 | Apple Inc. | Systems and methods for name pronunciation |
US9483461B2 (en) | 2012-03-06 | 2016-11-01 | Apple Inc. | Handling speech synthesis of content for multiple languages |
US9280610B2 (en) | 2012-05-14 | 2016-03-08 | Apple Inc. | Crowd sourcing information to fulfill user requests |
US9953088B2 (en) | 2012-05-14 | 2018-04-24 | Apple Inc. | Crowd sourcing information to fulfill user requests |
US8775442B2 (en) | 2012-05-15 | 2014-07-08 | Apple Inc. | Semantic search using a single-source semantic model |
US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
US10019994B2 (en) | 2012-06-08 | 2018-07-10 | Apple Inc. | Systems and methods for recognizing textual identifiers within a plurality of words |
US9721563B2 (en) | 2012-06-08 | 2017-08-01 | Apple Inc. | Name recognition system |
US10079014B2 (en) | 2012-06-08 | 2018-09-18 | Apple Inc. | Name recognition system |
US9495129B2 (en) | 2012-06-29 | 2016-11-15 | Apple Inc. | Device, method, and user interface for voice-activated navigation and browsing of a document |
US9576574B2 (en) | 2012-09-10 | 2017-02-21 | Apple Inc. | Context-sensitive handling of interruptions by intelligent digital assistant |
US9971774B2 (en) | 2012-09-19 | 2018-05-15 | Apple Inc. | Voice-based media searching |
US9547647B2 (en) | 2012-09-19 | 2017-01-17 | Apple Inc. | Voice-based media searching |
US8935167B2 (en) | 2012-09-25 | 2015-01-13 | Apple Inc. | Exemplar-based latent perceptual modeling for automatic speech recognition |
US10978090B2 (en) | 2013-02-07 | 2021-04-13 | Apple Inc. | Voice trigger for a digital assistant |
US10199051B2 (en) | 2013-02-07 | 2019-02-05 | Apple Inc. | Voice trigger for a digital assistant |
US10652394B2 (en) | 2013-03-14 | 2020-05-12 | Apple Inc. | System and method for processing voicemail |
US10642574B2 (en) | 2013-03-14 | 2020-05-05 | Apple Inc. | Device, method, and graphical user interface for outputting captions |
US9977779B2 (en) | 2013-03-14 | 2018-05-22 | Apple Inc. | Automatic supplementation of word correction dictionaries |
US9368114B2 (en) | 2013-03-14 | 2016-06-14 | Apple Inc. | Context-sensitive handling of interruptions |
US9733821B2 (en) | 2013-03-14 | 2017-08-15 | Apple Inc. | Voice control to diagnose inadvertent activation of accessibility features |
US11388291B2 (en) | 2013-03-14 | 2022-07-12 | Apple Inc. | System and method for processing voicemail |
US10572476B2 (en) | 2013-03-14 | 2020-02-25 | Apple Inc. | Refining a search based on schedule items |
US11151899B2 (en) | 2013-03-15 | 2021-10-19 | Apple Inc. | User training by intelligent digital assistant |
US10748529B1 (en) | 2013-03-15 | 2020-08-18 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
US9697822B1 (en) | 2013-03-15 | 2017-07-04 | Apple Inc. | System and method for updating an adaptive speech recognition model |
US10078487B2 (en) | 2013-03-15 | 2018-09-18 | Apple Inc. | Context-sensitive handling of interruptions |
US9922642B2 (en) | 2013-03-15 | 2018-03-20 | Apple Inc. | Training an at least partial voice command system |
US9633674B2 (en) | 2013-06-07 | 2017-04-25 | Apple Inc. | System and method for detecting errors in interactions with a voice-based digital assistant |
US9620104B2 (en) | 2013-06-07 | 2017-04-11 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
US9582608B2 (en) | 2013-06-07 | 2017-02-28 | Apple Inc. | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
US9966060B2 (en) | 2013-06-07 | 2018-05-08 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
US9966068B2 (en) | 2013-06-08 | 2018-05-08 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
US10657961B2 (en) | 2013-06-08 | 2020-05-19 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
US10185542B2 (en) | 2013-06-09 | 2019-01-22 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US9300784B2 (en) | 2013-06-13 | 2016-03-29 | Apple Inc. | System and method for emergency calls initiated by voice command |
US10791216B2 (en) | 2013-08-06 | 2020-09-29 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
US10296160B2 (en) | 2013-12-06 | 2019-05-21 | Apple Inc. | Method for extracting salient dialog usage from live data |
US9620105B2 (en) | 2014-05-15 | 2017-04-11 | Apple Inc. | Analyzing audio input for efficient speech and music recognition |
US10592095B2 (en) | 2014-05-23 | 2020-03-17 | Apple Inc. | Instantaneous speaking of content on touch devices |
US9502031B2 (en) | 2014-05-27 | 2016-11-22 | Apple Inc. | Method for supporting dynamic grammars in WFST-based ASR |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9842101B2 (en) | 2014-05-30 | 2017-12-12 | Apple Inc. | Predictive conversion of language input |
US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
US10169329B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Exemplar-based natural language processing |
US10289433B2 (en) | 2014-05-30 | 2019-05-14 | Apple Inc. | Domain specific language for encoding assistant dialog |
US11257504B2 (en) | 2014-05-30 | 2022-02-22 | Apple Inc. | Intelligent assistant for home automation |
US9633004B2 (en) | 2014-05-30 | 2017-04-25 | Apple Inc. | Better resolution when referencing to concepts |
US11133008B2 (en) | 2014-05-30 | 2021-09-28 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US10497365B2 (en) | 2014-05-30 | 2019-12-03 | Apple Inc. | Multi-command single utterance input method |
US10078631B2 (en) | 2014-05-30 | 2018-09-18 | Apple Inc. | Entropy-guided text prediction using combined word and character n-gram language models |
US9966065B2 (en) | 2014-05-30 | 2018-05-08 | Apple Inc. | Multi-command single utterance input method |
US9430463B2 (en) | 2014-05-30 | 2016-08-30 | Apple Inc. | Exemplar-based natural language processing |
US9760559B2 (en) | 2014-05-30 | 2017-09-12 | Apple Inc. | Predictive text input |
US9734193B2 (en) | 2014-05-30 | 2017-08-15 | Apple Inc. | Determining domain salience ranking from ambiguous words in natural speech |
US10083690B2 (en) | 2014-05-30 | 2018-09-25 | Apple Inc. | Better resolution when referencing to concepts |
US9785630B2 (en) | 2014-05-30 | 2017-10-10 | Apple Inc. | Text prediction using combined word N-gram and unigram language models |
US10904611B2 (en) | 2014-06-30 | 2021-01-26 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US9668024B2 (en) | 2014-06-30 | 2017-05-30 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US10659851B2 (en) | 2014-06-30 | 2020-05-19 | Apple Inc. | Real-time digital assistant knowledge updates |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US10446141B2 (en) | 2014-08-28 | 2019-10-15 | Apple Inc. | Automatic speech recognition based on user feedback |
US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US10431204B2 (en) | 2014-09-11 | 2019-10-01 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US10789041B2 (en) | 2014-09-12 | 2020-09-29 | Apple Inc. | Dynamic thresholds for always listening speech trigger |
US9886432B2 (en) | 2014-09-30 | 2018-02-06 | Apple Inc. | Parsimonious handling of word inflection via categorical stem + suffix N-gram language models |
US9986419B2 (en) | 2014-09-30 | 2018-05-29 | Apple Inc. | Social reminders |
US9668121B2 (en) | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
US9646609B2 (en) | 2014-09-30 | 2017-05-09 | Apple Inc. | Caching apparatus for serving phonetic pronunciations |
US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
US10552013B2 (en) | 2014-12-02 | 2020-02-04 | Apple Inc. | Data detection |
US11556230B2 (en) | 2014-12-02 | 2023-01-17 | Apple Inc. | Data detection |
US9711141B2 (en) | 2014-12-09 | 2017-07-18 | Apple Inc. | Disambiguating heteronyms in speech synthesis |
US9865280B2 (en) | 2015-03-06 | 2018-01-09 | Apple Inc. | Structured dictation using intelligent automated assistants |
US11087759B2 (en) | 2015-03-08 | 2021-08-10 | Apple Inc. | Virtual assistant activation |
US10567477B2 (en) | 2015-03-08 | 2020-02-18 | Apple Inc. | Virtual assistant continuity |
US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
US10311871B2 (en) | 2015-03-08 | 2019-06-04 | Apple Inc. | Competing devices responding to voice triggers |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US9899019B2 (en) | 2015-03-18 | 2018-02-20 | Apple Inc. | Systems and methods for structured stem and suffix language models |
US9842105B2 (en) | 2015-04-16 | 2017-12-12 | Apple Inc. | Parsimonious continuous-space phrase representations for natural language processing |
US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
US10127220B2 (en) | 2015-06-04 | 2018-11-13 | Apple Inc. | Language identification from short strings |
US10101822B2 (en) | 2015-06-05 | 2018-10-16 | Apple Inc. | Language input correction |
US10186254B2 (en) | 2015-06-07 | 2019-01-22 | Apple Inc. | Context-based endpoint detection |
US10255907B2 (en) | 2015-06-07 | 2019-04-09 | Apple Inc. | Automatic accent detection using acoustic models |
US11025565B2 (en) | 2015-06-07 | 2021-06-01 | Apple Inc. | Personalized prediction of responses for instant messaging |
US11500672B2 (en) | 2015-09-08 | 2022-11-15 | Apple Inc. | Distributed personal assistant |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US9697820B2 (en) | 2015-09-24 | 2017-07-04 | Apple Inc. | Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks |
US11010550B2 (en) | 2015-09-29 | 2021-05-18 | Apple Inc. | Unified language modeling framework for word prediction, auto-completion and auto-correction |
US10366158B2 (en) | 2015-09-29 | 2019-07-30 | Apple Inc. | Efficient word encoding for recurrent neural network language models |
US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
US11526368B2 (en) | 2015-11-06 | 2022-12-13 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US10446143B2 (en) | 2016-03-14 | 2019-10-15 | Apple Inc. | Identification of voice inputs providing credentials |
US9934775B2 (en) | 2016-05-26 | 2018-04-03 | Apple Inc. | Unit-selection text-to-speech synthesis based on predicted concatenation parameters |
US9972304B2 (en) | 2016-06-03 | 2018-05-15 | Apple Inc. | Privacy preserving distributed evaluation framework for embedded personalized systems |
US10249300B2 (en) | 2016-06-06 | 2019-04-02 | Apple Inc. | Intelligent list reading |
US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
US11069347B2 (en) | 2016-06-08 | 2021-07-20 | Apple Inc. | Intelligent automated assistant for media exploration |
US10354011B2 (en) | 2016-06-09 | 2019-07-16 | Apple Inc. | Intelligent automated assistant in a home environment |
US10490187B2 (en) | 2016-06-10 | 2019-11-26 | Apple Inc. | Digital assistant providing automated status report |
US10192552B2 (en) | 2016-06-10 | 2019-01-29 | Apple Inc. | Digital assistant providing whispered speech |
US10509862B2 (en) | 2016-06-10 | 2019-12-17 | Apple Inc. | Dynamic phrase expansion of language input |
US10067938B2 (en) | 2016-06-10 | 2018-09-04 | Apple Inc. | Multilingual word prediction |
US10733993B2 (en) | 2016-06-10 | 2020-08-04 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US11037565B2 (en) | 2016-06-10 | 2021-06-15 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US10297253B2 (en) | 2016-06-11 | 2019-05-21 | Apple Inc. | Application integration with a digital assistant |
US11152002B2 (en) | 2016-06-11 | 2021-10-19 | Apple Inc. | Application integration with a digital assistant |
US10269345B2 (en) | 2016-06-11 | 2019-04-23 | Apple Inc. | Intelligent task discovery |
US10521466B2 (en) | 2016-06-11 | 2019-12-31 | Apple Inc. | Data driven natural language event detection and classification |
US10089072B2 (en) | 2016-06-11 | 2018-10-02 | Apple Inc. | Intelligent device arbitration and control |
US10593346B2 (en) | 2016-12-22 | 2020-03-17 | Apple Inc. | Rank-reduced token representation for automatic speech recognition |
US11405466B2 (en) | 2017-05-12 | 2022-08-02 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US10791176B2 (en) | 2017-05-12 | 2020-09-29 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US10810274B2 (en) | 2017-05-15 | 2020-10-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
Also Published As
Publication number | Publication date |
---|---|
EP0287679A4 (en) | 1990-04-09 |
DE3750221T2 (en) | 1994-11-17 |
EP0287679A1 (en) | 1988-10-26 |
DE3750221D1 (en) | 1994-08-18 |
AU592236B2 (en) | 1990-01-04 |
WO1988002975A1 (en) | 1988-04-21 |
AU8076887A (en) | 1988-05-06 |
US4878230A (en) | 1989-10-31 |
EP0287679B1 (en) | 1994-07-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
USRE34562E (en) | Amplitude-adaptive vector quantization system | |
US4560977A (en) | Vector quantizer | |
EP0405584B1 (en) | Gain-shape vector quantization apparatus | |
US5398069A (en) | Adaptive multi-stage vector quantization | |
EP0411675A2 (en) | Interframe coding apparatus | |
US7072830B2 (en) | Audio coder | |
EP1837997A1 (en) | Long-term prediction encoding method, long-term prediction decoding method, devices thereof, program thereof, and recording medium | |
EP0529556A2 (en) | Vector-quatizing device | |
US5263119A (en) | Gain-shape vector quantization method and apparatus | |
US4783792A (en) | Apparatus for transmitting digital signal | |
US6397178B1 (en) | Data organizational scheme for enhanced selection of gain parameters for speech coding | |
JP2658816B2 (en) | Speech pitch coding device | |
CA2060310C (en) | Digital speech coder with vector excitation source having improved speech quality | |
KR20230010854A (en) | An improved concept for the representation of neural network parameters | |
JPS5875341A (en) | Data compression device using finite difference | |
Buzo et al. | Rate-distortion bounds for quotient-based distortions with application to Itakura-Saito distortion measures | |
JP3194930B2 (en) | Audio coding device | |
Hui et al. | Reduced storage VQ via secondary quantization | |
JPH0666948B2 (en) | Interframe vector quantization coding / decoding device | |
JP2975764B2 (en) | Signal encoding / decoding device | |
JPH06164415A (en) | Amplitude adaptive vector quantizing device | |
JPH0646805B2 (en) | Amplitude adaptive vector quantizer | |
JPH0527798A (en) | Linear predictive parameter encoding method for voice | |
Haoui | MEDIUM BAND SPEECH CODING: VECTOR QUANTIZATION WITH MEMORY. | |
JPH08263100A (en) | Vector quantizing device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 12 |