US6961912B2 - Feedback mechanism for use with visual selection methods - Google Patents
Feedback mechanism for use with visual selection methods Download PDFInfo
- Publication number
- US6961912B2 US6961912B2 US09/906,667 US90666701A US6961912B2 US 6961912 B2 US6961912 B2 US 6961912B2 US 90666701 A US90666701 A US 90666701A US 6961912 B2 US6961912 B2 US 6961912B2
- Authority
- US
- United States
- Prior art keywords
- active area
- sensable
- output
- human
- hyperlink target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
- 230000000007 visual effect Effects 0.000 title claims description 23
- 230000008713 feedback mechanism Effects 0.000 title abstract description 3
- 238000010187 selection method Methods 0.000 title description 2
- 238000000034 method Methods 0.000 claims abstract description 73
- 230000004044 response Effects 0.000 claims abstract description 26
- 238000005562 fading Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 abstract description 2
- 241001422033 Thestylus Species 0.000 description 49
- 238000013461 design Methods 0.000 description 8
- 230000009471 action Effects 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 3
- 238000007796 conventional method Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000011514 reflex Effects 0.000 description 2
- 238000010079 rubber tapping Methods 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Definitions
- the invention relates to a feedback mechanism for use with visual selection methods in graphical user interface systems.
- the invention is particularly advantageous with regard to graphical user interface systems that do not have a cursor or the like.
- Image maps are a widely used technique allowing users to perform graphical selections of hyperlink targets or active areas within a displayed image map.
- image maps are formed by associating an image with hyperlink targets or active areas.
- the browser displays an additional hypertext document.
- the additional document may provide additional information on the selected target, and/or provide a different, perhaps magnified, view of the originally displayed image map.
- a cursor-based graphical user interface system relies on the location of the cursor within the graphical user interface being continuously defined.
- Typical graphical user interface systems provide indicators to help a user interact with a displayed image, such as, for example, an image map, and to interact with hyperlink targets or active areas within the displayed image. Therefore, whenever the location of the cursor is determined by the system to be in a predefined area on the image map, such as even only within a specific hyperlink target or active area or within the image map, the location or existence of the hyperlink target or active area is identified on the graphical user interface by displaying a locational indicator.
- Such conventional techniques as in a cursor-based graphical user interface system, often rely on the cursor being positioned relative to one or more of the hyperlink targets or action areas without activating any of the controls on the cursor control device, such as a mouse, a joystick, a keyboard, a touch pad, a trackball, or the like.
- One such technique relies upon the cursor “hovering” over a hyperlink target or action area. Removing the locational indicator, or user tip, requires a separate gesture, such as moving the cursor control device.
- hand-held computing devices such as personal digital assistants (PDAs), personal organizers, palmtops, or handheld PCs.
- PDAs personal digital assistants
- Such hand-held computing devices typically have a liquid crystal display (LCD) with a touch-sensitive screen.
- a stylus is used to enter data through the screen.
- An input device such as a keypad, can also be included.
- These hand-held computing devices use the stylus or other instrument, in combination with the touch-sensitive display screen, rather than a cursor, to point to, and possibly select, specific locations within the graphical user interface.
- the stylus or other instrument in such hand-held computing devices performs functions similar to that of the combination of the cursor and the cursor control device in the above-described conventional cursor-based graphical user interface system.
- a continuously-identified cursor location is not available in systems that use a stylus or the like, such as those systems described above. Therefore, locating hyperlink targets or active areas in an image map can be difficult, confusing, or at least frustrating to a user when a cursor having a continuously-defined location, such as in a mouse-oriented and/or cursor-oriented system, is not available to interact with the hyperlink targets or active areas within an image map.
- Pen-based graphical user interfaces and touch-screen-based graphical user interfaces are exemplary systems that do not have cursors that have continuously-defined positions within the graphical user interface.
- a hyperlink target or active area within an image map will not even be indicated to the user until the user generates a first specific gesture on that hyperlink target or active area.
- a user is left to guess where the hyperlink targets or active areas are located within an image map, unless the desired hyperlink target or active area is directly located by a first contact gesture.
- Conventional techniques therefore lack a level of efficiency or sophistication in locating hyperlink targets or active areas that would be advantageous to a user.
- Pen-based graphical user interface systems similarly provide locational indicators or user tips that indicate the location of hyperlink targets or active areas within an image map when the stylus, for example, is placed within the boundaries of the image map.
- locational indicators or user tips that indicate the location of hyperlink targets or active areas within an image map when the stylus, for example, is placed within the boundaries of the image map.
- a user slides the stylus across the touch screen to identify the location of the hyperlink targets or active areas in an image map.
- the location of the hyperlink targets or active areas is displayed as long as contact is maintained between the stylus and the touch screen.
- the user then lifts the stylus to select the hyperlink target or active area that the stylus was in immediately before the stylus was lifted. Lifting the stylus, however, is an unnatural and unintuitive manner of selecting a hyperlink target or active area.
- all of the locational indicators that were activated as a result of sliding the stylus across the image map remain visible at least until the stylus is lifted. These locational indicators clutter the image map, making the process of
- locational indicators can be displayed while a hardware or software button is held down. This approach shares two problems with the “slide to see” technique. First, the user must remember at least one additional user interface gesture. Second, the user must execute input gestures to summon and dismiss the locational indicators.
- touch-oriented systems with large display screens may continually flash or display various hyperlink targets or active areas to direct a user to, or identify to the user, the hyperlink targets or active areas within an image map. While such continuous flashing or displaying of hyperlink targets or active areas is reasonably conceivable with large display screens, handheld devices typically have very small display screens. Thus, in a typical pen-based graphical user interface environment having a small display screen, either all of the hyperlink targets or active areas will not be able to be shown, or cluttering and overlapping of the hyperlink targets or active areas may occur, making selecting a desired hyperlink target or active area difficult and subject to guessing by the user. Furthermore, the number of continually flashing hyperlink targets or active areas is often distracting and unappealing to most users.
- the locational indicators are not shown at all, or they are always shown.
- the result is frustrating guesswork navigation by the user, who is required to locate and activate the hyperlink targets or active areas without assistance.
- the locational indicators are always shown, the result is a cluttered image map.
- inefficiencies in locating, identifying and/or selecting the hyperlink targets or active areas within an image map occur.
- This invention provides systems and methods for indicating the locations of hyperlink targets or active areas in an image map.
- This invention separately provides systems and methods for indicating the locations of hyperlink targets or active areas in graphical user interfaces that do not have cursors having continuously defined positions.
- This invention separately provides systems and methods for indicating the locations of hyperlink targets or active areas in response to a gesture made against an image map when the gesture is not made within a hyperlink target or active area.
- the systems and methods according to this invention address the inefficiencies in locating and/or selecting a hyperlink target or active area in a graphical user interface system. Because hyperlink targets or active areas in an image map may not be obvious to a user, locational indicators become important. In various exemplary embodiments, the locational indicators can be one or more highlighted images positioned relative to one or more hyperlink targets or active areas. In some exemplary embodiments, the locational indicators can be activated for all of the hyperlink targets or active areas in an image map. In other exemplary embodiments, only the n closest hyperlink targets or active areas closest to the location of a user's gesture within the cursorless graphical user interface can be activated. In this case, n is at least one, and can be any desired value.
- the locational indicators may be, for example, highlighted frames or other alterations in appearance that give an indication of the regions of the graphical user interface that are occupied by the hyperlink targets or active areas.
- the locational indicators may be, for example, pop-up text boxes or windows having a navigational tool as simple as a single word or phrase such as “left” or “to the left”, and/or may include, for example, a simple directional arrow to aid the user in locating, or navigating within an image map to a desired hyperlink target or active area located within an image map.
- the locational indicators may be any of a variety of other forms, individually or in combination, usable to direct a user to, or identify to a user, a desired hyperlink target or active area.
- Various other exemplary embodiments of the systems and methods according to this invention provide a “tap-tip” image map navigation mechanism and method for cursorless graphical user interface systems.
- the “tap-tip” technique provides locational indicators to an image map.
- the location of a hyperlink target or active area within a displayed image map is indicated for a limited duration to aid a user in locating and selecting a desired hyperlink target or active area within the image map.
- the locational indicators of the hyperlink targets or active areas in the image map are not always visible, as in prior art methods. Nor are the hyperlink targets or active areas of the invention always hidden, as in other prior art methods. Rather, in various exemplary embodiments according to this invention, the locational indicators of the hyperlink targets or active areas within an image map appear when a user “taps” a designated number of times, such as once, in a non-active area of the image map. Tapping in or on a hyperlink target or active area does not produce the locational indicators because a hyperlink target or active area has been successfully selected.
- a “miss” gesture has occurred.
- a location indicator for at least one hyperlink target or active area in the image map is displayed.
- the displayed one or more locational indicators remain displayed for a designated time period, for example, no more than two seconds after the corresponding “miss” gesture. After the designated time period has elapsed, the displayed one or more locational indicators of the hyperlink target or active area are no longer displayed.
- the user may tap on one of the located or identified hyperlink targets or active areas indicated by the one or more locational indicators at any time to select or activate that hyperlink target or active area.
- the one or more locational indicators do not need to appear suddenly and do not need to appear at exactly the same time.
- the one or more locational indicators “fade in” during the designated time period.
- the one or more locational indicators appear serially, with the locational indicators closest to the point of contact between the stylus and the touch screen appearing first.
- the one or more locational indicators do not need to disappear suddenly and do not need to disappear at exactly the same time.
- the displayed one or more locational indicators begin “fading away” at some predetermined point within the designated time period.
- the one or more locational indicators disappear serially, with the locational indicators closest to the point of contact between the stylus and the touch screen disappearing first.
- the locational indicators do not clutter the image map display as the locational indicators disappear and/or fade away after the designated time. That is, the hyperlink targets or active areas are visibly located and/or identified only long enough for the user to note the location of one or many of the hyperlink targets or active areas.
- the noted location may be used to select a hyperlink target or active area immediately, if desired, or remembered for use later. Therefore, navigation of the image map becomes easier, particularly when a user's initial “tap” gesture to locate a hyperlink target or active area has missed the location of any hyperlink target or active area.
- the hyperlink targets or active areas and the locational indicators fade away and become hidden after a designated period of time has elapsed, no additional gesture or input from the user is required to rid the image map of the locational indicators. This simplifies navigation and interaction with the graphical user interface and increases navigational efficiency.
- the techniques used to determine the designated time period may be varied depending on the needs of the user and the application program. In various exemplary embodiments, the designated time period may be fixed in advance, for example, at two seconds. A fixed time period is simple to implement and assures predictable behavior, an important quality in user interface design.
- the designated time period may also be set using user preference settings. Time period adjustments based on user preferences are also simple to implement and can give the user full control over the tip behavior. Such control is also an important quality in user interface design.
- the designated time period may be determined adaptively, for example, using automatic adjustments made in response to a given user's actions.
- An adaptive time period can be used to adjust to variations in individual user's abilities, such as variations in user response time and reflexes.
- a pop-up text or other locational indicator may appear for a similar designated time period, for example, two seconds, before the pop-up text or other locational indicator also fades away, or is otherwise no longer displayed on the image map.
- a similar designated time period for example, two seconds
- FIG. 1 shows a conventional image map within a handheld device
- FIG. 2 shows a cluttering effect of highlighted targets in a conventional image map within a handheld device
- FIG. 3 shows a handheld device having an image map displayed without hyperlink target or active area distinctions displayed according to the invention
- FIG. 4 shows exemplary user gesture positioning of a stylus to an image map within a handheld device according to the invention
- FIG. 5 shows an exemplary embodiment of a hyperlink target or active area made visibly distinct in an image map according to the invention
- FIG. 6 shows the information retrieved from the exemplary visibly distinct hyperlink target or active area in the image map shown in FIG. 5 according to the invention
- FIG. 7 is a flowchart outlining one exemplary embodiment of a method for locating hyperlink targets or active areas within an image map in a handheld device according to the invention.
- FIG. 8 shows an image map having hyperlink targets or active areas to be located and/or identified by touching or positioning of a stylus or other instrument within an image map according to the invention
- FIG. 9 shows exemplary hyperlink targets or active areas made visibly distinct within an image map by a single gesture of the stylus or other instrument to the image map according to a first exemplary embodiment of the systems and methods according to this invention
- FIG. 10 shows an exemplary embodiment of only the n hyperlink targets or active areas made visibly distinct corresponding to the position of the stylus or other instrument on the image map according to a second exemplary embodiment of the systems and methods according to this invention
- FIG. 11 shows the highlighting of hyperlink targets or active areas within a proximity range distance x corresponding to the position of the stylus relative to the various hyperlink targets or active areas according to a third exemplary embodiment of the systems and methods according to this invention
- FIG. 12 shows the hyperlink targets or active areas made visibly distinct only within a same quadrant as the user gesture's positioning of the stylus or other instrument to the image map according to a fourth exemplary embodiment of the systems and methods according to this invention
- FIG. 13 shows an exemplary pop-up text window with textual directional tips according to a fifth embodiment of the systems and methods according to this invention.
- FIG. 14 shows an exemplary directional indicator according to a sixth embodiment of the systems and methods according to this invention.
- FIG. 15 shows a combination of an exemplary pop-up text window with textual directional tips and an exemplary directional indicator according to a seventh embodiment of the systems and methods according to this invention
- FIG. 16 shows a combination of multiple exemplary directional indicators according to an eighth embodiment of the systems and methods according to this invention.
- FIG. 17 is a flowchart outlining a second exemplary embodiment of a method for locating hyperlink targets or active areas within an image map in a handheld device according to the invention.
- Locating hyperlink targets or active areas in an image map display in a cursorless graphical user interface system requires identifying where the hyperlink targets or active areas are within the image map. Because hyperlink targets or active areas within an image map are not always visible, a user must often guess the location of a desired hyperlink target or active area by repeatedly tapping a stylus or other instrument against the image map until the location and/or identification of the desired hyperlink target or active area is determined.
- previous pen-based graphical user interface systems include hand-held devices 1 with a stylus, or other instrument, 2 usable as an input device.
- the stylus 2 can be used to locate hyperlink targets or active areas in an image map 3 on a display screen 4 .
- the hyperlink targets or active areas are typically hidden, or otherwise not distinguishable, from the image displayed on the display screen 4 .
- the hyperlink targets or active areas may be indistinguishable from the other graphics displayed in an image map as a result of the Web-page design color preferences being the same or similar color preferences of the user.
- the hyperlink targets or active areas may be indistinguishable from the other graphics displayed in an image map as a result of a graphical user interface system setting.
- hyperlink targets or active areas appear when the user holds the stylus 2 or other input device so that it ‘hovers’ over the screen position of a hyperlink target or active area.
- the visual appearance of the hyperlink target or active area is altered to distinguish that hyperlink target or active area from the rest of the image map 3 , as shown, for example, by the highlighting of the hyperlink target or active area 5 in FIG. 1 .
- Highlighting the hyperlink target or active area 5 occurs only when the stylus 2 hovers above the display screen 4 within the bounds of the hyperlink target or active area 5 .
- the altered visual appearance, or highlighting, of the hyperlink target or active area remains active until a user actively removes the altered visual appearance, or highlighting, of the hyperlink target or active area 5 by lifting, sliding, or otherwise gesturing with the stylus 2 . If an appropriate gesture is not performed by a user, then the altered visual appearance, or highlighting, of the hyperlink target or active area 5 remains displayed.
- a plurality of hyperlink targets or active areas 5 , 6 , 7 and 8 may exist in a single image map display.
- the visual appearance of each of the hyperlink targets or active areas 5 , 6 , 7 and 8 is altered, or highlighted, relative to the other graphical images displayed on the display screen 4 upon the stylus 2 directly contacting the image map.
- multiple visibly distinct hyperlink targets or active areas 5 , 6 , 7 and 8 remain displayed unless the appropriate gesture to remove the altered visual appearance of each highlighted hyperlink target or active area 5 , 6 , 7 and 8 is performed by the user.
- the image map 3 therefore becomes cluttered in previous graphical user interface systems.
- a cursorless graphical user interface system that can identify the location of hyperlink targets or active areas within an image map display by displaying each hyperlink target or active area and directing a user to each hyperlink target or active area by displaying locational indicators would be advantageous to a user.
- Providing the hyperlink target or active area locations and/or identifications and locational indicators without requiring a hyperlink target or active area to be directly contacted by the stylus or other instrument would be advantageous as well, particularly when the user has performed a gesture to the image map but has missed the desired hyperlink target or active area location. This would permit a user to receive locational information guiding the user to a hyperlink target or active area even when the user gesture to the image map has missed the hyperlink target or active area completely. This is likely to occur when the hyperlink targets or active areas are not readily apparent to a user because the hyperlink targets or active areas are not normally visibly distinguished from the other graphics displayed on the image map display screen.
- a cursorless graphical user interface system that automatically removes from the display screen those hyperlink targets or active areas and locational indicators that were previously made visibly distinct without requiring any additional gesture by a user would be advantageous as well. This would permit one to more easily locate a desired hyperlink target or active area without the necessity of learning additional gestures to remove locational indicators resulting from prior user gestures, as occurs in conventional graphical user interface systems.
- FIG. 3 shows an exemplary embodiment of a cursorless graphical user interface system according to this invention.
- a hand-held cursorless graphical user interface device 101 includes a stylus or other instrument 102 for contacting a display screen 104 .
- the display screen 104 displays, for example, an image map 103 .
- the displayed image map 103 may be varied according to manipulations of the stylus 102 as it directly interacts with the image map 103 and the display screen 104 , or according to user-generated inputs from, for example, a keyboard 109 , or any other known or later developed input device.
- the stylus 102 is used by a user to touch various locations on the image map 103 when attempting to locate and/or identify hyperlink targets or active areas that are not readily apparent within the image map 103 .
- Visual alteration or highlighting is used to assist the user in identifying, locating and/or selecting hyperlink targets or active areas.
- examples of various locations to which a user may touch the stylus 102 are shown by dashed lines.
- a user may position the stylus 102 anywhere within the image map 103 to locate, identify and/or select the various hyperlink targets or active areas that may not be readily apparent within the displayed image map 103 . If the stylus position within the image map 103 corresponds to a hyperlink target or active area, such as the hyperlink target or active area 108 , then that hyperlink target or active area is selected.
- this gesture locates and/or identifies one or more hyperlink targets or active areas by displaying one or more of the hyperlink targets or active areas in a visibly distinguished manner, such as, for example, by highlighting, or otherwise altering the visual appearance, of one of the hyperlink targets or active areas, such as the hyperlink target or active area 108 .
- the system By highlighting the hyperlink targets or active areas, the system enables the user to distinguish the available hyperlink targets or active areas displayed in the image map 103 from the other, non-active graphical images displayed within the displayed image map 103 .
- a single gesture for example, by touching the stylus 102 , to the image map 103 on the display screen 104 a user immediately locates and/or identifies one or more of the hyperlink targets or active areas not previously visibly distinguishable in the displayed image map 103 .
- the user may perform a gesture to select a desired one of the highlighted hyperlink targets or active areas, such as, for example, the hyperlink target or active area 108 .
- This second gesture upon the desired hyperlink target or active area, such as, for example, the hyperlink target or active area 108 could result in a new image map 203 being displayed, as shown in FIG. 6 .
- the new image map 203 may have one or more additional hyperlink targets or active areas that a user could further identify, locate and select as desired using the same methods as described above.
- the highlighting or altering of the visual appearance of the one or more hyperlink targets or active areas lasts for a designated time period.
- the designated time period may be, for example, two seconds. After the designated time period expires, the highlighting of the one or more hyperlink targets or active areas would be automatically removed from the displayed image map 103 without any additional gestures or inputs by the user.
- Removing the highlighting of the one or more hyperlink targets or active areas may occur immediately upon the expiration of the designated time period.
- the highlighting of the one or more hyperlink targets or active areas may be removed gradually.
- the highlighting of the hyperlink target or active area may “fade away” gradually, beginning when the hyperlink target or active area is initially highlighted and ending upon the expiration of the designated time period.
- the highlighting of the one or more hyperlink targets or active areas is removed in response to a desired hyperlink target or active area being selected. As a result, in either case, the displayed image map 103 remains uncluttered and easier for a user to interact with.
- FIG. 7 is a flowchart outlining one exemplary embodiment of a method for locating and/or identifying hyperlink targets or active areas according to this invention.
- step S 100 operation continues to step S 200 , where the predetermined time period for highlighting the hyperlink targets or active areas is set to, for example, two seconds.
- step S 300 the image map 103 with hyperlink targets and/or active areas is shown.
- step S 400 a determination is made whether the user has input a gesture, such as, for example, touching the stylus 102 within the image map 103 displayed on the display screen 104 to identify and/or locate the hyperlink targets or active areas within the displayed image map 103 . If such a gesture has been input, operation then continues to step S 500 . Otherwise, operation returns to step S 400 .
- a gesture such as, for example, touching the stylus 102 within the image map 103 displayed on the display screen 104 to identify and/or locate the hyperlink targets or active areas within the displayed image map 103 . If such a gesture has been input, operation then continues to step
- the designated time period is determined based on preset user preference data that the user has provided to identify the user's preferred duration for the designated time period.
- the designated time period is determined based on an initial value, or a current value that has been dynamically determined, that is usable when dynamically adjusting the designated time period.
- step S 200 can be skipped or omitted.
- step S 500 a determination is made whether the input gesture “hit” any of the active areas or hyperlink targets or “missed” all of the active areas or hyperlink targets on the displayed image map. If an active area or hyperlink target was hit, operation continues to step S 600 . Otherwise, the input gesture “missed” all of the hyperlink targets or active areas in the displayed image map. Operation thus jumps to step S 700 .
- step S 600 the “hit” hyperlink target or active area is selected or activated.
- any action associated with the active area is performed or the page to which the selected hyperlink target is linked is displayed. Operation then jumps to step S 1300 .
- step S 700 one or more active areas and/or hyperlink targets are highlighted or otherwise visibly distinguished within the displayed image map (and/or audibly, tactilely and/or olfactorily located or identified) to identify those active areas and/or hyperlink targets to the user.
- step S 800 the time period counter is initialized with the designated time period.
- step S 900 a determination is made whether the designated time period has elapsed. If so, operation jumps to step S 1300 . Otherwise, if the predetermined time period has not elapsed, operation continues to step S 1000 .
- step S 1000 if implemented, the altered visual appearance or highlighting (and/or the audible, tactile and/or olfactory output presented to the user) is itself altered, based on the amount of the designated time period that has elapsed, to fade in and/or to fade out the highlighting or other altered visual appearance (and/or the audible, tactile and/or olfactory output presented to the user).
- step S 100 can be omitted. In this case, operation jumps directly from step S 900 to step S 1100 .
- step S 1100 the time period counter is updated to reflect the elapsed time since the last “miss” gesture was received from the user. Then, in step S 1200 , a determination is made whether a new gesture has been received from the user. If so, operation jumps back to step S 500 to determine if the new gesture received from the user is a “hit” gesture or a “miss” gesture”. Otherwise, if no new gesture has been received from the user, operation jumps back to step S 900 .
- step S 1300 because the designated time period has elapsed, or because the user has selected a hyperlink target or activated an active area before the designated time period elapsed, the highlighting or other altered visual appearance of the one or more active areas or hyperlink targets (and/or the audible, tactile and/or olfactory output presented to the user) is removed. Operation then returns to step S 400 .
- FIG. 7 can be modified as shown in FIG. 17 .
- step S 600 rather than jumping directly to S 1300 after the user has selected a hyperlink target or activated an active area before the designated time period elapsed, operation jumps instead to step S 900 .
- step S 200 rather than being performed between steps S 100 and S 300 , can instead be performed between steps S 700 and S 800 . This is especially useful when the user can change the designated time period, for example, by changing a preference value, or when the designated time period is dynamically determined based on the user's actions.
- FIG. 8 shows the display screen 104 and the displayed image map 103 of the hand held device 100 .
- FIG. 9 in response to the initial user gesture of touching the stylus 102 against an area of the image map 103 that is not within the bounds of any hyperlink target or active area of the displayed image map 103 , all of the hyperlink targets or active areas 105 – 108 within the image map 103 are highlighted, or otherwise made visibly distinct. By highlighting, or otherwise visibly distinguishing, the hyperlink targets or active areas 105 – 108 in the image map 103 , the user is provided with directional guidance.
- highlighting, or visibly distinguishing, the hyperlink targets or active areas 105 – 108 ends after a designated time period, such as, for example, two seconds, has elapsed.
- the highlighting is removed from the hyperlink targets or active areas automatically in response to either the designated time period expiring and, in various exemplary embodiments, additionally by the user selecting one of the hyperlink targets or active areas 105 – 108 .
- the highlighting may be gradually removed, for example, by fading out the highlighting of the one or more hyperlink targets or active areas such that the highlighting is completely removed by the time the designated time period has elapsed.
- the display screen 104 and image map 103 remain uncluttered permitting one or more of the various hyperlink targets or active areas to be efficiently located and/or identified. Further, no additional gesture by the user is required to remove the highlighting from the hyperlink targets or active areas 105 – 108 .
- the hyperlink targets or active areas may be highlighted, or made visibly distinguishable using any appropriate known or later developed technique, such as, for example, outlining, color change, appearance distortion, changing to a three- dimensional appearance, animation, addition of drop-shadows, or the like.
- These techniques need not indicate the location of the hyperlink target or active area in a manner that reflects its exact shape.
- line segments may be used to connect the point of contact between the stylus and the touch screen with the perimeter, center or centroid of the hyperlink targets or active areas.
- the center or centroid of the hyperlink targets or active areas may be indicated using glyphs.
- FIG. 10 shows a second exemplary embodiment in which only a predetermined number n of the hyperlink targets or active areas, that are closest to the position of the gesture on the image map 103 , are highlighted, or otherwise made visibly distinguishable, in correspondence with the position of the stylus 102 on the displayed image map 103 .
- the number n is set to one. Therefore only the hyperlink target or active area 106 is shown as highlighted. It should be appreciated, however, that the number n may be set to any positive whole number so that that number n of hyperlink targets or active areas corresponding to the position of the stylus 102 within the displayed image map 103 are highlighted.
- the number n of hyperlink targets or active areas may be dynamically adjusted to improve the ability of the user to discern the hyperlink targets or active areas.
- the number n of hyperlink targets or active areas is dynamically determined to avoid the display becoming overly cluttered.
- FIG. 11 shows a third exemplary embodiment in which the highlighting of hyperlink targets or active areas corresponds to a predetermined proximity range distance corresponding to the position of the stylus 102 relative to the various hyperlink targets or active areas within a displayed image map 103 .
- the proximity range is set such that only those hyperlink targets or active areas 105 – 107 within a distance x from the position of the stylus 102 are highlighted.
- the proximity range distance x may be set so that the distance x may be lesser or greater than that shown. As a result, fewer or more hyperlink targets or active areas may be highlighted according to the proximity range distance x selected.
- the number of hyperlink targets or active areas displayed may be dynamically adjusted to improve the ability of the user to discern the hyperlink targets or active areas.
- the number n of hyperlink targets or active areas is dynamically determined to avoid the display becoming overly cluttered.
- FIG. 12 shows the image map 103 divided into approximately equal quadrants 110 – 113 .
- the user gesture positioning the stylus or other instrument 102 in the quadrant 112 results in only those hyperlink targets or active areas extending into that quadrant 112 being highlighted, or otherwise made visibly distinct.
- only the active area 106 in FIG. 12 extends into the quadrant 112 .
- the user has made a “miss” gesture in the quadrant 112 .
- only the hyperlink target or active area 106 is highlighted, or otherwise made visibly distinct.
- highlighting, or visibly distinguishing the hyperlink targets or active areas 105 – 108 will automatically end upon the designated time period expiring or, in various exemplary embodiments, upon one of the hyperlink targets or active areas being selected.
- the highlighting of the hyperlink targets or active areas may be removed gradually such that the highlighting fades out completely after the designated time period has expired without requiring any additional user gesture.
- the efficiency of identifying, locating and/or selecting a hyperlink target or active area is increased.
- the user may simply repeat the appropriate gesture, such as, for example, touching the stylus 102 to the displayed image map 103 again to highlight the various hyperlink targets or active areas again.
- FIG. 13 shows a fifth exemplary embodiment of the invention, wherein some express directional tip 114 to guide a user to a desired hyperlink target or active area may be provided as a result of the user's gesture of touching the stylus 102 to the displayed image map 103 .
- some express directional tip 114 to guide a user to a desired hyperlink target or active area may be provided as a result of the user's gesture of touching the stylus 102 to the displayed image map 103 .
- directional tips 114 in a pop-up text window 115 could appear to help a user to locate, identify and/or select, for example, the nearby active area 106 .
- This is particularly useful when the image map 103 as displayed is bigger than the display 104 , such that the user would need to pan or scroll the image map relative to the display 104 .
- one or more of the active areas or hyperlink targets highlighted in response to a “miss” gesture may not appear on the portion of the image map 103 visible in the display 104 .
- This exemplary embodiment
- FIG. 13 shows an exemplary pop-up window 115 that provides textual directional tips 114 , such as, for example, “up, right” indicating to a user that the nearby hyperlink target or active area 106 is “up” and “to the right” of the position at which the stylus 102 was placed within the displayed image map 103 by the user.
- the pop-up text window 115 provided with directional tips 114 is displayed for a designated time period, for example, two seconds. After the designated time period has expired, the pop-up text window 115 and directional tips 114 are automatically removed from the display screen without any additional gesture or input by the user. The removal of the pop-up text window 115 and directional tips 114 may occur immediately when the designated time period has expired.
- the pop-up text window 115 and directional tips 114 may be removed gradually after the designated time period has expired such that the pop-up text window 115 and directional tips 114 fade out completely when the designated time period has elapsed.
- the pop-up text window 115 and directional tips 114 may be removed from the display automatically by the user's selection of a desired hyperlink target or active area.
- the user may repeat the gesture touching the stylus 102 to the displayed image map to display the pop-up text windows 115 and directional tips 114 for a renewed predetermined time period.
- the displayed image map 103 remains free of pop-up text windows or directional tips that would otherwise unnecessarily clutter the image map 103 .
- the efficiency of identifying, locating and/or selecting a desired hyperlink target or active area is increased.
- FIG. 14 shows a sixth exemplary embodiment in which the pop-up text window 115 and text-based directional tips 114 of the fifth embodiment, as shown in FIG. 13 , are replaced with, directional indicators 116 , such as, for example, arrows, to direct or guide a user from the position of the stylus 102 on the displayed image map 103 to a desired hyperlink target or active area, such as, for example, hyperlink target or active area 106 as shown in FIG. 9 .
- directional indicators 116 such as, for example, arrows
- the sixth exemplary embodiment shown in FIG. 14 provides one or more arrow directional indicators 116 displayed on the image map 103 as the result of touching the stylus 102 to the image map 103 .
- the display of the one or more arrow directional indicators 116 directs the user to hyperlink targets or active areas within the image map 103 , for example, active area 106 .
- the directional indicators 116 in the sixth exemplary embodiment are removed from the displayed image map 103 after a designated time period, for example, two seconds, has expired, similarly to that described in earlier embodiments.
- the directional indicators 116 may be removed from the displayed image map 103 automatically when the designated time period expires. Additionally, the directional indicators 116 may be removed gradually to fade out by the time the designated time period has expired. Further, the directional indicators 116 may be removed upon selecting a hyperlink target or active area. Thus, the same advantages of efficiently locating, identifying, and/or selecting a desired hyperlink target or active area are achieved.
- a combination of the pop-up text window 115 with text-based directional tips 114 and non-text directional indicators 116 could be provided simultaneously on the same displayed image map 103 to guide a user to a desired one of the various hyperlink targets or active areas within the displayed image map 103 .
- FIG. 15 shows a seventh exemplary embodiment of the invention in which the combination of pop-up text window 115 having text-based directional tips 114 and non-text directional indicators 116 are displayed simultaneously on the same image map 103 to guide a user to a desired hyperlink target or active area.
- FIG. 16 shows an eighth exemplary embodiment of the invention in which a combination of non-text directional indicators 116 – 118 are displayed simultaneously on the same image map 103 to guide a user to hyperlink targets or active areas.
- Non-text directional indicators 116 – 118 in FIG. 16 correspond to the nearest three hyperlink targets or active areas. It should be appreciated that the number of non-text directional indicators may be varied.
- the pop-window 115 with text-based directional tips 114 and the non-text directional indicators 116 – 118 may be removed from the displayed image map 103 after the designated time period expires or upon selection of a hyperlink target or active area.
- the image map 103 is not cluttered with unnecessary images.
- the removal of the pop-up text window 115 with text-based directional tips 114 and the non-text directional indicators 116 – 118 from the displayed image map 103 can occur gradually so that the pop-up text window 115 with text-based directional tips 114 and the non-text indicators 116 , as provided, fade away after the designated time period has expired.
- the visibly distinct hyperlink targets or active areas may also be removed immediately upon the user's selection of a hyperlink target or active area. In either case, the advantages and efficiencies of locating, identifying, and/or selecting hyperlink targets or active areas in a non-cluttered environment are achieved.
- various other exemplary embodiments of the systems and methods according to this invention provide other variations of directional locational indicators of the hyperlink targets or active areas within an image map to provide guidance to a user in locating, identifying, and/or selecting desired hyperlink targets or active areas within an image map.
- the locational indicators do not indicate the location of a specific hyperlink target or active area, but indicate the general location of one or more hyperlink targets or active areas. This is particularly useful when such hyperlink targets or active areas are off-screen, as suggested in the description of FIG. 13 .
- an image map that can be panned in two dimensions is combined with locational indicators in the form of arrows along the edge of the image map that point in the cardinal directions of the display.
- locational indicators in the form of arrows along the edge of the image map that point in the cardinal directions of the display.
- an image map that can be scrolled using scroll bar controls is combined with locational indicators that change the appearance of the scroll bar controls.
- locational indicators that change the appearance of the scroll bar controls.
- World Wide Web browsers commonly allow users to select the desired appearance of textual hyperlink targets.
- Such hyperlink targets can be underlined at all times, underlined when the user “hovers” the cursor over a specific hyperlink target, or never underlined.
- the user can also commonly change the color of the textual hyperlink targets.
- a first exemplary problem is that turning off hyperlink targets or making them visible only on the cursor “hovering” over the hyperlink targets puts the user in a situation similar to that of an image map, in that there are no visible cues available to help the user locate the hyperlink target.
- a second exemplary problem occurs because Web page designers can make design choices that interact with user application preferences.
- a third exemplary problem is that it is possible for Web page designers to create pages that intentionally obscure the location of the hyperlink targets. Such Web page designs are useful if the user can “hover” the cursor over potential hyperlink targets to learn their location. Such page designs are not useful if the user cannot perform the “hover” operation.
- the system knows the location of all of the hyperlink targets but the user does not necessarily know these locations. That is, discovery of the hidden or obscured hyperlink targets is inconvenient even if the “hover” operation is supported by the hypertext system. The user can click speculatively on possible hyperlink targets. However, it would be useful if the system provided additional locational indicators. Therefore, various exemplary embodiments of the systems and methods according to this invention are applicable to conventional textual hypertext as well as to graphical hypertext based on image maps.
- various exemplary embodiments of the systems and methods according to this invention apply to conventional graphical user interface systems using a cursor control device, such as a mouse, a joystick, a keyboard, a touch pad, a trackball, or the like in place of a touch-screen.
- a cursor control device such as a mouse, a joystick, a keyboard, a touch pad, a trackball, or the like in place of a touch-screen.
- the one or more locational indicators do not need to appear suddenly and/or do not need to appear at exactly the same time.
- the one or more locational indicators “fade in” during an initial portion of the designated time period.
- the one or more locational indicators appear serially during the initial portion of the designated time period.
- the locational indicators closest to the point of contact between the stylus and the touch screen appearing first, although the one or more locational indicators could appear in any desired order.
- the one or more locational indicators need not disappear suddenly and/or at exactly the same time.
- the displayed one or more locational indicators begin “fading away” at some predetermined point within the designated time period, such that the one or more locational indicators fade out during a final portion of the designated time period.
- the final portion could be the entire designated time period.
- the one or more locational indicators disappear serially. In various ones of such exemplary embodiments, the locational indicators closest to the point of contact between the stylus and the touch screen disappearing first, although the one or more locational indicators can disappear in any desired order.
- the one or more locational indicators fade out.
- the one or more locational indicators will fade out during the final portion of the designated period.
- the final portion of the designated time period begins upon the one or more locational indicators becoming fully faded in, for example, immediately after the initial period ends.
- the one or more locational indicators appear serially in a manner outlined above during the initial portion of the designated time period.
- each locational indicator may appear and disappear serially before the next locational indicator appears.
- each locational indicator may appear serially, with none of the one or more locational indicators disappearing until all of the one or more locational indicators have appeared. Then, either immediately, or alternatively after some middle portion of the designate time period, the one or more locational indicators begin serially disappearing as outlined above.
- the designated time period is fixed or predetermined, for example, at two seconds, prior to the systems and methods according to this invention being used to navigate within an image map. It should be appreciated that the designated time period can be any desired length.
- a fixed or predetermined time period is simple to implement and assures predictable behavior, an important quality in user interface design.
- the designated time period is determined using user preference settings. That is, the designated time period is changeable, but maintained at a particular value until and unless it is deliberately changed by the user. Time period adjustments based on user preferences are also simple to implement and can give the user more control over the behavior of the locational indicators. Such control is also an important quality in user interface design.
- the designated time period is adaptively determined.
- the time periods is dynamically changed using automatic adjustments made in response to a given user's actions.
- An adaptive time period can be used to adjust to variations in the abilities of an individual user, such as variations in user response time and reflexes, relative to other users or relative to that user's previous abilities. It should be appreciated that any known or later-developed technique usable to dynamically adjust the designated time period can be used in the systems and methods according to this invention.
- the techniques used to determine how the designated time period is determined and/or the techniques for varying the designated time period (or allowing the designated time period to be changed) may be selected and/or altered depending on the particular image maps and corresponding images that the systems and methods of this invention are being used with and/or the needs of the particular user that is using the systems and methods according to this invention to interact with an image map.
Abstract
Description
Claims (46)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/906,667 US6961912B2 (en) | 2001-07-18 | 2001-07-18 | Feedback mechanism for use with visual selection methods |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/906,667 US6961912B2 (en) | 2001-07-18 | 2001-07-18 | Feedback mechanism for use with visual selection methods |
Publications (2)
Publication Number | Publication Date |
---|---|
US20030016253A1 US20030016253A1 (en) | 2003-01-23 |
US6961912B2 true US6961912B2 (en) | 2005-11-01 |
Family
ID=25422785
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/906,667 Expired - Fee Related US6961912B2 (en) | 2001-07-18 | 2001-07-18 | Feedback mechanism for use with visual selection methods |
Country Status (1)
Country | Link |
---|---|
US (1) | US6961912B2 (en) |
Cited By (140)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040017404A1 (en) * | 1999-04-06 | 2004-01-29 | Vergics Corporation | Graph-based visual navigation through logical processes |
US20040109030A1 (en) * | 2002-12-09 | 2004-06-10 | International Business Machines Corporation | Adaptive timing and adaptive content for graphical user interfaces |
US20050083314A1 (en) * | 2001-07-22 | 2005-04-21 | Tomer Shalit | Computerized portable handheld means |
US20050154752A1 (en) * | 2004-01-08 | 2005-07-14 | Samsung Electronics Co., Ltd. | Display apparatus and method that display navigatable objects |
US20060004589A1 (en) * | 2004-07-02 | 2006-01-05 | General Motors Corporation | Method for mileage based proactive leasing in a telematics system |
US20060069999A1 (en) * | 2004-09-29 | 2006-03-30 | Nikon Corporation | Image reproduction apparatus and image reproduction program product |
US20060161871A1 (en) * | 2004-07-30 | 2006-07-20 | Apple Computer, Inc. | Proximity detector in handheld device |
US20060244727A1 (en) * | 2003-07-09 | 2006-11-02 | Salman Majeed D | Shared input key method and apparatus |
US20070143708A1 (en) * | 2005-12-19 | 2007-06-21 | Sap Ag | Overloaded hyperlink |
US20070296704A1 (en) * | 2006-06-26 | 2007-12-27 | Samsung Electronics Co., Ltd. | Virtual wheel interface for mobile terminal and character input method using the same |
US20080165133A1 (en) * | 2007-01-05 | 2008-07-10 | Chris Blumenberg | Method, system and graphical user interface for displaying hyperlink information |
US20080259041A1 (en) * | 2007-01-05 | 2008-10-23 | Chris Blumenberg | Method, system, and graphical user interface for activating hyperlinks |
US20100328260A1 (en) * | 2005-05-17 | 2010-12-30 | Elan Microelectronics Corporation | Capacitive touchpad of multiple operational modes |
US20110161892A1 (en) * | 2009-12-29 | 2011-06-30 | Motorola-Mobility, Inc. | Display Interface and Method for Presenting Visual Feedback of a User Interaction |
US20110167350A1 (en) * | 2010-01-06 | 2011-07-07 | Apple Inc. | Assist Features For Content Display Device |
US8239784B2 (en) | 2004-07-30 | 2012-08-07 | Apple Inc. | Mode-based graphical user interfaces for touch sensitive input devices |
US20120254736A1 (en) * | 2011-03-30 | 2012-10-04 | Elwha LLC, a limited liability company of the State of Delaware | Ascertaining presentation format based on device primary control determination |
US20120290974A1 (en) * | 2011-01-20 | 2012-11-15 | Vibrant Media, Inc. | Systems and methods for providing a discover prompt to augmented content of a web page |
US8381135B2 (en) | 2004-07-30 | 2013-02-19 | Apple Inc. | Proximity detector in handheld device |
US20140092100A1 (en) * | 2012-10-02 | 2014-04-03 | Afolio Inc. | Dial Menu |
US8726367B2 (en) | 2011-03-30 | 2014-05-13 | Elwha Llc | Highlighting in response to determining device transfer |
US8726366B2 (en) | 2011-03-30 | 2014-05-13 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US8739275B2 (en) | 2011-03-30 | 2014-05-27 | Elwha Llc | Marking one or more items in response to determining device transfer |
US8745725B2 (en) | 2011-03-30 | 2014-06-03 | Elwha Llc | Highlighting in response to determining device transfer |
US20140173489A1 (en) * | 2012-12-17 | 2014-06-19 | Sap Ag | Career history exercise with stage card visualization |
US8839411B2 (en) | 2011-03-30 | 2014-09-16 | Elwha Llc | Providing particular level of access to one or more items in response to determining primary control of a computing device |
US8863275B2 (en) | 2011-03-30 | 2014-10-14 | Elwha Llc | Access restriction in response to determining device transfer |
US8918861B2 (en) | 2011-03-30 | 2014-12-23 | Elwha Llc | Marking one or more items in response to determining device transfer |
US9153194B2 (en) | 2011-03-30 | 2015-10-06 | Elwha Llc | Presentation format selection based at least on device transfer determination |
US9239677B2 (en) | 2004-05-06 | 2016-01-19 | Apple Inc. | Operation of a computer with touch screen interface |
US9239673B2 (en) | 1998-01-26 | 2016-01-19 | Apple Inc. | Gesturing with a multipoint sensing device |
US9250734B2 (en) | 2007-01-03 | 2016-02-02 | Apple Inc. | Proximity and multi-touch sensor detection and demodulation |
US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
US9292111B2 (en) | 1998-01-26 | 2016-03-22 | Apple Inc. | Gesturing with a multipoint sensing device |
US9317111B2 (en) | 2011-03-30 | 2016-04-19 | Elwha, Llc | Providing greater access to one or more items in response to verifying device transfer |
US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US9483461B2 (en) | 2012-03-06 | 2016-11-01 | Apple Inc. | Handling speech synthesis of content for multiple languages |
US9495129B2 (en) | 2012-06-29 | 2016-11-15 | Apple Inc. | Device, method, and user interface for voice-activated navigation and browsing of a document |
US9535906B2 (en) | 2008-07-31 | 2017-01-03 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
US9575653B2 (en) | 2013-01-15 | 2017-02-21 | Blackberry Limited | Enhanced display of interactive elements in a browser |
US9582608B2 (en) | 2013-06-07 | 2017-02-28 | Apple Inc. | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
US9620104B2 (en) | 2013-06-07 | 2017-04-11 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
US9626955B2 (en) | 2008-04-05 | 2017-04-18 | Apple Inc. | Intelligent text-to-speech conversion |
US9633660B2 (en) | 2010-02-25 | 2017-04-25 | Apple Inc. | User profiling for voice input processing |
US9633674B2 (en) | 2013-06-07 | 2017-04-25 | Apple Inc. | System and method for detecting errors in interactions with a voice-based digital assistant |
US9639265B2 (en) | 2010-09-03 | 2017-05-02 | Microsoft Technology Licensing, Llc | Distance-time based hit-testing for displayed target graphical elements |
US9646614B2 (en) | 2000-03-16 | 2017-05-09 | Apple Inc. | Fast, language-independent method for user authentication by voice |
US9646609B2 (en) | 2014-09-30 | 2017-05-09 | Apple Inc. | Caching apparatus for serving phonetic pronunciations |
US9668121B2 (en) | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
US9697820B2 (en) | 2015-09-24 | 2017-07-04 | Apple Inc. | Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
US9760559B2 (en) | 2014-05-30 | 2017-09-12 | Apple Inc. | Predictive text input |
US9785630B2 (en) | 2014-05-30 | 2017-10-10 | Apple Inc. | Text prediction using combined word N-gram and unigram language models |
US9798393B2 (en) | 2011-08-29 | 2017-10-24 | Apple Inc. | Text correction processing |
US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US20170351917A1 (en) * | 2013-11-22 | 2017-12-07 | Samsung Electronics Co., Ltd | Method for recognizing a specific object inside an image and electronic device thereof |
US9842105B2 (en) | 2015-04-16 | 2017-12-12 | Apple Inc. | Parsimonious continuous-space phrase representations for natural language processing |
US9842101B2 (en) | 2014-05-30 | 2017-12-12 | Apple Inc. | Predictive conversion of language input |
US20170358238A1 (en) * | 2016-06-10 | 2017-12-14 | Renato CASUTT | Speed reading system and method |
US9858925B2 (en) | 2009-06-05 | 2018-01-02 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US9865280B2 (en) | 2015-03-06 | 2018-01-09 | Apple Inc. | Structured dictation using intelligent automated assistants |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US9886432B2 (en) | 2014-09-30 | 2018-02-06 | Apple Inc. | Parsimonious handling of word inflection via categorical stem + suffix N-gram language models |
US9899019B2 (en) | 2015-03-18 | 2018-02-20 | Apple Inc. | Systems and methods for structured stem and suffix language models |
US9934775B2 (en) | 2016-05-26 | 2018-04-03 | Apple Inc. | Unit-selection text-to-speech synthesis based on predicted concatenation parameters |
US20180101349A1 (en) * | 2015-06-23 | 2018-04-12 | Shuhei TSUBONE | Communication terminal, management system, communication system, and display method |
US9953088B2 (en) | 2012-05-14 | 2018-04-24 | Apple Inc. | Crowd sourcing information to fulfill user requests |
US9966068B2 (en) | 2013-06-08 | 2018-05-08 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
US9966065B2 (en) | 2014-05-30 | 2018-05-08 | Apple Inc. | Multi-command single utterance input method |
US9971774B2 (en) | 2012-09-19 | 2018-05-15 | Apple Inc. | Voice-based media searching |
US9972304B2 (en) | 2016-06-03 | 2018-05-15 | Apple Inc. | Privacy preserving distributed evaluation framework for embedded personalized systems |
US10043516B2 (en) | 2016-09-23 | 2018-08-07 | Apple Inc. | Intelligent automated assistant |
US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
US10067938B2 (en) | 2016-06-10 | 2018-09-04 | Apple Inc. | Multilingual word prediction |
US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
US10078631B2 (en) | 2014-05-30 | 2018-09-18 | Apple Inc. | Entropy-guided text prediction using combined word and character n-gram language models |
US10079014B2 (en) | 2012-06-08 | 2018-09-18 | Apple Inc. | Name recognition system |
US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
US10089072B2 (en) | 2016-06-11 | 2018-10-02 | Apple Inc. | Intelligent device arbitration and control |
US10101822B2 (en) | 2015-06-05 | 2018-10-16 | Apple Inc. | Language input correction |
US10127220B2 (en) | 2015-06-04 | 2018-11-13 | Apple Inc. | Language identification from short strings |
US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
US10156941B2 (en) | 2013-02-14 | 2018-12-18 | Quickstep Technologies Llc | Method and device for navigating in a display screen and apparatus comprising such navigation |
US10169329B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Exemplar-based natural language processing |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
US10186254B2 (en) | 2015-06-07 | 2019-01-22 | Apple Inc. | Context-based endpoint detection |
US10185542B2 (en) | 2013-06-09 | 2019-01-22 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US10192552B2 (en) | 2016-06-10 | 2019-01-29 | Apple Inc. | Digital assistant providing whispered speech |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US10241752B2 (en) | 2011-09-30 | 2019-03-26 | Apple Inc. | Interface for a virtual digital assistant |
US10241644B2 (en) | 2011-06-03 | 2019-03-26 | Apple Inc. | Actionable reminder entries |
US10249300B2 (en) | 2016-06-06 | 2019-04-02 | Apple Inc. | Intelligent list reading |
US10255907B2 (en) | 2015-06-07 | 2019-04-09 | Apple Inc. | Automatic accent detection using acoustic models |
US10269345B2 (en) | 2016-06-11 | 2019-04-23 | Apple Inc. | Intelligent task discovery |
US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
US10283110B2 (en) | 2009-07-02 | 2019-05-07 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
US10297253B2 (en) | 2016-06-11 | 2019-05-21 | Apple Inc. | Application integration with a digital assistant |
US10303266B2 (en) | 2011-01-31 | 2019-05-28 | Quickstep Technologies Llc | Three-dimensional man/machine interface |
US10318871B2 (en) | 2005-09-08 | 2019-06-11 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US10356243B2 (en) | 2015-06-05 | 2019-07-16 | Apple Inc. | Virtual assistant aided communication with 3rd party service in a communication session |
US10354011B2 (en) | 2016-06-09 | 2019-07-16 | Apple Inc. | Intelligent automated assistant in a home environment |
US10366158B2 (en) | 2015-09-29 | 2019-07-30 | Apple Inc. | Efficient word encoding for recurrent neural network language models |
US10410637B2 (en) | 2017-05-12 | 2019-09-10 | Apple Inc. | User-specific acoustic models |
US10446143B2 (en) | 2016-03-14 | 2019-10-15 | Apple Inc. | Identification of voice inputs providing credentials |
US10446141B2 (en) | 2014-08-28 | 2019-10-15 | Apple Inc. | Automatic speech recognition based on user feedback |
US10482874B2 (en) | 2017-05-15 | 2019-11-19 | Apple Inc. | Hierarchical belief states for digital assistants |
US10490187B2 (en) | 2016-06-10 | 2019-11-26 | Apple Inc. | Digital assistant providing automated status report |
US10496753B2 (en) | 2010-01-18 | 2019-12-03 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10509862B2 (en) | 2016-06-10 | 2019-12-17 | Apple Inc. | Dynamic phrase expansion of language input |
US10521466B2 (en) | 2016-06-11 | 2019-12-31 | Apple Inc. | Data driven natural language event detection and classification |
US10553209B2 (en) | 2010-01-18 | 2020-02-04 | Apple Inc. | Systems and methods for hands-free notification summaries |
US10552013B2 (en) | 2014-12-02 | 2020-02-04 | Apple Inc. | Data detection |
US10568032B2 (en) | 2007-04-03 | 2020-02-18 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US10567477B2 (en) | 2015-03-08 | 2020-02-18 | Apple Inc. | Virtual assistant continuity |
US10593346B2 (en) | 2016-12-22 | 2020-03-17 | Apple Inc. | Rank-reduced token representation for automatic speech recognition |
US10607141B2 (en) | 2010-01-25 | 2020-03-31 | Newvaluexchange Ltd. | Apparatuses, methods and systems for a digital conversation management platform |
US10659851B2 (en) | 2014-06-30 | 2020-05-19 | Apple Inc. | Real-time digital assistant knowledge updates |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10679605B2 (en) | 2010-01-18 | 2020-06-09 | Apple Inc. | Hands-free list-reading by intelligent automated assistant |
CN111309206A (en) * | 2020-02-04 | 2020-06-19 | 北京达佳互联信息技术有限公司 | Data processing method and device, electronic equipment and storage medium |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10706373B2 (en) | 2011-06-03 | 2020-07-07 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US10705794B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10733993B2 (en) | 2016-06-10 | 2020-08-04 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US10755703B2 (en) | 2017-05-11 | 2020-08-25 | Apple Inc. | Offline personal assistant |
US10789041B2 (en) | 2014-09-12 | 2020-09-29 | Apple Inc. | Dynamic thresholds for always listening speech trigger |
US10791176B2 (en) | 2017-05-12 | 2020-09-29 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US10810274B2 (en) | 2017-05-15 | 2020-10-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
USD903711S1 (en) * | 2018-10-31 | 2020-12-01 | Dolby Laboratories Licensing Corporation | Electronic device or portion thereof with animated graphical user interface |
US11010550B2 (en) | 2015-09-29 | 2021-05-18 | Apple Inc. | Unified language modeling framework for word prediction, auto-completion and auto-correction |
US11025565B2 (en) | 2015-06-07 | 2021-06-01 | Apple Inc. | Personalized prediction of responses for instant messaging |
US11217255B2 (en) | 2017-05-16 | 2022-01-04 | Apple Inc. | Far-field extension for digital assistant services |
US11379060B2 (en) | 2004-08-25 | 2022-07-05 | Apple Inc. | Wide touchpad on a portable computer |
US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
Families Citing this family (96)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060033724A1 (en) * | 2004-07-30 | 2006-02-16 | Apple Computer, Inc. | Virtual input device placement on a touch screen user interface |
US7397476B2 (en) * | 2000-05-31 | 2008-07-08 | Seiko Epson Corporation | Projector, projection display system, and corresponding method and recording medium |
AU2002258769A1 (en) * | 2001-04-09 | 2002-10-21 | America Online Incorporated | Server-based browser system |
US8095879B2 (en) | 2002-12-10 | 2012-01-10 | Neonode Inc. | User interface for mobile handheld computer unit |
JP2003288158A (en) * | 2002-01-28 | 2003-10-10 | Sony Corp | Mobile apparatus having tactile feedback function |
GB0203617D0 (en) * | 2002-02-15 | 2002-04-03 | Ibm | Application window closure in response to event in parent window |
US7343566B1 (en) * | 2002-07-10 | 2008-03-11 | Apple Inc. | Method and apparatus for displaying a window for a user interface |
CN1695329B (en) * | 2002-10-28 | 2010-05-12 | 皇家飞利浦电子股份有限公司 | Apparatus and method for replacing a media content item |
US7082572B2 (en) * | 2002-12-30 | 2006-07-25 | The Board Of Trustees Of The Leland Stanford Junior University | Methods and apparatus for interactive map-based analysis of digital video content |
US9213365B2 (en) | 2010-10-01 | 2015-12-15 | Z124 | Method and system for viewing stacked screen displays using gestures |
US20050041858A1 (en) * | 2003-08-21 | 2005-02-24 | International Business Machines Corporation | Apparatus and method for distributing portions of large web pages to fit smaller constrained viewing areas |
US7106312B2 (en) * | 2003-11-10 | 2006-09-12 | Microsoft Corporation | Text input window with auto-growth |
JP3720344B2 (en) * | 2004-01-23 | 2005-11-24 | 株式会社スクウェア・エニックス | GAME DEVICE, CHARACTER SELECTION METHOD IN VIDEO GAME, CHARACTER SELECTION PROGRAM, AND RECORDING MEDIUM CONTAINING CHARACTER SELECTION PROGRAM |
US20050195159A1 (en) * | 2004-02-23 | 2005-09-08 | Hunleth Frank A. | Keyboardless text entry |
TW200539031A (en) * | 2004-05-20 | 2005-12-01 | Elan Microelectronics Corp | A capacitor type touch pad with integrated graphic input function |
KR20070026659A (en) * | 2004-06-29 | 2007-03-08 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Discontinuous zoom |
US20060190812A1 (en) * | 2005-02-22 | 2006-08-24 | Geovector Corporation | Imaging systems including hyperlink associations |
US7728825B2 (en) * | 2005-03-22 | 2010-06-01 | Microsoft Corporation | Targeting in a stylus-based user interface |
FI20055369A0 (en) * | 2005-06-30 | 2005-06-30 | Nokia Corp | Method and device for processing digital media files |
US8542196B2 (en) * | 2005-07-22 | 2013-09-24 | Move Mobile Systems, Inc. | System and method for a thumb-optimized touch-screen user interface |
US8018440B2 (en) | 2005-12-30 | 2011-09-13 | Microsoft Corporation | Unintentional touch rejection |
US7770126B2 (en) * | 2006-02-10 | 2010-08-03 | Microsoft Corporation | Assisting user interface element use |
US20080022224A1 (en) * | 2006-03-07 | 2008-01-24 | Marengo Intellectual Property Ltd. | Pushed and pulled information display on a computing device |
US20070214430A1 (en) * | 2006-03-07 | 2007-09-13 | Coutts Daryl D | Textpane for pushed and pulled information on a computing device |
US20080028324A1 (en) * | 2006-03-07 | 2008-01-31 | Marengo Intellectual Property Ltd. | Multi-applicaton bulletin board |
WO2007110803A2 (en) * | 2006-03-24 | 2007-10-04 | Koninklijke Philips Electronics N.V. | Interactive display device |
US9009291B2 (en) * | 2006-05-12 | 2015-04-14 | W.W. Grainger, Inc. | System and method for directing attention to web site functionality |
JP2008012199A (en) * | 2006-07-10 | 2008-01-24 | Aruze Corp | Game system and image display control method thereof |
US8782133B2 (en) * | 2006-07-12 | 2014-07-15 | Daryl David Coutts | Multi-conversation instant messaging |
EP2045576A4 (en) * | 2006-07-20 | 2013-01-16 | Navitime Japan Co Ltd | Map display system, map display device, map display method, and map distribution server |
US20080034294A1 (en) * | 2006-07-21 | 2008-02-07 | Nokia Corporation | Tactile presentation of properties of a resource referenced through a link |
US7890863B2 (en) * | 2006-10-04 | 2011-02-15 | Immersion Corporation | Haptic effects with proximity sensing |
US20080288866A1 (en) * | 2007-05-17 | 2008-11-20 | Spencer James H | Mobile device carrousel systems and methods |
US8839142B2 (en) | 2007-06-08 | 2014-09-16 | Apple Inc. | Desktop system object removal |
WO2009120984A1 (en) | 2008-03-28 | 2009-10-01 | Kopin Corporation | Handheld wireless display device having high-resolution display suitable for use as a mobile internet device |
US20090193361A1 (en) * | 2008-01-30 | 2009-07-30 | Research In Motion Limited | Electronic device and method of controlling same |
JP4393565B1 (en) * | 2008-08-28 | 2010-01-06 | 株式会社東芝 | Display processing apparatus, display processing method, and program |
US8469813B2 (en) * | 2008-11-14 | 2013-06-25 | Wms Gaming, Inc. | Storing and using casino content |
US20100275120A1 (en) * | 2009-04-22 | 2010-10-28 | Nicholas Pappas | Processing of fields in motion picture videos or still photos |
KR101597553B1 (en) * | 2009-05-25 | 2016-02-25 | 엘지전자 주식회사 | Function execution method and apparatus thereof |
KR20110014444A (en) * | 2009-08-05 | 2011-02-11 | 삼성전자주식회사 | User interface method in web browsing, and electronic device and computer-readable medium thereof |
CN102712328B (en) * | 2009-11-12 | 2015-07-15 | 三菱电机株式会社 | Screen image information delivery display system and screen image information delivery display method |
US9411504B2 (en) | 2010-01-28 | 2016-08-09 | Microsoft Technology Licensing, Llc | Copy and staple gestures |
US8261213B2 (en) | 2010-01-28 | 2012-09-04 | Microsoft Corporation | Brush, carbon-copy, and fill gestures |
US9519356B2 (en) * | 2010-02-04 | 2016-12-13 | Microsoft Technology Licensing, Llc | Link gestures |
US9367205B2 (en) | 2010-02-19 | 2016-06-14 | Microsoft Technolgoy Licensing, Llc | Radial menus with bezel gestures |
US9965165B2 (en) | 2010-02-19 | 2018-05-08 | Microsoft Technology Licensing, Llc | Multi-finger gestures |
US9274682B2 (en) | 2010-02-19 | 2016-03-01 | Microsoft Technology Licensing, Llc | Off-screen gestures to create on-screen input |
US9310994B2 (en) | 2010-02-19 | 2016-04-12 | Microsoft Technology Licensing, Llc | Use of bezel as an input mechanism |
US9454304B2 (en) | 2010-02-25 | 2016-09-27 | Microsoft Technology Licensing, Llc | Multi-screen dual tap gesture |
KR101690232B1 (en) * | 2010-05-28 | 2016-12-27 | 엘지전자 주식회사 | Electronic Device And Method Of Controlling The Same |
US10013976B2 (en) | 2010-09-20 | 2018-07-03 | Kopin Corporation | Context sensitive overlays in voice controlled headset computer displays |
US9122307B2 (en) | 2010-09-20 | 2015-09-01 | Kopin Corporation | Advanced remote control of host application using motion and voice commands |
US9377862B2 (en) * | 2010-09-20 | 2016-06-28 | Kopin Corporation | Searchlight navigation using headtracker to reveal hidden or extra document data |
WO2012044713A1 (en) * | 2010-10-01 | 2012-04-05 | Imerj LLC | Drag/flick gestures in user interface |
US9658732B2 (en) | 2010-10-19 | 2017-05-23 | Apple Inc. | Changing a virtual workspace based on user interaction with an application window in a user interface |
US10740117B2 (en) | 2010-10-19 | 2020-08-11 | Apple Inc. | Grouping windows into clusters in one or more workspaces in a user interface |
US9542202B2 (en) | 2010-10-19 | 2017-01-10 | Apple Inc. | Displaying and updating workspaces in a user interface |
US9292196B2 (en) | 2010-10-19 | 2016-03-22 | Apple Inc. | Modifying the presentation of clustered application windows in a user interface |
US10152192B2 (en) | 2011-02-21 | 2018-12-11 | Apple Inc. | Scaling application windows in one or more workspaces in a user interface |
US20120240019A1 (en) * | 2011-03-17 | 2012-09-20 | Ebay Inc. | Method and system for tracking web link usage |
WO2012154938A1 (en) | 2011-05-10 | 2012-11-15 | Kopin Corporation | Headset computer that uses motion and voice commands to control information display and remote devices |
US20130080932A1 (en) | 2011-09-27 | 2013-03-28 | Sanjiv Sirpal | Secondary single screen mode activation through user interface toggle |
US9569057B2 (en) * | 2012-01-05 | 2017-02-14 | Sony Corporation | Information processing apparatus and method for outputting a guiding operation to a user |
US20130179844A1 (en) * | 2012-01-06 | 2013-07-11 | Mirko Mandic | Input Pointer Delay |
US8929954B2 (en) | 2012-04-25 | 2015-01-06 | Kopin Corporation | Headset computer (HSC) as auxiliary display with ASR and HT input |
JP6289448B2 (en) | 2012-04-25 | 2018-03-07 | コピン コーポレーション | Instant translation system |
US9442290B2 (en) | 2012-05-10 | 2016-09-13 | Kopin Corporation | Headset computer operation using vehicle sensor feedback for remote control vehicle |
GB201215283D0 (en) * | 2012-08-28 | 2012-10-10 | Microsoft Corp | Searching at a user device |
US9582122B2 (en) | 2012-11-12 | 2017-02-28 | Microsoft Technology Licensing, Llc | Touch-sensitive bezel techniques |
US20150332107A1 (en) * | 2012-12-24 | 2015-11-19 | Nokia Technologies Oy | An apparatus and associated methods |
US9301085B2 (en) | 2013-02-20 | 2016-03-29 | Kopin Corporation | Computer headset with detachable 4G radio |
JP6094550B2 (en) * | 2013-09-17 | 2017-03-15 | 株式会社リコー | Information processing apparatus and program |
US9477337B2 (en) | 2014-03-14 | 2016-10-25 | Microsoft Technology Licensing, Llc | Conductive trace routing for display and bezel sensors |
US9396354B1 (en) | 2014-05-28 | 2016-07-19 | Snapchat, Inc. | Apparatus and method for automated privacy protection in distributed images |
US9537811B2 (en) | 2014-10-02 | 2017-01-03 | Snap Inc. | Ephemeral gallery of ephemeral messages |
US9113301B1 (en) | 2014-06-13 | 2015-08-18 | Snapchat, Inc. | Geo-location based event gallery |
US10824654B2 (en) | 2014-09-18 | 2020-11-03 | Snap Inc. | Geolocation-based pictographs |
US10284508B1 (en) | 2014-10-02 | 2019-05-07 | Snap Inc. | Ephemeral gallery of ephemeral messages with opt-in permanence |
KR102399589B1 (en) * | 2014-11-05 | 2022-05-18 | 삼성전자주식회사 | Method and apparatus for displaying object and recording medium thereof |
US10311916B2 (en) | 2014-12-19 | 2019-06-04 | Snap Inc. | Gallery of videos set to an audio time line |
US9385983B1 (en) | 2014-12-19 | 2016-07-05 | Snapchat, Inc. | Gallery of messages from individuals with a shared interest |
US10133705B1 (en) | 2015-01-19 | 2018-11-20 | Snap Inc. | Multichannel system |
EP3272078B1 (en) | 2015-03-18 | 2022-01-19 | Snap Inc. | Geo-fence authorization provisioning |
US10135949B1 (en) | 2015-05-05 | 2018-11-20 | Snap Inc. | Systems and methods for story and sub-story navigation |
ES2892972T3 (en) * | 2015-11-02 | 2022-02-07 | Univ Texas | Methods of CD40 activation and immune checkpoint blockade |
US10354425B2 (en) | 2015-12-18 | 2019-07-16 | Snap Inc. | Method and system for providing context relevant media augmentation |
US10200906B2 (en) * | 2016-09-02 | 2019-02-05 | Qualcomm Incorporated | Systems and methods for radio resource management |
US20180146223A1 (en) * | 2016-11-22 | 2018-05-24 | Facebook, Inc. | Enhancing a live video |
US10582277B2 (en) | 2017-03-27 | 2020-03-03 | Snap Inc. | Generating a stitched data stream |
US11526659B2 (en) | 2021-03-16 | 2022-12-13 | Microsoft Technology Licensing, Llc | Converting text to digital ink |
US11372486B1 (en) | 2021-03-16 | 2022-06-28 | Microsoft Technology Licensing, Llc | Setting digital pen input mode using tilt angle |
US11361153B1 (en) * | 2021-03-16 | 2022-06-14 | Microsoft Technology Licensing, Llc | Linking digital ink instances using connecting lines |
US11435893B1 (en) | 2021-03-16 | 2022-09-06 | Microsoft Technology Licensing, Llc | Submitting questions using digital ink |
US11875543B2 (en) | 2021-03-16 | 2024-01-16 | Microsoft Technology Licensing, Llc | Duplicating and aggregating digital ink instances |
WO2023028599A1 (en) * | 2021-08-27 | 2023-03-02 | Rock Cube Holdings LLC | Systems and methods for time-dependent hyperlink presentation |
Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5513309A (en) * | 1993-01-05 | 1996-04-30 | Apple Computer, Inc. | Graphic editor user interface for a pointer-based computer system |
US5721851A (en) | 1995-07-31 | 1998-02-24 | International Business Machines Corporation | Transient link indicators in image maps |
US5910800A (en) | 1997-06-11 | 1999-06-08 | Microsoft Corporation | Usage tips for on-screen touch-sensitive controls |
US5978848A (en) * | 1997-03-14 | 1999-11-02 | International Business Machines Corporation | Web browser method and system for backgrounding a link access during slow link access time periods |
US5983244A (en) | 1996-09-27 | 1999-11-09 | International Business Machines Corporation | Indicating when clickable image link on a hypertext image map of a computer web browser has been traversed |
US6020881A (en) * | 1993-05-24 | 2000-02-01 | Sun Microsystems | Graphical user interface with method and apparatus for interfacing to remote devices |
US6057844A (en) * | 1997-04-28 | 2000-05-02 | Adobe Systems Incorporated | Drag operation gesture controller |
US6125385A (en) * | 1996-08-01 | 2000-09-26 | Immersion Corporation | Force feedback implementation in web pages |
US6184883B1 (en) * | 1998-03-18 | 2001-02-06 | International Business Machines Corporation | Computer system, program product and method utilizing in-focus switch delay for user interface components |
US6243091B1 (en) * | 1997-11-21 | 2001-06-05 | International Business Machines Corporation | Global history view |
US6271840B1 (en) * | 1998-09-24 | 2001-08-07 | James Lee Finseth | Graphical search engine visual index |
US6321158B1 (en) * | 1994-06-24 | 2001-11-20 | Delorme Publishing Company | Integrated routing/mapping information |
US6342908B1 (en) * | 1999-03-22 | 2002-01-29 | International Business Machines Corporation | Progressive window organization |
US6396500B1 (en) * | 1999-03-18 | 2002-05-28 | Microsoft Corporation | Method and system for generating and displaying a slide show with animations and transitions in a browser |
US6405238B1 (en) * | 1998-07-31 | 2002-06-11 | Hewlett-Packard Co. | Quick navigation upon demand to main areas of web site |
US20020075333A1 (en) * | 2000-12-15 | 2002-06-20 | International Business Machines Corporation | Proximity selection of selectable items in a graphical user interface |
US6661439B1 (en) * | 1999-06-17 | 2003-12-09 | Nec Corporation | Information visualization system |
US6704034B1 (en) * | 2000-09-28 | 2004-03-09 | International Business Machines Corporation | Method and apparatus for providing accessibility through a context sensitive magnifying glass |
-
2001
- 2001-07-18 US US09/906,667 patent/US6961912B2/en not_active Expired - Fee Related
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5513309A (en) * | 1993-01-05 | 1996-04-30 | Apple Computer, Inc. | Graphic editor user interface for a pointer-based computer system |
US6020881A (en) * | 1993-05-24 | 2000-02-01 | Sun Microsystems | Graphical user interface with method and apparatus for interfacing to remote devices |
US6321158B1 (en) * | 1994-06-24 | 2001-11-20 | Delorme Publishing Company | Integrated routing/mapping information |
US5721851A (en) | 1995-07-31 | 1998-02-24 | International Business Machines Corporation | Transient link indicators in image maps |
US6125385A (en) * | 1996-08-01 | 2000-09-26 | Immersion Corporation | Force feedback implementation in web pages |
US5983244A (en) | 1996-09-27 | 1999-11-09 | International Business Machines Corporation | Indicating when clickable image link on a hypertext image map of a computer web browser has been traversed |
US5978848A (en) * | 1997-03-14 | 1999-11-02 | International Business Machines Corporation | Web browser method and system for backgrounding a link access during slow link access time periods |
US6057844A (en) * | 1997-04-28 | 2000-05-02 | Adobe Systems Incorporated | Drag operation gesture controller |
US5910800A (en) | 1997-06-11 | 1999-06-08 | Microsoft Corporation | Usage tips for on-screen touch-sensitive controls |
US6243091B1 (en) * | 1997-11-21 | 2001-06-05 | International Business Machines Corporation | Global history view |
US6184883B1 (en) * | 1998-03-18 | 2001-02-06 | International Business Machines Corporation | Computer system, program product and method utilizing in-focus switch delay for user interface components |
US6405238B1 (en) * | 1998-07-31 | 2002-06-11 | Hewlett-Packard Co. | Quick navigation upon demand to main areas of web site |
US6271840B1 (en) * | 1998-09-24 | 2001-08-07 | James Lee Finseth | Graphical search engine visual index |
US6396500B1 (en) * | 1999-03-18 | 2002-05-28 | Microsoft Corporation | Method and system for generating and displaying a slide show with animations and transitions in a browser |
US6342908B1 (en) * | 1999-03-22 | 2002-01-29 | International Business Machines Corporation | Progressive window organization |
US6661439B1 (en) * | 1999-06-17 | 2003-12-09 | Nec Corporation | Information visualization system |
US6704034B1 (en) * | 2000-09-28 | 2004-03-09 | International Business Machines Corporation | Method and apparatus for providing accessibility through a context sensitive magnifying glass |
US20020075333A1 (en) * | 2000-12-15 | 2002-06-20 | International Business Machines Corporation | Proximity selection of selectable items in a graphical user interface |
Non-Patent Citations (6)
Title |
---|
D. Ragget, HTML 3.2 Reference Specification, World-Wide Web Consortium, Boston, MA Jan 1997. |
J. F. Kelley et al. "IBM EXPO '92 Guest Services System", Proc. 37<SUP>th </SUP>HFES Annual Meeting, Oct. 1993; pp. 1-5. |
P. M. Aoki, et al., "Tap Tips: Lightweight Discovery of Touchscreen Targets", Extended Abstracts, ACM SIGCHI Conf. on Human Factors in Computing Systems, Seattle, WA, Mar. 2001, 237-238. |
R. Makkuni, "The Crossing Exhibit & The Future of the Cultural Learning Interface", Culture Track of the 9<SUP>th </SUP>World Wide Web Conference, Amsterdam, the Netherlands, May 2000. |
R. McCool et al., NCSA HTTPd, National Center for Supercomputing Applications, University of Illinois, Urbana-Champign, IL, 1993-1996. |
T. Berners-Lee et al., Hypertext Markup Language-2.0, RFC 1866, Internet Engineering Task Force, Marina Del Ray, CA. Nov. 1995; pp. 1-77. |
Cited By (204)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9292111B2 (en) | 1998-01-26 | 2016-03-22 | Apple Inc. | Gesturing with a multipoint sensing device |
US9239673B2 (en) | 1998-01-26 | 2016-01-19 | Apple Inc. | Gesturing with a multipoint sensing device |
US9811237B2 (en) * | 1999-04-06 | 2017-11-07 | Iii Holdings 2, Llc | Visual navigation of virtual environments through logical processes |
US20040017404A1 (en) * | 1999-04-06 | 2004-01-29 | Vergics Corporation | Graph-based visual navigation through logical processes |
US9646614B2 (en) | 2000-03-16 | 2017-05-09 | Apple Inc. | Fast, language-independent method for user authentication by voice |
US20050083314A1 (en) * | 2001-07-22 | 2005-04-21 | Tomer Shalit | Computerized portable handheld means |
US9606668B2 (en) | 2002-02-07 | 2017-03-28 | Apple Inc. | Mode-based graphical user interfaces for touch sensitive input devices |
US20040109030A1 (en) * | 2002-12-09 | 2004-06-10 | International Business Machines Corporation | Adaptive timing and adaptive content for graphical user interfaces |
US9030415B2 (en) * | 2003-07-09 | 2015-05-12 | Varia Holdings Llc | Shared input key method and apparatus |
US20060244727A1 (en) * | 2003-07-09 | 2006-11-02 | Salman Majeed D | Shared input key method and apparatus |
US20050154752A1 (en) * | 2004-01-08 | 2005-07-14 | Samsung Electronics Co., Ltd. | Display apparatus and method that display navigatable objects |
US9239677B2 (en) | 2004-05-06 | 2016-01-19 | Apple Inc. | Operation of a computer with touch screen interface |
US20060004589A1 (en) * | 2004-07-02 | 2006-01-05 | General Motors Corporation | Method for mileage based proactive leasing in a telematics system |
US8381135B2 (en) | 2004-07-30 | 2013-02-19 | Apple Inc. | Proximity detector in handheld device |
US8612856B2 (en) | 2004-07-30 | 2013-12-17 | Apple Inc. | Proximity detector in handheld device |
US7653883B2 (en) * | 2004-07-30 | 2010-01-26 | Apple Inc. | Proximity detector in handheld device |
US9348458B2 (en) | 2004-07-30 | 2016-05-24 | Apple Inc. | Gestures for touch sensitive input devices |
US8239784B2 (en) | 2004-07-30 | 2012-08-07 | Apple Inc. | Mode-based graphical user interfaces for touch sensitive input devices |
US10042418B2 (en) | 2004-07-30 | 2018-08-07 | Apple Inc. | Proximity detector in handheld device |
US20060161871A1 (en) * | 2004-07-30 | 2006-07-20 | Apple Computer, Inc. | Proximity detector in handheld device |
US11036282B2 (en) | 2004-07-30 | 2021-06-15 | Apple Inc. | Proximity detector in handheld device |
US8479122B2 (en) | 2004-07-30 | 2013-07-02 | Apple Inc. | Gestures for touch sensitive input devices |
US11379060B2 (en) | 2004-08-25 | 2022-07-05 | Apple Inc. | Wide touchpad on a portable computer |
US8176426B2 (en) * | 2004-09-29 | 2012-05-08 | Nikon Corporation | Image reproduction apparatus and image reproduction program product |
US20060069999A1 (en) * | 2004-09-29 | 2006-03-30 | Nikon Corporation | Image reproduction apparatus and image reproduction program product |
US20100328260A1 (en) * | 2005-05-17 | 2010-12-30 | Elan Microelectronics Corporation | Capacitive touchpad of multiple operational modes |
US10318871B2 (en) | 2005-09-08 | 2019-06-11 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US20070143708A1 (en) * | 2005-12-19 | 2007-06-21 | Sap Ag | Overloaded hyperlink |
US20070296704A1 (en) * | 2006-06-26 | 2007-12-27 | Samsung Electronics Co., Ltd. | Virtual wheel interface for mobile terminal and character input method using the same |
US8223127B2 (en) * | 2006-06-26 | 2012-07-17 | Samsung Electronics Co., Ltd. | Virtual wheel interface for mobile terminal and character input method using the same |
US9830036B2 (en) | 2007-01-03 | 2017-11-28 | Apple Inc. | Proximity and multi-touch sensor detection and demodulation |
US9367158B2 (en) | 2007-01-03 | 2016-06-14 | Apple Inc. | Proximity and multi-touch sensor detection and demodulation |
US9250734B2 (en) | 2007-01-03 | 2016-02-02 | Apple Inc. | Proximity and multi-touch sensor detection and demodulation |
US20080259041A1 (en) * | 2007-01-05 | 2008-10-23 | Chris Blumenberg | Method, system, and graphical user interface for activating hyperlinks |
US8547353B2 (en) | 2007-01-05 | 2013-10-01 | Apple Inc. | Method, system, and graphical user interface for displaying hyperlink information on a web page |
US20110134066A1 (en) * | 2007-01-05 | 2011-06-09 | Chris Blumenberg | Method, System, and Graphical User Interface for Displaying Hyperlink Information |
US7889184B2 (en) * | 2007-01-05 | 2011-02-15 | Apple Inc. | Method, system and graphical user interface for displaying hyperlink information |
US7889185B2 (en) | 2007-01-05 | 2011-02-15 | Apple Inc. | Method, system, and graphical user interface for activating hyperlinks |
US20080165133A1 (en) * | 2007-01-05 | 2008-07-10 | Chris Blumenberg | Method, system and graphical user interface for displaying hyperlink information |
US10568032B2 (en) | 2007-04-03 | 2020-02-18 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US10381016B2 (en) | 2008-01-03 | 2019-08-13 | Apple Inc. | Methods and apparatus for altering audio output signals |
US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
US9626955B2 (en) | 2008-04-05 | 2017-04-18 | Apple Inc. | Intelligent text-to-speech conversion |
US9865248B2 (en) | 2008-04-05 | 2018-01-09 | Apple Inc. | Intelligent text-to-speech conversion |
US9535906B2 (en) | 2008-07-31 | 2017-01-03 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
US10108612B2 (en) | 2008-07-31 | 2018-10-23 | Apple Inc. | Mobile device having human language translation capability with positional feedback |
US10795541B2 (en) | 2009-06-05 | 2020-10-06 | Apple Inc. | Intelligent organization of tasks items |
US9858925B2 (en) | 2009-06-05 | 2018-01-02 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US10475446B2 (en) | 2009-06-05 | 2019-11-12 | Apple Inc. | Using context information to facilitate processing of commands in a virtual assistant |
US11080012B2 (en) | 2009-06-05 | 2021-08-03 | Apple Inc. | Interface for a virtual digital assistant |
US10283110B2 (en) | 2009-07-02 | 2019-05-07 | Apple Inc. | Methods and apparatuses for automatic speech recognition |
US20110161892A1 (en) * | 2009-12-29 | 2011-06-30 | Motorola-Mobility, Inc. | Display Interface and Method for Presenting Visual Feedback of a User Interaction |
US20110167350A1 (en) * | 2010-01-06 | 2011-07-07 | Apple Inc. | Assist Features For Content Display Device |
US10679605B2 (en) | 2010-01-18 | 2020-06-09 | Apple Inc. | Hands-free list-reading by intelligent automated assistant |
US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
US9548050B2 (en) | 2010-01-18 | 2017-01-17 | Apple Inc. | Intelligent automated assistant |
US10553209B2 (en) | 2010-01-18 | 2020-02-04 | Apple Inc. | Systems and methods for hands-free notification summaries |
US10706841B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Task flow identification based on user intent |
US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
US10705794B2 (en) | 2010-01-18 | 2020-07-07 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US10496753B2 (en) | 2010-01-18 | 2019-12-03 | Apple Inc. | Automatically adapting user interfaces for hands-free interaction |
US11423886B2 (en) | 2010-01-18 | 2022-08-23 | Apple Inc. | Task flow identification based on user intent |
US10607141B2 (en) | 2010-01-25 | 2020-03-31 | Newvaluexchange Ltd. | Apparatuses, methods and systems for a digital conversation management platform |
US10984327B2 (en) | 2010-01-25 | 2021-04-20 | New Valuexchange Ltd. | Apparatuses, methods and systems for a digital conversation management platform |
US10607140B2 (en) | 2010-01-25 | 2020-03-31 | Newvaluexchange Ltd. | Apparatuses, methods and systems for a digital conversation management platform |
US10984326B2 (en) | 2010-01-25 | 2021-04-20 | Newvaluexchange Ltd. | Apparatuses, methods and systems for a digital conversation management platform |
US11410053B2 (en) | 2010-01-25 | 2022-08-09 | Newvaluexchange Ltd. | Apparatuses, methods and systems for a digital conversation management platform |
US10049675B2 (en) | 2010-02-25 | 2018-08-14 | Apple Inc. | User profiling for voice input processing |
US9633660B2 (en) | 2010-02-25 | 2017-04-25 | Apple Inc. | User profiling for voice input processing |
US9639265B2 (en) | 2010-09-03 | 2017-05-02 | Microsoft Technology Licensing, Llc | Distance-time based hit-testing for displayed target graphical elements |
US11016609B2 (en) | 2010-09-03 | 2021-05-25 | Microsoft Technology Licensing, Llc | Distance-time based hit-testing for displayed target graphical elements |
US20120290974A1 (en) * | 2011-01-20 | 2012-11-15 | Vibrant Media, Inc. | Systems and methods for providing a discover prompt to augmented content of a web page |
US10303266B2 (en) | 2011-01-31 | 2019-05-28 | Quickstep Technologies Llc | Three-dimensional man/machine interface |
US11175749B2 (en) | 2011-01-31 | 2021-11-16 | Quickstep Technologies Llc | Three-dimensional man/machine interface |
US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
US10102359B2 (en) | 2011-03-21 | 2018-10-16 | Apple Inc. | Device access using voice authentication |
US8745725B2 (en) | 2011-03-30 | 2014-06-03 | Elwha Llc | Highlighting in response to determining device transfer |
US8839411B2 (en) | 2011-03-30 | 2014-09-16 | Elwha Llc | Providing particular level of access to one or more items in response to determining primary control of a computing device |
US20120254736A1 (en) * | 2011-03-30 | 2012-10-04 | Elwha LLC, a limited liability company of the State of Delaware | Ascertaining presentation format based on device primary control determination |
US9317111B2 (en) | 2011-03-30 | 2016-04-19 | Elwha, Llc | Providing greater access to one or more items in response to verifying device transfer |
US9153194B2 (en) | 2011-03-30 | 2015-10-06 | Elwha Llc | Presentation format selection based at least on device transfer determination |
US8713670B2 (en) * | 2011-03-30 | 2014-04-29 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US8726367B2 (en) | 2011-03-30 | 2014-05-13 | Elwha Llc | Highlighting in response to determining device transfer |
US8726366B2 (en) | 2011-03-30 | 2014-05-13 | Elwha Llc | Ascertaining presentation format based on device primary control determination |
US8918861B2 (en) | 2011-03-30 | 2014-12-23 | Elwha Llc | Marking one or more items in response to determining device transfer |
US8739275B2 (en) | 2011-03-30 | 2014-05-27 | Elwha Llc | Marking one or more items in response to determining device transfer |
US8863275B2 (en) | 2011-03-30 | 2014-10-14 | Elwha Llc | Access restriction in response to determining device transfer |
US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
US11120372B2 (en) | 2011-06-03 | 2021-09-14 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US10241644B2 (en) | 2011-06-03 | 2019-03-26 | Apple Inc. | Actionable reminder entries |
US10706373B2 (en) | 2011-06-03 | 2020-07-07 | Apple Inc. | Performing actions associated with task items that represent tasks to perform |
US9798393B2 (en) | 2011-08-29 | 2017-10-24 | Apple Inc. | Text correction processing |
US10241752B2 (en) | 2011-09-30 | 2019-03-26 | Apple Inc. | Interface for a virtual digital assistant |
US9483461B2 (en) | 2012-03-06 | 2016-11-01 | Apple Inc. | Handling speech synthesis of content for multiple languages |
US9953088B2 (en) | 2012-05-14 | 2018-04-24 | Apple Inc. | Crowd sourcing information to fulfill user requests |
US10079014B2 (en) | 2012-06-08 | 2018-09-18 | Apple Inc. | Name recognition system |
US9495129B2 (en) | 2012-06-29 | 2016-11-15 | Apple Inc. | Device, method, and user interface for voice-activated navigation and browsing of a document |
US9971774B2 (en) | 2012-09-19 | 2018-05-15 | Apple Inc. | Voice-based media searching |
US20140092100A1 (en) * | 2012-10-02 | 2014-04-03 | Afolio Inc. | Dial Menu |
US9430133B2 (en) * | 2012-12-17 | 2016-08-30 | Sap Se | Career history exercise with stage card visualization |
US20140173489A1 (en) * | 2012-12-17 | 2014-06-19 | Sap Ag | Career history exercise with stage card visualization |
US10712908B2 (en) | 2012-12-17 | 2020-07-14 | Sap Se | Career history exercise data visualization |
US10152228B2 (en) | 2013-01-15 | 2018-12-11 | Blackberry Limited | Enhanced display of interactive elements in a browser |
US9575653B2 (en) | 2013-01-15 | 2017-02-21 | Blackberry Limited | Enhanced display of interactive elements in a browser |
US10156941B2 (en) | 2013-02-14 | 2018-12-18 | Quickstep Technologies Llc | Method and device for navigating in a display screen and apparatus comprising such navigation |
US11836308B2 (en) | 2013-02-14 | 2023-12-05 | Quickstep Technologies Llc | Method and device for navigating in a user interface and apparatus comprising such navigation |
US11550411B2 (en) | 2013-02-14 | 2023-01-10 | Quickstep Technologies Llc | Method and device for navigating in a display screen and apparatus comprising such navigation |
US9620104B2 (en) | 2013-06-07 | 2017-04-11 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
US9633674B2 (en) | 2013-06-07 | 2017-04-25 | Apple Inc. | System and method for detecting errors in interactions with a voice-based digital assistant |
US9582608B2 (en) | 2013-06-07 | 2017-02-28 | Apple Inc. | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
US9966060B2 (en) | 2013-06-07 | 2018-05-08 | Apple Inc. | System and method for user-specified pronunciation of words for speech synthesis and recognition |
US9966068B2 (en) | 2013-06-08 | 2018-05-08 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
US10657961B2 (en) | 2013-06-08 | 2020-05-19 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
US10185542B2 (en) | 2013-06-09 | 2019-01-22 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US11113523B2 (en) | 2013-11-22 | 2021-09-07 | Samsung Electronics Co., Ltd | Method for recognizing a specific object inside an image and electronic device thereof |
US10115015B2 (en) * | 2013-11-22 | 2018-10-30 | Samsung Electronics Co., Ltd | Method for recognizing a specific object inside an image and electronic device thereof |
US20170351917A1 (en) * | 2013-11-22 | 2017-12-07 | Samsung Electronics Co., Ltd | Method for recognizing a specific object inside an image and electronic device thereof |
US10078631B2 (en) | 2014-05-30 | 2018-09-18 | Apple Inc. | Entropy-guided text prediction using combined word and character n-gram language models |
US9842101B2 (en) | 2014-05-30 | 2017-12-12 | Apple Inc. | Predictive conversion of language input |
US9785630B2 (en) | 2014-05-30 | 2017-10-10 | Apple Inc. | Text prediction using combined word N-gram and unigram language models |
US9760559B2 (en) | 2014-05-30 | 2017-09-12 | Apple Inc. | Predictive text input |
US11133008B2 (en) | 2014-05-30 | 2021-09-28 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9966065B2 (en) | 2014-05-30 | 2018-05-08 | Apple Inc. | Multi-command single utterance input method |
US10169329B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Exemplar-based natural language processing |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US10497365B2 (en) | 2014-05-30 | 2019-12-03 | Apple Inc. | Multi-command single utterance input method |
US9668024B2 (en) | 2014-06-30 | 2017-05-30 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US10904611B2 (en) | 2014-06-30 | 2021-01-26 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US10659851B2 (en) | 2014-06-30 | 2020-05-19 | Apple Inc. | Real-time digital assistant knowledge updates |
US10446141B2 (en) | 2014-08-28 | 2019-10-15 | Apple Inc. | Automatic speech recognition based on user feedback |
US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US10431204B2 (en) | 2014-09-11 | 2019-10-01 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US10789041B2 (en) | 2014-09-12 | 2020-09-29 | Apple Inc. | Dynamic thresholds for always listening speech trigger |
US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
US9646609B2 (en) | 2014-09-30 | 2017-05-09 | Apple Inc. | Caching apparatus for serving phonetic pronunciations |
US9986419B2 (en) | 2014-09-30 | 2018-05-29 | Apple Inc. | Social reminders |
US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
US9886432B2 (en) | 2014-09-30 | 2018-02-06 | Apple Inc. | Parsimonious handling of word inflection via categorical stem + suffix N-gram language models |
US9668121B2 (en) | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
US10552013B2 (en) | 2014-12-02 | 2020-02-04 | Apple Inc. | Data detection |
US11556230B2 (en) | 2014-12-02 | 2023-01-17 | Apple Inc. | Data detection |
US9865280B2 (en) | 2015-03-06 | 2018-01-09 | Apple Inc. | Structured dictation using intelligent automated assistants |
US11087759B2 (en) | 2015-03-08 | 2021-08-10 | Apple Inc. | Virtual assistant activation |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
US10311871B2 (en) | 2015-03-08 | 2019-06-04 | Apple Inc. | Competing devices responding to voice triggers |
US10567477B2 (en) | 2015-03-08 | 2020-02-18 | Apple Inc. | Virtual assistant continuity |
US9899019B2 (en) | 2015-03-18 | 2018-02-20 | Apple Inc. | Systems and methods for structured stem and suffix language models |
US9842105B2 (en) | 2015-04-16 | 2017-12-12 | Apple Inc. | Parsimonious continuous-space phrase representations for natural language processing |
US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
US10127220B2 (en) | 2015-06-04 | 2018-11-13 | Apple Inc. | Language identification from short strings |
US10356243B2 (en) | 2015-06-05 | 2019-07-16 | Apple Inc. | Virtual assistant aided communication with 3rd party service in a communication session |
US10101822B2 (en) | 2015-06-05 | 2018-10-16 | Apple Inc. | Language input correction |
US11025565B2 (en) | 2015-06-07 | 2021-06-01 | Apple Inc. | Personalized prediction of responses for instant messaging |
US10186254B2 (en) | 2015-06-07 | 2019-01-22 | Apple Inc. | Context-based endpoint detection |
US10255907B2 (en) | 2015-06-07 | 2019-04-09 | Apple Inc. | Automatic accent detection using acoustic models |
US20180101349A1 (en) * | 2015-06-23 | 2018-04-12 | Shuhei TSUBONE | Communication terminal, management system, communication system, and display method |
US11144276B2 (en) | 2015-06-23 | 2021-10-12 | Ricoh Company, Ltd. | Communication terminal, management system, communication system, and display method |
US10789035B2 (en) * | 2015-06-23 | 2020-09-29 | Ricoh Company, Ltd. | Communication terminal, management system, communication system, and display method |
US11500672B2 (en) | 2015-09-08 | 2022-11-15 | Apple Inc. | Distributed personal assistant |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US9697820B2 (en) | 2015-09-24 | 2017-07-04 | Apple Inc. | Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks |
US10366158B2 (en) | 2015-09-29 | 2019-07-30 | Apple Inc. | Efficient word encoding for recurrent neural network language models |
US11010550B2 (en) | 2015-09-29 | 2021-05-18 | Apple Inc. | Unified language modeling framework for word prediction, auto-completion and auto-correction |
US11587559B2 (en) | 2015-09-30 | 2023-02-21 | Apple Inc. | Intelligent device identification |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US11526368B2 (en) | 2015-11-06 | 2022-12-13 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US10446143B2 (en) | 2016-03-14 | 2019-10-15 | Apple Inc. | Identification of voice inputs providing credentials |
US9934775B2 (en) | 2016-05-26 | 2018-04-03 | Apple Inc. | Unit-selection text-to-speech synthesis based on predicted concatenation parameters |
US9972304B2 (en) | 2016-06-03 | 2018-05-15 | Apple Inc. | Privacy preserving distributed evaluation framework for embedded personalized systems |
US10249300B2 (en) | 2016-06-06 | 2019-04-02 | Apple Inc. | Intelligent list reading |
US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
US11069347B2 (en) | 2016-06-08 | 2021-07-20 | Apple Inc. | Intelligent automated assistant for media exploration |
US10354011B2 (en) | 2016-06-09 | 2019-07-16 | Apple Inc. | Intelligent automated assistant in a home environment |
US10067938B2 (en) | 2016-06-10 | 2018-09-04 | Apple Inc. | Multilingual word prediction |
US10490187B2 (en) | 2016-06-10 | 2019-11-26 | Apple Inc. | Digital assistant providing automated status report |
US10733993B2 (en) | 2016-06-10 | 2020-08-04 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US11037565B2 (en) | 2016-06-10 | 2021-06-15 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
US10509862B2 (en) | 2016-06-10 | 2019-12-17 | Apple Inc. | Dynamic phrase expansion of language input |
US20170358238A1 (en) * | 2016-06-10 | 2017-12-14 | Renato CASUTT | Speed reading system and method |
US10192552B2 (en) | 2016-06-10 | 2019-01-29 | Apple Inc. | Digital assistant providing whispered speech |
US11152002B2 (en) | 2016-06-11 | 2021-10-19 | Apple Inc. | Application integration with a digital assistant |
US10089072B2 (en) | 2016-06-11 | 2018-10-02 | Apple Inc. | Intelligent device arbitration and control |
US10297253B2 (en) | 2016-06-11 | 2019-05-21 | Apple Inc. | Application integration with a digital assistant |
US10521466B2 (en) | 2016-06-11 | 2019-12-31 | Apple Inc. | Data driven natural language event detection and classification |
US10269345B2 (en) | 2016-06-11 | 2019-04-23 | Apple Inc. | Intelligent task discovery |
US10043516B2 (en) | 2016-09-23 | 2018-08-07 | Apple Inc. | Intelligent automated assistant |
US10553215B2 (en) | 2016-09-23 | 2020-02-04 | Apple Inc. | Intelligent automated assistant |
US10593346B2 (en) | 2016-12-22 | 2020-03-17 | Apple Inc. | Rank-reduced token representation for automatic speech recognition |
US10755703B2 (en) | 2017-05-11 | 2020-08-25 | Apple Inc. | Offline personal assistant |
US11405466B2 (en) | 2017-05-12 | 2022-08-02 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US10791176B2 (en) | 2017-05-12 | 2020-09-29 | Apple Inc. | Synchronization and task delegation of a digital assistant |
US10410637B2 (en) | 2017-05-12 | 2019-09-10 | Apple Inc. | User-specific acoustic models |
US10482874B2 (en) | 2017-05-15 | 2019-11-19 | Apple Inc. | Hierarchical belief states for digital assistants |
US10810274B2 (en) | 2017-05-15 | 2020-10-20 | Apple Inc. | Optimizing dialogue policy decisions for digital assistants using implicit feedback |
US11217255B2 (en) | 2017-05-16 | 2022-01-04 | Apple Inc. | Far-field extension for digital assistant services |
USD903711S1 (en) * | 2018-10-31 | 2020-12-01 | Dolby Laboratories Licensing Corporation | Electronic device or portion thereof with animated graphical user interface |
CN111309206A (en) * | 2020-02-04 | 2020-06-19 | 北京达佳互联信息技术有限公司 | Data processing method and device, electronic equipment and storage medium |
US11662896B2 (en) | 2020-02-04 | 2023-05-30 | Beijing Dajia Internet Information Technology Co., Ltd | Method of content presentation, electronic device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
US20030016253A1 (en) | 2003-01-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6961912B2 (en) | Feedback mechanism for use with visual selection methods | |
CN109643217B (en) | Apparatus and method for proximity-based interaction with user interface objects | |
EP1567927B1 (en) | System and method for user interface with displaced representation of touch area | |
EP2256614B1 (en) | Display control apparatus, display control method, and computer program | |
EP3273339B1 (en) | Touch input cursor manipulation | |
EP1674976B1 (en) | Improving touch screen accuracy | |
KR101919645B1 (en) | Explicit touch selection and cursor placement | |
US9223471B2 (en) | Touch screen control | |
JP5325943B2 (en) | Information processing apparatus, information processing method, and program | |
JP4851821B2 (en) | System, method and computer readable medium for calling electronic ink or handwriting interface | |
EP2225628B1 (en) | Method and system for moving a cursor and selecting objects on a touchscreen using a finger pointer | |
JP4734435B2 (en) | Portable game device with touch panel display | |
JP4602166B2 (en) | Handwritten information input device. | |
KR20160005013A (en) | Delay warp gaze interaction | |
EP2154603A2 (en) | Display apparatus, display method, and program | |
US6963349B1 (en) | Information processing apparatus, control method therefor, and computer-readable memory | |
JP2004078693A (en) | Visual field movement operating method | |
JP2004192573A (en) | Information processor and information display method | |
US20090015568A1 (en) | Method and Apparatus for Implementing Slider Detents | |
JP2000172398A (en) | Interface control for performing switching among display areas on display device | |
JP2008530645A (en) | selector | |
JP2018023792A (en) | Game device and program | |
JP5769841B2 (en) | Portable game device with touch panel display | |
JP6126639B2 (en) | A portable game device having a touch panel display and a game program. | |
JP5523381B2 (en) | Portable game device with touch panel display |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: XEROX CORPORATION, CONNECTICUT Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AOKI, PAUL M.;BURTON, RICHARD R.;HURST, AMY K.;AND OTHERS;REEL/FRAME:012035/0026;SIGNING DATES FROM 20010717 TO 20010718 |
|
AS | Assignment |
Owner name: BANK ONE, NA, AS ADMINISTRATIVE AGENT, ILLINOIS Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:013111/0001 Effective date: 20020621 Owner name: BANK ONE, NA, AS ADMINISTRATIVE AGENT,ILLINOIS Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:013111/0001 Effective date: 20020621 |
|
AS | Assignment |
Owner name: JPMORGAN CHASE BANK, AS COLLATERAL AGENT, TEXAS Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:015134/0476 Effective date: 20030625 Owner name: JPMORGAN CHASE BANK, AS COLLATERAL AGENT,TEXAS Free format text: SECURITY AGREEMENT;ASSIGNOR:XEROX CORPORATION;REEL/FRAME:015134/0476 Effective date: 20030625 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.) |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20171101 |
|
AS | Assignment |
Owner name: XEROX CORPORATION, CONNECTICUT Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JPMORGAN CHASE BANK, N.A. AS SUCCESSOR-IN-INTEREST ADMINISTRATIVE AGENT AND COLLATERAL AGENT TO BANK ONE, N.A.;REEL/FRAME:061388/0388 Effective date: 20220822 Owner name: XEROX CORPORATION, CONNECTICUT Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JPMORGAN CHASE BANK, N.A. AS SUCCESSOR-IN-INTEREST ADMINISTRATIVE AGENT AND COLLATERAL AGENT TO JPMORGAN CHASE BANK;REEL/FRAME:066728/0193 Effective date: 20220822 |