WO2013097492A1 - 一种手持设备和电视机的ui界面交互系统及方法 - Google Patents

一种手持设备和电视机的ui界面交互系统及方法 Download PDF

Info

Publication number
WO2013097492A1
WO2013097492A1 PCT/CN2012/081504 CN2012081504W WO2013097492A1 WO 2013097492 A1 WO2013097492 A1 WO 2013097492A1 CN 2012081504 W CN2012081504 W CN 2012081504W WO 2013097492 A1 WO2013097492 A1 WO 2013097492A1
Authority
WO
WIPO (PCT)
Prior art keywords
handheld device
event
television set
touch
operation mode
Prior art date
Application number
PCT/CN2012/081504
Other languages
English (en)
French (fr)
Inventor
刘江
余静江
Original Assignee
惠州Tcl移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 惠州Tcl移动通信有限公司 filed Critical 惠州Tcl移动通信有限公司
Priority to US14/125,267 priority Critical patent/US9723352B2/en
Priority to EP12862098.6A priority patent/EP2800389A4/en
Publication of WO2013097492A1 publication Critical patent/WO2013097492A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1626—Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42224—Touch pad or touch panel provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00—Aspects of display data processing
    • G09G2340/04—Changes in size, position or resolution of an image
    • G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2370/00—Aspects of data communication
    • G09G2370/12—Use of DVI or HDMI protocol in interfaces along the display data pipeline

Definitions

  • the invention relates to a television system and a communication method thereof, in particular to a UI interface interaction system and method of a handheld device and a television.
  • smart TV conforms to the trend of “high definition”, “networking” and “intelligence” of TV sets, but the so-called true smart TV should be able to obtain from various channels such as network, AV equipment and PC.
  • the ability to program content so that the content that consumers most need is clearly displayed on the big screen through an easy-to-use integrated operation interface.
  • the future of smart TV will be an entertainment center where users can search for TV channels, record TV shows, play cable TV shows, conduct online video, watch movies and play games.
  • UI interface interaction design ie user interface (User Interface) interaction is a kind of design that people interact with TV or computer in recent years.
  • UI design not only makes the product have personality and taste, but also makes the user's operation comfortable and simple. Freedom, fully embodies the positioning and characteristics of the product. Since the general TV does not have a touch function, the current common method of interacting with the TV is to use a mouse or a keyboard. However, the above method does not satisfactorily meet the user's need to simply operate the television through the handheld device. For example, the user cannot perform a precise operation such as selecting a movie or a song, and at the same time, playing a game requires a large-area sliding touch operation, so that the user The operation of the television set by the handheld device is greatly inconvenient.
  • an object of the present invention is to provide a UI interface interaction system and method for a handheld device and a television, aiming at solving the problem of inconvenient operation of the television set by the handheld device in the prior art.
  • a UI interface interaction method between a handheld device and a television set comprising the following steps:
  • the television transmits the EDID data of the television to the second HDMI transmission module through the first HDMI transmission module;
  • the handheld device transmits the EDID data of the television set to the display management module by using the second HDMI transmission module;
  • the display management module initializes UI display data according to the EDID data, and outputs the UI display data to the television set;
  • the gesture management module initializes the operation mode to a cursor mode
  • the handheld device receives a touch event of the user, updates the UI display data, and sends the data to the television set;
  • the operation mode includes a cursor mode and a touch mode
  • the step E includes:
  • E12. Determine whether the operation mode is the cursor mode, and if yes, save the coordinates of the press event, and not send the touch event; if not, send the touch event, update the UI display data and Transmitted to the television set;
  • the step E includes:
  • E21 determining whether the operation mode is the cursor mode, if not, transmitting the touch event, updating the UI display data and transmitting the data to the television; if yes, proceeding to the next step;
  • E22 determining whether the moving distance of the movement event is greater than a threshold, and if not, processing the movement event; if yes, entering a cursor movement state, calculating and moving a display position of the cursor, updating the UI display data, and transmitting Give the TV set.
  • step E when the type of the touch event is the press event, and the coordinates of the press event are in the operation mode Within the switching area, the operating mode is switched to the touch mode.
  • the operation mode switching area is disposed at the upper left of the touch screen.
  • a UI interface interaction system for a handheld device and a television set comprising:
  • a television set including a display screen and a first HDMI transmission module connected to the display screen;
  • the handheld device includes a second HDMI transmission module, a display management module, a gesture management module, and a touch screen connected in sequence;
  • the second HDMI transmission module is communicatively coupled to the first HDMI transmission module, and configured to transmit EDID data of a television set from the first HDMI transmission module to the display management module, where the touch screen is used for Receiving a user's touch event;
  • the display management module is configured to initialize UI display data according to the EDID data, and transmit the UI display data to a television set, where the gesture management module is configured to manage an operation mode.
  • the operation mode includes a cursor mode and a touch mode.
  • the types of the touch events include a press event and a move event.
  • the touch screen is provided with an operation mode switching area for switching the operation mode.
  • the operation mode switching area is disposed at the upper left of the touch screen.
  • a UI interface interaction method between a handheld device and a television set comprising the following steps:
  • the television transmits the EDID data of the television to the second HDMI transmission module through the first HDMI transmission module;
  • the handheld device transmits the EDID data of the television set to the display management module by using the second HDMI transmission module;
  • the display management module initializes UI display data according to the EDID data, and outputs the UI display data to the television set;
  • the gesture management module initializes the operation mode to a cursor mode
  • the handheld device receives a touch event of the user, updates the UI display data, and sends the data to the television.
  • the operation mode includes a cursor mode and a touch mode.
  • the types of the touch events in the step E include a press event and a mobile event.
  • the step E when the type of the touch event is the press event, the step E includes:
  • E12. Determine whether the operation mode is the cursor mode, and if yes, save the coordinates of the press event, and not send the touch event; if not, send the touch event, update the UI display data and Transfer to the television set.
  • the step E includes:
  • E21 determining whether the operation mode is the cursor mode, if not, transmitting the touch event, updating the UI display data and transmitting the data to the television; if yes, proceeding to the next step;
  • E22 determining whether the moving distance of the movement event is greater than a threshold, and if not, processing the movement event; if yes, entering a cursor movement state, calculating and moving a display position of the cursor, updating the UI display data, and transmitting Give the TV set.
  • step E when the type of the touch event is the press event, and the coordinates of the press event are switched in the operation mode In the area, the operation mode is switched to the touch mode.
  • the operation mode switching area is disposed at the upper left of the touch screen.
  • the UI interface interaction system and method of the handheld device and the television set of the invention are extremely simple and convenient to operate, and only need to operate the touch screen of the handheld device, thereby satisfying the requirement for precise operation of selecting a movie or a song on the television, and Meet the needs of users who need a large area of sliding touch when playing games.
  • This method can not only give full play to the high-resolution display advantage of the TV, but also fully utilize the advantages of the simple operation of the handheld device, and provide a good mobile Internet experience for the user.
  • the present invention utilizes a handheld device with a touch screen to operate the television without adding other hardware such as a mouse or a keyboard, and all operations can be performed using only the handheld device, thereby reducing the cost of the device.
  • FIG. 1 is a schematic structural diagram of a UI interface interaction system of a handheld device and a television set according to the present invention
  • FIG. 2 is a flowchart of a UI interface interaction method between a handheld device and a television set according to the present invention
  • FIG. 3 is a flowchart of a press event processing of a UI interface interaction method of a handheld device and a television set according to the present invention
  • FIG. 4 is a flow chart of a mobile event processing of a UI interface interaction method of a handheld device and a television set according to the present invention.
  • the present invention provides a UI interface interaction system and method for a handheld device and a television.
  • the present invention is further described in detail below in order to make the objects, technical solutions and effects of the present invention more clear and clear. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
  • FIG. 1 is a schematic structural diagram of a UI interface interaction system of a handheld device and a television set according to the present invention.
  • UI interface interaction design ie user interface (User Interface) interaction is a kind of interaction between human and machine in recent years.
  • UI design not only makes the product have personality and taste, but also makes the user's operation comfortable and simple. Freedom and fully reflect the positioning and characteristics of the software.
  • the UI interface interaction system of the handheld device and the television of the present invention is realized by the communication connection of the HDMI transmission module of the television 110 and the handheld device 120, and the HDMI English is called High.
  • Definition Multmedia Interface which refers to a high-definition multimedia interface, is a digital video or audio interface technology that can simultaneously transmit audio and video signals; as shown in FIG. 1 , the television 110 mainly includes a first HDMI transmission module and a display screen.
  • the handheld device 120 includes a touch screen sequentially connected, a gesture management module, a display management module, and a second HDMI transmission module.
  • the television set 110 is provided with a first HDMI transmission module
  • the handheld device 120 is provided with a second HDMI transmission module
  • the handheld device 120 is further provided with an HDMI transmission.
  • the hardware interface allows the user to communicatively connect the second HDMI transmission module of the handheld device 120 to the first HDMI transmission module of the television set 110 via the HDMI data line.
  • the handheld device 120 can obtain the EDID data in the television 110 by means of the HDMI protocol transmission, that is, the extended display identification data (Extended Display Identification Data), EDID data is a VESA standard data format, including TV performance parameters, including TV display screen resolution, supplier information, maximum image size, color settings, vendor presets and other information.
  • the handheld device 120 adjusts the resolution of the touch screen to match the display screen resolution of the television 110 according to the acquired EDID data.
  • the handheld device 120 obtains the EDID data of the television 110 for the first time.
  • the resolution of the touch screen of the handheld device 120 is adjusted to improve the experience of the handheld device 120.
  • the display management module of the handheld device 120 initializes the UI display data according to the information such as the screen resolution of the television 110 in the acquired EDID data, and the UI display data is the display data of the user interface, and the display management module of the handheld device 120 will
  • the UI display data is transmitted to the television 110 through the second HDMI transmission module and the first HDMI transmission module, and the television 110 synchronously displays the updated screen according to the UI display data, instead of simply touching the screen resolution of the handheld device 120.
  • the display is delivered to the television 110 for display.
  • the handheld device 120 can be adapted to different parameters of the television set 110 by the HDMI connection of the handheld device 120 and the television set 110, such as the user's television size and display screen.
  • the resolution may be completely different, and the display management module and the second transmission mode of the handheld device 120 After the UI display data to the television, you can ensure the output high definition television set TV.
  • the handheld device 120 further provides a gesture management module and a touch screen, and the gesture management module can provide a switching function of a cursor mode and a touch mode, and correspondingly, is set on the touch screen of the handheld device 120.
  • An operation mode switching area for the user to switch the operation mode.
  • FIG. 2 is a flowchart of a UI interface interaction method between a handheld device and a television set according to the present invention.
  • the UI interface interaction method of the present invention mainly includes the following steps:
  • the television 110 transmits the EDID data of the television 110 to the second HDMI transmission module through the first HDMI transmission module.
  • the process is first, the CPU in the television 110 reads the EDID data of the television, and then the first HDMI transmission module. Reading the EDID data of the television 110, and transmitting the EDID data to the second HDMI transmission module for processing;
  • the handheld device 120 transmits the EDID data of the television 110 to the display management module by using the second HDMI transmission module. After receiving the EDID data of the television 110, the display management module performs an operation of initializing the UI display data.
  • the display management module initializes the UI display data, and outputs the UI display data to the television 110.
  • the display management module may initialize UI display data according to information such as the screen resolution of the television 110 in the EDID data, and then transmit the UI display data to the first HDMI transmission module through the second HDMI transmission module, and finally synchronize on the television 110. display;
  • the gesture management module initializes the operation mode, and the default operation mode is the cursor mode.
  • the cursor mode the user can accurately locate the touch point of each of the smallest units on the television. Specifically, a small icon appears on the TV screen. Used to prompt the user for the current cursor position;
  • the touch screen receives the touch event of the user, updates the UI display data, and sends the updated UI display data to the television 110 for response.
  • the position of the cursor is moved, but The touch event will not be sent to the current upper application, such as the video selector response.
  • the user moves the cursor to the desired location, he can click on any area of the touch screen, and the click event will be sent to Upper level application. During this process, a small icon appears on the TV screen.
  • the process of operating the TV is similar to operating the computer.
  • the coordinates of the click event sent by the user are the coordinates of the cursor displayed on the TV screen, not the position coordinates of the user clicking on the touch screen. .
  • the application controlled by the user through the handheld device 120 is an application that is provided by the handheld device 120, and is not a TV-related or unrelated application.
  • the purpose of the present invention is to perform on the handheld device 120.
  • the control of the television set 110 is performed on the television set 110 to fully utilize the high-resolution display advantages of the television set 110, and the advantage of the simple operation of the handheld device 120 can be utilized.
  • the user can click on an operation mode switching area provided by the gesture management module to the user, and the operation mode switching area can be set at the upper left of the touch screen, only You need to click once in the operation mode switching area to switch to the touch mode.
  • the cursor mode can be switched back.
  • the gesture management module initializes the operation mode to the cursor mode in the step S04; and after step S05, the method further includes:
  • the switching operation mode is a touch mode, and the touch screen is touched and the user's touch event is sent.
  • the switching mode can be switched to the touch mode by clicking a preset operation mode on the touch screen, that is, the type of the touch event in step S05 is pressed.
  • the event, and the coordinates are in the operation mode switching area, at which time the switching operation mode is the touch mode.
  • Any touch action by the user on the touch screen, such as clicking or swiping is sent directly to the upper application, such as the game program response.
  • the television can respond to the action according to the touch gesture, such as single-point sliding or multi-point zooming, and the coordinates of the touch event sent by the user are the position coordinates of the user clicking or sliding on the touch screen.
  • the handheld device 120 determines the type of the touch event, and the types of the touch event include: a moving event and a pressing event, and correspondingly according to different types of touch events. Responding action
  • FIG. 3 is a flowchart of a press event processing of a UI interface interaction method between a handheld device and a television according to the present invention.
  • the step S05 includes:
  • L01 determining whether the coordinate is in the operation mode switching area, if yes, switching the operation mode to proceed to the next step; if not, proceeding directly to the next step; specifically, the user pressing on the touch screen of the handheld device 120 After the operation, the handheld device 120 determines whether the pressed coordinate is in the operation mode switching area, and if it is in the operation mode switching area, switches the operation mode, and if not, proceeds to the next step;
  • the handheld device 120 determines whether it is a cursor mode, if yes, saving the pressed coordinates, not transmitting a touch event; if not, transmitting a touch event, updating the UI display data and transmitting the data to the television 110. In this process, regardless of the current operating mode of the handheld device 120, the handheld device 120 first determines whether it is the cursor mode, if it is, saves the pressed coordinates, does not send a touch event; if not, sends the touch time, updates the UI display data And transmitted to the television set 110.
  • FIG. 4 is a flowchart of a mobile event processing method of a UI interface interaction method between a handheld device and a television set according to the present invention.
  • the touch event type is a mobile event
  • the step S05 includes:
  • the handheld device determines whether it is a cursor mode, if not, transmitting a touch event, updating the UI display data and transmitting the data to the television 110, and if so, proceeding to the next step; when the user performs a moving operation on the touch screen, the handheld device first determines the current Whether the operation mode is the cursor mode, if it is not the cursor mode, that is, the current operation mode is the touch mode, the touch event is sent, the UI display data is updated and transmitted to the television; if it is the cursor mode, the next step is entered;
  • T02 determining whether the moving distance is greater than a threshold, and if not, not processing; if yes, entering a cursor moving state, calculating and moving the display position of the cursor, updating the UI display data, and transmitting the data to the television 110.
  • the handheld device In the cursor mode, after the user performs the moving operation, the handheld device first determines whether the moving distance is greater than the threshold, and if not, does not process; if the moving distance is greater than the threshold, enters the cursor moving state, and then calculates and moves the cursor display position. , then update the UI display data and send it to the TV.
  • the UI interface interaction method and system of the handheld device and the TV of the present invention utilizes a handheld device with a touch screen to operate the television without adding other hardware such as a mouse or a keyboard, and only needs to use the handheld device to complete all operations. , which reduces the cost of the equipment.
  • the operation of the invention is extremely simple, and the data transmission and operation between the handheld device and the television is realized by using the existing HDMI interface, and only the touch screen of the handheld device is required to satisfy the selection of a movie or a song on the television.
  • the need for precise operation also satisfies the need for users to need a large area of sliding touch when playing games.
  • This method can not only give full play to the high-resolution display advantage of the TV, but also fully utilize the advantages of the simple operation of the handheld device, and provide a good mobile Internet experience for the user.

Abstract

本发明公开了一种手持设备和电视机的UI界面交互系统及方法，包括第二HDMI传输模块、触摸屏幕、手势管理模块及显示管理模块、第一HDMI传输模块及电视屏幕的设置和连接。本发明手持设备和TV的UI界面交互方法及系统，利用带有触摸屏幕的手持设备对电视进行操作，而不需要增加其他的硬件如鼠标或键盘等，仅需使用手持设备即可完成所有操作，从而降低了设备的成本。

Description

一种手持设备和电视机的UI界面交互系统及方法 技术领域
本发明涉及电视机系统及其通讯方法，尤其涉及一种手持设备和电视机的UI界面交互系统及方法。
 背景技术
目前，智能电视的出现，顺应了电视机“高清化”、“网络化”及“智能化”的趋势，但所谓真正的智能电视，应该具备能从网络、AV设备、PC等多种渠道获得节目内容的能力，以便能通过简单易用的整合式操作界面，简易操作将消费者最需要的内容在大屏幕上清晰地展现出来。未来的智能电视将是一个娱乐中心，用户可以进行搜索电视频道、录制电视节目、播放有线电视节目、进行网络视频、看电影及玩游戏等众多的活动。
在目前智能手机、智能电视的时代，人们娱乐的范围更大了，方式也更多了，很多用户希望能够通过手持设备直接在电视上进行玩游戏、选择喜爱的电影播放等操作。UI界面交互设计，即用户界面（User Interface）交互是近年来兴起的一种人和电视或电脑进行交互的设计，UI设计不仅让产品有个性有品味，并且使得用户的操作变得舒适、简单 、自由，充分体现了产品的定位和特点。由于一般的电视不具备触摸功能，所以，目前常见的与电视交互的方法还是使用鼠标或键盘等。但上述方法并不能很好地满足用户通过手持设备简单操作电视的需求，比如，无法满足用户进行选择电影或歌曲等精确操作时，同时进行玩游戏等需要大面积滑动触摸操作要求，这样，用户通过手持设备对电视机的操作存在极大地不便。
因此，现有技术还有待于改进和发展。
 技术问题
鉴于上述现有技术的不足，本发明的目的在于提供一种手持设备和电视机的UI界面交互系统及方法，旨在解决现有技术中通过手持设备对电视机操作不方便的问题。
 技术解决方案
一种手持设备和电视机的UI界面交互方法，其包括以下步骤：
A、电视机通过第一HDMI传输模块将电视机的EDID数据传输至第二HDMI传输模块；
B、手持设备通过所述第二HDMI传输模块将所述电视机的EDID数据传输至显示管理模块；
C、所述显示管理模块根据所述EDID数据初始化UI显示数据，并将所述UI显示数据输出至所述电视机；
D、手势管理模块初始化操作模式为光标模式；
E、所述手持设备接收用户的触摸事件，更新所述UI显示数据并发送至所述电视机；
所述操作模式包括光标模式和触摸模式；
当所述触摸事件的类型为所述按下事件时，所述步骤E包括：
E11、根据所述按下事件的坐标是否在操作模式切换区域内，确定是否切换所述操作模式，进入下一步骤；
E12、判断所述操作模式是否是所述光标模式，若是，则保存所述按下事件的坐标，不发送所述触摸事件；若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机；
当所述触摸事件的类型为所述移动事件时，所述步骤E包括：
E21、判断所述操作模式是否是所述光标模式，若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机；若是，则进入下一步骤；
E22、判断所述移动事件的移动距离是否大于阀值，若否，则不处理所述移动事件；若是，则进入光标移动状态，计算并移动光标的显示位置，更新所述UI显示数据并传送给所述电视机。
在本发明所述的手持设备和电视机的UI界面交互方法中，在步骤E中，当所述触摸事件的类型为所述按下事件，且所述按下事件的坐标在所述操作模式切换区域内，则切换所述操作模式为所述触摸模式。
在本发明所述的手持设备和电视机的UI界面交互方法中，所述操作模式切换区域设置于所述触摸屏幕的左上方。
一种手持设备和电视机的UI界面交互系统，其包括：
电视机，包括显示屏幕及与所述显示屏幕连接的第一HDMI传输模块；
手持设备，包括依次连接的第二HDMI传输模块、显示管理模块、手势管理模块及触摸屏幕；
所述第二HDMI传输模块与所述第一HDMI传输模块通讯相连，用于将来自于所述第一HDMI传输模块的电视机的EDID数据传输至所述显示管理模块，所述触摸屏幕用于接收用户的触摸事件；
所述显示管理模块用于根据EDID数据初始化UI显示数据，并将所述UI显示数据传输至电视机，所述手势管理模块用于管理操作模式。
在本发明所述的手持设备和电视机的UI界面交互系统中，所述操作模式包括光标模式和触摸模式。
在本发明所述的手持设备和电视机的UI界面交互系统中，所述触摸事件的类型包括按下事件和移动事件。
在本发明所述的手持设备和电视机的UI界面交互系统中，所述触摸屏幕设有用于切换所述操作模式的操作模式切换区域。
在本发明所述的手持设备和电视机的UI界面交互系统中，所述操作模式切换区域设置于所述触摸屏幕的左上方。
一种手持设备和电视机的UI界面交互方法，其包括以下步骤：
A、电视机通过第一HDMI传输模块将电视机的EDID数据传输至第二HDMI传输模块；
B、手持设备通过所述第二HDMI传输模块将所述电视机的EDID数据传输至显示管理模块；
C、所述显示管理模块根据所述EDID数据初始化UI显示数据，并将所述UI显示数据输出至所述电视机；
D、手势管理模块初始化操作模式为光标模式；
E、所述手持设备接收用户的触摸事件，更新所述UI显示数据并发送至所述电视机。
在本发明所述的手持设备和电视机的UI界面交互方法中，所述操作模式包括光标模式和触摸模式。
在本发明所述的手持设备和电视机的UI界面交互方法中，所述步骤E中所述触摸事件的类型包括按下事件和移动事件。
在本发明所述的手持设备和电视机的UI界面交互方法中，当所述触摸事件的类型为所述按下事件时，所述步骤E包括：
E11、根据所述按下事件的坐标是否在操作模式切换区域内，若确定是否切换所述操作模式，进入下一步骤；
E12、判断所述操作模式是否是所述光标模式，若是，则保存所述按下事件的坐标，不发送所述触摸事件；若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机。
在本发明所述的手持设备和电视机的UI界面交互方法中，当所述触摸事件的类型为所述移动事件时，所述步骤E包括：
E21、判断所述操作模式是否是所述光标模式，若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机；若是，则进入下一步骤；
E22、判断所述移动事件的移动距离是否大于阀值，若否，则不处理所述移动事件；若是，则进入光标移动状态，计算并移动光标的显示位置，更新所述UI显示数据并传送给所述电视机。
在本发明所述的手持设备和电视机的UI界面交互方法中，步骤E中，当所述触摸事件的类型为所述按下事件，且所述按下事件的坐标在所述操作模式切换区域内，则切换所述操作模式为所述触摸模式。
在本发明所述的手持设备和电视机的UI界面交互方法中，所述操作模式切换区域设置于所述触摸屏幕的左上方。
 有益效果
本发明手持设备和电视机的UI界面交互系统及方法，操作极其简便，只需要对手持设备的触摸屏幕进行操作，即可满足在电视上进行选择电影或歌曲等需要精确操作的要求，还可满足用户在玩游戏时需要大面积滑动触摸的需求。这种方式既能充分发挥电视的高分辨率的显示优势，又能充分发挥手持设备的操作简单的优势，为用户提供了良好的移动互联网体验。另外，本发明利用带有触摸屏幕的手持设备对电视进行操作，而不需要增加其他的硬件如鼠标或键盘等，仅需使用手持设备即可完成所有操作，从而降低了设备的成本。
 附图说明
图1为本发明手持设备和电视机的UI界面交互系统的结构示意图；
图2为本发明手持设备和电视机的UI界面交互方法的流程图；
图3为本发明手持设备和电视机的UI界面交互方法的按下事件处理流程图；
图4为本发明手持设备和电视机的UI界面交互方法的移动事件处理流程图。
 本发明的最佳实施方式
本发明提供一种手持设备和电视机的UI界面交互系统及方法，为使本发明的目的、技术方案及效果更加清楚、明确，以下对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
请参见图1，其是本发明手持设备和电视机的UI界面交互系统的结构示意图。UI界面交互设计，即用户界面（User Interface）交互是近年来兴起的一种人和机器进行交互的设计，UI设计不仅让产品有个性有品味，并且使得用户的操作变得舒适、简单。自由、充分体现软件的定位和特点。
本发明手持设备和电视机的UI界面交互系统是通过电视机110和手持设备120的HDMI传输模块的通讯连接来实现的，HDMI英文全称为High Definition Multmedia Interface，是指高清晰度多媒体接口，是一种数字化视频或音频接口技术，可同时传输音频和影音信号；如图1所示，该电视机110主要包括第一HDMI传输模块及显示屏幕，该手持设备120包括依次连接的触摸屏幕、手势管理模块、显示管理模块及第二HDMI传输模块。
具体来说，在本发明较佳实施例中，所述电视机中110设有第一HDMI传输模块，手持设备120中设有第二HDMI传输模块，手持设备120上还提供有一个HDMI传输用的硬件接口，用户可通过HDMI数据线将手持设备120的第二HDMI传输模块通讯连接到电视机110的第一HDMI传输模块。手持设备120可通过HDMI协议传输的方式获取电视机110中的EDID数据，即扩展显示标识数据（Extended Display Identification Data），EDID数据是一种VESA标准数据格式，包含电视机性能的参数，其中包含有电视机显示屏幕分辨率、供应商信息、最大图像大小、颜色设置、厂商预设置等信息。
手持设备120会根据获取的EDID数据将其触摸屏幕的分辨率调整至与电视机110显示屏幕分辨率相匹配，本发明较佳实施例中，手持设备120获取电视机110的EDID数据是为了先调整手持设备120触摸屏幕的分辨率，以提高手持设备120的体验效果。手持设备120的显示管理模块会根据所获取的EDID数据中的电视机110显示屏幕分辨率等信息，初始化UI显示数据，UI显示数据即用户界面的显示数据，手持设备120的显示管理模块会将UI显示数据通过第二HDMI传输模块及第一HDMI传输模块传输至电视机110中，电视机110根据该UI显示数据同步显示更新后的画面，而非简单地将手持设备120的触摸屏幕分辨率投放到电视机110上进行显示，上述过程可保证手持设备120传输到电视机110的UI显示数据为标准的HDMI高清输出，从而充分发挥电视机110的高分辨率的显示优势，为用户提供最优的移动互联网体验，本发明的一个重要特点是通过手持设备120和电视机110的HDMI连接来使所述手持设备120能够适用于不同参数的电视机110，例如用户的电视机尺寸及显示屏幕分辨率可能完全不同，而通过手持设备120的显示管理模块及第二传输模块将UI显示数据传输至电视机后，可保证电视机输出高清TV。
如图1所示，所述手持设备120还提供了一个手势管理模块及触摸屏幕，所述手势管理模块可提供光标模式和触摸模式的切换功能，相应地，在手持设备120的触摸屏幕上设置一操作模式切换区域，用于用户切换操作模式，此时，还需要协调硬件上手持设备120的触摸屏幕和电视机110的显示屏幕的点对点关系，通过在触摸屏幕上进行触摸，然后显示屏幕上会在相应的地方进行显示。
请参见图2，图2为本发明手持设备和电视机的UI界面交互方法的流程图，如图所示，本发明的UI界面交互方法主要包括以下步骤：
S01、电视机110通过第一HDMI传输模块将电视机110的EDID数据传输至第二HDMI传输模块，该过程首先是电视机110内的CPU读取电视机的EDID数据，然后第一HDMI传输模块读取电视机110的EDID数据，再将该EDID数据传输给第二HDMI传输模块进行处理；
S02、手持设备120通过第二HDMI传输模块将电视机110的EDID数据传输至显示管理模块，显示管理模块接收到电视机110的EDID数据后，便进行初始化UI显示数据的操作；
S03、显示管理模块初始化UI显示数据，并将UI显示数据输出至电视机110。显示管理模块可根据EDID数据中的电视机110屏幕分辨率等信息，初始化UI显示数据，然后将UI显示数据通过第二HDMI传输模块传输至第一HDMI传输模块，并最终在电视机110上同步显示；
S04、手势管理模块初始化操作模式，并可默认操作模式为光标模式，光标模式下，用户可以精确定位到电视上的每一个最小单元的触摸点，具体来说，电视屏幕上会出现一个小图标，用于提示用户当前光标的位置；
S05、触摸屏幕接收用户的触摸事件，更新UI显示数据并将更新后的UI显示数据发送至电视机110进行响应，当用户在手持设备120的触摸屏幕上滑动时，会移动光标的位置，但不会将触摸事件发送给当前的上层应用程序例如视频选择程序响应，当用户将光标移动到需要的位置后，可以在触摸屏幕的任何区域中点击一下，此时，会将该点击事件发送给上层应用程序。此过程中，电视屏幕上会出现一个小图标，操作电视的过程类似于操作电脑，用户发送的点击事件的坐标是光标在电视屏幕上的显示坐标，而不是用户在触摸屏幕上点击的位置坐标。另外需要说明的是，本发明中用户通过手持设备120进行控制的应用程序是手持设备120自带的应用程序，并非电视有关或无关的应用程序，本发明的目的在于在手持设备120上进行对电视机110的控制，并在电视机110上进行显示，以充分发挥电视机110的高分辨率的显示优势，又能利用手持设备120的操作简单的优势。
当用户需要进行其他操作时，例如需要使用连续的触摸或者sensor功能时，用户可以点击手势管理模块提供给用户的一个操作模式切换区域，该操作模式切换区域可设置在触摸屏幕的左上方，只需在该操作模式切换区域内点击一次即可切换为触摸模式，当用户在该操作模式切换区域内再点击一次，即可切换回光标模式。
具体地，如图2所示，所述步骤S04中所述手势管理模块初始化操作模式为光标模式；并且步骤S05之后还包括：
S06、切换操作模式为触摸模式，对触摸屏幕进行触摸并发送用户的触摸事件。当用户需要切换为触摸模式时，例如需要进行大面积滑动触摸操作，可通过点击触摸屏幕上预先设定好的操作模式切换区域切换为触摸模式，即步骤S05中的触摸事件的类型为按下事件，且坐标在操作模式切换区域内，此时切换操作模式为触摸模式。用户在触摸屏幕上的任何触摸动作例如点击或滑动都会直接发送给上层应用程序如游戏程序响应。在此过程中，电视机可以根据触摸手势进行动作响应，如单点的滑动或多点的缩放，用户发送的触摸事件的坐标是用户在触摸屏幕上点击或滑动的位置坐标。
具体来说，用户对触摸屏幕进行触摸动作发送触摸事件后，手持设备120会判断触摸事件的类型，触摸事件的类型包括：移动事件和按下事件，根据各不同的触摸事件的类型，进行相应的响应动作；
请参阅图3，图3为本发明手持设备和电视机的UI界面交互方法的按下事件处理流程图，当触摸事件的类型为按下事件时，如图所示，所述步骤S05包括：
L01、判断坐标是否在操作模式切换区域内，若是，则切换操作模式，进入下一步骤；若否，则直接进入下一步骤；具体来说，用户在手持设备120的触摸屏幕上进行按下操作后，手持设备120会判断按下的坐标是否在操作模式切换区域内，如果是在操作模式切换区域内就切换操作模式，如果不是，进入下一步骤；
L02、判断是否是光标模式，若是，则保存按下坐标，不发送触摸事件；若否，则发送触摸事件，更新UI显示数据并传送给电视机110。此过程中，不管当前手持设备120为何种操作模式，手持设备120会先判断是否是光标模式，如果是就保存按下坐标，不发送触摸事件；如果不是，则发送触摸时间，更新UI显示数据并传送给电视机110。
请参阅图4，图4为本发明手持设备和电视机的UI界面交互方法的移动事件处理流程图，当触摸事件类型为移动事件时，如图所示，所述步骤S05包括：
T01、判断是否是光标模式，若否，则发送触摸事件，更新UI显示数据并传送给电视机110，若是，则进入下一步骤；用户在触摸屏幕上进行移动操作时，手持设备先判断当前操作模式是否是光标模式，如果不是光标模式，即当前操作模式为触摸模式，则发送触摸事件，更新UI显示数据并传送给电视机；如果是光标模式，则进入下一步骤；
T02、判断移动距离是否大于阀值，若否，则不处理；若是，则进入光标移动状态，计算并移动光标的显示位置，更新UI显示数据并传送给电视机110。在光标模式下，用户进行移动操作后，手持设备先判断移动距离是否大于阀值，如果没有，不进行处理；如果移动距离大于阀值，则进入光标移动状态，再计算并移动光标的显示位置，然后更新UI显示数据并传送给电视机。
本发明手持设备和TV的UI界面交互方法及系统，利用带有触摸屏幕的手持设备对电视进行操作，而不需要增加其他的硬件如鼠标或键盘等，仅需使用手持设备即可完成所有操作，从而降低了设备的成本。另外，本发明操作极其简便，利用现有的HDMI接口实现手持设备与电视机之间的数据传输和操作，只需要对手持设备的触摸屏幕进行操作，即可满足在电视上进行选择电影或歌曲等需要精确操作的要求，还可满足用户在玩游戏时需要大面积滑动触摸的需求。这种方式既能充分发挥电视的高分辨率的显示优势，又能充分发挥手持设备的操作简单的优势，为用户提供了良好的移动互联网体验。
应当理解的是，本发明的应用不限于上述的举例，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，所有这些改进和变换都应属于本发明所附权利要求的保护范围。
 本发明的实施方式
工业实用性
序列表自由内容

Claims (15)

  1. 一种手持设备和电视机的UI界面交互方法，其包括以下步骤：
    A、电视机通过第一HDMI传输模块将电视机的EDID数据传输至第二HDMI传输模块；
    B、手持设备通过所述第二HDMI传输模块将所述电视机的EDID数据传输至显示管理模块；
    C、所述显示管理模块根据所述EDID数据初始化UI显示数据，并将所述UI显示数据输出至所述电视机；
    D、手势管理模块初始化操作模式为光标模式；
    E、所述手持设备接收用户的触摸事件，更新所述UI显示数据并发送至所述电视机；
    所述操作模式包括光标模式和触摸模式；
    当所述触摸事件的类型为所述按下事件时，所述步骤E包括：
    E11、根据所述按下事件的坐标是否在操作模式切换区域内，确定是否切换所述操作模式，进入下一步骤；
    E12、判断所述操作模式是否是所述光标模式，若是，则保存所述按下事件的坐标，不发送所述触摸事件；若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机；
    当所述触摸事件的类型为所述移动事件时，所述步骤E包括：
    E21、判断所述操作模式是否是所述光标模式，若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机；若是，则进入下一步骤；
    E22、判断所述移动事件的移动距离是否大于阀值，若否，则不处理所述移动事件；若是，则进入光标移动状态，计算并移动光标的显示位置，更新所述UI显示数据并传送给所述电视机。
  2. 根据权利要求1所述的手持设备和电视机的UI界面交互方法，其中在步骤E中，当所述触摸事件的类型为所述按下事件，且所述按下事件的坐标在所述操作模式切换区域内，则切换所述操作模式为所述触摸模式。
  3. 根据权利要求1所述的手持设备和电视机的UI界面交互方法，其中所述操作模式切换区域设置于所述触摸屏幕的左上方。
  4. 一种手持设备和电视机的UI界面交互系统，其包括：
    电视机，包括显示屏幕及与所述显示屏幕连接的第一HDMI传输模块；
    手持设备，包括依次连接的第二HDMI传输模块、显示管理模块、手势管理模块及触摸屏幕；
    所述第二HDMI传输模块与所述第一HDMI传输模块通讯相连，用于将来自于所述第一HDMI传输模块的电视机的EDID数据传输至所述显示管理模块，所述触摸屏幕用于接收用户的触摸事件；
    所述显示管理模块用于根据EDID数据初始化UI显示数据，并将所述UI显示数据传输至电视机，所述手势管理模块用于管理操作模式。
  5. 根据权利要求4所述的手持设备和电视机的UI界面交互系统，其中所述操作模式包括光标模式和触摸模式。
  6. 根据权利要求4所述的手持设备和电视机的UI界面交互系统，其中所述触摸事件的类型包括按下事件和移动事件。
  7. 根据权利要求4所述的手持设备和电视机的UI界面交互系统，其中所述触摸屏幕设有用于切换所述操作模式的操作模式切换区域。
  8. 根据权利要求7所述的手持设备和电视机的UI界面交互系统，其中所述操作模式切换区域设置于所述触摸屏幕的左上方。
  9. 一种手持设备和电视机的UI界面交互方法，其包括以下步骤：
    A、电视机通过第一HDMI传输模块将电视机的EDID数据传输至第二HDMI传输模块；
    B、手持设备通过所述第二HDMI传输模块将所述电视机的EDID数据传输至显示管理模块；
    C、所述显示管理模块根据所述EDID数据初始化UI显示数据，并将所述UI显示数据输出至所述电视机；
    D、手势管理模块初始化操作模式为光标模式；
    E、所述手持设备接收用户的触摸事件，更新所述UI显示数据并发送至所述电视机。
  10. 根据权利要求9所述的手持设备和电视机的UI界面交互方法，其中所述操作模式包括光标模式和触摸模式。
  11. 根据权利要求10所述的手持设备和电视机的UI界面交互方法，其中所述步骤E中所述触摸事件的类型包括按下事件和移动事件。
  12. 根据权利要求11所述的手持设备和电视机的UI界面交互方法，其中当所述触摸事件的类型为所述按下事件时，所述步骤E包括：
    E11、根据所述按下事件的坐标是否在操作模式切换区域内，若确定是否切换所述操作模式，进入下一步骤；
    E12、判断所述操作模式是否是所述光标模式，若是，则保存所述按下事件的坐标，不发送所述触摸事件；若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机。
  13. 根据权利要求11所述的手持设备和电视机的UI界面交互方法，其中当所述触摸事件的类型为所述移动事件时，所述步骤E包括：
    E21、判断所述操作模式是否是所述光标模式，若否，则发送所述触摸事件，更新所述UI显示数据并传送给所述电视机；若是，则进入下一步骤；
    E22、判断所述移动事件的移动距离是否大于阀值，若否，则不处理所述移动事件；若是，则进入光标移动状态，计算并移动光标的显示位置，更新所述UI显示数据并传送给所述电视机。
  14. 根据权利要求12所述的手持设备和电视机的UI界面交互方法，其中步骤E中，当所述触摸事件的类型为所述按下事件，且所述按下事件的坐标在所述操作模式切换区域内，则切换所述操作模式为所述触摸模式。
  15. 根据权利要求12所述的手持设备和电视机的UI界面交互方法，其中所述操作模式切换区域设置于所述触摸屏幕的左上方
PCT/CN2012/081504 2011-12-28 2012-09-17 一种手持设备和电视机的ui界面交互系统及方法 WO2013097492A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/125,267 US9723352B2 (en) 2011-12-28 2012-09-17 User interface interaction system and method for handheld device and TV set
EP12862098.6A EP2800389A4 (en) 2011-12-28 2012-09-17 USER INTERFACE SYSTEM AND METHOD FOR INTERACTION BETWEEN A PORTABLE DEVICE AND A TELEVISION

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110447137.8 2011-12-28
CN2011104471378A CN102572567A (zh) 2011-12-28 2011-12-28 一种手持设备和电视机的ui界面交互系统及方法

Publications (1)

Publication Number Publication Date
WO2013097492A1 true WO2013097492A1 (zh) 2013-07-04

Family

ID=46416831

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/081504 WO2013097492A1 (zh) 2011-12-28 2012-09-17 一种手持设备和电视机的ui界面交互系统及方法

Country Status (4)

Country Link
US (1) US9723352B2 (zh)
EP (1) EP2800389A4 (zh)
CN (1) CN102572567A (zh)
WO (1) WO2013097492A1 (zh)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572567A (zh) * 2011-12-28 2012-07-11 惠州Tcl移动通信有限公司 一种手持设备和电视机的ui界面交互系统及方法
CN102547179B (zh) 2011-12-29 2014-06-25 惠州Tcl移动通信有限公司 一种手持设备及与电视同步显示的方法
CN103577077A (zh) * 2012-07-20 2014-02-12 晨星软件研发(深圳)有限公司 符号输入装置、符号输入方法及相关的电脑程序产品
CN103813191B (zh) * 2012-11-15 2019-01-18 中兴通讯股份有限公司 机顶盒以及基于机顶盒的使用方法
CN103124378B (zh) * 2012-12-07 2016-04-06 东莞宇龙通信科技有限公司 基于通信终端与电视机多屏互动的输入方法及系统
US9836437B2 (en) * 2013-03-15 2017-12-05 Google Llc Screencasting for multi-screen applications
CN103546793A (zh) * 2013-10-30 2014-01-29 乐视致新电子科技（天津）有限公司 一种控制智能电视界面滚动的方法和装置
CN103546795A (zh) * 2013-10-30 2014-01-29 乐视致新电子科技（天津）有限公司 一种控制智能电视界面滚动的方法和装置
WO2015062515A1 (zh) * 2013-10-30 2015-05-07 乐视致新电子科技（天津）有限公司 一种控制智能电视界面滚动的方法和装置
CN103729069A (zh) * 2013-11-29 2014-04-16 乐视致新电子科技（天津）有限公司 智能电视中的光标控制方法和装置
CN103645847A (zh) * 2013-12-02 2014-03-19 乐视致新电子科技（天津）有限公司 通过移动终端模拟鼠标控制智能电视的方法和系统
CN103809856A (zh) * 2014-02-24 2014-05-21 联想(北京)有限公司 一种信息处理方法和第一电子设备
WO2015190877A1 (ko) * 2014-06-12 2015-12-17 엘지전자(주) Hdmi를 사용하여 데이터를 송수신하기 위한 방법 및 장치
CN108495157A (zh) * 2015-03-26 2018-09-04 海信集团有限公司 一种智能电视的同步信息获取方法
US20170064376A1 (en) * 2015-08-30 2017-03-02 Gaylord Yu Changing HDMI Content in a Tiled Window
CN106101803B (zh) * 2016-06-13 2020-06-02 Tcl移动通信科技（宁波）有限公司 一种智能电视的显示屏控制方法及系统
CN106534750B (zh) * 2016-10-09 2019-04-26 北京小米移动软件有限公司 显示控制方法及装置
CN109032733A (zh) * 2018-07-10 2018-12-18 深圳Tcl数字技术有限公司 终端设备管理方法、系统及计算机可读存储介质
CN110753244B (zh) * 2018-07-24 2022-10-28 中兴通讯股份有限公司 一种场景同步方法、终端及存储介质
CN111104082A (zh) * 2019-12-12 2020-05-05 深圳市深智电科技有限公司 一种画面显示及处理方法、终端及存储介质
CN116828263A (zh) * 2023-08-30 2023-09-29 华光影像科技有限公司 一种8k4k影视制作界面切换系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008109341A (ja) * 2006-10-25 2008-05-08 Sharp Corp 携帯型電子機器，テレビジョン受像機，テレビジョン受像機操作システム
CN101489076A (zh) * 2009-01-19 2009-07-22 Tcl通力电子（惠州）有限公司 一种hdmi分辨率设置的方法
JP2011217236A (ja) * 2010-04-01 2011-10-27 Funai Electric Co Ltd 携帯情報処理装置
CN102572567A (zh) * 2011-12-28 2012-07-11 惠州Tcl移动通信有限公司 一种手持设备和电视机的ui界面交互系统及方法

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8479122B2 (en) * 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
WO2000078050A1 (en) * 1999-06-11 2000-12-21 United Video Properties, Inc. Interactive television application system with hand-held application device
US7123212B2 (en) * 2000-12-22 2006-10-17 Harman International Industries, Inc. Information transmission and display method and system for a handheld computing device
WO2006075267A2 (en) * 2005-01-14 2006-07-20 Philips Intellectual Property & Standards Gmbh Moving objects presented by a touch input display device
KR100830467B1 (ko) * 2006-07-13 2008-05-20 엘지전자 주식회사 터치 패널을 갖는 영상기기 및 이 영상기기에서 줌 기능을수행하는 방법
US7996869B2 (en) * 2006-08-18 2011-08-09 Sony Corporation Automatically reconfigurable multimedia system with interchangeable personality adapters
US8812629B2 (en) * 2008-04-18 2014-08-19 Universal Electronics Inc. System and method for configuring the remote control functionality of a portable device
KR101299683B1 (ko) * 2006-10-20 2013-08-26 삼성전자주식회사 디스플레이장치, 디스플레이 시스템 및 그 제어방법
WO2009135044A1 (en) * 2008-04-30 2009-11-05 Zeevee, Inc. System and method for channel selection for local broadcasting
US20100064228A1 (en) * 2008-09-11 2010-03-11 Ely Tsern Expandable system architecture comprising a handheld computer device that dynamically generates different user environments with secondary devices with displays of various form factors
CN101753878B (zh) * 2008-12-09 2011-11-16 深圳Tcl新技术有限公司 一种触摸屏遥控器的遥控方法
TWI442271B (zh) * 2009-07-03 2014-06-21 Wistron Corp 多模式觸控之方法、使用多重單點觸控指令之方法及具有觸控裝置之電子裝置
US20110163966A1 (en) * 2010-01-06 2011-07-07 Imran Chaudhri Apparatus and Method Having Multiple Application Display Modes Including Mode with Display Resolution of Another Apparatus
US9092129B2 (en) * 2010-03-17 2015-07-28 Logitech Europe S.A. System and method for capturing hand annotations
WO2011145700A1 (ja) * 2010-05-19 2011-11-24 シャープ株式会社 再生装置、表示装置、テレビジョン受像機、システム、認識方法、プログラム、及び、記録媒体
TW201237728A (en) * 2011-03-08 2012-09-16 Acer Inc Screen rotation lock methods and systems, and computer program products thereof
US9285950B2 (en) * 2011-03-30 2016-03-15 Google Inc. Hover-over gesturing on mobile devices
US9239837B2 (en) * 2011-04-29 2016-01-19 Logitech Europe S.A. Remote control system for connected devices
CN102662514B (zh) * 2012-03-30 2017-03-29 中兴通讯股份有限公司 一种控制触摸屏的方法和移动终端
JP5866027B2 (ja) * 2012-10-19 2016-02-17 三菱電機株式会社 情報処理装置、情報端末、情報処理システムおよびキャリブレーション方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008109341A (ja) * 2006-10-25 2008-05-08 Sharp Corp 携帯型電子機器，テレビジョン受像機，テレビジョン受像機操作システム
CN101489076A (zh) * 2009-01-19 2009-07-22 Tcl通力电子（惠州）有限公司 一种hdmi分辨率设置的方法
JP2011217236A (ja) * 2010-04-01 2011-10-27 Funai Electric Co Ltd 携帯情報処理装置
CN102572567A (zh) * 2011-12-28 2012-07-11 惠州Tcl移动通信有限公司 一种手持设备和电视机的ui界面交互系统及方法

Also Published As

Publication number Publication date
US20140130091A1 (en) 2014-05-08
EP2800389A1 (en) 2014-11-05
US9723352B2 (en) 2017-08-01
CN102572567A (zh) 2012-07-11
EP2800389A4 (en) 2015-07-15

Similar Documents

Publication Publication Date Title
WO2013097492A1 (zh) 一种手持设备和电视机的ui界面交互系统及方法
US9569159B2 (en) Apparatus, systems and methods for presenting displayed image information of a mobile media device on a large display and control of the mobile media device therefrom
WO2017111358A1 (en) User terminal device, and mode conversion method and sound system for controlling volume of speaker thereof
WO2014092476A1 (en) Display apparatus, remote control apparatus, and method for providing user interface using the same
WO2014182117A1 (en) Method and apparatus for displaying user interface through sub device that is connectable with portable electronic device
US7538686B2 (en) Remote controller with a communication function
WO2015178677A1 (en) User terminal device, method for controlling user terminal device, and multimedia system thereof
KR101493906B1 (ko) 영상처리장치와 디스플레이 장치 및 디스플레이 장치의 제어 방법
WO2014058250A1 (en) User terminal device, sns providing server, and contents providing method thereof
WO2014182109A1 (en) Display apparatus with a plurality of screens and method of controlling the same
WO2016022002A1 (en) Apparatus and method for controlling content by using line interaction
WO2017052168A1 (ko) 전자 장치 및 그 ui 제공 방법
WO2018080165A1 (en) Image display apparatus, mobile device, and methods of operating the same
WO2015020288A1 (en) Display apparatus and the method thereof
WO2015119389A1 (en) User terminal and control method thereof
WO2015194755A1 (ko) 사용자 단말 장치 및 그 제어 방법
WO2016182361A1 (en) Gesture recognition method, computing device, and control device
WO2015069082A1 (en) Display apparatus and method of controlling the same
WO2015194697A1 (en) Video display device and operating method thereof
WO2018080176A1 (en) Image display apparatus and method of displaying image
WO2018124823A1 (en) Display apparatus and controlling method thereof
WO2016024824A1 (en) Display apparatus and method of controlling the same
CN113448462A (zh) 个人输入装置的驱动方法
WO2016129843A1 (en) Display apparatus and display method
WO2015182844A1 (ko) 디스플레이 장치, 사용자 단말 장치, 서버 및 그 제어 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12862098

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 14125267

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2012862098

Country of ref document: EP