Key Points
- It seems likely that US Patent 12346399B2, titled “Method and system for a web interaction with objects and remote display technologies,” describes a system for using mobile devices as controllers and smart televisions as displays, with cloud-based processing.
- Research suggests the patent involves web technologies like WebSockets and WebRTC for real-time interaction, supporting various use cases such as gaming and video conferencing.
- The evidence leans toward the system enabling touch gesture inputs and flexible authentication methods, with practical applications in streaming and remote control scenarios.
- There is no significant controversy noted, but the complexity of the technology suggests it may evolve with future innovations.
Patent Overview
US Patent 12346399B2, filed with priority to March 31, 2023, introduces a distributed operating system designed for seamless interaction between mobile devices and smart televisions. The system allows mobile devices to act as controllers, while smart TVs serve as displays, with all messaging, streaming, and computation handled through cloud or decentralized systems. This setup addresses limitations of traditional remote management protocols like RDP, VNC, and ICA, enhancing user interaction for modern web-based applications.
Technical Details
The patent details a method involving generating messages for browsers on different devices. A first message displays a virtual representation of a physical user input device (e.g., game controller) on the mobile device’s browser, while a second message enables the smart TV’s browser to interact with content based on mobile inputs. It processes touch gesture data, converting it into updates for the TV’s content, using technologies like WebSockets, WebRTC, and JavaScript libraries. The system supports QR codes for device association and offers flexible authentication, such as biometrics or certificate-based systems.
Applications and Features
The system supports various controller types, including touch, 3D gesture, microphone, and camera, with specific message structures for events like “touch start” or “swipe right.” Use cases include game control, drawing applications (e.g., via https://app.mevia.television/paintbursh/), video conferencing, and niche applications like doorbell control. It also integrates with streaming services like Netflix, allowing users to control playback from their mobile device while viewing on the TV, enhancing remote interaction flexibility.
Detailed Survey Note on US Patent 12346399B2
This survey note provides an in-depth analysis of US Patent 12346399B2, titled “Method and system for a web interaction with objects and remote display technologies,” filed with priority to March 31, 2023, under U.S. Provisional Patent Application Ser. No. 63/456,018. The patent, invented by Edwin A. Hernandez-Mondragon and assigned to an individual, focuses on a distributed operating system that enhances interaction between mobile devices and smart televisions, leveraging cloud-based or decentralized processing. This note aims to summarize the patent’s description, technical implementation, features, and applications, ensuring a comprehensive understanding for researchers, technologists, and industry professionals.
Patent Background and Purpose
The patent addresses the limitations of traditional remote management protocols such as Remote Desktop Protocol (RDP), Virtual Network Computing (VNC), and Independent Computing Architecture (ICA), which are often inadequate for the dynamic, interactive needs of modern web-based applications. It introduces a system where mobile devices serve as controllers, and smart televisions act as displays, with all messaging, streaming, and computation managed in the cloud or a decentralized system. This setup aims to create a seamless, scalable platform for remote interaction, enhancing user experience in scenarios like gaming, video conferencing, and streaming services. The patent claims priority to a provisional application filed on March 31, 2023, indicating its recent development and relevance to current technological trends.
Technical Implementation and Method Steps
The core of the patent lies in its method for facilitating web interactions, detailed in the claims and description. The process begins with generating a first message for a browser on a first computing device (typically a mobile device), which includes instructions to display a representation of a physical user input device interface, such as a game controller or keyboard. This message is then provided to the first browser. A second message is generated for a second browser on a second computing device (e.g., a smart TV), enabling user interaction with content based on inputs from the first browser’s interface. The system receives a third message from the first browser, containing touch gesture data from user engagement, which is converted into updates for the content rendered or executed by the second browser. These updates are then provided to the second browser via a fourth message, ensuring real-time synchronization.
The technical implementation relies on modern web technologies, including WebSockets for real-time communication, WebRTC for streaming, and JavaScript/CSS libraries such as gestures.js and mevia.js for handling interactions. Communication protocols like HTTP, HTTPS, RTMP, HLS, and DASH are supported, along with STUN/TURN servers (e.g., stun.eglacorp.com) for network traversal. The system also incorporates SocketIO for efficient messaging and supports QR codes for device association, enhancing usability. Authentication is optional and may include biometrics, username/password, certificate-based methods (e.g., 802.1X, PKI), or payment validation, adding security and flexibility.
Features and Capabilities
The patent outlines a versatile system with support for various controller types, including palette, game, keyboard, microphone, camera, touch, 3D gesture, USB card reader, and NFC, catering to diverse interaction needs. Message structures are defined for different events, such as “Message = { evt: ‘touch start’, X: position X, Y: position Y }” or “Message = { evt: ‘Command’, Command: ‘Swipe Right’ },” ensuring precise communication between devices. The system allows for user selection of web applications, generating alternative interface representations, and includes the entire layout of the physical user input device, executed using at least one JavaScript library for display and another for interaction.
Additional features include the ability to receive an identification message with application identification data, determining the physical user input device’s brand, type, and model, which may be associated with a QR code and include destination server information. The system supports decentralized or cloud-based processing, enhancing scalability, and can handle complex interactions like gesture training, with normalized steps (200-300) for neural network training, achieving accuracy ranges of 94-97% after 20-25 epochs, using 70% for training and 30% for testing in gesture sequences.
Applications and Use Cases
The patent enumerates several practical applications, highlighting its versatility. For gaming, a mobile device can act as a game controller for applications displayed on a smart TV, with an example URL like https://app.mevia.television/gamecontroller. Drawing applications are supported, such as via https://app.mevia.television/paintbursh/, where users can interact with a canvas using touch gestures. Video conferencing is another key use case, with the mobile device serving as a microphone or camera controller, accessible through https://callApp.mevia.television/call. Niche applications include doorbell control, parking garage access, and NFT Lab interactions, demonstrating the system’s adaptability.
The system also integrates with streaming services like Netflix, allowing users to control playback and settings from their mobile device while viewing on the TV, enhancing the remote control experience. These use cases are supported by specific URLs and message formats, ensuring compatibility with existing web applications and providing a foundation for future innovations in remote display technologies.
Supporting Evidence and Context
The inventor’s background, Edwin A. Hernandez-Mondragon, includes extensive experience in mobile computing and media streaming, with additional patents listed on platforms like Justia Patents, such as systems for delivering multimedia content from the cloud to cable operators (US Patent Application 17/493,490). This context reinforces the patent’s credibility and aligns with the inventor’s expertise in mobile and cloud technologies. Non-patent citations, such as Iqbal and Campbell (2022) on potential security issues in touchless technology and Joveski et al. on semantic multimedia remote display, provide further context, though they are not directly cited in the patent claims.
The patent’s relevance is underscored by its recent filing and the growing demand for integrated mobile-TV ecosystems, as evidenced by URLs like https://www.qararairways.com/tradeportal/en/QR-NDC.html, mentioned in non-patent citations, related to QR code implementations. This survey note confirms the patent’s description and functionality, ensuring a comprehensive understanding for stakeholders interested in remote interaction technologies.
Field | Details |
---|---|
Patent Number | US12346399B2 |
Application Number | US18/622,249 |
Priority Date | March 31, 2023 (U.S. Provisional Patent Application Ser. No. 63/456,018) |
Inventor | Edwin A. Hernandez-Mondragon |
Assignee | Individual |
Field of Disclosure | Communications and processing, distributed systems for mobile controllers and smart TVs |
Key Technologies | WebSockets, WebRTC, SocketIO, JavaScript/CSS libraries, QR codes |
Controller Types | Palette, game, keyboard, microphone, camera, touch, 3D gesture, USB, NFC |
Communication Protocols | HTTP, HTTPS, WS/WSS, WebRTC, RTMP, HLS, DASH, STUN/TURN servers |
Authentication | Biometrics, username/password, certificate-based (802.1X, PKI), payment validation |
Example URLs | https://app.mevia.television/paintbursh/, https://app.mevia.television/gamecontroller, https://callApp.mevia.television/call |
This table summarizes key technical details, providing a quick reference for the patent’s scope and implementation. The survey note, as of 03:23 PM EDT on Thursday, July 10, 2025, ensures all information is current and relevant, offering a detailed foundation for further research or application development.
Downl