{"id":13969323,"url":"https://github.com/emidan19/deep-tempest","last_synced_at":"2025-07-21T13:30:30.541Z","repository":{"id":248693058,"uuid":"819608460","full_name":"emidan19/deep-tempest","owner":"emidan19","description":"Restoration for TEMPEST images using deep-learning","archived":false,"fork":false,"pushed_at":"2024-12-17T18:55:45.000Z","size":517825,"stargazers_count":600,"open_issues_count":7,"forks_count":84,"subscribers_count":11,"default_branch":"main","last_synced_at":"2025-04-12T01:36:20.815Z","etag":null,"topics":["deep-learning","gnu-radio","image-restoration","pytorch","sdr","tempest"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/emidan19.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"COPYING","code_of_conduct":null,"threat_model":null,"audit":null,"citation":"CITATION.cff","codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-06-24T21:21:49.000Z","updated_at":"2025-04-05T00:35:55.000Z","dependencies_parsed_at":"2024-08-11T20:25:52.947Z","dependency_job_id":"e00df5a8-a4d9-410b-a8d4-56ce2c168d8a","html_url":"https://github.com/emidan19/deep-tempest","commit_stats":null,"previous_names":["emidan19/deep-tempest"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/emidan19/deep-tempest","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/emidan19%2Fdeep-tempest","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/emidan19%2Fdeep-tempest/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/emidan19%2Fdeep-tempest/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/emidan19%2Fdeep-tempest/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/emidan19","download_url":"https://codeload.github.com/emidan19/deep-tempest/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/emidan19%2Fdeep-tempest/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266311311,"owners_count":23909605,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-21T11:47:31.412Z","response_time":64,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","gnu-radio","image-restoration","pytorch","sdr","tempest"],"created_at":"2024-08-08T22:00:33.714Z","updated_at":"2025-07-21T13:30:30.528Z","avatar_url":"https://github.com/emidan19.png","language":"Python","funding_links":[],"categories":["Python","Projects"],"sub_categories":["📋 Others"],"readme":"# Deep-tempest:  Using Deep Learning to Eavesdrop on HDMI from its Unintended Electromagnetic Emanations\n\n\u003cimg src=\"deep-tempest.png\"/\u003e\n\n## Summary\n\nIn this project we have extended the original [**gr-tempest**](https://github.com/git-artes/gr-tempest) (a.k.a. [Van Eck Phreaking](https://en.wikipedia.org/wiki/Van_Eck_phreaking) or simply TEMPEST; i.e. spying on a video display from its unintended electromagnetic emanations) by using deep learning to improve the quality of the spied images. See an illustrative diagram above. Some examples of the resulting inference of our system and the original unmodified version of gr-tempest below.\n\n\u003cimg src=\"examples.png\"/\u003e\n\nThe following external webpages provide a nice summary of the work:\n* NewScientist: [AI can reveal what’s on your screen via signals leaking from cables](https://www.newscientist.com/article/2439853-ai-can-reveal-whats-on-your-screen-via-signals-leaking-from-cables/)\n* RTL-SDR.com: [DEEP-TEMPEST: EAVESDROPPING ON HDMI VIA SDR AND DEEP LEARNING](https://www.rtl-sdr.com/deep-tempest-eavesdropping-on-hdmi-via-sdr-and-deep-learning/)\n* PC World: [Hackers can wirelessly watch your screen via HDMI radiation](https://www.pcworld.com/article/2413156/hackers-can-wirelessly-watch-your-screen-via-hdmi-radiation.html)\n* Techspot: [AI can see what's on your screen by reading HDMI electromagnetic radiation](https://www.techspot.com/news/104015-ai-can-see-what-screen-reading-hdmi-electromagnetic.html)\n* Futura: [Hallucinant : ce système permet d’afficher et espionner ce qu’il y a sur l’écran d’un ordinateur déconnecté](https://www.futura-sciences.com/tech/actualites/technologie-hallucinant-ce-systeme-permet-afficher-espionner-ce-quil-y-ecran-ordinateur-deconnecte-114883/)\n* hackster.io: [Deep-TEMPEST Reveals All](https://www.hackster.io/news/deep-tempest-reveals-all-c8cb4f0ebd08)\n* Hacker News: [Deep-Tempest: Using Deep Learning to Eavesdrop on HDMI](https://news.ycombinator.com/item?id=41116682)\n* TechXplore: [Security researchers reveal it is possible to eavesdrop on HDMI cables to capture computer screen data](https://techxplore.com/news/2024-07-reveal-eavesdrop-hdmi-cables-capture.html)\n* Tom's Hardware: [AI can snoop on your computer screen using signals leaking from HDMI cables — researchers develop new AI model that enables using antennas for long-range attacks](https://www.tomshardware.com/tech-industry/cyber-security/ai-can-snoop-on-your-computer-screen-using-signals-leaking-from-hdmi-cables)\n* Montevideo Portal: [¿Por qué la inteligencia artificial puede ver una pantalla? Un estudio uruguayo indagó](https://www.montevideo.com.uy/Ciencia-y-Tecnologia/-Por-que-la-inteligencia-artificial-puede-ver-una-pantalla-Un-estudio-uruguayo-indago-uc895790)\n* El Observador: [Uruguayos interceptan señales del cable HDMI para espiar monitores y asombran al mundo](https://www.elobservador.com.uy/uruguayos-interceptan-senales-del-cable-hdmi-espiar-monitores-y-asombran-al-mundo-n5954308)\n* El País: [La amenaza invisible: uruguayos descubrieron cómo un hacker podría espiar tu pantalla a través del cable HDMI](https://www.elpais.com.uy/domingo/la-amenaza-invisible-uruguayos-descubrieron-como-un-hacker-podria-espiar-tu-pantalla-a-traves-del-cable-hdmi)\n\n## Video demo\n\nWe are particularly interested in recovering the text present in the display, and we improve the Character Error Rate from 90% in the unmodified gr-tempest, to less than 30% using our module. Watch a video of the full system in operation:\n\n[\u003cimg src=\"https://img.youtube.com/vi/ig3NWg_Yzag/maxresdefault.jpg\" width=\"50%\"/\u003e ](https://www.youtube.com/watch?v=ig3NWg_Yzag)\n\n## How does it works? (and how to cite our work or data)\n\nYou can find a detailed technical explanation of how deep-tempest works in [**our article**](https://arxiv.org/abs/2407.09717). If you found our work or data useful for your research, please consider citing it as follows:\n\n````\n@inproceedings{deep_tempest,\nauthor = {Fern\\'{a}ndez, Santiago and Mart\\'{\\i}nez, Emilio and Varela, Jorge and Mus\\'{e}, Pablo and Larroca, Federico},\ntitle = {Deep-TEMPEST: Using Deep Learning to Eavesdrop on HDMI from its Unintended Electromagnetic Emanations},\nyear = {2024},\nurl = {https://doi.org/10.1145/3697090.3697094},\nbooktitle = {Proceedings of the 13th Latin-American Symposium on Dependable and Secure Computing (LADC '24)},\n}\n\n````\n\n## Data\n\nIn addition to the source code, we are also open sourcing the whole dataset we used. Follow [this dropbox link](https://www.dropbox.com/scl/fi/7r2o8nbws45q30j5lkxjb/deeptempest_dataset.zip?rlkey=w7jvw275hu8tsyflgdkql7l1c\u0026st=e8rdldz0\u0026dl=0) to download a ZIP file (~7GB). After unzipping, you will find synthetic and real captured images used for experiments, training, and evaluation during the work. These images consists of 1600x900 resolution with the SDR's center frequency at the third pixel-rate harmonic (324 MHz).\n\nThe structure of the directories containing the data is **different** for **synthetic data** compared to **captured data**:\n\n### Synthetic data\n\n* *ground-truth* (directory with reference/monitor view images)\n    - image1.png\n    - ...\n    - imageN.png\n\n* *simulations* (directory with synthetic degradation/capture images)\n    - image1_synthetic.png\n    - ...\n    - imageN_synthetic.png\n\n### Real data\n\n- image1.png (*image1 ground-truth*)\n- ...\n- imageN.png (*imageN ground-truth*)\n\n* *Image 1* (directory with captures of *image1.png*)\n    - capture1_image1.png\n    - ...\n    - captureM_image1.png\n\n* ...\n\n* *Image N* (directory with captures of *image1.png*)\n    - capture1_imageN.png\n    - ...\n    - captureM_imageN.png\n\n## Code and Requirements\n\nClone the repository:\n\n```shell\ngit clone https://github.com/emidan19/deep-tempest.git\n```\n\nBoth [gr-tempest](./gr-tempest/) and [end-to-end](./end-to-end/) folders contains a guide on how to execute the corresponding files for image capturing, inference and train the deep learning architecture based on DRUNet from [KAIR image restoration repository](https://github.com/cszn/KAIR/tree/master).\n\n### deep-tempest Environment Setup\n\nThis guide describes how to set up the environment for using the `deep-tempest` repository. You can choose between two setup options: using **Conda** or **Pyenv + venv**. The code works with both **Python 3.12** and **Python 3.10**, and has been tested on Ubuntu 22.04.5 LTS and Ubuntu 24.04.2 LTS, so you can choose either version depending on your system and preference. The example below use **Python 3.12**.\n\nThe system runs with CUDA 12.4, but the environment uses the PyTorch and Torchvision build for CUDA 12.1, as it is the latest stable release officially provided by PyTorch.\n\n\n---\n\n### Prerequisite (Required for All Options):\n\nBefore setting up the environment, you must install Tesseract OCR:\n\n```bash\nsudo apt update\nsudo apt install tesseract-ocr\n```\n\n### Option 1: Using Conda:\n\n#### Create and activate a new Conda environment:\n\n```shell\nconda create -n deeptempest python=3.12\nconda activate deeptempest\n```\n#### Install dependencies from the provided YAML file:\n\n```shell\nconda env update --file tempest_conda.yml\n```\n\n#### Install additional required packages:\n\n```shell\npip install torch==2.5.1+cu121 torchvision==0.20.1+cu121 --index-url https://download.pytorch.org/whl/cu121\npip install pybind11==2.13.6\npip install --no-build-isolation git+https://github.com/sfernandezr/fastwer.git\n```\n\n### Option 2: Using Pyenv + venv\n\n#### Create and activate a virtual environment:\n\n```shell\npython3.12 -m venv deeptempest\ncd deeptempest\nsource bin/activate\n```\n\n#### Install dependencies from tempest_pyenv file:\n\n```shell\npip install -r tempest_pyenv.txt\n```\n\n#### Install additional required packages manually:\n\n```shell\npip install torch==2.5.1+cu121 torchvision==0.20.1+cu121 --index-url https://download.pytorch.org/whl/cu121\npip install pybind11==2.13.6\npip install --no-build-isolation git+https://github.com/sfernandezr/fastwer.git\n```\n\n\nRegarding installations with GNU Radio, **it is necessary to use the [gr-tempest](./gr-tempest/) version in this repository** *(which contains a modified version of the original gr-tempest)*. After this, run the following *grc* files flowgraphs to activate the *hierblocks*:\n- [binary_serializer.grc](./gr-tempest/examples/binary_serializer.grc)\n- [FFT_autocorrelate.grc](./gr-tempest/examples/FFT_autocorrelate.grc)\n- [FFT_crosscorrelate.grc](./gr-tempest/examples/FFT_crosscorrelate.grc)\n- [Keep_1_in_N_frames.grc](./gr-tempest/examples/Keep_1_in_N_frames.grc)\n\nFinally run the flowgraph [deep-tempest_example.grc](./gr-tempest/examples/deep-tempest_example.grc) to capture the monitor images and be able to recover them with better quality using the *Save Capture* block.\n\n## Credits\n\nIIE Instituto de Ingeniería Eléctrica, \nFacultad de Ingeniería, \nUniversidad de la República, \nMontevideo, Uruguay, \nhttp://iie.fing.edu.uy/investigacion/grupos/artes/\n\nPlease refer to the LICENSE file for contact information and further credits.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Femidan19%2Fdeep-tempest","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Femidan19%2Fdeep-tempest","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Femidan19%2Fdeep-tempest/lists"}