{"id":44634671,"url":"https://github.com/cwi-dis/rcea360vr-chi2021","last_synced_at":"2026-02-14T17:20:12.878Z","repository":{"id":97041224,"uuid":"325505877","full_name":"cwi-dis/RCEA360VR-CHI2021","owner":"cwi-dis","description":"CHI 2021 paper (RCEA-360VR) source code for our (a) Viewport-dependent annotation fusion method (b) Viewport-based fine-grained V-A video overlay generator","archived":false,"fork":false,"pushed_at":"2021-03-12T12:43:06.000Z","size":26315,"stargazers_count":2,"open_issues_count":0,"forks_count":3,"subscribers_count":6,"default_branch":"master","last_synced_at":"2025-09-10T07:41:01.342Z","etag":null,"topics":["affective-computing","emotion","ground-truth","hci","method","vr"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mpl-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/cwi-dis.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2020-12-30T09:13:32.000Z","updated_at":"2022-07-26T08:14:32.000Z","dependencies_parsed_at":null,"dependency_job_id":"4287219e-1c6d-4aa4-92df-a53047adea9e","html_url":"https://github.com/cwi-dis/RCEA360VR-CHI2021","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/cwi-dis/RCEA360VR-CHI2021","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cwi-dis%2FRCEA360VR-CHI2021","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cwi-dis%2FRCEA360VR-CHI2021/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cwi-dis%2FRCEA360VR-CHI2021/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cwi-dis%2FRCEA360VR-CHI2021/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/cwi-dis","download_url":"https://codeload.github.com/cwi-dis/RCEA360VR-CHI2021/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cwi-dis%2FRCEA360VR-CHI2021/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29450850,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-14T15:52:44.973Z","status":"ssl_error","status_checked_at":"2026-02-14T15:52:11.208Z","response_time":53,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["affective-computing","emotion","ground-truth","hci","method","vr"],"created_at":"2026-02-14T17:20:12.288Z","updated_at":"2026-02-14T17:20:12.870Z","avatar_url":"https://github.com/cwi-dis.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## CHI 2021 paper: RCEA-360VR\n\nSource code for our CHI 2021 paper:\n\u003e*RCEA-360VR: Real-time, Continuous Emotion Annotation in 360° VR Videos for Collecting Precise Viewport-dependent Ground Truth Labels*\n\nRepository contains:\n\n1. [Viewport-dependent annotation fusion method](source)\n2. [Viewport-based fine-grained V-A video overlay generator + example videos](video_results)\n\nExample results for our viewport-dependent label fusion method:\n![Example viewport-dependent V-A overlay videos](video_results/video_examples/example_VD_labelled_vids.gif)\n\n*[Explanation of source code will be finalized soon]*\n\n## Preprint + Video Preview\n\nPreprint (.pdf) here: [chi2021_rcea360VR_preprint](preprint/chi2021_rcea360VR_preprint.pdf)\n\n30s video preview (on YouTube):\n\n[![30s video preview](https://abdoelali.com/assets/rcea360vr_thumbnail.png)](https://www.youtube.com/watch?v=dSeCyH6OuIc \"CHI 2021 RCEA-360VR\")\n\n\n## Citing this paper or code\n\n**Please cite our paper in any published work that uses any of these resources.**\n\nBiBTeX:\n```\n@inproceedings{Xue2021,\n  title = {RCEA-360VR: Real-time, Continuous Emotion Annotation in 360° VR Videos for Collecting Precise Viewport-dependent Ground Truth Labels},\n  author = {Tong Xue and Abdallah El Ali and Tianyi Zhang and Gangyi Ding and Pablo Cesar},\n  booktitle = {Proceedings of the International Conference on Human Factors in Computing Systems 2021},\n  series = {CHI '21},\n  year = {2021},\n  location = {Yokohama, Japan},\n  pages = {1-15},\n  keywords = {Emotion, annotation, 360°, virtual reality, ground truth, labels, viewport-dependent, real-time, continuous},\n  url = {https://doi.org/10.1145/3411764.3445487},\n  abstract = {Precise emotion ground truth labels for 360° virtual reality (VR) video watching are essential for fine-grained predictions under varying viewing behavior. However, current annotation techniques either rely on post-stimulus discrete self-reports, or real-time, continuous emotion annotations (RCEA) but only for desktop/mobile settings. We present RCEA for 360° VR videos (RCEA-360VR), where we evaluate in a controlled study (N=32) the usability of two peripheral visualization techniques: HaloLight and DotSize. We furthermore develop a method that considers head movements when fusing labels. Using physiological, behavioral, and subjective measures, we show that (1) both techniques do not increase users' workload, sickness, nor break presence (2) our continuous valence and arousal annotations are consistent with discrete within-VR and original stimuli ratings (3) users exhibit high similarity in viewing behavior, where fused ratings perfectly align with intended labels. Our work contributes usable and effective techniques for collecting fine-grained viewport-dependent emotion labels in 360° VR.},\n  }\n  ```\n\nACM Ref Citation:\n\n*Tong Xue, Abdallah El Ali, Tianyi Zhang, Gangyi Ding, and Pablo Cesar (2021). RCEA-360VR: Real-time, Continuous Emotion Annotation in 360° VR Videos for Collecting Precise Viewport-dependent Ground Truth Labels. In CHI Conference on Human Factors in Computing Systems (CHI ’21), May 8–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 15 pages. https://doi.org/10.1145/3411764.3445487*\n\n\n## Licenses\n\nCode in this repo is released under [Mozilla Public\nLicense 2.0](https://github.com/ayman/hubs-research-2021/blob/main/LICENSE).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcwi-dis%2Frcea360vr-chi2021","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fcwi-dis%2Frcea360vr-chi2021","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fcwi-dis%2Frcea360vr-chi2021/lists"}