https://github.com/darthgera123/appearance-editing

Codebase for Neural View Synthesis and Appearance Editing from Unstructured Images
https://github.com/darthgera123/appearance-editing

Last synced: about 1 month ago
JSON representation

Codebase for Neural View Synthesis and Appearance Editing from Unstructured Images

• Host: GitHub
• URL: https://github.com/darthgera123/appearance-editing
• Owner: darthgera123
• Created: 2021-12-19T20:24:35.000Z (almost 3 years ago)
• Default Branch: main
• Last Pushed: 2022-10-06T20:56:41.000Z (about 2 years ago)
• Last Synced: 2023-03-06T17:25:09.096Z (over 1 year ago)
• Language: Python
• Size: 3.05 MB
• Stars: 5
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
Neural View Synthesis and Appearance Editing from Unstructured Images

Indian Conference on Computer Vision, Graphics and Image Processing



  

    Pulkit Gera1,

    Aakash KT1,

    Dhawal Sirikonda1,

    P J Narayanan1

  



1CVIT, IIIT Hyderabad







  

    [Project page]

    [Paper]

    [Video]

    [Data]

    [bibtex]

  





Abstract


  We present a neural rendering framework for simultaneous view synthesis and appearance editing of a scene from

  multi-view images captured under known environment illumination. Existing approaches either achieve view synthesis alone or view synthesis along with relighting, without direct control over the scene’s appearance. Our approach explicitly disentangles the appearance and learns a lighting representation that is independent of it. Specifically, we  independently estimate the BRDF and use it to learn a lighting-only representation of the scene. Such disentanglement allows our approach to generalize to arbitrary changes in appearance while performing view synthesis. We show results of editing the appearance of a real scene, demonstrating that our approach produces plausible appearance editing. The performance of our view synthesisapproach is demonstrated to be at par with state-of-the-art

  approaches on both real and synthetic data.



# Code Instructions

## Prerequisites

This code was tested on UBuntu 20.04, with Python 3.8. For running the code we used `pytorch 3.8`. Please check `requirements.txt` for other dependencies


## Preprocess the Data

Checkout [`preprocess`](./preprocess) for instructions on how to generate and preprocess the data.

## Running code

+ [`DNR`](./DNR) for instructions on how to run DNR code.

+ [`Independent`](./Independent) for instructions on how to run code with independent optimization.

+ [`Joint`](./Joint) for instructions on how to run code with joint optimization.