paper-with-me

홈 › Papers

SketchINR: A First Look into Sketches as Implicit Neural Representations

2024-03-14 · CVPR 2024 1 · Hmrishav Bandyopadhyay, Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Tao Xiang, Timothy Hospedales, Yi-Zhe Song

We propose SketchINR, to advance the representation of vector sketches with implicit neural models. A variable length vector sketch is compressed into a latent space of fixed dimension that implicitly encodes the underlying shape as a function of time and strokes. The learned function predicts the $xy$ point coordinates in a sketch at each time and stroke. Despite its simplicity, SketchINR outperforms existing representations at multiple tasks: (i) Encoding an entire sketch dataset into a fixed size latent vector, SketchINR gives $60\times$ and $10\times$ data compression over raster and vector sketches, respectively. (ii) SketchINR's auto-decoder provides a much higher-fidelity representation than other learned vector sketch representations, and is uniquely able to scale to complex vector sketches such as FS-COCO. (iii) SketchINR supports parallelisation that can decode/render $\sim$$100\times$ faster than other learned vector representations such as SketchRNN. (iv) SketchINR, for the first time, emulates the human ability to reproduce a sketch with varying abstraction in terms of number and complexity of strokes. As a first look at implicit sketches, SketchINR's compact high-fidelity representation will support future work in modelling long and complex sketches.

📄 PDF Abstract BibTeX arXiv:2403.09344

Code (1)

hmrishavbandy/SketchINR-Code 공식 구현 pytorch

Tasks

Data CompressionDecoder

Similar Papers 제목 키워드 기반

Recursive Sketches for Modular Deep Learning

2019-05-29 · Badih Ghazi, Rina Panigrahy, Joshua R. Wang

We present a mechanism to compute a sketch (succinct summary) of how a complex modular deep network processes its inputs. The sketch summarizes essential information about the inputs and outputs of the network and can be…

Deep Learning

SENS: Part-Aware Sketch-based Implicit Neural Shape Modeling

2023-06-09 · Alexandre Binninger, Amir Hertz, Olga Sorkine-Hornung, Daniel Cohen-Or 외

We present SENS, a novel method for generating and editing 3D models from hand-drawn sketches, including those of abstract nature. Our method allows users to quickly and easily sketch a shape, and then maps the sketch in…

Decoder

Learning via social awareness: Improving a deep generative sketching model with facial feedback

2018-02-13 · Natasha Jaques, Jennifer McCleary, Jesse Engel, David Ha 외

In the quest towards general artificial intelligence (AI), researchers have explored developing loss functions that act as intrinsic motivators in the absence of external rewards. This paper argues that such research has…

AI Agent

Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objects

2023-06-09 · Deng Yu, Manfred Lau, Lin Gao, Hongbo Fu

We present a novel freehand sketch beautification method, which takes as input a freely drawn sketch of a man-made object and automatically beautifies it both geometrically and structurally. Beautifying a sketch is chall…

Discovering Design Concepts for CAD Sketches

2022-10-26 · Yuezhi Yang, Hao Pan

Sketch design concepts are recurring patterns found in parametric CAD sketches. Though rarely explicitly formalized by the CAD designers, these concepts are implicitly used in design for modularity and regularity. In thi…