Implicit Neural Representations with Periodic Activation Functions

@article{sitzmann2020implicit,
  title={Implicit neural representations with periodic activation functions},
  author={Sitzmann, Vincent and Martel, Julien and Bergman, Alexander and Lindell, David and Wetzstein, Gordon},
  journal={Advances in neural information processing systems},
  volume={33},
  pages={7462--7473},
  year={2020}
}

link

SIREN stands for SInusoidal REpresentation Network

Formalize the way the weights of a network can be used to directly “store” something that then can be reconstructed. Similar to DeepSDF , Occupancy Networks or NeRF , but using sinusoidal activation functions

They are Multi Layer Perceptrons , just with as activation function.

Need to initialize weights based on a specific uniform distribution to work well.