Replication of the Forward-Forward Algorithm on MNIST and a Log of Hyperparameter Search

Forward-Forward のMNIST 追試とハイパーパラメータ探索

Replication of the Forward-Forward Algorithm on MNIST and a Log of Hyperparameter Search

　This paper is a Japanese tutorial article that summarizes our replication of the Forward-Forward (FF) algorithm on MNIST in the supervised label-in-input setting. We verify the correspondence between the implementation and the mathematical formulation and organize our hyperparameter exploration in a hypothesisintervention-result-interpretation-next-step format, providing tables and figures aggregated across runs from the experiment logs. In our replication, the best test error under label-search inference was 2.12% with jitter augmentation (± 2 pixels) after 500 epochs.

Creators Shirahama Naruki

Creators Nakaya Naofumi

Creators Watanabe Satoshi

[isIdenticalTo] https://doi.org/10.60457/jislr.2.2_19