Proxy Network for Few Shot Learning

Bin Xiao, Chien-Liang Liu, Wen-Hoar Hsaio
Proceedings of The 12th Asian Conference on Machine Learning, PMLR 129:657-672, 2020.

Abstract

The use of a few examples for each class to train a predictive model that can be generalizedto novel classes is a crucial and valuable research direction in artificial intelligence. Thiswork addresses this problem by proposing a few-shot learning (FSL) algorithm called proxynetwork under the architecture of meta-learning. Metric-learning based approaches assumethat the data points within the same class should be close, whereas the data points inthe different classes should be separated as far as possible in the embedding space. Weconclude that the success of metric-learning based approaches lies in the data embedding,the representative of each class, and the distance metric. In this work, we propose asimple but effective end-to-end model that directly learns proxies for class representativeand distance metric from data simultaneously. We conduct experiments on CUB andmini-ImageNet datasets in 1-shot-5-way and 5-shot-5-way scenarios, and the experimentalresults demonstrate the superiority of our proposed method over state-of-the-art methods.Besides, we provide a detailed analysis of our proposed method.

Cite this Paper

BibTeX
@InProceedings{pmlr-v129-xiao20a, title = {Proxy Network for Few Shot Learning}, author = {Xiao, Bin and Liu, Chien-Liang and Hsaio, Wen-Hoar}, booktitle = {Proceedings of The 12th Asian Conference on Machine Learning}, pages = {657--672}, year = {2020}, editor = {Pan, Sinno Jialin and Sugiyama, Masashi}, volume = {129}, series = {Proceedings of Machine Learning Research}, month = {18--20 Nov}, publisher = {PMLR}, pdf = {http://proceedings.mlr.press/v129/xiao20a/xiao20a.pdf}, url = {https://proceedings.mlr.press/v129/xiao20a.html}, abstract = {The use of a few examples for each class to train a predictive model that can be generalizedto novel classes is a crucial and valuable research direction in artificial intelligence. Thiswork addresses this problem by proposing a few-shot learning (FSL) algorithm called proxynetwork under the architecture of meta-learning. Metric-learning based approaches assumethat the data points within the same class should be close, whereas the data points inthe different classes should be separated as far as possible in the embedding space. Weconclude that the success of metric-learning based approaches lies in the data embedding,the representative of each class, and the distance metric. In this work, we propose asimple but effective end-to-end model that directly learns proxies for class representativeand distance metric from data simultaneously. We conduct experiments on CUB andmini-ImageNet datasets in 1-shot-5-way and 5-shot-5-way scenarios, and the experimentalresults demonstrate the superiority of our proposed method over state-of-the-art methods.Besides, we provide a detailed analysis of our proposed method.} }
Endnote
%0 Conference Paper %T Proxy Network for Few Shot Learning %A Bin Xiao %A Chien-Liang Liu %A Wen-Hoar Hsaio %B Proceedings of The 12th Asian Conference on Machine Learning %C Proceedings of Machine Learning Research %D 2020 %E Sinno Jialin Pan %E Masashi Sugiyama %F pmlr-v129-xiao20a %I PMLR %P 657--672 %U https://proceedings.mlr.press/v129/xiao20a.html %V 129 %X The use of a few examples for each class to train a predictive model that can be generalizedto novel classes is a crucial and valuable research direction in artificial intelligence. Thiswork addresses this problem by proposing a few-shot learning (FSL) algorithm called proxynetwork under the architecture of meta-learning. Metric-learning based approaches assumethat the data points within the same class should be close, whereas the data points inthe different classes should be separated as far as possible in the embedding space. Weconclude that the success of metric-learning based approaches lies in the data embedding,the representative of each class, and the distance metric. In this work, we propose asimple but effective end-to-end model that directly learns proxies for class representativeand distance metric from data simultaneously. We conduct experiments on CUB andmini-ImageNet datasets in 1-shot-5-way and 5-shot-5-way scenarios, and the experimentalresults demonstrate the superiority of our proposed method over state-of-the-art methods.Besides, we provide a detailed analysis of our proposed method.
APA
Xiao, B., Liu, C. & Hsaio, W.. (2020). Proxy Network for Few Shot Learning. Proceedings of The 12th Asian Conference on Machine Learning, in Proceedings of Machine Learning Research 129:657-672 Available from https://proceedings.mlr.press/v129/xiao20a.html.

Related Material