Relative Entropy Minimizing-Based Theory of Intelligent Systems

分类： 数学 >> 统计和概率 提交时间： 2019-07-21

Xi, Guangcheng

摘要： Based on the point of view of neuroethology and cognition-psychology, general frame of theory for intelligent systems is presented by means of principle of relative entropy minimizing in this paper. Cream of the general frame of theory is to present and to prove basic principle of intelligent systems: entropy increases or decreases together with intelligence in the intelligent systems. The basic principle is of momentous theoretical significance and practical significance .From the basic principle can not only derive two kind of learning algorithms (statistical simulating annealing algorithms and annealing algorithms of mean-field theory approximation) for training large kinds of stochastic neural networks,but also can thoroughly dispel misgivings created by second law of thermodynamics on 'peoplespsychology ,hence make one be fully confident of facing life.Because of Human society, natural world, and even universe all are intelligent systems.

同行评议状态:待评议

 点击量 28743  下载量 3026  评论