Incorporation of Perception-based Information in Robot Learning Using Fuzzy Reinforcement Learning Agents

Robot learning in unstructured environments has been proved to be an extremely challenging problem, mainly because of many uncertainties always present in the real world. Human beings, on the other hand, seem to cope very well with uncertain and unpredictable environments, often relying on perception-based information. Furthermore, humans beings can also utilize perceptions to guide their learning on those parts of the perception-action space that are actually relevant to the task. Therefore, we conduct a research aimed at improving robot learning through the incorporation of both perceptionbased and measurement-based information. For this reason, a fuzzy reinforcement learning (FRL) agent is proposed in this paper. Based on a neural-fuzzy architecture, different kinds of information can be incorporated into the FRL agent to initialise its action network, critic network and evaluation feedback module so as to accelerate its learning. By making use of the global optimisation capability of GAs (genetic algorithms), a GA-based FRL (GAFRL) agent is presented to solve the local minima problem in traditional actor-critic reinforcement learning. On the other hand, with the prediction capability of the critic network, GAs can perform a more effective global search. Different GAFRL agents are constructed and verified by using the simulation model of a physical biped robot. The simulation analysis shows that the biped learning rate for dynamic balance can be improved by incorporating perception-based information on biped balancing and walking evaluation. The biped robot can find its application in ocean exploration, detection or sea rescue activity, as well as military maritimeac tivity.     

项国土资源部“金土工程”正式立

由国土资源部向国家申报的“金土工程”一期建设项目建议书，于5月31日得到国家发改委正式批准。“金土工程”成为2002年确定的国家“十二金”电子政务重点工程之外第一个正式批准立项的电子政务工程项目。按照国家发改委对项目建议书的批复，“金土工程”一期建设包括：制定相关国土资源信息化标准；在国土资源部、31个省（市、区)和32个城市，建立相关土地基础数据库和耕地保护业务管理应用系统：建立重要矿产的矿产资源基础数据库和管理应用系统；     

八庙—青山金红石矿床化学成分与成矿关系

本矿床是我国金红石矿床重要的成因及工业类型，为具有特定化学成分的岩石在特定变质条件下形成的。本文通过对大量数据的处理，查明了化学成分与成矿的关系：高Ａｌ２Ｏ３、ＭｇＯ、Ｆｅ２Ｏ３＋ＦｅＯ、Ｋ２Ｏ、Ｐ２Ｏ５、Ｈ２Ｏ＋、ＭｎＯ，低ＳｉＯ２、ＣａＯ、Ｎａ２Ｏ、ＣＯ２、Ｓ等，利于钛富集；高ＴｉＯ２、ＭｇＯ、Ｐ２Ｏ５、Ｓ，低ＳｉＯ２、ＣａＯ、Ｋ２Ｏ、Ａｌ２Ｏ３、Ｆｅ２Ｏ３／ＦｅＯ，利于金红石形成；高Ｓｃ、Ｚｒ、Ｎｉ、Ｚｎ及Ｌａ／Ｙｂ，低Ｙ、Ｎｂ、Ｔｈ、Ｃｄ、Ｂａ、Ｂｅ、ΣＲＥＥ，利于金红石纯度提高。对研究矿床成因及寻找新的同类矿床等有重要意义     

扎河坝地区的细碧岩及其金矿化

扎河坝地区的细碧岩是扎河坝蛇绿岩套的主要岩石组合之一。它具有特征的枕状体和杏仁体构造,又有较典型的细碧岩岩石学特征,还是该区金矿化的含矿母岩。金矿化产于细碧岩构造破碎带内,与蚀变黄铁矿关系最为密切。