Incorporation of Perception-based Information in Robot Learning Using Fuzzy Reinforcement Learning Agents

Robot learning in unstructured environments has been proved to be an extremely challenging problem, mainly because of many uncertainties always present in the real world. Human beings, on the other hand, seem to cope very well with uncertain and unpredictable environments, often relying on perception-based information. Furthermore, humans beings can also utilize perceptions to guide their learning on those parts of the perception-action space that are actually relevant to the task. Therefore, we conduct a research aimed at improving robot learning through the incorporation of both perceptionbased and measurement-based information. For this reason, a fuzzy reinforcement learning (FRL) agent is proposed in this paper. Based on a neural-fuzzy architecture, different kinds of information can be incorporated into the FRL agent to initialise its action network, critic network and evaluation feedback module so as to accelerate its learning. By making use of the global optimisation capability of GAs (genetic algorithms), a GA-based FRL (GAFRL) agent is presented to solve the local minima problem in traditional actor-critic reinforcement learning. On the other hand, with the prediction capability of the critic network, GAs can perform a more effective global search. Different GAFRL agents are constructed and verified by using the simulation model of a physical biped robot. The simulation analysis shows that the biped learning rate for dynamic balance can be improved by incorporating perception-based information on biped balancing and walking evaluation. The biped robot can find its application in ocean exploration, detection or sea rescue activity, as well as military maritimeac tivity.     

Galileo系统及其在中国的应用

较详细地介绍了Galileo系统的全面体系结构、频率设计、服务内容及其广泛的应用范围，指出了它与GPS系统相比的优点，并对开发和增强Galileo系统在我国多层次、全方位的应用提出了建议。     

定位服务忙天涯若比邻

据说人类80%的活动都与地理位置相关,由此而产生了许许多多的与“位置”相关的技术与服务,从远古的路标、地图、……,到当今时髦的GIS、导航系统、……,都是每个人日常生活与工作中不可缺少的一部分。与此同时,人类的通讯手段也在不断发展,无线通讯已将“天涯咫尺”变为现实,以至于见到某个人对着电话说“您现在在哪儿,在国内吗?”时,已不会有人觉得奇怪了。得益于人类80%活动的需求和现代通讯技术的发展,定位服务(LocationBasedService,LBS)得以产生并飞速发展。LBS是多学科交叉融合的产物,它将无线通讯技术、互联网技术、空间数据库…     

我国气象导航发展综述

简述了气象导航技术在世界上的兴起和在我国的发展与现状，气象导航的优越性和具体操作过程，指出超级巨型计算机等高新技术的引进将使气象导航产生一个质的飞跃。     

导航定位后处理信息管理系统

介绍了采用VC 语言开发的导航后处理系统的结构、功能特点、系统配置、操作方法及在海洋勘探中的应用。     

简讯

《国际浅海海湾、河口及陆架物理学学术讨论会》在我院召开，《北太平洋海域海洋气象导航》研究成果通过评审     

伽利略系统及其地面段的设计

伽利略(Galileo)系统是欧洲的全球卫星导航服务(GNSS)系统，依据有关Galileo系统建设的最新资料，比较系统地介绍了Galileo系统的定义、提供的服务、联合执行体的组织运作模式和SAR服务等，详细地介绍了系统地面段的设计状况和某些问题。     

一种基于电子地图的GPS导航定位技术

阐述了三种微机与GPS接收机间通讯的方法，并剖析了数种常见GPS接收机数据格式，基于图层结构用面向对象方法（OO）成功地构律字适用于导航定位的电子地图，该种导航定位技术已成功地应用于面向多波束数据后处理的成图系统MBChart，并在多波束勘测中得到初步试用，已取得预期效果。