FITS数据文件的检索和访问

普适图像传输系统(Flexible Image Transport System,FITS)是天文学领域应用最广泛的数据格式.自从20世纪80年代FITS格式被国际天文联合会(IAU)正式公布为国际标准以来,大部分的天文数据都是以FITS文件的形式在世界各地的数据中心和天文学家手中保存和交换.采用文件系统方式保存管理的FITS数据文件,很难适应程序化的检索和定位需求.随着FITS文件数量的不断增加以及虚拟天文台技术的发展,为这些以文件形式保存的天文数据提供检索功能的需求越来越迫切.FITS头以关键词值对的形式确切定义了所属FITS文件的结构,还提供了数据本身诸多特性的重要信息.FITS头中保存的这些信息可以满足大部分FITS数据文件查询检索的需求.将FITS头中的信息利用数据库来保存和管理,可以极大的方便对FITS文件的检索和定位.FITS头归档入库系统(FitHAS)是中国虚拟天文台项目开发的一个简单实用的FITS头信息归档入库工具,能够方便的将单个或者多个FITS文件的主FITS头信息导入到数据库中,为FITS数据文件的查询检索奠定基础,进而为虚拟天文台等更高层次的数据访问服务部署创造条件.本文介绍FITS数据格式,FITS头的基本结构;探讨虚拟天文台环境下FITS数据文件检索定位的实现方式;阐述FitHAS的功能特点、设计开发和使用方法.     

FITS文件管理器设计与实现

FITS文件管理器(FITS Manager)着眼于对中小规模数量的FITS文件的管理,实现对FITS文件的快速查找、预览以及相关处理。在不改变天文学家现有工作习惯的前提下融入虚拟天文台先进的技术和功能。FITS Manager采用了日趋流行的插件式软件开发模式,在完成了软件跨平台的同时极大地增强了软件的可扩展性。在FITS Manager中,所有的应用功能都由功能插件完成,软件核心组件则为应用插件提供了简便的接口、提高公用功能的复用程度。通过社区开发的模式不断添加各种功能的插件,FITS Manager将努力成为天文学家处理FITS文件的高效平台。     

在Windows／VC ＋＋环境下编程实现FITS图像的显示

FITS是广泛应用于天文领域中数据转换、分析和数据存储的标准计算机数据文件格式,如何在Windows环境下开发出方便有效的FITS图像应用软件具有现实意义.本文简要介绍了FITS格式文件的概况、演化和最新进展,重点描述了如何在Windows/VC 6.0环境下编程实现FITS图像的显示.     

CCD数据文件的管理

本文叙述利用Delphi的数据库功能进行的CCD数据文件管理程序的设计。着重介绍了数据库生成、按日期和类型访问文件、暗流文件选取、头文件修改等问题的处理。这个程序是为紫金山天文台双瞳望远镜开发的CCD图象处理软件的组成部分     

FITS变长数组在暗物质卫星数据存储中的应用研究

FITS是空间天文领域广泛使用的一种数据格式,空间天文数据文件通常采用定长数据结构存储为FITS文件。作为我国首颗发射的空间科学卫星,暗物质粒子探测卫星科学数据源包具有长度可变的特点。在暗物质卫星数据处理过程中,急需设计支持可变长度数据的存储结构和处理方法。设计了一种支持长度可变数组的FITS格式,并实现了采用该数据结构的数据处理、存储和管理。应用于暗物质卫星地面处理中,验证结果表明,该方法实现了编辑级产品数据存储,显著降低了产品数据量,节约了存储空间,同时提升了处理效率。     

FITSIO软件包的简介及应用举例

简单介绍了用于读写FITS格式文件的FITSIO软件包的主要功能和特点。利用该软件包对 SDSS(Sloan Digital Sky Survey)数据中椭圆星系NGC4044和漩涡星系NGC5227的g,r,i三个波段的 FITS图像文件进行了重新读写,使这三个波段的FITS文件中天体的坐标完全对应。并以此合成了“真彩图”和“颜色分布图”,可以清楚地看出这些星系不同位置处颜色的变化。     

基于WCS的FITS图像天球定位综述及通用可视化研究

求取FITS(Flexible Image Transport System)文件头中以键/值对形式记录的坐标参数是FITS图像在天球参考系中定位的关键,研究坐标参数求解的一般过程具有重要意义.通过结合观测相机相关参数、天文照相图片识别算法以及WCS(World Coordinate System)理论能够有效实现坐标参数的求解,其中,CCD参数可确定图像对应天区在星表中的坐标范围,从而与星表结合可构建区域星表;天文照相图片识别完成了图像与区域星表间的匹配,得到一定数量恒星的CCD平面坐标与其天球坐标的对应表;WCS根据球面到平面不同投影方式建立两个坐标系之间的传递函数,选择其中一种并代入对应表中数据,解算函数的转换参数从而确定图像像素及其对应的天球坐标.FITS图像作为天文领域科学数据传输与分析的主流数据格式,仅限于在专业天文软件中进行查看、编辑及分析,在天文科普教育中存在局限性.因此,研究一种通用的图像可视化方法意义非凡.通过对FITS与PNG或JPEG图像进行格式转换,以AVM(Astronomy Visualization Metadata)的形式将FITS文件头中的坐标参数转换为元数据并添加到PNG或JPEG的文件头中,能够满足天文爱好者在非天文软件平台下查看及分析天文图像的一般需求.整体设计流程通过java编程实现并通过SExtractor、虚拟天文台可视化工具WWT、图片查看器等软件进行了相关测试.     

基于ImageJ的图片格式批量转换软件的设计与实现

介绍了开源的纯Java语言图像处理程序——ImageJ,以及如何利用ImageJ程序包进行二次开发.利用该程序包,实现了从WinView所获取的图片文件格式TIFF、SPE到FITS文件格式的批量转换.并在此基础上,提出了如何利用该程序包实现其它图片格式之间相互单独以及批量转换的方法.     

中国频谱射电日像仪FITS-IDI文件格式研究

我国新一代中国频谱射电日像仪（Chinese Spectral Radio Heliograph,CSRH）原始观测数据采用自定义格式,在进行后续处理与共享使用时必须转换相应的格式.在分析FITS-IDI（FITS Interferometry Data Interchange）格式的基础上,结合CSRH的实际观测模式与数据产出方式,定义与设计了符合项目情况的FITS-IDI格式及字段,并对FITS-IDI文件中若干字段的值如何获取、计算进行了深入讨论.根据定义生成的FITS-IDI文件已成功导入CASA软件,并可以进行后续处理.经过对CASA测量集文件的核实,证明了数据生成的正确性.本研究有效地推进了CSRH的建设工作,也对其他射电干涉阵数据存储有一定的参考价值.     

R语言应用于LAMOST光谱分析初探

以可扩展性极强的开源软件R程序语言为工具,发挥在统计学和数据挖掘领域强大的数据分析能力,重点研究R语言用于读写FITS格式文件软件包RFITSIO的主要功能和特点,并对LOMAST采集的FITS文件进行详细介绍,将海量LOMAST巡天光谱DR2数据用RFITSIO读出恒星光谱,并利用R语言的主成分分析工具提取各类型光谱数据的特征量即主成分。从含有大量冗余信息的光谱中提取代表恒星光谱特征的主要成分,通过采用主成分分析方法提取光谱特征,重构后能够有效降低原始光谱数据受噪声的影响,为后续数据挖掘工作提供研究基础。     

CCD光谱的IRAF和FITS格式转换

美国国立光学天文台的IRAF软件系统,已成为国内光谱处理的主要计算机软件之一。由射电天文需要发展起来的FITS格式,已作为国际上交换磁带数据资料的通用格式。本文简单地介绍了FITS格式,讨论了如何将厚片CCD光谱观测资料转换为IRAF图像,继而转换为标准FITS格式。这对于使用IRAF系统进行光谱处理,以及国内国际间的资料交换是有用的。     

Enhanced management of personal astronomical data with FITSManager

Although the roles of data centers and computing centers are becoming more and more important, and on-line research is becoming the mainstream for astronomy, individual research based on locally hosted data is still very common. With the increase of personal storage capacity, it is easy to find hundreds to thousands of FITS files in the personal computer of an astrophysicist. Because Flexible Image Transport System (FITS) is a professional data format initiated by astronomers and used mainly in the small community, data management toolkits for FITS files are very few. Astronomers need a powerful tool to help them manage their local astronomical data. Although Virtual Observatory (VO) is a network oriented astronomical research environment, its applications and related technologies provide useful solutions to enhance the management and utilization of astronomical data hosted in an astronomer’s personal computer. FITSManager is such a tool to provide astronomers an efficient management and utilization of their local data, bringing VO to astronomers in a seamless and transparent way. FITSManager provides fruitful functions for FITS file management, like thumbnail, preview, type dependent icons, header keyword indexing and search, collaborated working with other tools and on-line services, and so on. The development of the FITSManager is an effort to fill the gap between management and analysis of astronomical data.     

The Euro3D data format: A common FITS data format for integral field spectrographs

As integral field spectrographs have become more common around the world and in Europe in particular, the need for a common data format has been recognized. Here, we present the Euro3D format that is adapted as a post‐instrumentalsignature‐removal format for all instruments within the Euro3D network. It follows the FITS standard, and includes several extensions, all of them being binary FITS tables. This article is intended to give a comprehensive overview, but does not attempt to serve as a full definition document. (© 2004 WILEY‐VCH Verlag GmbH & Co. KGaA, Weinheim)     

VOFilter： Bridging Virtual Observatory and Industrial Office Applications

VOFilter is an XML based filter developed by the Chinese Virtual Observatory project to transform tabular data files from VOTable format into OpenDocument format. VOTable is an XML format defined for the exchange of tabular data in the context of the Virtual Observatory (VO). It is the first Proposed Recommendation defined by International Virtual Observatory Alliance, and has obtained wide support from both the VO community and many Astronomy projects. OpenOffice.org is a mature, open source, and front office application suite with the advantage of native support of industrial standard OpenDocument XML file format. Using the VOFilter, VOTable files can be loaded in OpenOffice.org Calc, a spreadsheet application, and then displayed and analyzed as other spreadsheet files. Here, the VOFilter acts as a connector, bridging the coming VO with current industrial office applications. We introduce Virtual Observatory and technical background of the VOFilter. Its workflow, installation and usage are presented. Existing problems and limitations are also discussed together with the future development plans.     

SOLAR-A reformatted data files and observing log

All of the SOLAR-A telemetry data will be reformatted before distribution to the analysis computers and the various users. This paper gives an overview of the files which will be created and the format and organization which the files will use. The organization has been chosen to be efficient in space, to ease access to the data, and to allow for the data to be transportable to different machines. An observing log file will be created automatically using the reformatted data files as the input. It will be possible to perform searches with the observing log to list cases where instruments are in certain modes and/or seeing certain signal levels.After the launch the name of SOLAR-A has been changed to YOHKOH.     

FITS、BMP和SCR图象格式及相互转换

本文详细介绍图象的ＦＩＴＳ格式、ＢＭＰ格式和ＳＣＲ格式。ＦＩＴＳ格式已经是天文界的通用格式，几乎所有的天文软件包都支持这一格式，而ＢＭＰ格式在ＰＣ计算机上有广泛的运用，有大量ＰＣ软件支持ＢＭＰ图象的显示，处理和打印。云南天文台的ＳＣＲ格式是ＰＣ机采集ＣＣＤ图象所使用的格式。实现这三种格式的相互转换，就可以自由的将ＣＣＤ图象在ＰＣ机和工作站上进行各种处理。转换的包括图象头和图象数据的转换，其关键在于交换数据的高低字节。     

Low-cost high performance distributed data storage for multi-channel observations

The New Vacuum Solar Telescope (NVST) is a 1-m solar telescope that aims to observe the fine structures in both the photosphere and the chromosphere of the Sun. The observational data acquired simultaneously from one channel for the chromosphere and two channels for the photosphere bring great challenges to the data storage of NVST. The multi-channel instruments of NVST, including scientific cameras and multi-band spectrometers, generate at least 3 terabytes data per day and require high access performance while storing massive short-exposure images. It is worth studying and implementing a storage system for NVST which would balance the data availability, access performance and the cost of development. In this paper, we build a distributed data storage system (DDSS) for NVST and then deeply evaluate the availability of real-time data storage on a distributed computing environment. The experimental results show that two factors, i.e., the number of concurrent read/write and the file size, are critically important for improving the performance of data access on a distributed environment. Referring to these two factors, three strategies for storing FITS files are presented and implemented to ensure the access performance of the DDSS under conditions of multi-host write and read simultaneously. The real applications of the DDSS proves that the system is capable of meeting the requirements of NVST real-time high performance observational data storage. Our study on the DDSS is the first attempt for modern astronomical telescope systems to store real-time observational data on a low-cost distributed system. The research results and corresponding techniques of the DDSS provide a new option for designing real-time massive astronomical data storage system and will be a reference for future astronomical data storage.