guest ::
| Home > Articles > Published articles > Efficient Lossless Compression of Integer Astronomical Data |
| Home > Articles > Published articles > Efficient Lossless Compression of Integer Astronomical Data |
(Universitat Autònoma de Barcelona. Departament d'Enginyeria de la Informació i de les Comunicacions) (Universitat Autònoma de Barcelona. Departament d'Enginyeria de la Informació i de les Comunicacions) (Universitat Autònoma de Barcelona. Departament d'Enginyeria de la Informació i de les Comunicacions)| Date: | 2023 |
| Description: | 6 pàg. |
| Abstract: | Each new generation of telescope produces increasingly larger astronomical data volumes, which are expected to reach the order of exabytes in the next decade. Effective and fast data compression methods are paramount to help the scientific community contain storage costs and improve transmission times. Astronomical data differs significantly from natural and Earth-observation images, asking for specifically tailored compression approaches. This paper presents a novel lossless compression technique that employs the discrete Haar wavelet transform within the JPEG 2000 standard. Its performance is compared to that of a comprehensive selection of compressors, including fpack, the most common technique in astronomical observatories, as well as other algorithms highly competitive for other types of data. Experiments are performed on a large data set of 16 bit integer images, produced by telescopes around the world and representative of a wide variety of astronomical scenarios. The proposed technique has two modes. The first mode outperforms all the other tested techniques in terms of compression performance. It surpasses the most competitive configuration of fpack by, respectively, 5. 3% (about 0. 3 bits per sample), having also 4. 5% lower compression and decompression times. The second mode is the fastest among all tested techniques. Its compression and decompression times are 2. 5 and 3. 5 times faster than the fastest configuration of fpack, while also yielding a 2. 4% better compression performance (0. 15 bits per sample). |
| Grants: | European Commission 801370 Agencia Estatal de Investigación PID2021-125258OB-I00 Agència de Gestió d'Ajuts Universitaris i de Recerca SGR/2021-00643 Agència de Gestió d'Ajuts Universitaris i de Recerca 2018/BP-00008 |
| Rights: | Aquest document està subjecte a una llicència d'ús Creative Commons. Es permet la reproducció total o parcial, la distribució, la comunicació pública de l'obra i la creació d'obres derivades, fins i tot amb finalitats comercials, sempre i quan es reconegui l'autoria de l'obra original.  |
| Language: | Anglès |
| Document: | Article ; recerca ; Versió publicada |
| Subject: | Astronomy data reduction (1861) ; Astronomy data analysis (1858) ; Astronomy software (1855) |
| Published in: | Publications of the Astronomical Society of the Pacific, Vol. 135, number 1051 (Sep. 2023) , art. 94502, ISSN 1538-3873 |
