Is there a fundamental upper limit for the significance I/σ(I) of observations from X-ray and neutron diffraction experiments?

Title data

Henn, Julian ; Meindl, Kathrin:
Is there a fundamental upper limit for the significance I/σ(I) of observations from X-ray and neutron diffraction experiments?
In: Acta Crystallographica Section A. Vol. 66 (2010) Issue 6 . - pp. 676-684.
ISSN 1600-5724
DOI: https://doi.org/10.1107/S0108767310038808

Official URL:

Abstract in another language

The answer is yes. A fundamental limit exists, which is not strongly applicable to individual reflections but to a sufficiently large set of reflections such as any set for structure determination. The limit originates from Poisson statistics which gives a minimum (average) error. The proposed limit of significance and a proposed decrease in significance due to data processing are also tested by monitoring W = łangle Ihkl1/2 ångle/ łangle σ (Ihkl) ångle for raw and for Bragg data. Since Poisson statistics are the lower limit for the experimental standard uncertainties, it is expected that \it W < 1 for raw and Bragg data, and that \it W decreases upon data processing. \it W also gives a measure of systematic errors in the experimental data as W ≃ 1 characterizes pure Poisson data, W\gg1 is physically impossible for sufficiently large data sets of unmerged reflections and \it W < 1 describes the contamination with systematic errors. Systematic differences depending on the software used to process the data were found. Also, the frequency distributions in particular of σ(\it I) values change considerably depending on the data-processing software used. We have no explanation for these differences in the distributions of σ(\it I), which lead to distinct changes in the frequency distribution of the significances \it I/σ(\it I) compared with the raw data. Another consequence of Poisson statistics is that lower limits also exist for the agreement factors, the internal agreement factor and the goodness of fit. These limits depend on the moments łangle 1/I\rm o ångle, łangle I\rm o ångle, łangle I\rm o² ångle and łangle I\rm o1/2 ångle of the observed set of intensities I\rm o about the origin. These agreement factors are theoretically attainable when no systematic sources of error apply. They may be used in future to construct further measures of systematic error in experimental data.

Further data

Item Type:	Article in a journal
Refereed:	Yes
Keywords:	significance limit; Poisson's statistics; neutron diffraction; X-ray diffraction
Institutions of the University:	Faculties > Faculty of Mathematics, Physics und Computer Science > Group Material Sciences > Chair Crystallography > Chair Crystallography - Univ.-Prof. Dr. Sander van Smaalen Faculties Faculties > Faculty of Mathematics, Physics und Computer Science Faculties > Faculty of Mathematics, Physics und Computer Science > Group Material Sciences Faculties > Faculty of Mathematics, Physics und Computer Science > Group Material Sciences > Chair Crystallography
Result of work at the UBT:	Yes
DDC Subjects:	500 Science > 530 Physics
Date Deposited:	31 Jul 2015 06:45
Last Modified:	31 Jul 2015 06:45
URI:	https://eref.uni-bayreuth.de/id/eprint/17458