Evaluation of Tipping Bucket Rain Gauge Performance and Data Quality
Evaluation of Tipping Bucket Rain Gauge Performance and Data Quality
Evaluation of Tipping Bucket Rain Gauge Performance and Data Quality
uk
It’s our job to make sure that air, land and water are looked after by
everyone in today’s society, so that tomorrow’s generations inherit a
cleaner, healthier world.
This report is printed on Cyclus Print, a 100% recycled Environment Agency’s Project Manager:
stock, which is 100% post consumer waste and is totally David Brown, North West Region, Richard Fairclough
chlorine free. Water used is treated and in most cases House, Warrington
returned to source in better condition than removed.
Research Collaborator:
Further copies of this report are available from: The Met Office – www.meto.gov.uk
The Environment Agency’s National Customer Contact
Centre by emailing enquiries@environment- Science Project Number:
agency.gov.uk or by telephoning 08708 506506. W6-048
Product Code:
SCHO0904BIFW-E-P
ii Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Science at the Environment
Agency
The work of the Science Group is a key ingredient in the partnership between
research, policy and operations that enables the Agency to protect and restore our
environment.
The Environment Agency’s Science Group focuses on five main areas of activity:
• Setting the agenda: To identify the strategic science needs of the Agency to
inform its advisory and regulatory roles.
• Sponsoring science: To fund people and projects in response to the needs
identified by the agenda setting.
• Managing science: To ensure that each project we fund is fit for purpose and
that it is executed according to international scientific standards.
• Carrying out science: To undertake the research itself, by those best placed to
do it - either by in-house Agency scientists, or by contracting it out to
universities, research institutes or consultancies.
• Providing advice: To ensure that the knowledge, tools and techniques
generated by the science programme are taken up by relevant decision-makers,
policy makers and operational staff.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data iii
Quality
ACKNOWLEDGEMENTS
The project manger is pleased to acknowledge the commitment and enthusiasm of the
Environment Agency hydrometry staff Gary Kinsella and Billy Fleming in ensuring the
success of the field testing phase. The project manager would also like to acknowledge
the technical support and commitment of the staff at Eskdalemuir, particularly Ian
Dawson, whose input to the project also greatly improved the quality of the data
collected.
iv Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
EXECUTIVE SUMMARY
This report covers four key areas:
1. An in depth literature review of the issues and problems pertaining to the use of
tipping bucket raingauges (TBRs)
2. A survey of current Environment Agency practice pertaining to the use of TBRs.
3. Laboratory testing of 8 types of TBR to determine the best method for calibration
and compare gauge reliability and accuracy
4. Field evaluation of 8 types of TBR to assess, reliability in the field, relative
performance in terms of catch compared to the standard Meteorological Office 5"
The need for the work arose from the fact that the Environment Agency routinely
collects rainfall data for flood risk prediction, flood warning and water resource
planning activities. Discrepancies between the records obtained from tipping bucket
raingauges (TBRs) and conventional storage gauges. The problem that has been
identified, namely under-recording by TBRs, has particular implications for work
relating to water resources since, whilst the error may be relatively small on any one
event, the significance may increase as rainfall totals are accumulated over longer
periods.
The literature review found general agreement among the authors of the papers
reviewed that one of the most important factors affecting raingauge performance is
exposure to wind and that the effect increases with height of the gauge rim above the
ground surface. Evidence was found in the literature that use of gauges with an
aerodynamic shape (champagne glass) were measurably better than standard shapes
(cylindrical). The other most important effect identified in the literature reviewed relates
to the relationship between TBR calibration error and rainfall rate. This was reported to
be most marked during heavy rainfall, when water flowing in to the buckets while they
are tipping can represent an error of up to 10 – 30% compared to a co-located storage
gauge.
The laboratory investigations compared the two methods, constant rate and burette,
currently used by the Environment Agency for calibration of TBRs. It was concluded
that constant rate method should provide a calibration coefficient that is more robust at
higher intensities than one measured by the burette method. It was also concluded that
gauges calibrated by the constant rate method will underestimate at higher rainfall
intensities and better precision could be obtained by use of a full dynamic calibration
(i.e. calibration at a number of rates).
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data v
Quality
Uplands of Scotland. The National Grid Reference of the site is NT 32356026 and the
station is located at an altitude of 242 m. Long-term average annual rainfall for the site
is 1567mm. Eight different types of tipping bucket rain gauge were tested by
comparison against a control gauge (meteorological office 5″ gauge read daily) at a
vertical height of 12″. To allow greater experimental robustness, three of each gauge
type were deployed, making a total of 24 TBR gauges at the test site. Supplementary
control data were obtained from 2 extra meteorological office 5″ gauges ; one pit
mounted and one behind a turf wall.
Under the conditions encountered at the study site it was found that a TBR caught at
least 5% rainfall less than a standard meteorological office 5" gauge and that under
reading could be has large as ca. 20% with the worst performing gauges. Under the
conditions encountered at the study site considerable differences in rainfall catch were
observed between different types of TBR. A key finding was that under the conditions
encountered at the study site an aerodynamic gauge achieved the catch that was closest
to a standard meteorological office 5" gauge. No definitive link could be shown
between variations in either temperature or wind speed and the rainfall catch of a
specific gauge although on a qualitative basis the results suggest that there is a seasonal
link, with a 4-5 % reduction in TBR catch (for all gauge types) observed in the winter
months. Due to the low rainfall intensities encountered at the study site implementation
of a correction using dynamic calibration did not significantly increase measured catch
although benefits may well be obtained at other sites.
vi Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
CONTENTS
ACKNOWLEDGEMENTS iv
EXECUTIVE SUMMARY v
LIST OF FIGURES viii
LIST OF TABLES ix
1. INTRODUCTION 1
2. METHODOLOGY 2
2.1 Literature Review 2
2.2 Laboratory testing of gauges 2
2.3 Field testing of TBR gauges 2
3. LITERATURE REVIEW 3
3.1 Objective 3
3.2 Introduction 3
3.3 Tipping Bucket Errors and calibration 3
3.4 Tipping Bucket Raingauge Construction and Use 7
3.5 Tipping Bucket Raingauge data Manipulation and
Comparison of Data sets 7
3.6 Comparison of TBR types 8
3.7 Comparison with other Automatic Systems 9
3.8 Discussion 11
4. LABORATORY STUDIES 13
4.1 Introduction 13
4.2 Detailed Methodology 14
4.3 Results 17
4.4 Discussion 22
4.5 Overview of Calibration Methods 24
4.6 Specific Conclusions arising from laboratory tests 25
REFERENCES 49
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data vii
Quality
LIST OF FIGURES
Figure 4.1: Percentage error in rainfall measurement as a consequence of the
difference between calibration temperature (20°C) and operational temperature due to
changes in density of water.
Figure 4.2: Influence of calibration method on amount of rainfall required for 7500
tips
Figure 4.3: Relationship between % error and rainfall intensity for gauges calibrated
at 10-12 mm hr-1.
Figure 4.4: Change in % error in measurement due drift in calibration with time
(based on simulated rainfall.
Figure 5.3b: Comparison of tipping bucket totals (1 June 2002 to 31 May 3002)
against meteorological office 5" gauge total-block 2
Figure 5.3c: Comparison of tipping bucket totals (1 June 2002 to 31 May 3002)
against meteorological office 5" gauge total-block 3
Figure 5.4a: Percentage of rainfall recorded by pit and turfwall gauges – all year
Figure 5.4b: Percentage of rainfall recorded by pit and turfwall gauges – non winter
Figure 5.4c: Percentage of rainfall recorded by pit and turfwall gauges – winter only
Figure 5.5: Relationships between relative catch (%) and average wind speed when
raining
viii Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
LIST OF TABLES
Table 4.1: Summary of temperature testing based on all 3 blocks
Table 5.2: Overall catches (June, 2002 to May, 2003 inclusive) from manually read
gauges
Table 5.5: Mean catch for each gauge type expressed as a proportion of the pit/turf
wall gauges
Table 5.6a: Duncans test – Probabilities for Post Hoc tests - whole season
Table 5.6b: Duncans test – Probabilities for Post Hoc tests – winter
Table 5.6c: Duncans test – Probabilities for Post Hoc tests – non-winter
Table 5.8: Mean catch for each gauge type expressed as a proportion of the
pit/turf wall gauges
Table 5.9: Relative catches (%) of individual gauges (whole year data)
Table 5.11: Cumulative period (minutes in year) during which intensities were over
10mm hr-1 in any 5 minutes maximum duration possible per year
525600 hours.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data ix
Quality
1 INTRODUCTION
The Environment Agency routinely collects hydrometric data for flood risk prediction,
flood warning and water resource planning activities. As part of this work they have
identified discrepancies between the records obtained from tipping bucket raingauges
(TBRs) and conventional storage gauges. The problem that has been identified, namely
under-recording by TBRs, has particular implications for work relating to water
resources since, whilst the error may be relatively small on any one event, the
significance may increase as rainfall totals are accumulated over longer periods.
Work is needed to determine whether the discrepancy between the two systems is
systematic and can be linked to specific factors, or occurs randomly. If the error is
systematic, and is linked to some specific variable, data correction may be possible.
The environmental factors that are likely to be most critical are rainfall intensity, wind
speed and raindrop size although temperature may also play a part. Raingauges supplied
by different manufacturers may perform differently and performance may also change
with time, depending for example, on the robustness of the equipment and the
environmental conditions under which it is used. Calibration of gauges is thus also a
key issue relating to data quality. Variation between different types of dataloggers used
to collect and store the data is considered less likely to be a contributing factor, given
reliable supporting programming. However, detection of false signals due to inductive
effects in the cable connecting the gauges to the logger can occur. For example,
spurious rainfall data have been detected which were traced to the effect of an electric
cattle fence running parallel to the data collection cable.
1 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
2 METHODOLOGY
This section describes the overall approach used in each of the sections, however, the
detailed methodologies pertaining to individual tests will be found in the specific
chapters relating to this topic area
The objective of the review was to provide a synopsis of the most recent International
publications addressing TBR deployment, data quality, calibration methodology and
measurement errors. The approach used was to evaluate all publications with relevant
keywords cited on the Key databases DIALOG, CAB etc and thus identify all relevant
references published within the last twenty years. All known UK manufacturers of
meteorological equipment were contacted and asked to contribute any relevant in-house
publications to the review. The review also made use of available information from
International standards pertaining to the use of raingauges. Data was also sourced
relating to comparative trials of raingauges undertaken by the UK Meteorological
office, for which purpose a member of its staff was retained as a project consultant.
Eight different patterns of TBR were tested covering a wide range of materials, shapes
and cost. The work in this area focussed on a number of specific key issues:
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 2
Quality
3 LITERATURE REVIEW
3.1 Objective
3.2 Introduction
The Tipping Bucket Raingauge (TBR) is widely cited as having been invented as long
ago as the seventeenth century by Sir Christopher Wren (e.g. Biswas 1970). In the
intervening years the TBR has been extensively refined, and is now one of the most
popular recording raingauges in use by many national weather agencies. Although the
basic principle of individual gauge designs are similar, there is no international
standard, and many different models are in use nationally and internationally which may
vary in materials and design. Guidelines for the siting and use of raingauges are
produced by individual national meteorological offices, and also by the World
Meteorological Organisation (WMO). In the UK, in addition to the Meteorological
Office guidelines, there is a British Standard (BS 7843) covering all aspects of
raingauge use. A number of these recommendations/guidelines are incorporated in the
relevant sections of the Environment Agency’s Hydrometric Manual.
The advantages of TBRs are well known, and have been reported extensively. For
instance, Smoot (1971) and Linsley (1973) reported on their high accuracy in recording
low-to-intermediate intensity rainfalls, reliability and suitability for remote recording.
Conversely, researchers have also been aware of potential recording problems for an
equally long period. Problems with under-recording when compared with a storage
gauge are identified in the UK Meteorological Office handbook of meteorological
instruments as early as the 1956 edition. Under-recording during high-intensity rainfall
events was reported by Bruce and Clark (1966), and the use of calibration methods to
remedy this problem by Smoot (1971).
Other possible recording inaccuracies are common to all raingauges, including TBRs,
and include those due to location (aspect and exposure), especially wind effects, which
were extensively reported by Robinson and Rodda (1969).
This report seeks to give an overview of recent (<20 years) published research into the
use of the TBR and alternative automatic gauges, including aspects of data quality and
calibration. The information presented will be applied to the wider review of TBR
laboratory and field performance being undertaken by the Environment Agency.
Reviews of published papers are given in chronological order under each section.
Folland (1988) Reviewed the problem of raingauge exposure (to wind effects) and
developed a quantitative theory of raingauge exposure. He considered wind flow over
3 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
the orifice of a standard 5 inch raingauge using wind tunnel data published by Robinson
and Rodda (1969) and Helliwell and Green (1974). The resulting model was integrated
for a range of raindrop sizes and frequency distributions after Ulbrich (1983) to give a
range of curves describing the percentage of rainfall lost at given wind speeds and
rainfall characteristics. The calculated results compared well to observed losses under
UK conditions, using ground level gauges as a reference. He also suggested a new
design of raingauge (“flat champagne glass gauge”) which aimed to substantially lower
the systematic losses of rainfall volume in the high winds commonly found over
exposed areas of land.
BS 7843 2.1 (1996) Identifies over-exposure (to wind) as the most important factor
contributing to loss of catch by all raingauges. As the wind speed is known to increase
with height above the ground surface, the recommended method of reducing wind
effects is by mounting the raingauge in a pit with the collecting rim at ground surface.
This method can increase rainfall catch at lowland sites by 3% to 6%, and at windy
upland sites by up to 20% compared to a standard above-ground gauge. Other suggested
methods of reducing errors due to exposure include the construction of a turf wall round
the gauge to the height of the collection rim, at a distance of five times the gauge height.
The use of wind breaks, or the use of natural hollows are also considered acceptable,
although objects with an angle of elevation over 26.5° from a gauge location will lead to
over-sheltering, and reduced rainfall catch.
Seibert et al. (1999) Sought to reduce systematic errors due to aerodynamic effects and
wetting losses known to bias point measurements of precipitation. In the NOPEX
project a rain gauge with a new type of windshield and a special weighing construction
was used to minimize these errors. The windshield consisted of a flange surrounding the
gauge at the level of the orifice. The idea was to screen the area above the orifice from
the disturbance of the wind field by the gauge. At different locations the measured
precipitation amounts were compared with the amounts caught by standard gauges. The
analysis showed that the catch of the new gauge was higher than that of the standard
gauges. A difference of about 3% was related to reduced wind-induced losses, while a
difference of about 0.25 mm per event was explained as elimination of wetting loss. At
one location the differences were related to wind speed and rainfall intensity to evaluate
the effect of the windshield. The relative differences were largest (20%) for events with
low intensity and high wind speed.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 4
Quality
3.3.2 Solid precipitation
Goodison and Louie (1985) Describe the use of a snowgauge to measure the water
equivalent of snowfall in Canada, where one third of the mean precipitation for the
country occurs as snow. The Canadian Nipher shielded snowgauge gave an average
catch within 10% of the ground true (determined using snow boards) at wind speeds of
up to 5.5 ms-1.
WMO (1994) and BS 7843 2.1 (1996) Both identify that raingauge exposure errors are
magnified when measuring snowfall, where an error in the range 10-50% of actual
deposition can be expected. Sources of error include “Blow out” in low temperatures
where small snow particles are sucked out of the collector by wind eddies above the
collector. “Blow in” when drifting of snow occurs, and burial in major snow events.
Problems other than exposure effects include “arching” when snow adheres to the
funnel rim and bridges the gauge orifice when temperatures are close to melting. And
“over topping” of the gauge. Specialized snow gauges designed to melt snow in the
collector are much more effective, although are rarely used in the UK.
Adami and Da Deppo (1986) Investigated systematic errors associated with TBRs. The
research focused on the accuracy of the tools used for operational use by the National
Hydrological Service of the Italian Ministry of Works. Positive errors (to 2-3%) were
shown at intensities lower than the calibration standard of 60 mm/hr and negative errors
(to 7%) were seen at higher intensities. Non-negligible sources of error, other than those
referring to external effects of wind, splashing, wetting, evaporation and blowing snow,
are singled out, e.g., horizontal misalignments or poor upkeep. A new type of weight
pluviograph (raingauge) aimed at overriding the mentioned shortcomings was
conceived and developed. A brief description of the structure of the instrument was
given, including the details of the collecting mouth and the electronic scaling. The
foremost feature of the tool, which can inserted at ease within centralized data
acquisition systems, lies in its high sensitivity in recording very intense precipitation.
Niemczynowicz (1986) Carried out the dynamic calibration of three types of TBR in use
in the Nordic countries (the LTH, PLUMATIC and RIMCO gauges). It was found in all
5 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
gauges tested that the volume of water required to tip the bucket was not a constant
characteristic for the gauge but depended upon rainfall intensity. Thus, to avoid errors, a
calculation of the rainfall intensity or of rainfall volume from tipping bucket
registrations must go through an empirical, usually non-linear calibration function. The
procedure involved in the dynamic calibration of the tipping bucket rain gages is
described. Examples of typical calibration curves are provided. The magnitude of
errors, with regard to measured rainfall intensity, which occur when linear gauge
calibration is used ranged from 2% across the measuring range for the RIMCO gauge
(siphon system delivers constant flow to bucket) to 10% at 5mm min-1 for the
PLUMATIC raingauge.
Hsu Sheng (1990) Tested the rainfall rate error associated with a TBR under various
rainfall intensities. It was found that the rate-error could be as large as a 35%
underestimation of the actual rainfall amount at an upper measurable limit of the gauge,
and close to 8% for less extreme events. However, if a laboratory-based regression
equation was applied to normalize the rate-error on each of 10-minute records, the error
of underestimation could be reduced to as low as 0.8%. Other possible errors were
observed in the laboratory. These were generally small, and difficult to quantify. They
included surface tension effects, and the time taken for the bucket to drain totally. It was
estimated that these effects would amount to no more than 2% of the rate error.
Simic and Maksimovic (1994) Considered the dynamic characteristics of using a siphon
that can be applied to control the movement of rainwater from the collecting funnel of a
raingauge to the compartments of the tipping bucket. Since commercially available
tipping bucket raingauges suffer from non-linearity, a modified siphon was developed.
The dimensions of its elements were designed to meet linearity requirements up to a
certain maximum rainfall intensity. The modified raingauge was shown to achieve
linearity for the chosen range of intensities.
Humphrey et al. (1997) developed an automated method for the dynamic calibration of
TBRs. The system consisted of a programmable pump, datalogger, digital balance, and
computer. Calibration was performed in two steps: 1) pump calibration and 2) rain
gauge calibration. Pump calibration ensures precise control of water flow rates
delivered to the rain gauge funnel; rain gauge calibration ensures precise conversion of
bucket tip times to actual rainfall rates. Calibration of the pump and one rain gauge for
10 selected pump rates typically requires about 8 h. Data files generated during rain
gauge calibration were used to compute rainfall intensities and amounts from a record
of bucket tip times collected in the field. The system was tested using 5 types of
commercial TBRs (15.2-, 20.3-, and 30.5-cm diameters; 0.1-, 0.2-, and 1.0-mm
resolutions) and using 14 TBRs of a single type (20.3-cm diameter; 0.1-mm resolution).
Ten pump rates ranging from 3 to 154 ml min-1 were used to calibrate the TBRs and
represented rainfall rates between 6 and 254mm h-1 depending on the rain gauge
diameter. All pump calibration results were very linear with R2 values greater than
0.99. All rain gauges exhibited large non-linear underestimation errors (between 5%
and 29%) that decreased with increasing rain gauge resolution and increased with
increasing rainfall rate, especially for rates greater than 50mm h-1. Calibration curves of
bucket tip time against the reciprocal of the true pump rate for all rain gauges also were
linear with R2 values of 0.99. Calibration data for the 14 rain gauges of the same type
were very similar. The developed system can calibrate TBRs efficiently, accurately, and
virtually unattended and could be modified for use with other rain gauge designs.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 6
Quality
3.4 Tipping Bucket Raingauge Construction and Use
Cornish and Green (1981) Constructed a TBR from mainly plastic materials more
economically than the equivalent commercially available gauges. Over a two month
trial, 24 h rainfall of 1-69 mm was recorded with an accuracy of 2% when compared to
a storage gauge.
Hughes, Strangeways and Roberts (1993) tested a prototype “champagne glass” and a
production model “cone” gauge. He found that these “aerodynamic” models had the
capacity to improve rainfall catch, and could be exposed well above ground in windy
conditions while still giving reasonable results.
Hanna (1995) Notes that there was to date no international agreement for raingauge
design, only a compromise in the form of the World Meteorological Organisation
(WMO) Interim Reference Precipitation Gauge which was considered to be markedly
different from most national gauge designs. The author suggests that wind turbulence is
likely to statistically outweigh any instrumental errors that may be specific to the TBR,
and that special importance must be attached to more rigorous and quantitative rather
than qualitative site selection. As windshields were considered to be demonstrably of
limited use, a certain amount of natural shielding was suggested to be preferable. Apart
from the wind turbulence problem, reduction of the discrete sampling error of the TBR
was discussed. While there was as yet no absolute standard for rainfall measurement,
there was clearly a need to standardise a suitably effective and practical type of TBR.
The Weighing Tipping Bucket Raingauge (WTBR), a direct-rate measuring instrument,
was believed to offer the greatest future potential once practical versions could be more
widely implemented, while taking care to maintain historical continuity of precipitation
records.
Hellin and Haigh (1998) Reported the performance of a TBR located in southern
Honduras during Hurricane Mitch. The Gauge recorded 698mm in a 41 hour period,
with peak rates approaching 60mm h-1.
Maksimovic, Buzek and Petrovic (1991) Presented a methodology for correcting TBR
data to take account of non-linearity in rainfall catch at differing rainfall intensities.
They also investigated errors due to “double tipping” and bucket volume, and suggested
corrections.
Sevruk (1996) Compares the 6-year mean annual difference in precipitation values as
measured using the Hellmann (storage) gauge and the tipping-bucket recording
precipitation gauge at the same open site at the Airport of Geneva. The tipping-bucket
gauge was shown to record less precipitation by a mean of 14%. The percentage
differences in daily precipitation amounts depended on wind speed and intensity of
precipitation. The non-linear prediction model developed from these data was based on
576 daily values during the period 1980-1985, and showed that there was a threshold
value of precipitation intensity for each interval of wind speed. This threshold value
increases with increasing wind speed. Below the threshold value a sharp increase in
percentage difference exists with decreasing intensity. It was suggested that
7 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
relationships of a similar nature could have a general application for corrections of the
wind-induced error of precipitation measurement or for adjustments of precipitation
values from one gauge type to the other
Yu et al. (1997) Discuss discrete sampling errors when using TBRs to develop
infiltration – time relationships in small catchments. An analytic expression was derived
for sampling errors associated with a constant rainfall intensity or runoff rate. The
analytic results were then generalized to include real precipitation events when both
rainfall intensity and runoff rate are highly variable. The implications on equipment
design and assessment of model performance were considered.
Marsalek (1981) Carried out laboratory calibrations on three TBRs available in Canada.
– The Canadian Atmospheric Environment Service TBR, The Stevens TBR (Leupold
and Stevens Inc) and Texas Electronics model 6118-1. These were calibrated in the
laboratory by adjusting the volume required to tip the bucket and by correcting the
raingauge output readings. In the volumetric calibration, the effects of raingauge
installation, the wetting of buckets, and the surface tension of the liquid used were
considered. To calibrate the raingauge output, the recorded rainfall intensities were
compared to the actual intensities calculated from the rate of inflow to the raingauge
receiver. Recorded intensities were typically smaller than actual ones, in extreme cases
by as much as 10%. This underestimate was explained by the loss of water during the
bucket rotation. Estimates of these losses were made by timing the bucket movement
for various rainfall intensities. The movement of the bucket from rest to the central
position was found to take 0.3 – 0.6 seconds, depending on rainfall intensity. Finally,
the sensitivity of the TBR output to the variations in the basic design parameters of the
raingauge were studied numerically using the analytical expression derived for the
recorded intensity.
Muller and Van Londen (1983) Compared the accuracy of three raingauges in use in the
Netherlands. The Thies raingauge, the electrical Royal Netherlands Meteorological
Institute (KNMI) rain gage, and the standard KNMI rain gage were compared with each
other and with World Meteorological Organisation (WMO) requirements. The Thies
drop counting system did not meet WMO requirements and was worse than the KNMI
rain gages for the measurement of rainfall amounts. The Thies tipping bucket system
results were so strongly dependent on the bucket cleanliness that errors of 5% were
common. The use of such a system was not recommended. The electrical KNMI rain
gage with float did not meet WMO requirements. The KNMI standard is simple, but an
extra calibration is required if this gauge is used for comparative measurements
Met office (2000) The UK Met office carried out a trial to test the performance and long
term reliability of some of the most common TBRs used in the UK. This was carried out
at the Eskdalemuir observatory between January 1998 and June 2000. Gauges from
Casella, Munro, Didcot instruments and Environmental Measurements were compared
with the Met Office MK5 TBR and a standard five inch check gauge; 90 –95% of daily
values produced by the gauges tested were within 10% of the check gauge reading. The
Munro and Didcot gauges had the least scatter, with 80% of daily readings within 5% of
the check gauge value. A possible seasonal variation in the results from the Casella
gauge when compared to the check gauge was identified. It was suggested that this
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 8
Quality
might have been due to the plastic used for the buckets having a different co-efficient of
expansion than that used in the other gauges.
Kreuels and Breuer (1986) Evaluated both a TBR and a drop size disdrometer (device
for the optical detection and measurement of precipitation particles) on days with
different wind speed and gust conditions. Both instruments were operated with a 1-min
time resolution; and were carefully calibrated and system corrected. It was assumed that
differing results would be due to environmental parameters. In the measurements of
heavy storms with 1-min intensities as great as 90 mm/hr, deficits in water amount for
the rain gage were found to be between 0 and 35%. Besides the wind, all other
meteorological parameters were identical for both instruments. The drop size
disdrometer was less susceptible to wind in regard to its installation. The only
explanation for the water deficits was considered to be the influence of wind. To
characterize this influence, it was suggested that the velocity of wind gusts rather than
the mean velocity should be considered. It was suggested that new criteria should be
developed to address the problems identified.]]
Hewston and Sweet (1989) Describe the use of a Weighing Tipping Bucket Raingauge
(WTBR) developed by the Operational Instrumentation Branch of the UK
Meteorological Office. In this device, the tipping bucket mechanism is suspended by a
strain wire between the poles of a magnet. This wire is excited electrically at its
resonate frequency, which is dependent on the tension in the wire due to the mass of the
tipping bucket mechanism. As rain water from the collector enters the bucket, the
tension on the wire increases, and there is a proportional increase in the resonate
frequency of the wire. By measuring this change the rate of rain water accumulation can
be calculated. The sharp change in resonant frequency as the bucket tips is taken into
account in these calculations. The instrument was compared with a standard tilting
siphon gauge on performance requirements for weapons systems trials, where accurate
measurement of rainfall rate is required at a all intensities and at sampling periods as
short as 10 seconds. The WTBR proved to be close to the tilting siphon instrument in
long term accuracy, but was far superior in resolving rainfall intensity down to 10
second increments, allowing accurate determination of rainfall intensity peaks.
Schonhuber, H.E. et. al. (1995) Compared data collected by a 2D video disdrometer and
a standard TBR during winter storms in Austria. In an event of 20mm rainfall, in which
intensity was up to 10mm h-1 the disdrometer recorded 7% less than the TBR. However,
the disdrometer was able to resolve light drizzle several hours before the TBR collected
the first bucket of water.
Nystuen et al. (1996) Rainfall data from six different types of automatic rain gauge
systems were collected for a set of summer rain events and for a set of winter rain
events at Miami, Florida. The rain gauge systems included three types of collection
gauges: weighing, capacitance, and tipping bucket; two gauges that inherently measure
rainfall rate: optical scintillation and underwater acoustical inversion; and one gauge
that detects individual raindrops: the disdrometer. All of these measurement techniques
produced rainfall estimates that were highly correlated to one another. However, each
method had limitations. The collection gauges were affected by flow irregularities
between the catchment basin and the measurement chambers. This affects the accuracy
9 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
of rainfall-rate measurements from these instruments, especially at low rainfall rates. In
the case of the capacitance gauge, errors in 1-min rainfall rates could exceed 10mm/h.
The rainfall rate gauges showed more scatter than the collection gauges for rainfall rates
over 5mm/h, and the scatter was relatively independent of rainfall rate. Changes in drop
size distribution within an event could not be used to explain the scatter observed in the
optical rain gauge data. The acoustical inversion method can be used to measure the
drop size distribution, allowing rainfall classification and estimation of other rain
parameters--for example, reflectivity or liquid water content--in addition to rainfall rate.
The acoustical inversion method had the advantage of an extremely large catchment
area, resulting in very high time resolution. The disdrometer showed a large scatter
relative to the other rain gauge systems for low rainfall rates. This was consistent with
the small catchment area for the disdrometer system.
Grossklaus et al. (1997) described a new optical disdrometer optimized for use in high
wind speed. The minimal detectable size of droplets is 0.35 mm. Each drop is measured
separately with regard to its size and residence time within the sensitive volume. From
the available information, the drop size distribution can be calculated with a resolution
of 0.05mm in diameter either by evaluation of the residence time of drops or by drop
counting knowing the local wind. Rain rates can be determined from the droplet spectra
by assuming terminal fall velocity of the drops according to their size. Long-term
simultaneous measurements of the disdrometer and a conventional rain gauge have been
used to validate this procedure.
Nystuen (1999) Evaluated six different types of automatic rain gauges, including tipping
bucket, weighing, capacitance, optical, disdrometer, and acoustical sensors.
These were deployed for 17 months (September 1993-January 1995) at the Atlantic
Oceanographic and Meteorological Laboratory in Miami, Florida. Different rainfall
conditions encountered during the experiment ranged from winter frontal rainfall to a
tropical storm (Tropical Storm Gordon). Overall, all of the rain gauges performed well,
with inter-correlation’s of the order 0.9 or better using 1-min rainfall rates and biases of
less than 10%; however, each showed limitations under different rainfall situations. In
particular, under extremely heavy rainfall rates (over 100 mm/h), the disdrometer and
tipping bucket rain gauges biased low, while the optical rain gauge biased high. Under
light rainfall rates (under 2 mm/h), the capacitance and tipping bucket rain gauges
showed significant instrument noise using a 1-min sampling interval. The optical gauge
was sensitive to the relative proportion of small to large raindrops within the rain. The
raindrop distribution parameter N0, the coefficient of the exponential fit to the drop size
distribution, could be used to predict the optical gauge bias. When N0 is large (relatively
more small drops), the optical gauge biases high, and when N0 is small (relatively more
large drops), the optical gauge biases low. The acoustic rain measurement showed
significant variability when compared to the other gauges. The acoustic measurement is
very sensitive to the presence of very large raindrops (over 3.5mm diameter) as these
raindrops are extraordinarily loud underwater and prevent the smaller drop size
populations from being heard and accurately counted when they are present. While the
range of wind speeds encountered during the experiment was limited, wind did affect
the performance of several of the gauges. At higher wind speeds (over 5ms-1), the
disdrometer and acoustic rain gauges biased low and the instrument noise of the
capacitance gauge increased significantly.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 10
Quality
3.8 Discussion
There is general agreement among the authors of the papers reviewed that one of the
most important factors affecting raingauge performance is exposure to wind. This effect
increases with height above the ground surface, such that a gauge installed at 305mm
above the ground surface may have a reduced catch of between 3% (lowland site and
20% (upland site) compared to a gauge installed at ground level (BS 7843 1996). This
factor may give rise to differences in catch between TBRs and check gauges when there
is a relative difference in height between them. The British Standard, Met Office and
WMO all suggest recommended methods of siting gauges to reduce exposure. These
involve reducing or modifying wind flow over the collector by either locating at ground
level (“pit gauge”), or constructing an earth (turf) bank to smooth wind flow. The
relationship between exposure error (reduction in rainfall catch) and observed
conditions is complex, although several researchers have developed models to describe
the process (Robinson and Rodda 1969, Folland 1988). Recommended solutions for
data correction are also given by the WMO. Design factors may reduce the effect of
exposure, with evidence from several researchers (Folland 1988, Hughes et al. 1993)
that “aerodynamic” gauges are measurably better than standard shapes. Commercially
available raingauges have been produced (e.g. Environmental Measurements Ltd) using
these designs.
A number of factors specific to the TBR have been identified. These include errors in
recording caused by evaporation from the bucket, time of tipping and “bouncing” of the
bucket. All of these parameters are likely to produce only small errors, and many can be
reduced in a well-designed gauge. The most important effect identified in many of the
reports reviewed relates to the relationship between TBR calibration error and rainfall
rate. This is most marked during heavy rainfall, when water flowing in to the buckets
while they are tipping can represent an error of up to 10 – 30% compared to a co-
located storage gauge (BS 7843 1996 and others). The nature of this rainfall/rate error
relationship has been described as non-linear (Calder and Kidd 1978, Humphrey et al.
1997), but in the British Standard is described as linear between 0 and 100mm/hour.
The solution to this problem favoured by some national meteorological services (UK
Met Office, Canadian Atmospheric Environment Service), has been to apply a
correction factor derived from the ratio of mean daily TBR readings compared to check
gauge readings. This approach relies on the availability of a daily read check gauge, and
would not suitable for correcting event based sampling where accuracy within small
time steps is required. The alternative, outlined by a number of researchers (e.g. -
Calder and Kidd 1978, Niemczynowicz 1986, Humphrey et al. 1997), is to carry out a
dynamic calibration of the TBR in order to quantify the error over a range of rainfall
intensities. A number of the papers reviewed suggested numerical methods describing
this relationship.
Alternative automatic systems reviewed include developments of the TBR such as the
weighing TBR (Hewston and Sweet 1989). This instrument has the potential to achieve
a much higher resolution than the standard TBR, although retains the possible
inaccuracies associated with the tipping mechanism. Cost may preclude its use in
extensive networks, as commercial models are three times as expensive as standard
TBRs (C Addis 2001, personal communication). Optical/video measurement of
precipitation using a disdrometer to measure and evaluate individual particles has been
developed in the last 20 years, often in conjunction with weather radar systems (to
11 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
provide “ground truth” information). Several researchers have shown good correlation
between these systems and direct measuring raingauges including TBRs (e.g.
Schonhuber, H.E. et al. 1995 Nystuen 1999). Disdrometers have the added advantage of
detecting and differentiating the nature of precipitation (rain, snow, hail etc) as well as
its quantity, and can operate in all wind conditions. At present disdrometers are used as
tools for investigating the nature of precipitation, and are usually close to the necessary
data processing facilities.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 12
Quality
4 LABORATORY STUDIES
4.1 Introduction
The Environment Agency routinely collects hydrometric data for flood risk prediction,
flood warning and water resource planning activities. As part of this work they have
identified discrepancies between the records obtained from tipping bucket raingauges
(TBRs) and conventional storage gauges. The problem that has been identified, namely
under-recording by TBRs, has particular implications for work relating to water
resources since, whilst the error may be relatively small on any one event, the
significance may increase as rainfall totals are accumulated over longer periods. The
Agency standard gauge has a calibration coefficient of 0.2 mm per tips as standard (i.e.
1 tip = 0.2 mm). This bucket 'calibration coefficient' of 0.2 mm is used for each tip over
the whole range of rainfall intensities measured; i.e. they do not apply a dynamic
calibration coefficient. When dynamic calibration is used a range of calibration
coefficients are determined and applied to better reflect the volume of water per tip at
different intensities.
Work was needed to determine whether the discrepancy between the two systems was
systematic and could be linked to specific factors, or occurs randomly. If the error was
systematic, and was linked to some specific variable, such as a deficiency of the
calibration method, data correction may be possible. The factor that was thought to
most likely to be critical to calibration was rainfall intensity, although temperature may
also play a part. It has been reported in the literature (Calder and Kidd, 1978) that
dynamic calibration of TBRs was required to achieve both high resolution and accuracy.
They stated that in general, a non-linear relationship existed between flow rate and the
tipping rate of a tipping-bucket gauge. This difference arose from the fact that it took a
finite but fixed time for the bucket to tip. As a consequence of this, an amount of
rainfall could fall into an already full bucket during the time taken to tip. This amount
increased with the rainfall intensity and as a consequence rainfall is underestimated.
The use of a calibration curve covering a range of intensities has been recommended by
a number of workers, for example, Niemczynowicz (1986). Other methods have also
been proposed to either avoid or correct for this non-linearity, including the use of a
siphon that is incorporated between the receiver and the bucket and is designed to
empty at a constant flow rate into the bucket. However, such solutions, while providing
a better measurement of total rainfall, smooth out the measurement of peak intensity.
13 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
0.2
0.15
% Error in calibration due to expansion of water
0.1
0.05
0
0 5 10 15 20 25 30
-0.05
-0.1
-0.15
-0.2
-0.25
-0.3
Temperature (°C)
(Plot derived from information on changes in water density with temperature reported in
Weast, 1971)
This was undertaken using 24 new rain gauges of 8 different types which are identified
by numbers 1 to 8 to ensure confidentiality.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 14
Quality
Burette Method
The buckets on each gauge were labelled A and B and the volume required to make
both the A and B bucket tip was measured by dripping in water from a 20 ml burette
following the standard procedure (BS 7843 2.1, 1996).
The gauges were set up on a specially designed bench such that the delivery from each
bucket could be collected in a beaker. All the gauges were connected to a NEWLOG
datalogger set to record the number of tips in each 5 minute time interval.
15 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
further measurements were made to provide three values that could be used to produce a
mean calibration coefficient for the gauge.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 16
Quality
Prior to starting the tests each pump/tube combination was run in for minimum of 12
hours. The pumps were controlled by a time switch that stopped the pump after periods
equivalent to 1 year, 2 years and 10 years rainfall so that spot checks on the calibration
of the gauge could be carried out. The number of times each tipping bucket tipped was
recorded on a Newlog datalogger running at a 5 minute time interval. A record was kept
of any breakages that occurred or faults that developed. If any gauge failed to operate,
for a reason that required repair to the gauge itself, rather than from external influences,
then it was deemed to have failed testing and testing of that gauge ceased.
4.3 Results
1600
1525
1500
Rainfall needed to cause 7500 tips
1475
1450
1425
1400
1375
1350
1325
1300
1275
1250
Type 1 Type 2 Type 3 Type 4 Type 5 Type 6 Type 7
Figure 4.2: Relationship of rainfall required for 7500tips and calibration method
17 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
4.3.2 Effect of temperature at time of calibration on calibration coefficient
obtained from constant rate method
The effect of changing temperature (20°C to 4°C and 4°C to 20°C) and movement on
measured calibration coefficients of the gauges are summarized in Table 4.1.
Differences between the calibration coefficient measured at 20°C and that measured at
4°C are small in most cases.
If moving the gauges had no effect, then returning the gauges to their starting
temperature should return the calibration coefficients to their original values; this was
clearly not the case, but in most cases differences due to this factor were small. Despite
the minimal impact of temperature on measured rainfall; the data presented have been
corrected to take account of the changes in the density of water that occur between 20°C
and 4°C. The changes represented here thus represent the impact of changing
temperature on the instruments themselves, or of moving the instruments. Clearly gauge
type 6, stands out as the being the most affected of the gauges. After the gauge type 6,
the next most affected by temperature changes was type 5. It is interesting to note that
the type 6 gauges were constructed entirely of stainless steel and the mechanism of type
5 was predominantly plastic.
Analysis of variance, using a criss cross design, of the combined data obtained from
gauge sets 1 &2 showed that the difference in calibration coefficients that occurred as a
consequence of moving the gauges (initial compared to end) was not statistically
significant (P>0.5). However, the difference due to changes in temperature were (P<
0.05). When the data relating to the type 6 gauges were excluded from the analysis the
difference caused by temperature changes was no longer statistically significant. Thus
although there were clearly differences arising from both factors in the case of all of the
gauges, the variation due to movement falls within the repeatability of measurement of
the calibration coefficient (for the gauges).
Analysis of variance using all three sets of data, each as the blocks, and looking at the
difference between first temperature and second temperature i.e. 20-4°C and 4-20°C
showed that there was a significant gauge-temperature interaction (P=0.022). When the
data from the type 6 gauge were excluded from the analysis, the significance level
remained similar (P=0.017). Examination of the means suggest that this significant
interaction arises from the divergent behaviour of the gauges e.g. type 1 calibration
coefficient goes from 0.196 at 20°C to 0.191 at 4°C, whereas the type 5 goes from 0.193
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 18
Quality
at 20°C to 0.201 at 4°C. This divergence amplifies the gauge interaction causing the
difference to be significant. The actual magnitudes of the changes for the gauges
(+0.005 to -0.008), other than the type 6 are similar to the standard error of difference
(0.004899) and this suggest that these differences are not truly significant. Thus only in
the case of type 6 gauges was calibration significantly influenced by temperature
changes.
19 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
15
0 20 40 60 80 100 120 140 160
10
-5
% Error
-10
-15
-20
-30
Simulated rainfall intensity (mm hr-1)
Figure 4.3: Overall Relationship between % error and rainfall intensity for gauges
calibrated at 10-12 mm hr-1.
On average the drift in the calibration did not result in an error of measurement of more
than +/- 4.5%. Drift was not linear with time and with some gauges the impact on
percentage error of measured rainfall was ca. 3% after only one-year and then
subsequently decreased again from 2-10 years. In the worst individual case (replicate 2
of Gauge 6), the error in measurement increased by nearly 8% in the first year. Some
gauges (type 5 & 7) were particularly resistant to drift. However, as only two gauges of
each type were tested it would be inappropriate to recommend that these gauge types
can be used in the field for longer than the others without calibration
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 20
Quality
5
2 Type 1
Type 2
Type 3
1
Type 4
Type 5
0
Type 6
0 2 4 6 8 10 12
Type 7
-1
Type 8
-2
-3
-4
Simulated years
Figure 4.4: Change in % error in measurement due drift in calibration with time
(based on simulated rainfall)
type 1
The small adjustment nuts were fiddly, making fine adjustment difficult.
type 2
This was provided with 5mm adjustment bolts which were easy to adjust, making it one
of the first gauges to be brought into calibration. However, gauge number 2 was found
to lock up in central position with water pouring either side of the bucket divider. When
the gauges was examined by the supplier’s engineer, following failure under test, it was
found that the reed switch and magnet had been set too closely together during the
manufacturing process.
type 3
Too many adjustment fasteners (three) but a very good bucket design, water empties
completely, due to small wire on the bucket.
type 4
Very easy to adjust but very shallow bucket angle plus a rough texture of the surface
leads to water retention after tip.
21 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
type 5
Easy to adjust, but no locking nuts. Some collection losses due to splashing and had to
be modified to allow calibration.
type 6
This gauge was very difficult to adjust due to poor quality plastic screws that wore very
rapidly. The bucket empties well but when filling, water almost runs over central divide
before tipping, which could present problems if the bucket balance starts to drift during
use.
type 7
This gauge appeared good to adjust at first but it was difficult to get the calibration
exactly right. Responded erratically to adjustment this could be due to asymmetry in
hemispherical stops. Good visual markers on stops aided adjustment. The bucket holds
a lot of water after tipping which could be lost due to evaporation causing small error if
subsequent tip is sometime later.
type 8
This was very easy to adjust, however, in the absence of an instruction manual; the
bucket can be incorrectly inserted, even by technical staff used to setting up TBRs,
causing it to be a long way out of calibration. One of the gauges supplied was found to
have a defective reed switch. The replacement of this was found to be quite difficult.
4.4 Discussion
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 22
Quality
negative calibrate gauges to between 0 and +2% rather than +/- 2%. In this way the
errors would cancel each other out.
The impact on error of measurement was inverse when the gauges were calibrated at
4°C and used at 20°C. Thus an alternative approach to error reduction might be to
calibrate at the most common temperature at which rainfall occurs when deployed in the
field. However, as this temperature would vary spatially and temporally this approach
might prove to complex to implement. Consideration of the range of temperatures
encountered in the UK suggests that 20°C should certainly be the maximum
temperature at which gauges are calibrated if errors are to be minimized.
The impact of this intensity dependence of calibration on rainfall records will vary
according to the frequency with which higher rainfall intensities occur at the location
where a specific gauge is being used. The variability in the data suggests that a large
number of determinations will be required to develop a robust relationship between
intensity and percentage error for a specific type of gauge. However, given the
relatively small number of different gauge types used by the Environment Agency this
should not prove an insurmountable problem. Should a decision be made to adopt error
correction, to offset the affect of the intensity dependence of the calibration, then it is
recommended to undertake a pilot study on a single gauge type. A carefully determined
correction factor could then be used to correct the data to take account of intensity
effects. This test should be possible on one of the datasets where the agency have
identified a discrepancy between the check gauge and tipping bucket totals.
An alternative solution to the problem could be to use TBRs with buckets with a larger
volume per tip, for example 0.5 mm. This would decrease the tipping rate and hence
reduce the error. However, adopting this solution would tend to increase evaporation
losses during summer due to the increased residence time in the bucket following small
amounts of precipitation.
23 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
4.4.3 Long-term reliability tests
The fact that the long-term reliability tests produced no failures suggests that it is
corrosion in the outdoor environment that is the key cause of failure rather than just
repeated tipping. However, the tests have provided useful data supporting the need for
regular calibration of tipping bucket raingauges if first class accuracy is to be
maintained. Based on the rate of drift, an annual calibration should be adequate in areas
where rainfall is less than 750 mm per annum. In areas where there is higher rainfall, or
if a high degree of precision were required, then biannual calibration would provide a
better control as in many cases most drift occurred during the first year's simulation.
The gauges where the bucket surface was rough tended to retain more water after the
bucket had tipped than those where it was smooth. The effects of this will be to slightly
increase the volume required at the next depth if sufficient time passes to allow this
small volume of water to evaporate. However, the amounts of water concerned are so
small that the impact of this "increased wetting up error" on the rainfall record will be
minimal.
The continuous rate method has a significant advantage in that it provides an approach
which is closest to the mode of operation of the gauge during rainfall and the calibration
coefficient at least takes account of losses that occur during tip time at the intensity at
which it is calibrated. As a consequence, underestimation of rainfall due to losses
during time it takes the bucket to tip are likely to be greater with gauges which are
calibrated by the burette method. However, it could be argued that the burette methods
would provide a better calibration for very fine low intensity rain than calibration at ca.
10-mm hr-1.
The standard Environment Agency constant rate method is based on filling a calibration
rig with a known volume of water from a volumetric flask and then running the pump,
which supplies water to the gauges, until it is empty as described in the Environment
Agency, Hydrometric Manual. However, using this method, it is difficult to be sure of
the exact amount of water that has been put into the gauge since the residues retained in
the system may be variable. The method used by ADAS in this study (section 3.2)
overcomes this problem by making a direct measurement of the water input which can
be compared against the amount collected from the buckets with confidence.
Neither the burette method nor the constant rate method themselves would be expected
to be particularly affected by temperature changes. In the case of the constant rate
method this is because a direct measurement of the mass of water delivered to the gauge
is made. Any changes in pump delivery rate that might occur due to temperature
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 24
Quality
changes are irrelevant unless the errors become gross and this is unlikely. In the case of
the burette method the burettes themselves are normally calibrated for use at 25 degrees
C. Decreasing temperature will tend to reduce slightly the volume delivered. However,
to some extent this will be balanced by the change in the water density. In any case it is
a quite simple matter to calibrate the mass of water delivered by the burette against
temperature.
The greatest scope for error in the constant rate method is splashing losses between the
buckets and the collection vessels. However, controls can be put in place such that this
is detected and kept within acceptable limits. If larger diameter gauges are tested, such
as the FSS500, it is suggested that a larger volume of water be used for the test to
increase the number of tips counted. However, this will also increase the time taken for
the test, which may have logistical implications. If the same of volume of water is used
with a large diameter gauge as a small one, then the number of tips counted is
significantly reduced. The greater the number of tips counted, the more precise the
estimate of the calibration coefficient is likely to be. If it were feasible to set the gauges
up to run unattended on the calibration rig, then an increase in the volume of water used
would be desirable for all gauges, as this would increase the number of tips counted.
The constant rate method of calibration should provide a calibration coefficient that is
more robust at higher intensities than one measured by the burette method.
Gauges calibrated by the constant rate method will underestimate at higher rainfall
intensities and better precision could be obtained by use of a full dynamic calibration
The calibration coefficient of tipping bucket rain gauges varies with temperature
although in most gauges the change is small
The influence of temperature on the calibration methods is likely to be small and can be
corrected for.
Tipping bucket rain gauges need at least annual calibration and possible biannual in
high rainfall areas.
25 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
5 FIELD TESTING OF GAUGES
5.1 Introduction
The Environment Agency routinely collects hydrometric data for flood risk prediction,
flood warning and water resource planning activities. As part of this work
discrepancies have been identified between the records obtained from tipping bucket
raingauges (TBRs) and conventional storage gauges. The problem that has been
identified, namely under-recording by TBRs, has particular implications for work
relating to water resources since, whilst the error may be relatively small on any one
event, the significance increases as rainfall totals are accumulated over longer periods.
The Agency standard gauge has a calibration coefficient of 0.2 mm per tips as standard
(i.e. 1 tip = 0.2 mm) which is measured at a rainfall rate of ca. 10 mm hr-1. This
measured bucket 'calibration coefficient' of 0.2 mm is used for each tip over the whole
range of rainfall intensities measured; i.e. they do not apply a dynamic calibration
coefficient. When dynamic calibration is used a range of calibration coefficients are
determined and applied to better reflect the volume of water per tip at different
intensities.
Work was needed to determine whether the discrepancy between the two systems was
systematic and could be linked to specific factors, or occurred randomly. If the error
was systematic, and was linked to some specific variable, such as e.g. a deficiency of
the calibration method or rainfall intensity, data correction may be possible.
The factor that was thought to most likely to be critical to calibration was rainfall
intensity, although temperature may also play a part. It has been reported in the
literature (Calder and Kidd, 1978) that dynamic calibration of TBRs was required to
achieve both high resolution and accuracy. They stated that in general, a non-linear
relationship existed between flow rate and the tipping rate of a tipping-bucket gauge.
This difference arose from the fact that it took a finite but fixed time for the bucket to
tip. As a consequence of this, an amount of rainfall could fall into an already full
bucket during the time taken to tip. This amount increased with the rainfall intensity and
as a consequence rainfall is underestimated. The use of a calibration curve covering a
range of intensities has been recommended by a number of workers, for example,
Niemczynowicz (1986). Other methods have also been proposed to either avoid or
correct for this non-linearity, including the use of a siphon that is incorporated between
the receiver and the bucket and is designed to empty at a constant flow rate into the
bucket. However, such solutions, while providing a better measurement of total
rainfall, smooth out the measurement of peak intensity.
The other main factor thought to be likely to influence catch was over-exposure (to
wind). This is identified as the most important factor contributing to loss of catch by all
rain gauges (BS 7843 2.1, 1996). Similarly, the World Meteorological Organisation
(1994) states that the suggested aim when selecting a site for a gauge would be to
choose a location that gives the minimum possible wind speed over the gauge orifice,
without blocking precipitation by surrounding terrain. The impact of exposure to wind
on rain gauge catch has been well documented in the literature e.g. Folland (1988) who
suggested a new design of raingauge (“flat champagne glass gauge”) which aimed to
substantially lower the systematic losses of rainfall volume in the high winds commonly
found over exposed areas of land. Tests of a prototype “champagne glass” and a
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 26
Quality
production model “cone” gauge found that these “aerodynamic” models had the
capacity to improve rainfall catch, and could be exposed well above ground in windy
conditions while still giving reasonable results (Hughes, Strangeways and Roberts,
1993). Therefore, as “champagne glass” tipping bucket rain gauges are commercially
available and the Environment Agency have purchased a number model for use in high
exposure situations there was also a need to understand what impact the use of this type
of gauge may have on the rainfall record. In addition the Agency own a number of
other makes of gauge and needed to identify the key characteristics that make a TBR
function well
Therefore a field trial was established to compare, in the field, the performance of eight
different patterns of TBR against that of a standard meteorological office 5" gauge.
The hillside in the vicinity of the Observatory slopes generally from NW to SE, the
mean height above sea level being 800ft or 244 metres. Cassock Hill, slightly more than
a mile distant to the NW, is (367m) while the benchmark at Davington School, ¼ mile
to SE is 699ft (213m) above MSL. To the East, the ground slopes fairly rapidly to the
valley bottom. The height at the River White Esk, at a point due East of the Observatory
and about mile away being 675ft(208m) above MSL. Beyond the river, Dumfedling
Hill rises to a height of nearly 1200ft (366m) above MSL. Some 4-5 miles away to the
North is a high ridge, the highest point of which is Ettrick Pen (to NNW)
2270FT(700M) above MSL. Rather more than half a mile to the West, the ground rises
to 1040ft (317m) and reaches nearly 1200ft(366m) a further half mile on. To S and SSE,
The Observatory commands a view of the White Esk Valley as far as Hartmanor, 4
miles away. Beyond, the upper slope of Cauldkine Hill, about 10 miles distant, is
visible.
The National Grid Reference of the site is NT 32356026 and the station is located at an
altitude of 242 m. Long-term average annual rainfall for the site is 1567mm.
27 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Image produced from the Ordnance Survey <a href="http://www.ordnancesurvey.co.uk/getamap">Get-a-map</a> service. Image
reproduced with kind permission of <a href="http://www.ordnancesurvey.co.uk/">Ordnance Survey</a> and <a
href="http://www.osni.gov.uk/">Ordnance Survey of Northern Ireland</a>.
Image produced from the Ordnance Survey <a href="http://www.ordnancesurvey.co.uk/getamap">Get-a-map</a> service. Image
reproduced with kind permission of <a href="http://www.ordnancesurvey.co.uk/">Ordnance Survey</a> and <a
href="http://www.osni.gov.uk/">Ordnance Survey of Northern Ireland</a>.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 28
Quality
5.2.2 Experimental Design
Eight different types of tipping bucket rain gauge were tested, which for the purpose of
experimental design were considered as the treatments. These are described as types 1
to 8 for reasons of confidentiality. These were compared against a control gauge
(meteorological office 5″ gauge read daily) at a vertical height of 12″. Supplementary
control data will be obtained from 2 extra meteorological office 5″ gauges, one pit
mounted and one turf wall. The treatments were as follows:
The gauges were laid out in a randomised block design with each of the treatments and
controls replicated three times (Figure 5.2 and Table 5.1)
29 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Old tower –where anemometer located
Upslope
N
19
Fibre
20
optic
cable
21
10 22
23
11
12 24
1 Block 3
Block 1 13 25
2
14 26
3
15 27
4
16
5
17 Block 2
6
18
7
30
8
10m
9
Downslope
Each tipping bucket gauge was mounted on a precast concrete paving slab, which itself
was bedded on a sand and cement mixture to ensure stability. All gauges were installed
following standard Environment Agency procedures and also taking account of any
manufacturer specific instructions. Each block of raingauges was connected to a
separate Newlog datalogger that recorded the exact time when a tip was measured on
each of the gauges.
5.2.3 Measurements
A continuos record was kept, on a NEWLOG datalogger, of each tip recorded on each
raingauge. The rainfall recorded by the standard meteorological office 5″ gauges,
including exposed and those in pit and turf wall installations, was measured at 1400
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 30
Quality
hours each day every day using standard meteorological office procedures. Data
describing wind speed (average and gust) and direction, at hourly intervals were
provided by the close by climate station (a 2m high tower 15m from block 1) operated
by the Meteorological Office. Temperature and relative humidity data were provided
from the measuring facilities some 300m away at the observatory
The performance of the gauges following snowfall was compared using a simple scale
was used to assess the amounts remaining in all the gauges: (0=Clear, Tr=Trace,
S=Slight, M=Moderate, L=Large). A record was also kept of any faults that developed
with individual gauges or specific operational problems encountered
Snowfall
Days with sleet or snow reported
Trial year 21
1911 - 2001 Average 56
Sunshine
Trial year 1290.1 hours
1911 - 2001 Average 1190.2 hours
Mean Temperature
Trial year 7.97°C
1911 - 2001 Average 7.10°C
31 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
The year of the trial period was unremarkable when compared to the past 12 years or so,
with above average temperatures and reduced snow frequency. The most significant
rainfall event was undoubtedly 21st/22nd October, when between 65 and 70mm were
recorded by the check gauges in 24 hours. In all, the period 20th - 27th October
produced about 170mm.
Wind direction was in line with long term averages, being predominantly from the
Southwest. Similarly, wind speeds were very much in line with the past few years, that
is somewhat lower than historically due to the shelter effects of local afforestation.
5.3 Results
Table 5.2: Overal catches (June, 2002 to May, 2003 inclusive) from manually read
gauges
The total rainfall recorded at the observatory was less than the total of 1622 mm
recorded at the turf wall check gauge on the trial site. The figure for the trial site would
have been considerably higher still had it been possible to measure the accumulation of
snow which fell in early February.
To allow a comparison of the raw catch data from the TBRs against total catch by the
check gauges individual totals were calculated for the study period. A total was
produced for each TBR for the days when that specific gauge was operational, a total
was also produced for same time period using the meteorological office 5" gauge
(control gauge) in the same block. The totals derived in this way are presented in
figures 5.3a to 5.3c and an overall summary is presented in table 5.3.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 32
Quality
1600 100%
95%
1200
Rainfall (mm)
90%
800 85%
80%
400
75%
0 70%
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6
Figure 5.3a: Comparison of tipping bucket totals (1 June 2002 to 31 May 3002)
against meteorological office 5" gauge total (block 1).
1600 120%
100%
1200
Rainfall (mm)
80%
800 60%
40%
400
20%
0 0%
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6
Figure 5.3b: Comparison of tipping bucket totals (1 June 2002 to 31 May 3002)
against meteorological office 5" gauge total (block 2).
1600 100%
80%
1200
Rainfall (mm)
60%
800
40%
400
20%
0 0%
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6
33 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
The first, and most striking fact that can be noted from this data is that, on average,
none of the TBRs came within 5% of the check gauge totals. It is also immediately
evident that the best performing gauges were those with an aerodynamic shape.
Detailed consideration of the data presented in the graphs was undertaken by ranking
the gauges in order of performance (table 5.4). This showed that while the type 7 had
consistently the highest catch compared to the controls that there was little to choose
between the type 8 and the type 4 in two out of three blocks. The type 3 always stood
out as having a low catch in all three blocks and the type 6 in two out of three. The close
agreement (<1%) between the Met Office 5" check gauges annual totals in blocks 1,2
and 3 should also be noted.
The relative performance of each of the gauge types (including the meteorological
office 5″) expressed as mean percentage of the rainfall recorded by the pit and turf wall
gauges (based on the subset described above) are presented in table 5.5 for the whole
year, winter (November to March) and non winter periods. The use of data expressed
as a proportion of the pit and turf wall gauges, rather than as a proportion of the control,
had the additional advantage of allowing the impact of aerodynamic effects on the
meteorological office 5" gauge to be quantified and removed this interaction from any
assessment of the TBRs. The catch measured by the type 7 (plastic aerodynamic gauge)
corresponded most closely to that measured by the standard meteorological office
5″gauge in all three cases, followed closely by the type 4 (stainless steel aerodynamic)
and type 8 gauges. The next highest catch (4th in rank order) was consistently recorded
by the type 5 gauge. Fifth and sixth places in rank order were by the type 1 and type 2
gauges when either the whole year or winter data were considered. However in the case
of the non winter data 6th position was occupied by the type 6 gauge, which shared
lowest rank position with the type 3 based on the whole year data and was the worst
performer over the winter period.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 34
Quality
Table 5.5: Mean catch for each gauge type expressed as a proportion of the pit/turf
wall gauges
The mean catch for each gauge and the 95% confidence intervals are presented in
figures 5.4a, to 5.4c. It can be seen from this that the confidence interval around the
mean catch from the meteorological office 5" gauge is much tighter than around any of
the other gauges. Further, the confidence intervals around the means of all different
types of gauges are larger during the winter period, i.e. in winter the agreement between
gauges of the same type is less good.
Dunnett's test showed that the mean catch over the whole period from the
meteorological office 5" gauge was significantly greater than that from the tipping
bucket gauges (type 7 (p<0.05) and all other gauges (p<0.0001). In the non winter
period the catches from all the tipping bucket rain gauges was less than that from the
meteorological office 5" gauge (p<0.0001). In contrast when the winter period only
was considered the catch from the type 7 gauge was not significantly different from the
meteorological office 5" gauge (p>0.05) whereas the catches from all the other tipping
bucket gauges were significantly less (p<0.0001).
Duncan’s test was used to allow comparison between individual gauges as opposed to a
simple comparison of all gauges against a control. The results of this are presented in
Tables 5.6a to 5.6c. This test allows the gauges to be allocated to groups, or
populations, with catches that are significantly different. For example the test shows
that the standard meteorological office 5" gauge and the type 7 gauges both have mean
catches that are statistically different from each other and the rest of the gauges. The
populations to which gauges belong are shown in table 5.7, in which groups or
populations are placed in order of the magnitude of the mean catch.
35 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
% of mean rainfall recorded by pit/turf wall
100
95
90
85
80
75
70
65
60
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6 Met
Office
5"
Figure 5.4a Percentage of rainfall recorded by pit and turfwall gauges – all year
% of mean rainfall recorded by pit/turf wall
100
95
90
85
80
75
70
65
60
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6 Met
Office
Figure 5.4b: Percentage of rainfall recorded by pit and turfwall gauges – 5"
non winter
% of mean rainfall recorded by pit/turf wall
100
95
90
85
80
75
70
65
60
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6 Met
Office
5"
Figure 5.4c: Percentage of rainfall recorded by pit and turfwall gauges –
winter only
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 36
Quality
Table 5.6a: Duncans test – Probabilities for Post Hoc tests - whole season
Gauge type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6 Met. Office 5″
Mean 93.97 89.61 82.54 89.23 83.79 76.52 80.97 76.93 97.12
type 7
type 4 0.000009*
type 1 0.000004* 0.000003*
type 8 0.000011* 0.650119 0.000011*
type 5 0.000003* 0.000011* 0.128894 0.000009*
type 3 0.000005* 0.000004* 0.000003* 0.000004* 0.000004*
type 2 0.000004* 0.000004* 0.056145 0.000003* 0.000884* 0.000011*
type 6 0.000004* 0.000004* 0.000011* 0.000004* 0.000003* 0.61469 0.000010*
Met. Office 0.000139* 0.000011* 0.000004* 0.000003* 0.000004* 0.000001* 0.000004* 0.000005*
5″
Table 5.6b: Duncans test – Probabilities for Post Hoc tests – winter
Gauge type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6 Met. Office 5″
Mean 93.77 87.76 80.94 88.80 82.17 75.41 80.91 70.99 96.42
type 7
type 4 0.000014*
type 1 0.000004* 0.000011*
type 8 0.000107* 0.417353 0.000003*
type 5 0.000003* 0.000020* 0.336903 0.000011*
type 3 0.000004* 0.000004* 0.000032* 0.000004* 0.000003*
type 2 0.000004* 0.000003* 0.981116 0.000004* 0.357351 0.000025*
type 6 0.000005* 0.000004* 0.000003* 0.000004* 0.000004* 0.000558* 0.000011*
Met. Office 0.038016* 0.000003* 0.000004* 0.000011* 0.000004* 0.000005* 0.000004* 0.000001*
5″
Table 5.6c: Duncans test – Probabilities for Post Hoc tests – non-winter
Gauge type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6 Met. Office 5″
Mean 94.17 91.40 84.10 89.64 85.34 77.54 81.03 82.14 97.73
type 7
type 4 0.005504*
type 1 0.000004* 0.000003*
type 8 0.000019* 0.078328 0.000011*
type 5 0.000003* 0.000011* 0.213703 0.000025*
type 3 0.000005* 0.000004* 0.000003* 0.000004* 0.000004*
type 2 0.000004* 0.000004* 0.003059* 0.000004* 0.000034* 0.000473*
type 6 0.000004* 0.000004* 0.049564* 0.000003* 0.001922* 0.000017* 0.269464
Met. Office 0.000363* 0.000011* 0.000004* 0.000003* 0.000004* 0.000001* 0.000005* 0.000004*
5″
37 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Table 5.7: Allocation of gauges to significantly different populations using Duncans
test, in order of decreasing performance
Clearly the type 7 stands out as the gauge that had catch that that was closest to that of
the standard meteorological office 5" gauge, but it caught significantly less (p<0.05).
The type 4 gauges and the type 8 gauges had catches that were not significantly
different whatever period is considered but which have a significantly lower catch again
than the type 7. When the whole year data set is considered group 4 contains type
5/type 1 and group 5 type 1/type 2. This occurs because the confidence intervals around
the means for type 5 and type 1 overlap and type 1 and type 2 overlap but the type 2 and
type 5 do not. In winter there is no significant difference (p>0.05) between the catch of
the type 1, type 2 or type 5 gauges whereas in the non-winter period only the type 5 and
type 1 are indistinguishable (p>0.05). In the non-winter period the catch of the type 2
was not significantly greater than that of the type 6 (p>0.05) forming a group with the
5th lowest catch. However, when considered over the whole year the type 6 and the
type 3 gauges had similar catches (p>0.05) but which were significantly lower than the
type 1/type 2 group (p<0.05). When the winter period was considered separately the
type 6 caught significantly less than the type 3 (p<0.05) with the converse being true in
summer.
Met. Office 5 ″>type 7>type 4&type 8>>type 1,type 5,type 2>>type 3&type 6.
(94.2%) (91-89%) (84-81%) (78-76%)
This shows that during the study period there was a definite seasonal effect on gauge
performance amounting to on average a 4-5% lower reading for winter than summer.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 38
Quality
Table 5.8: Mean catch for each gauge type expressed as a proportion of the pit/turf
wall gauges (Table 5.5 Repeated)
9
Monthly average wind speed (kn)
3
be 02
03
2
3
be 02
03
3
02
02
ob 002
00
ug 200
00
00
nu 200
20
20
20
20
20
em 20
,2
,2
,2
2
t,
il,
,
y,
r,
,
,
r,
r,
ay
ly
ry
ch
er
ne
us
be
pr
ar
Ju
ua
M
Ju
ar
A
em
em
br
M
ct
A
Ja
ov
pt
ec
C
Fe
Se
D
N
39 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
The coefficients obtained from the regression analysis, and the R2 values for the
relationships, are presented in Appendix A for whole year, winter (November to March)
and non-winter periods respectively. All regression equations were of the form:
y = c +mx
where
y is the Proportional catch
x is the meteorological variable in question
m is the slope of the regression line
c is a constant
All the intercept values derived by the regression analysis were significantly greater
than zero (p<0.05), but this is as much a reflection of their magnitude as anything else
and some of the slopes were significantly different from zero. However, and more
crucially, all the R2 values for the relation ships were very small (<0.2) which means
that very little inference can be drawn from the equations as they explain very little of
the variation in the gauge catch.
However, it is interesting to note that when windspeed or gust speed are the dependant
variables and winter or all year data are considered only the regression line for the type
7 has a small positive slope. This indicates that the type 7 gauges are catching the same,
or more rain at various windspeeds whereas the other gauges show a decrease in catch
with increasing windspeed). Patterns within the non-winter data, when there is likely to
be less wind, were less clear. Negative slopes dominated the regression lines between
catch and temperature, i.e. as temperature increased catch tended to decrease. The only
positive slopes being that for the type 4 (nearly flat) and the type 6 which was not only
positive but had the largest magnitude of any of the gauges.
Further regression analyses were undertaken using the difference between mean wind
speed and mean gust speed (a possible index of wind variability) and multiple
regression of wind, gust and temperature were undertaken. These relationships were as
weak, or weaker than, the simple regressions and are therefore not presented.
Summary plots of the regression lines based on all three replicates of each gauge are
presented in figure 5.6 for whole year, winter and non-winter datasets respectively, and
the parameters describing these relationships are available in Appendix A. It can be
seen from these graphs that the gauge which appears to be least influenced by wind
speed is the type 7, with even the meteorological office 5" gauge showing a predicted
decline in catch at higher windspeeds. Interestingly, only the relationship between wind
speed and relative catch for the meteorological office 5" gauge had an intercept, which
was close to 100%. Assuming a linear relationship between catch and windspeed the
intercept should tend to 100% for all gauges at zero wind, if wind is the main influence.
However, whether this difference is real or a function of the considerable variation in
response between replicates is open to question. The considerable variation between
replicates is clearly a major cause of the low % variance accounted for by the overall
relationships derived from the observed data. Additionally, the assumption that the
relationship is linear is possibly not valid.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 40
Quality
Whole year
110
100
Relative catch (%)
90
80
70
60
0 5 10 15 20 25
Average windspeed when raining (kn)
Winter period
110
100
Relative catch (%)
90
80
70
60
0 5 10 15 20 25
Average windspeed when raining (kn)
Non winter period
110
100
Relative catch (%)
90
80
70
60
0 5 10 15 20 25
Average windspeed when raining (kn)
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6
Figure 5.6: Relationships between relative catch (%) and average wind speed
during hours when rainfall is recorded
41 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Consideration of the mean relative catches (whole season for each gauge), presented in
table 5.9, identifies that, for a given gauge, in most cases the catch is higher in Block 1
than Block 2 or Block 3 and similarly Block 2 catch tends to be higher than Block 3.
This raises the issue of whether the exposure, and hence wind speed varies significantly
across the site.
Table 5.9: Relative catches (%) of individual gauges (whole year data)
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 42
Quality
A comparison was also made, using a short period of data when large rainfall occurred,
and intensities reached ca. 15 mm hr-1, between a dynamic calibration based on a 5
minute time step and correction based on the time of tip. The results (figure 5.7) show
that no significant improvement was obtained by the time of tip approach and that the
differences between the TBRs and the manually read gauges were much greater than
any dynamic corrections
100.00
Rainfall between 18 and 24 October, 2002 (mm)
No dynamic correction
95.00
Dynamic correction at 5
minute timestep
Dynamic correction based on
90.00 time of tip
Met Office 5"
80.00
75.00
type 7 type 4 type 1 type 8 type 5 type 3 type 2 type 6
The fact that small only increases in catch were brought about by implementation of the
dynamic calibration were due to the fact that rainfall intensities were only in excess of
the amount (10mm hour) for relatively short periods during the study period (Table
5.11)
Table 5.11: Cumulative period (minutes in year) during which intensities were
over 10mm hr-1 in any 5 minutes maximum duration possible per year
525600 hours.
43 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
presented an excellent opportunity to compare the length of time unmelted snow
remained in the various types of gauges. The results are presented in table 5.12.
Only a limited number of faults were identified during the field test and no failure of
major components such as reed switches occurred. Gauge specific problems identified
are reported below
type 7.
Leveling found to be difficult due to plastic installation screws and lack of an external
bubble. Algal growth was found to occur on buckets and filters tended to need regular
cleaning
type 4
No specific faults reported
type 1
No specific faults reported
type 8
No specific faults reported
type 5
Filter reported to both blow away and retain water at other times.
type 3
Lacquer coating started to come off one bucket by July 02 (deployed in the field Jan.
02)
type 2
Buckets found to lock in central (balanced position)
type 6
No specific faults reported
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 44
Quality
5.4 Discussion
Comparison of the catches from the TBRs with either that of the plain meteorological
office 5" check gauge or the pit/turf wall gauges showed surprisingly large variations
with the TBRs recording consistently less rain fall than the manually read gauges. In the
case of the type 7 and type 4 this contrasts to the findings of (Porter, 2000) who
reported that the catch of the aerodynamic gauges tended to exceed that of the
meteorological office 5" gauge. However, from the standpoint of the other gauges
tested, the data reported by (Porter, 2000) generally supports the finding of this study,
i.e. that TBRs catch less rain. Of the gauges tested by (Porter, 2000) the type 1 gauge
performed particularly poorly being out of agreement with the check gauge by more
than 5% for 36% of the time which is consistent with the findings of this study.
However, in some periods during the summer (Porter, 2000) found that the TBRs
caught more rain than the meteorological office 5" check gauge which is at variance
with the results reported on here. The TBR with the catch closest to the pit/turf wall
gauges or meteorological office 5" check gauge was the type 7 plastic aerodynamic rain
gauge; this tends to suggest an aerodynamic effect as the cause of the differences in
performance. This is supported by the fact that TBR with the next highest catch was the
type 4 also aerodynamic, although its catch was not significantly different from that of
the conventionally shaped type 8 gauge.
A seasonal component to catch performance was observed with performance for all
TBRs observed to be 4 -5 % lower in winter than summer when compared to the turf
and pit gauge controls. The same trend was also observed in the standard Met Office 5”
gauges, with recorded 3 % less in winter then summer when compared to the turf and
pit check gauges. However, it was impossible to identify a statistically significant wind
effect although the slopes of the regression lines suggest that there may be an effect.
The question to answer therefore is why no effect could be demonstrated. It is
suggested that the failure may be due to differences in scale between the measurement
of the wind and what the gauges are exposed too.
Wind velocity was measured at one point (2m) above ground level) whereas each of the
gauges are a slightly different height and at different locations relative to the point at
which the wind speed is measured. A further issue is that, as the predominant wind
comes in to the site it passes across trees, then moorland with say 50cm high vegetation
and cut then grass immediately around the gauges. This raises concerns as to whether
the wind velocity, and turbulence, may change across the site. Expert advice (Lapworth
Pers comm.) suggested that “the change in wind velocity over the whole field is very
sensitive at the height of interest. For instance depending on the actual values of the
upstream and downstream roughness lengths, then at a height of 0.1m the wind speed
might increase by a factor of 2 over the site while at 0.5 metres it might increase by a
factor of 10% over the site.” To determine whether this effect was real or not it would
be necessary implement the actual values of the relevant parameters (i.e. z0 values,
heights of interest, horizontal distances of the rain gauges) into the formula by Panofsky
and Townsend (1964) and obtain the results from the analytic theory. It was considered
that a detailed evaluation of this effect was beyond the brief of the study. However, it
may be that to fully elucidate the interaction between windspeed and catch it may be
necessary to use micro anemometers located close to each gauge and at the same type
8vation to ensure that the measured wind speed is the same as that seen by the gauge.
45 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Similarly temperature effects could not be statistically confirmed although interestingly
the regression line between type 6 gauge catch an ambient temperature had the greatest
slope. The type 6 gauge was identified in the laboratory-testing phase (Hodgkinson,
2002) as being the gauge most influenced by changes in temperature.
The use of a dynamic calibration approach was not found to increase rainfall catch
greatly at this site. However, the rainfall intensities encountered were not high enough
to frequently trigger the need for dynamic correction, rather it rained steadily for long
periods. The low intensity of rainfall that occurred may in itself be a key to the low
catches measured by the TBRs as low intensities tend to be associated with small drop
sizes which will be more easily deflected by wind or turbulence. However, this does
not explain why the TBRs are more affected than the standard meteorological office 5″
gauges. The difference in gauge performance may simple be a consequence of the
height to width ratio of the respective gauges, with the meteorological office 5″
representing less resistance to the wind than the other gauges and hence causing less
turbulence and thus achieving a greater catch. The noise in the data, and other issues
such as the possibility of changes in wind velocity across the site makes further
evaluation of the effects inappropriate.
That the dynamic calibration did not adequately transform the TBR total to that of the
manual gauge presents a problem as it did not explain the TBR under-read. Impacts of
TBR gauge accuracy, if uncorrected for, will have an impact on the rainfall record as a
record. For example in terms of climate change trend analysis, a 4-5 % step change in
rainfall measurement accuracy will have a considerable impact on a temporal rainfall
analysis of rainfall records.
To overcome this, the following solution is proposed. Every TBR gauge should have a
standard Met Office 5" gauge read on a monthly (or of a different frequency depending
upon rainfall quantities) basis as part of the standard site configuration. For the
equivalent time period, the TBR record should be corrected to match that of the
manually read check gauge. This transformation will be simple and linear, which has
the benefits of being easy to apply. This is approach is supported by the fact that a
dynamic calibration based on rainfall intensity did not make a significant difference to
the record. Correcting the TBR data in this way will minimize the impact on the long
term record of different TBR gauge type characteristics, will ensure BS and Met Office
good practice standards, and can be applied to existing historic TBR records also.
Only the type 2 gauge was found to have serious problems in that it locked in the
balanced position with water passing into both buckets. This problem also occurred in
the laboratory tests (Hodgkinson, 2002) although it was remedied by a visit from a type
2 engineer. This suggest that extra care will need to be taken when setting up these
gauges. This problem was not reported by (Porter, 2000) who also tested the type 2
gauge and found it to be particularly reliable; this suggests that the problem may have
arisen due to change in construction that has occurred recently. Other practical issues
that came to light were greater algal growth on the white plastic gauges (type 7) and the
fact that effectively gauge albedo (colour and material) greatly influenced the time the
gauges remained block after snowfall. It may therefore be worth considering gauges that
maximize the gain of energy for the sun when selecting equipment for locations with
high snowfall.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 46
Quality
5.5 Conclusions
Under the conditions encountered at the study site the best performing TBR gauge
caught only 95% of the rainfall recorded by an unsheltered standard Met Office 5"
gauge. The range of rainfall catch recorded by the TBR gauges varied from 77 to 95 %
of the standard unsheltered Met Office 5" gauges.
The unsheltered standard Met Office 5" gauges caught only 96 % of the rainfall
recorded by the standard Met Office 5" gauge in a turf wall configuration. The standard
Met Office 5" gauge in a pit configuration recorded 1.5 % less rainfall than the turf wall
configuration.
Under the conditions encountered at the study site an aerodynamic gauge (ARG 100)
was the best performing TBR gauge with a catch that was closest to the turf and pit
standard Met Office 5" gauge configurations.
Due to the low rainfall intensities encountered at the study site implementation of a
correction using dynamic calibration did not significantly increase measured catch. To
overcome the impact on long term records of TBR gauge accuracy, transformation of
the TBR total by a the total measured by a standard Met Office 5" gauge over a monthly
(or similar) equivalent timebase is recommended.
Further work is required to test the performance of TBRs under a wider range of
climatic conditions.
47 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
6 NEED FOR FURTHER WORK
If the dynamic calibration curves obtained in the laboratory testing phase are to be
applied then these will need to be refined by increased replication using a larger number
of gauges to improve confidence in the relationships.
The results obtained from the field trial are only applicable to the climatic conditions
pertaining to Eskdalemuir. For the results to be applicable the work, or at least
sufficient of it to represent those gauges either used or likely to be used by the Agency,
needs to be repeated at a number of locations to represent cross section of range of
climatic conditions encountered in England and Wales.
To fully understand the interaction between wind speed and gauge catch future work
would need to ensure that the wind profile seen by each gauge is fully captured.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 48
Quality
REFERENCES
Alvey, N., Galwey, N. and Lane, P., 1982. An Introduction to Genstat. Academic
Press, London.
Calder, I. R. and Kidd, C. H. R., 1978. Note on the dynamic calibration of tipping-
bucket gauges. Journal of Hydrology, Amsterdam, 39(3/4): 383-386.
Duncan, D. B. 1955. Multiple range and multiple F tests. Biometrics, Vol 11, Pp1-42.
Goodison, B.E and and Louie, P.Y.T, 1985. Canadian Methods for Precipitation
Measurement and Correction. Workshop on the correction of precipitation
measurements. 1-3 April 1985. Zurich.
Hanna, E. 1995. How effective are tipping bucket rainguages ? a review. Weather. Oct
1995. 50(10): 336-342. Bracknell, England.
Hellin, J. and Haigh, M.J 1998. Rainfall in Honduras during Hurricane Mitch. UK
Department for International Development (DFID) research project.
Helliwell, P.R. and Green,M.J 1974. Raingauge Performance Studies. Final report to the
NERC. Institute of Hydrology. Wallingford.
49 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Hewston, C. M.; Sweet, S. H. 1989. Trials use of a weighing tipping-bucket rain gauge.
Meteorological Magazine, 118:132-134, June 1989 Bracknell, Eng.
Hodgkinson R A, 2000. Evaluation of tipping bucket rain gauge performance and data
quality - Report on laboratory testing as part of Environment Agency Science Project
W6-048
Hughes, C., Strangeways I.C. and Roberts A.M. 1993. Field evaluation of two
aerodynamic raingauges. Weather 48. Pp66-71.
Linsley, R.K.,A manual on collection of hydrologic data for urban drainage design.
Hydrocomp, Inc., Palo Alto, Calif.
Maksimovic, C.; Buzek, L.; Petrovic, J.(1991) Corrections of rainfall data obtained by
tipping bucket rain gauge .Atmospheric Research 27(1-3) 45-53 New York.
Met office 2000. Internal Met Office report on the trial of tipping bucket raingauges
Muller, S.H. and Van Londen, A. 1983. The evaluation of rain gauges illustrated by the
Thies rain gauge and the type 8ctrical raingauge of the Royal Netherlands
Meteorological Institute. Royal Netherlands Meteorological Institute.
Porter M. 2000. Final report on the trial of tipping bucket raingauges carried out at
Eskdalemuir Observatory between January 1998 and June 2000 Meteorological Office
Unpublished Report.
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 50
Quality
Robinson, A.C and Rodda, J.C. 1969. Rain, wind and the aerodynamic characteristics of
rainguages. Meteorological magazine 98. pp 113-120.
Schonhuber, H.E. et. al. 1995. Weather Radar Versus 2D-Vidio-Disdrometer Data.
Proceedings of the III international Symposium on Hydrological Application of
Weather Radars. Aug 20-23 1995. Sao Paulo, Brazil.
Seibert, J. et.al 1999. Reducing systematic errors in rainfall measurements using a new
type of gauge. Agricultural and forest meteorology, 1999,Volume: 98-99 ,341-348 .
Simic, M. and Maksimovic, C. 1994. Effect of the siphon control on the dynamic
characteristics of a tipping bucket raingauge. Hydrological Sciences Journal. 39(1) 35-
36. Oxford, England.
Smoot, G.F.,1971. Data Collection for real time systems. Treatise on urban water
systems. Colorado State University Press, Fort Collins, Colorado.
Ulbrich , C.W. 1983. Natural variations in the analytical form of the raindrop size
distribution. J. Climatol. Appl. Meteorology. 22,1764-1775
Weast, R. C., 1971. Handbook of Chemistry and Physics The Chemical Rubber Co
Ohio,
Yu, B., Ciesiolka, C.A.A., Rose, C.W. and Coughlan, K.J. 1997. Note on sampling
errors in the rainfall and runoff data collected by tipping bucket technology.
Transactions of the American Society of Agricultural Engineers. Vol 40 (5) 1305-1309.
51 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Appendix A
Title Parameters describing regression relationships between relative
rainfall catch and other climatic parameters
Regression analysis based on whole year data
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 52
Quality
Regression analysis based on winter data
Footnote
All intercepts were significantly different from 0 (p<0.0001)
p values refer to whether the slopes of the regression lines significantly different from zero
53 Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data
Quality
Regression analysis based on non-winter data
Footnote
All intercepts were significantly different from 0 (p<0.0001)
p values refer to whether the slopes of the regression lines significantly different from zero
Environment Agency Evaluation of Tipping Bucket Rain Gauge Performance and Data 54
Quality