Testing

Last edited: 26 February 2024

PEP station (closed), 5-25-21 — Solar Cookers International's PEP testing station, *Photo credit: Alan Bigelow*

PEP station (open), 5-25-21 — The PEP testing station inner workings, *Photo credit: Alan Bigelow*

Various methods of testing are available to compare solar cookers. Solar Cookers International responded to requests from cooks, manufacturers, and organizations to create an objective, scientific process to evaluate solar cookers - the Performance Evaluation Process (PEP). PEP is based on the internationally accepted ASAE S580.1 protocol for Testing and Reporting Solar Cooker Performance and included within the International Organization for Standardization (ISO) harmonized laboratory test protocols for clean cookstoves and clean cooking solutions. The testing process is standards-based and replicable. PEP results report the standard cooking power of solar cookers in watts. Consumers and policy makers need to also take into account additional factors relative to their climate, geography, and cultural practices when making buying decisions.

News[]

January 2024: Cooking efficiency calculation published by ELSEVIER - In their Science Direct collection, 'Testing Solar Cookers for Cooking Efficiency' has been published in the recent issue of Solar Energy Advances, Vol. 4, 2024. Established under the direction of Solar Cookers International Program and Science Director, Dr. Alan Bigelow, the Performance Evaluation Process (PEP) is recognized as a valid method for testing the performance of solar cookers. SCI is now proposing that a metric for cooking efficiency be added to standards for measuring solar cooker performance. Other team members responsible for the cooking efficiency calculation are Justin Tabatchnick, who also designed the testing mechanism, and SCI Executive Director, Caitlyn Hughes. View the report.

December 2022: SCI testing advocacy at COP27 - Several Solar Cookers International representatives attended COP27 this past November in Sharm el-Sheikh, Egypt. Part of their agenda focussed on universal testing standards. Alan Bigelow, SCI Science Director, compared ISO and PEP performance standards with techniques explained by Joshi Jyoti, used at the Nepal Bureau of Standards and Metrology (NBSM).

COP27_press_conference_with_the_Nepal_Bureau_of_Standards_and_Metrology_(NBSM)-2 — COP27 press conference with the Nepal Bureau of Standards and Metrology (NBSM)-2

June 2020: PEP Update - On a 19 June 2020 video conference, Solar Cookers International Executive Director, Caitlyn Hughes and Science Director, Alan Bigelow, conducted a basic overview of the different types of solar cookers, explained the various parts of the Performance Evaluation Process (PEP) test station, and the history behind the process. They also shared results and lessons learned from conducting tests on specific solar cookers.

SCI PEP University of Nairobi Kenya 2019

June 2019: Solar Cookers International opens new PEP testing center at the University of Nairobi, Kenya - SCI’s PEP test allows manufacturers and consumers to know the cooking power of solar cookers without brand bias and to develop a baseline for comparison. PEP testing demonstrates to solar cooker users and investors the power, in watts, they can expect from a specific model of solar cooker. SCI PEP results are trustworthy because the PEP test is based on an internationally accepted protocol for testing and reporting solar cooker performance. SCI also has centers in Lalitpur, Nepal; New York, USA; and California, USA. Having global locations for SCI PEP testing centers is important to advancing the adoption of solar cooking worldwide and is an example of SCI’s leadership role within the solar cooking sector. Local testing of solar cookers supports the regional economy, job growth and builds capacity in the sector.

July 2018: ISO standards for laboratory test protocols for solar cookers now published - The International Organization for Standardization (ISO), a worldwide federation of national standards bodies, has published ISO 19867-1:2018: Clean cookstoves and clean cooking solutions -- Harmonized laboratory test protocols -- Part 1: Standard test sequence for emissions and performance, safety and durability. These standard tests can yield product specifications useful to both designers and consumers. These standards will help drive the market for clean cookstoves by motivating manufacturers to produce high-quality cookstoves and by providing expectations to guide consumers in product selection. Tests for solar cookers are included in these standards, where for instance, the ASAE S580.1 protocol for testing and reporting solar cooker performance is the normative reference for the power measurement (in Watts). The Solar Cookers International Performance Evaluation Process (PEP) harmonizes with the published ISO 19867-1:2018 laboratory test protocols. For more information about the importance of the work by technical committee ISO/TC 285, see Improving health with new standards for cleaner cookstoves.

May 2018: Solar Cookers International (SCI) is now offering a service to measure the standardized cooking power of solar cookers (in Watts) at testing centers in Nepal, California, and New York, USA. SCI’s performance evaluation process (PEP) uses a test station that automates the ASAE S580.1 protocol for testing and reporting solar cooker performance. The ASAE S580.1 protocol harmonizes with ISO/TC 285 standardization in the field of clean cookstoves and clean cooking solutions. Test results provide a single measure of thermal performance, so customers may compare different designs when selecting a solar cooker. The standardized-cooking-power specification for solar cookers is akin to the miles-per-gallon (or kilometers-per-liter) specification for automobiles, which helps guide consumer choice. With this testing service now available, SCI is keen to promote and partner with projects using solar cookers that have been tested according to SCI’s PEP. SCI welcomes manufacturers to have their solar cookers tested, even during the design and prototype stages of development to reduce the number of costly redesigns. Please contact SCI at info@solarcookers.org to arrange to have your solar cooker tested. To hear more about SCI’s testing program, listen to an interview with SCI Science Director and Representative at the United Nations Alan Bigelow, Ph.D.

February 2018: Performance Evaluation Process featured in Public Private Alliance Foundation newsletter - Solar Cookers International's Performance Evaluation Process (PEP) was featured in the February 9th, 2018 issue of the Public Private Alliance Foundation (PPAF) newsletter. PPAF states that "the PEP provides public accountability among manufacturers and provides users (individuals, government agencies, etc.) with information they need to select appropriate solar cooking devices. The units are low cost and portable, with open source components. Testing stations have been set up so far in New York, California and Nepal."

October 2017: ISO gathers in Nepal, 30 October - 3 November 2017: The ISO process for clean cookstoves will have its concluding session in Katmandu. Solar cooker manufacturers, particularly in the 29 participating member countries, should connect with your country delegates and share these two points: Solar cookers are Tier 4 cookstoves according to IWA, and solar cookers are an important technology to be included in the ISO/TC 285.
03 August 2017, Thursday, (7pm EDT, 23:00 GMT/UTC): Solar cooker performance evaluation webinar - The International Solar Energy Society, ISES, joins with Solar Cookers International to provide the latest developments from the performance evaluation process (PEP) for solar cookers, to help provide consumers with useful information, and to hold manufacturers to a public accountability standard. Registration information...

Earthboundtech, optical comparative test grapgh, 6-7-17 — *Credit: Earthbound Technology*

June 2017: Reciprocal optical testing - Earthbound Technology conducted their reciprocal optical testing on the Hypar Solar Cooker and Parvati Solar Cooker in April 2017, and used comparative data from a CooKit analysis done in 2014. The Hyper solar cooker reflector utilizes a combination of a conical outer ring with a parabolic inner dish. This allows for more diffuse solar energy directed at the cookpot, while still having some concentration that a parabolic reflector can provide. More information on reciprocal optical testing procedures and results can be found on their website at http://www.earthboundtech.com/optical-test.

Black-body spectrum for Pyrex — Transmission spectrum for Pyrex

April 2017: Testing season begins for the Solar Cookers International PEP testing station - The SCI testing station for the performance evaluation process (PEP) for solar cookers was introduced during the 6th SCI World Conference 2017 held at the Muni Seva Ashram, Gujarat, India. Since then, the PEP testing station returned to the wintry weather of the SCI base in New York, where outdoor temperatures were too cold for testing according to the ASABE S580.1 protocol. With the arrival of spring and warmer temperatures, the PEP testing station is now primed for a testing season. Meanwhile, the SCI PEP team has 1) built a second PEP testing station for its base in California; 2) established a 2-point calibration routine for thermocouple measurements; 3) is finalizing an assembly manual for its testing station, and 4) will soon launch a pilot project to validate the SCI PEP at several locations worldwide. In a preliminary experiment, the SCI PEP testing station measured significant improvement in the CooKit solar cooker performance when the plastic bag glazing was replaced with a clamshell of two 4-quart Pyrex bowls. The transmission spectrum for Pyrex shows that it has high transmission for visible light (it lets sunlight in) and poor transmission for infrared light emitted from a hot black-body irradiator (it blocks heat radiation from a cooking pot from escaping).
January 2017:

Dr._Alan_Bigelow_-_Performance_Evaluation_Process_(PEP)_for_Solar_Cookers

August 2016: Solar cooker performance evaluation process - Dr. Alan Bigelow and will be presenting the Solar Cookers International solar cooker performance evaluation process (PEP) at the 6th SCI World Conference 2017 in Gujarat, India in January 2017.

July 2015: ASABE makes ASAE S580.1 NOV2013 available online for free - Paul Funk reports that ANSI member, The American Society of Agricultural and Biological Engineers, has officially made Standard ASAE S580.1: Testing and Reporting Solar Cooker Performance available online for free for humanitarian reasons.

April 2014: Bernhard Müller describes his latest approach for measuring the aperture openings, or solar collection area, for solar cookers here: Explanations of the Aperture Area - Bernhard Müller

Earthbound Tech cooker test, 5-3-14 — Reciprocal Photo Test for Measuring Solar Cooker Performance, *(Photo: Earthbound Technology)*

April 2014: A photo is used to evaluate solar cooker output William Bradley, founder of Earthbound Technology, has been working on developing a new approach for analyzing the potential performance output for solar panel cooker and parabolic solar cookers. It involves placing a light source into the cookpot and photographing and measuring the reflected light. Read a summary at: Reciprocal Photo Test for Measuring Solar Cooker Performance

March 2014: The global solar cooking sector acquires a delegate to participate in establishing cookstove and clean cooking solutions standards - Paul Funk from the USDA Agricultural Research Service, and former Solar Cookers International Board member, with a strong background in solar thermal cookstove testing, has been approved as a delegate by the International Organization of Standardization(ISO) community. Paul was a delegate to the plenary ISO Technical Committee 285 meeting held in Nairobi, Kenya February 10-14, 2014. He joined wood stove experts from 11 countries and 4 liaison groups (The Global Alliance for Clean Cookstoves, The World LP Gas Association, The World Bank, and UNICEF) for a week of technical meetings to develop standards for testing clean cookstoves. Dr. Funk earned a Ph.D. analyzing solar cookers, and later wrote a test standard for solar cookers (ASAE S-581). He taught mechanical engineering and now is a scientist with the USDA Agricultural Research Service. He states “My goals must be modest. As a delegate representing the USA, I must support the consensus position of the American National Standards Institute, and not my own opinions. I hope, however, to exert some small influence to prevent solar cookers being excluded or rated poorly by the clean cookstove test standard.”

ASABE test standard image, 12-4-13, — Determining the solar intercept area, ASABE S580.1

December 2013: Technical testing standards for solar cookers updated - The American Society of Agricultural and Biological Engineers (ASABE), based in St. Joseph, Michigan, USA, has revised its solar cooker standard. The organization is recognized worldwide for developing voluntary standards for food, agricultural, and biological systems. Often sited in technical reviews, the updated version will replace the current standards established ten years ago. The goal is to promote uniformity and consistency in the terms and units used to describe, test, rate, and evaluate solar cookers, solar cooker components, and solar cooker operation. However, it is outside of the scope of the standards to factor in cost, durability, and user satisfaction. Review the new standards: ASAE information on Testing and Reporting Solar Cooker Performance
November 2012: ASABE (the society for engineering applicable to agricultural, food, and biological systems) is revising the international standard, S580, "Testing and Reporting Solar Cooker Performance." The intent of this standard is to make it possible to test solar cookers with a minimum investment in technology, in any location, while arriving at a value that is repeatable independent of climate, and easily understood. It uses Watts of cooking power to rate box-type, panel-type and concentrating (or parabolic dish-type) solar cookers. The document may be viewed here: http://solarcooking.org/asae_test_std.pdf and comments may be sent to: pfunk@nmsu.edu.
February 2012: Ajay Chandak, a respected and experienced innovator with solar cooking technologies, has provided the following insights to stove testing. It appears one of his greatest concerns is that all stoves, solar and bio-fuel types, be tested with the same procedures and using the same criteria. This will provide relevant information to be able to compare all the various cooking technologies. His comments are below:

I think we need all three tests. During recent training program at our end we included WBT and CCT for solar cookers. My view is that all three tests are required for any cook stove for following reasons.

1. WBT: This test is useful for rating cookstoves in one category: For e.g. if we talk of solar dish cookers then this test compare different dish cookers on their performance, efficiency etc. Same is valid for other cookstoves. We can compare all woodstoves on one to one basis. I think the test needs to be simplified from the current form.

2. CCT: This test provides fuel saving potential of the cookstove with presumption that both the existing cooking option and proposed new cookstoves are operated in the best possible manner. All cookstoves, irrespective of fuel type, renewable or fossil, solar, biogas, biomass, LPG, kerosene will be compared with what so ever the cookstoves we want to replace. So, this test provides comparison amongst different technologies while WBT provides comparison amongst same technology. CCT is utmost important to get solar also introduced as one of the possible options, and it can only be accepted by different committees and bodies if we provide them comparative scale of solar with other technologies. CCT will also form the benchmark for any carbon funding activity for renewable energy project to know what is the carbon emission saving potential of a particular technology.

3. KPT: This is practical version of CCT. In CCT we presume that the existing cooking technology and new proposed technology are used in best possible manner. However, in practice it is not so. Moreover, in CCT fuel/emission saving potential will depend on time of usage by the end user, which we take by estimate. In KPT we are replicating real life situation to find out actual saving potential considering all uncertainties in usage timing, variation in food habits, variation in cooking quantities, variation in cooking practices etc.

For this reason, we need to consider same set of tests for all technologies. There may be additional tests for few technologies, but at least WBT, CCT and KPT should be common to all. Any way WBT and CCT also hardly require any costly equipment, normally a thermometer and weighing machine is adequate for these tests. I feel that all tests should be as simple as possible and sample sizes to be reduced to less than 3% in case of KPT. As CCT establishes the benchmark on how much can be saved, it makes sense to reduce the sample size in KPT.

Relative tests[]

A possible testing scenario:

Heat a liter of water simultaneously in two cookers, one with the modification to be tested and one without. The two cookers to be tested could also be two completely different models.
After a time (before the water boils in either cooker), measure the temperature of the water in both cookers.
Use these measurements to determine how many degrees each cooker raised the temperature of the water.
Calculate the percentage difference between these two temperature changes and report this along with a description of the modification that you tested.

Absolute tests[]

"Stove performance varies greatly, and the performance of a specific stove is often different in the lab and in the field. Testing allows implementers to learn how well stoves perform and to quantify improvements in fuel efficiency and emissions. Test results can be used to guide implementation decisions and to improve stove design and performance. Below is a collection of stove testing resources that may be of interest to PCIA Partners." - PICA (More information...)

Water Boiling Test (WBT)[]

The Water Boiling Test is a laboratory test that evaluates stove performance while completing a standard task (boiling and simmering water) in a controlled environment to investigate the heat transfer and combustion efficiency of the stove. They are the easiest, quickest, and cheapest to conduct, but reveal the technical performance of a stove, not necessarily what it can achieve in real households. WBT testing protocol

Controlled Cooking Test (CCT)[]

The Controlled Cooking Test is a field test that measures stove performance in comparison to traditional cooking methods when a cook prepares a local meal. The CCT is designed to assess stove performance in a controlled setting using local fuels, pots, and practice. It reveals what is possible in households under ideal conditions but not necessarily what is actually achieved by households during daily use. CCT testing protocol

Kitchen Performance Test (KPT)[]

The Kitchen Performance Test is a field test used to evaluate stove performance in field-based settings. It is designed to assess actual impacts on household fuel consumption and the qualitative aspects of stove performance through household surveys. KPTs are typically conducted in the course of an actual dissemination effort with real populations cooking normally, and are designed to demonstrate the differences in consumption of cooking fuels between households using traditional cooking technologies and households using improved stove technologies. Kitchen Performance Test (KPT) - Bob Bailis

SCI Performance Evaluation Process (PEP)[]

Main article: Performance Evaluation Process

In 2016, Solar Cookers International and the International Solar Energy Society began the process of creating a solar cooker testing program called the Performance Evaluation Process (PEP) under the direction of Dr. Alan Bigelow. The project involves establishing a uniform method of testing.

SCI Network of Testing Centers:

Kenya - Nairobi, University of Nairobi
Nepal – Lalitpur, Centre for Rural Technology
USA – Nyack, New York, Solar Cookers International
USA – Pollock Pines (Greater Sacramento area), California. Solar Cookers International

Results[]

Click on the image below to be taken to comparative PEP test results on the Solar Cookers International website. And see all the currently tested cookers with articles on this wiki at PEP tested solar cookers.

SCI PEP documents[]

July 2018: A technical description of the methodology: Performance Evaluation Process (PEP) for Solar Cookers - Dr. Alan Bigelow

January 2017: Development of a Performance Evaluation Process (PEP) for Solar Cookers - Dr. Alan Bigelow

What to test[]

A focus only on speed and highest temperatures eliminates one important feature for some. The intuitive "fastest, hottest is always best" overlooks the benefits of slow, unattended cooking where food never burns, and sun angle adjustments are seldom needed. This is often mentioned as a favorite feature by consumer feedback from solar cooks around the world. A bias against slow, gentle solar cookers that cook like crockpots—ideal for many favored dishes—reduces market access for large populations of women whose daily needs and finances often don't fit with using the "hottest, fastest" devices. Solar cooker designers' reliance on what they THINK is best for women is too seldom confirmed by consumer feedback, which varies widely with region-specific foods, women's daily demands, climate, etc. However, powerful cookers that cook very fast provide a cooking experience much like cooks are used to with traditional stoves. This might make this type of cooker more easily accepted.