Validation and reproducibility of computerised cell-viability analysis of tissue slices
© Jomha et al; licensee BioMed Central Ltd. 2003
Received: 3 December 2002
Accepted: 21 March 2003
Published: 21 March 2003
The identification of live cells using membrane integrity dyes has become a frequently used technique, especially with articular cartilage and chondrocytes in situ where tissue slices are used to assess cell recovery as a function of location. The development of a reproducible computerised method of cell evaluation would eliminate many variables associated with manual counting and significantly reduce the amount of time required to evaluate experimental results.
To validate a custom computerised counting program, intra-person and inter-person cell counts of nine human evaluators (three groups – unskilled, novice, and experienced) were compared with repeated pixel counts of the custom program on 15 digitised images (in triplicate) of chondrocytes in situ stained with fluorescent dyes.
Results indicated increased reproducibility with increased experience within evaluators [Intraclass Correlation Coefficient (ICC) range = 0.67 (unskilled) to 0.99 (experienced)] and between evaluators [ICC = 0.47 (unskilled), 0.85 (novice), 0.93 (experienced)]. The computer program had perfect reproducibility (ICC = 1.0). There was a significant relationship between the average of the experienced evaluators results and the custom program results (ICC = 0.77).
This study demonstrated that increased experience in cell counting resulted in increased reproducibility both within and between human evaluators but confirmed that the computer program was the most reproducible. There was a good correlation between the intact cell recovery determined by the computer program and the experienced human evaluators. The results of this study showed that the computer counting program was a reproducible tool to evaluate intact cell recovery after use of membrane integrity dyes on chondrocytes in situ. This and the significant decrease in the time used to count the cells by the computer program advocate its use in future studies because it has significant advantages.
Keywordscell counting computerised viability assessment chondrocytes reproducibility tissue slices
Assessment of cell recovery in tissues using membrane integrity dyes has become a frequently used technique. This is especially so with articular cartilage and chondrocytes in situ because the embedding of cartilage cells within the complex matrix makes other techniques such as cell culture and metabolite production impractical. However, there is minimal literature that documents the effectiveness or reproducibility of the methods used to count intact cells versus disrupted cells. Such literature is important because the manual counting of cells has the potential for significant variation within/between evaluators, within/between studies and between labs. It is also very time consuming. The development of a reproducible, computerised method of cell evaluation after staining with membrane integrity dyes would eliminate many of the variables associated with manual counting. Importantly, the same program could be used by different labs allowing direct comparison of results between labs. Furthermore, a computerised method could perform the task in a small fraction of the time required by a human, resulting in huge time and cost savings.
Membrane integrity stains such as Syto 13, fluorescein diacetate (FDA) and ethidium bromide (EB) have been used successfully in determining cell integrity in intact articular cartilage [1–6] and have demonstrated the best correlation with long-term survival after transplantation in articular cartilage . Membrane integrity stains aid in evaluating cell viability by inferring that cells with disrupted membranes are dead  while those with intact membranes have at least retained the possibility of being intact and viable. By combining the nuclear binding stains Syto 13 and EB, contrasting colours (green and red, respectively) can be observed for differentiation purposes. Intact cells will allow uptake of Syto 13 and exclude the EB resulting in green fluorescence when viewed under fluorescence microscopy. Conversely, cells with disrupted membranes allow uptake and binding of EB as well as the Syto 13 and these cells will stain red or yellow, enhancing the ability to differentiate between cells with intact and disrupted cell membranes. These stains can be used in situ so that cell recovery as a function of location within the matrix can be determined and neither fixation nor embedding is required to obtain cartilage sections.
Colour differentiation is not always distinct with chondrocytes in situ because of the surrounding cartilage matrix. The matrix may partially absorb the stains making the distinction of cells from the background less well defined. Additionally, minor membrane leakage results in less complete EB uptake producing cells of a lighter red or yellow colour further confusing the distinction between intact and disrupted cells. This subjective aspect of the evaluation created inconsistencies between human evaluators and led to the development of a computer cell-counting program to provide a reproducible determination of the percentage of intact cells versus disrupted cells.
The program design was based on the same principles as colorimetry , which measures light intensity at different wavelengths. Colorimetry is a well-established technique and although this technique does not identify individual cells, it is used widely to determine the relative percentage of involved cells when compared to a control group. Based on these principles, a computer program was designed to provide the percentage of green pixels (Syto 13 stain) versus red pixels (EB stain) after elimination of the background in a digitised image.
A reproducible method of evaluating intact cell recovery is required to adequately evaluate results from experimental procedures with chondrocytes in situ. It was hypothesized that the computer counting program was more reproducible than human cell evaluation because of the variability both within and between humans. This study examined the inter-person and intra-person reproducibility of nine human subjects (divided into three groups) on digitised images of chondrocytes in situ stained with fluorescent dyes and compared the results to the computer assessment of the images.
Fifteen digitised images from previous experiments on pig articular cartilage were collected. Osteochondral dowels of 10 mm diameter had undergone various experimental conditions that included exposure to dimethyl sulfoxide (1 M, 3 M, 6 M) followed by slow cooling (2-stage cryopreservation [10, 11]), or rapid cooling by plunging into liquid nitrogen . After the experimental procedures, 70 μm slices were removed using a Vibratome® (TPI, St. Louis, Missouri) sectioning from the articular surface to the cartilage-bone junction across the widest portion of the dowel. The slices were stained using membrane integrity dyes of ethidium bromide (EB; Sigma, St. Louis, MO) and Syto 13 (Molecular Probes, Eugene, OR) (200 μM EB with 50 μM Syto mixed in PBS). Cells with intact membranes stained green due to the absorption of the Syto stain with the exclusion of the EB stain. Cells with disrupted membranes could not exclude the EB stain and therefore stained red. The slices were viewed using a Leitz fluorescence (440–480 nm) microscope (Leitz, Germany) using a 10X objective and a tube factor of 0.63X. Digital images (800 × 600 pixels) were recorded using a digital camera (Pixera DiRactor, Pixera Corporation, Los Gatos, CA) and stored on computer.
Pixels above the threshold intensity for each colour were designated to be red, green, or black using the following algorithm.
If ((Ired > Thred) and (Ired > Igreen))
then Igreen is set to zero, Iblue is set to zero, and Ired remains
if ((Igreen > Thgreen) and (Igreen > Ired))
then Ired is set to zero, Iblue is set to zero, and Igreenremains
else the pixel is set to black
Fifteen slices were selected with varying proportions of green and red cells. Three copies of each image were made with one being the original image, one a mirror image, and one rotated 180° to make it difficult for each observer to identify the pictures. The 45 images were arranged in random order for assessment. Three groups of three human evaluators were selected. The "unskilled" group consisted of three people (US1, US2, US3) with computer entry experience but no science research or cell counting background. The "novice" group consisted of three people (NV1, NV2, NV3) with less than one year of science research background but no experience counting cells. The expert group consisted of three people (EX1, EX2, EX3) with a greater than one year science research background and some experience counting cells. All evaluators were provided with the same instructions. The total number of green and red cells for each of the 45 images was recorded by clicking the computer cursor on each cell to demarcate it as green or red with the totals recorded by a data collection program.
The computer counting program scanned each of the same 45 images and the percentage of green pixels compared to red pixels was recorded as previously described.
The results were tabulated and statistical analysis was performed including Intraclass Correlation Coefficient (ICC) within (Intra-Rater) human evaluators and between (Inter-Rater) humans and/or computer in addition to 95% confidence intervals using SPSS-10.07 (SPSS Inc, San Rafael, CA).
Intra-Rater ICC for all human evaluators and the computer program. There was increased reproducibility, in general, with increased experience. EX3 demonstrated the highest ICC (0.99) while the computer program was perfectly reproducible (ICC = 1.00).
US1 – unskilled
US2 – unskilled
US3 – unskilled
NV1 – novice
NV2 – novice
NV3 – novice
EX1 – experienced
EX2 – experienced
EX3 – experienced
Inter-Rater ICC within each group and including the computer program. The "ICC with computer program" denotes the ICC when the results from the computer program were included in the results with the human evaluators. The experienced evaluators demonstrated an excellent ICC (0.93) when compared to each other and when the computer program results were included (0.84). The novices also demonstrated a very good correlation (0.85) within their group but there was a further decrease in the ICC when the computer program was included (0.75). The unskilled group had no correlation (0.47 and 0.36).
ICC without computer program
ICC with computer program
ICC with 95% confidence intervals
95% confidence intervals
The ratio of green to red was consistently but not invariably assessed higher by humans than by the computer program. The ICC of the novice and experienced groups were closely correlated with larger 95% confidence intervals in the novice group. The unskilled group had no correlation with the computer program.
The purpose of this study was to validate the use of a custom computer counting program to be used in place of human evaluation of chondrocytes in situ after staining with membrane integrity dyes. The results of this study supported the hypothesis that the computer counting program was the most reproducible method of counting chondrocytes in situ after staining with membrane integrity dyes. As expected, the computer program had perfect reproducibilityin evaluating the three copies of the 15 digitised pictures (ICC = 1.0) while there was always some error with the human evaluators. The best human evaluator (EX3) came close to the computer program's reproducibility (ICC = 0.99) but as experience decreased, the reproducibility decreased (Table 1). In addition, the highest correlation between the three most experienced evaluators was ICC = 0.93, with decreasing correlation between evaluators with less experience (Table 2). Although the results of this experiment showed that experience in science research and cell counting increased reproducibility (higher Intra-Rater ICCs and Inter-Rater ICCs), the computer program was consistently the most reproducible.
Table 3 demonstrates that there was a good correlation between the two methods of cell evaluation (ICC = 0.77) but it was noted that the humans consistently (with occasional exceptions) assessed the ratio of green to red as a higher value than the computer program. This was likely due to the colours at the threshold (yellow), more likely considered green by humans and red by computer pixel intensity determination. The use of membrane integrity dyes is a well-accepted method of preliminary assessment of cell recovery after experimental protocols. Currently, manual counting is the only method of cell evaluation of chondrocytes in situ after membrane integrity staining. The custom computer program demonstrated sufficient correlation with the manual counting of experienced human evaluators to warrant its use in the described situation. It is not possible to determine the accuracy of the computer program because there is no absolute measure of viable chondrocytes in situ for comparison in these images because there are difference sources of errors in the computer and human assessments. This program is an improvement over human evaluators because of inherent inconsistencies noted within and between humans. In addition to being more reproducible than humans, the program is much quicker and significantly increases the amount of time required to evaluate the cells.
Membrane integrity has become a popular method of determining cell viability, especially with articular cartilage [1–6, 12]. This has been supported by evidence of good correlation between a high proportion of cells with membrane integrity and successful outcome after transplantation . The difficulty of using membrane integrity dyes with chondrocytes in situ stems from the absorption of some stain into the background matrix. The necessity of maintaining the background while evaluating chondrocytes in situ can make differentiating colours more difficult and also can provide an optical illusion with respect to the colours seen by different cell counters. The difficulties can be readily appreciated in the Figure 3 images.
Figure 4 shows that after application of the computed algorithm, the differentiation between red and green becomes much more distinct, and visually correlates with the images seen in Figure 3. The selected cutoff at the 85th percentile pixel intensity ensured that variations between absorption of stain into the matrix, minor variations in stain intensity created during mixing, and lighting differences in the microscope were eliminated. The images in Figure 4 demonstrate an advantage of using combined stains. The distribution of the relative amounts of red/green can be visualised and the recovery of cells as a function of location within the matrix can provide valuable information regarding mechanisms of cell injury during cryopreservation. Indeed, characteristic patterns of cell recovery can be consistently found with specific experimental protocols [1, 13]. The computer program provided a consistent and reproducible method of measuring intact cell recovery that can be used to compare results between different experimental techniques and between different labs.
Cost is an important factor in research. Counting of stained cells in one experiment has taken up to 435 hours when performed by a human evaluator . This same cell evaluation can be completed in seconds when using the computer program (to assess the digital images), drastically reducing the cost involved but, more importantly, allowing increased numbers of samples to be evaluated which significantly increases the reproducibility within the experiment .
The use of the computer program does raise some concerns although some of these are the same as for human evaluation. The method described provides the ratio of pixel intensities that are representative of the cellular experimental outcome and not the individual cell count itself. Counting of individual cells is extremely difficult for humans, especially in tissues of high cell density like articular cartilage and these counts are prone to the same errors as automated counting. Cells that stain green are considered alive because their membranes are intact. This results in an upper limit for recovery, because the cells may have sustained lethal injury that has not yet resulted in loss of membrane integrity, one of the final events of cell death [8, 15, 16]. It has been suggested that cells that have some membrane damage, and thus may be permeable to EB, can repair this membrane damage and those cells may survive . Conversely, some cell damage may be due to intracellular events and may not have progressed to membrane disruption by the time the stains are applied . Nevertheless, assessment of membrane integrity is a useful method in situations where the plasma membrane is a likely target for injury.
In conclusion, this experiment provided evidence that a custom computer counting program was more reproducible than human cell evaluators, and was shown to be a valid method for determination of chondrocyte recovery in situ after membrane integrity staining. The computer program can provide a useful method of measuring cell outcomes after experimental procedures on tissues systems, while reducing the time and costs involved. It can also allow comparison of results between labs without considering the variations between human evaluators.
The authors thank Lauren Beaupre for statistical analysis. JAW Elliott holds a Canada Research Chair in Interfacial Thermodynamics. Funding was provided by University of Alberta Hospital Foundation, Edmonton Civic Employees Charitable Assistance Fund, and the Edmonton Orthopaedic Research Society.
- Jomha NM, Anoop PC, Bagnall K, McGann LE: Effects of increasing concentrations of dimethyl sulfoxide during cryopreservation of porcine articular cartilage. Cell Pres Tech. 2002, 1 (2): 111-120. 10.1089/153834402320882610.View ArticleGoogle Scholar
- Muldrew K, Chung M, Novak K, Schachar NS, Zernicke RF, McGann LE, Rattner JB, Matyas JR: Evidence of chondrocyte repopulation in adult ovine articular cartilage following cryoinjury and long-term transplantation. Osteoarthritis Cartilage. 2001, 9 (5): 432-439. 10.1053/joca.2000.0409.View ArticlePubMedGoogle Scholar
- Jomha N: Cryopreservation of human articular cartilage. in Experimental Surgery, Masters Thesis. 1996, University of Alberta: EdmontonGoogle Scholar
- Muldrew K, Hurtig M, Novak K, Schachar N, McGann LE: Localization of freezing injury in articular cartilage. Cryobiology. 1994, 31 (1): 31-38. 10.1006/cryo.1994.1004.View ArticlePubMedGoogle Scholar
- Bujia J, Kremer D, Sudhoff H, Viviente E, Sprekelsen C, Wilmes E: Determination of viability of cryopreserved cartilage grafts. Eur Arch Otorhinolaryngol. 1995, 252 (1): 30-34.View ArticlePubMedGoogle Scholar
- Ohlendorf C, Tomford WW, Mankin HJ: Chondrocyte survival in cryopreserved osteochondral articular cartilage. J Orthop Res. 1996, 14 (3): 413-416.View ArticlePubMedGoogle Scholar
- Schachar NS, Novak K, Hurtig M, Muldrew K, McPherson R, Wohl G, Zernicke RF, McGann LE: Transplantation of cryopreserved osteochondral Dowel allografts for repair of focal articular defects in an ovine model. J Orthop Res. 1999, 17 (6): 909-919.View ArticlePubMedGoogle Scholar
- Malinin TI: Injury of human polymorphonuclear granulocytes frozen in the presence of cryoprotective agents. Cryobiology. 1972, 9 (2): 123-130.View ArticlePubMedGoogle Scholar
- Mosmann T: Rapid colorimetric assay for cellular growth and survival: Application to proliferation and cytotoxicity assays. J Immunol Methods. 1963, 65: 55-63. 10.1016/0022-1759(83)90303-4.View ArticleGoogle Scholar
- McGann LE, Farrant J: Survival of tissue culture cells frozen by a two-step procedure to -196 degrees C. II. Warming rate and concentration of dimethyl sulphoxide. Cryobiology. 1976, 13 (3): 269-273.View ArticlePubMedGoogle Scholar
- McGann LE, Farrant J: Survival of tissue culture cells frozen by a two-step procedure to -196 degrees C. I. Holding temperature and time. Cryobiology. 1976, 13 (3): 261-268.View ArticlePubMedGoogle Scholar
- Muldrew K, Novak K, Studholme C, Wohl G, Zernicke R, Schachar NS, McGann LE: Transplantation of articular cartilage following a step-cooling cryopreservation protocol. Cryobiology. 2001, 43 (3): 260-267. 10.1006/cryo.2001.2349.View ArticlePubMedGoogle Scholar
- Jomha NM, Anoop PC, McGann LE: Chondrocyte recovery in cryopreserved porcine articular cartilage after bone carrier alteration. Cryo Letters. 2002, 23 (4): 263-268.PubMedGoogle Scholar
- Gundersen HJ, Osterby R: Optimizing sampling efficiency of stereological studies in biology: or 'do more less well!'. J Microsc. 1981, 121 (Pt 1): 65-73.View ArticlePubMedGoogle Scholar
- Tavakol K, Miller RG, Bazett-Jones DP, Hwang WS, McGann LE, Schachar NS: Ultrastructural changes of articular cartilage chondrocytes associated with freeze-thawing. J Orthop Res. 1993, 11 (1): 1-9.View ArticlePubMedGoogle Scholar
- Malinin TI, Mnaymneh W, Lo HK, Hinkle DK: Cryopreservation of articular cartilage. Ultrastructural observations and long-term results of experimental distal femoral transplantation. Clin Orthop. 1994, 303: 18-32.PubMedGoogle Scholar
- McGann LE, Yang HY, Walterson M: Manifestations of cell damage after freezing and thawing. Cryobiology. 1988, 25 (3): 178-185.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2474/4/5/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.