### Abstract

The current standard correlation coefficient used in the analysis of microarray data was introduced by M. B. Eisen, P. T. Spellman, P. O. Brown, and D. Botstein [(1998) Proc. Natl. Acad. Sci. USA 95, 14863-14868]. Its formulation is rather arbitrary. We give a mathematically rigorous correlation coefficient of two data vectors based on James-Stein shrinkage estimators. We use the assumptions described by Eisen et al., also using the fact that the data can be treated as transformed into normal distributions. While Eisen et al. use zero as an estimator for the expression vector mean μ, we start with the assumption that for each gene, μ is itself a zero-mean normal random variable [with a priori distribution script N sign (0, τ
^{2})], and use Bayesian analysis to obtain a posteriori distribution of μ in terms of the data. The shrunk estimator for μ differs from the mean of the data vectors and ultimately leads to a statistically robust estimator for correlation coefficients. To evaluate the effectiveness of shrinkage, we conducted in silico experiments and also compared similarity metrics on a biological example by using the data set from Eisen et al. For the latter, we classified genes involved in the regulation of yeast cell-cycle functions by computing clusters based on various definitions of correlation coefficients and contrasting them against clusters based on the activators known in the literature. The estimated false positives and false negatives from this study indicate that using the shrinkage metric improves the accuracy of the analysis.

Original language | English (US) |
---|---|

Pages (from-to) | 9668-9673 |

Number of pages | 6 |

Journal | Proceedings of the National Academy of Sciences of the United States of America |

Volume | 100 |

Issue number | 17 |

DOIs | |

State | Published - Aug 19 2003 |

### Fingerprint

### ASJC Scopus subject areas

- Genetics
- General

### Cite this

*Proceedings of the National Academy of Sciences of the United States of America*,

*100*(17), 9668-9673. https://doi.org/10.1073/pnas.1633770100

**Shrinkage-based similarity metric for cluster analysis of microarray data.** / Cherepinsky, Vera; Feng, Jiawu; Rejali, Marc; Mishra, Bhubaneswar.

Research output: Contribution to journal › Article

*Proceedings of the National Academy of Sciences of the United States of America*, vol. 100, no. 17, pp. 9668-9673. https://doi.org/10.1073/pnas.1633770100

}

TY - JOUR

T1 - Shrinkage-based similarity metric for cluster analysis of microarray data

AU - Cherepinsky, Vera

AU - Feng, Jiawu

AU - Rejali, Marc

AU - Mishra, Bhubaneswar

PY - 2003/8/19

Y1 - 2003/8/19

N2 - The current standard correlation coefficient used in the analysis of microarray data was introduced by M. B. Eisen, P. T. Spellman, P. O. Brown, and D. Botstein [(1998) Proc. Natl. Acad. Sci. USA 95, 14863-14868]. Its formulation is rather arbitrary. We give a mathematically rigorous correlation coefficient of two data vectors based on James-Stein shrinkage estimators. We use the assumptions described by Eisen et al., also using the fact that the data can be treated as transformed into normal distributions. While Eisen et al. use zero as an estimator for the expression vector mean μ, we start with the assumption that for each gene, μ is itself a zero-mean normal random variable [with a priori distribution script N sign (0, τ 2)], and use Bayesian analysis to obtain a posteriori distribution of μ in terms of the data. The shrunk estimator for μ differs from the mean of the data vectors and ultimately leads to a statistically robust estimator for correlation coefficients. To evaluate the effectiveness of shrinkage, we conducted in silico experiments and also compared similarity metrics on a biological example by using the data set from Eisen et al. For the latter, we classified genes involved in the regulation of yeast cell-cycle functions by computing clusters based on various definitions of correlation coefficients and contrasting them against clusters based on the activators known in the literature. The estimated false positives and false negatives from this study indicate that using the shrinkage metric improves the accuracy of the analysis.

AB - The current standard correlation coefficient used in the analysis of microarray data was introduced by M. B. Eisen, P. T. Spellman, P. O. Brown, and D. Botstein [(1998) Proc. Natl. Acad. Sci. USA 95, 14863-14868]. Its formulation is rather arbitrary. We give a mathematically rigorous correlation coefficient of two data vectors based on James-Stein shrinkage estimators. We use the assumptions described by Eisen et al., also using the fact that the data can be treated as transformed into normal distributions. While Eisen et al. use zero as an estimator for the expression vector mean μ, we start with the assumption that for each gene, μ is itself a zero-mean normal random variable [with a priori distribution script N sign (0, τ 2)], and use Bayesian analysis to obtain a posteriori distribution of μ in terms of the data. The shrunk estimator for μ differs from the mean of the data vectors and ultimately leads to a statistically robust estimator for correlation coefficients. To evaluate the effectiveness of shrinkage, we conducted in silico experiments and also compared similarity metrics on a biological example by using the data set from Eisen et al. For the latter, we classified genes involved in the regulation of yeast cell-cycle functions by computing clusters based on various definitions of correlation coefficients and contrasting them against clusters based on the activators known in the literature. The estimated false positives and false negatives from this study indicate that using the shrinkage metric improves the accuracy of the analysis.

UR - http://www.scopus.com/inward/record.url?scp=0043194165&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0043194165&partnerID=8YFLogxK

U2 - 10.1073/pnas.1633770100

DO - 10.1073/pnas.1633770100

M3 - Article

C2 - 12902543

AN - SCOPUS:0043194165

VL - 100

SP - 9668

EP - 9673

JO - Proceedings of the National Academy of Sciences of the United States of America

JF - Proceedings of the National Academy of Sciences of the United States of America

SN - 0027-8424

IS - 17

ER -