Simple low order multivariate GARCH models imply marginal processes with a lot of persistence in the form of high order lags. This is not what we find in many situations however, where parsimonious univariate GARCH(1,1) models for instance describe quite well the conditional volatility of some asset returns. In order to explain this paradox, we show that in the presence of common GARCH factors, parsimonious univariate representations can result from large multivariate models generating the conditional variances and conditional covariances/correlations. The diagonal model without any contagion effects in conditional volatilities gives rise to similar conclusions though. Consequently, after having extracted a block of assets representing some form of parsimony, remains the task of determining if we have a set of independent assets or instead a highly dependent system generated with a few factors. To investigate this issue, we first evaluate a reduced rank regressions approach for squared returns that we extend to cross-returns. Second we investigate a likelihood ratio approach, where under the null the matrix parameters have a reduced rank structure. It emerged that the latter approach has quite good properties enabling us to discriminate between a system with seemingly unrelated assets (e.g. a diagonal model) and a model with few common sources of volatility.