Copula (probability theory)

In probability theory and statistics, a copula is a multivariate cumulative distribution function for which the marginal probability distribution of each variable is uniform on the interval [0, 1]. Copulas are used to describe the dependence between random variables. Their name comes from the Latin for "link" or "tie", similar but unrelated to grammatical copulas in linguistics[citation needed]. Copulas have been used widely in quantitative finance to model and minimize tail risk[1] and portfolio-optimization applications.[2]

Sklar's theorem states that any multivariate joint distribution can be written in terms of univariate marginal distribution functions and a copula which describes the dependence structure between the variables.

Copulas are popular in high-dimensional statistical applications as they allow one to easily model and estimate the distribution of random vectors by estimating marginals and copulae separately. There are many parametric copula families available, which usually have parameters that control the strength of dependence. Some popular parametric copula models are outlined below.

Two-dimensional copulas are known in some other areas of mathematics under the name permutons and doubly-stochastic measures.

Mathematical definitionEdit

Consider a random vector (X_{1},X_{2},\dots ,X_{d}). Suppose its marginals are continuous, i.e. the marginal CDFs {\displaystyle F_{i}(x)=\Pr[X_{i}\leq x]} are continuous functions. By applying the probability integral transform to each component, the random vector

(U_{1},U_{2},\dots ,U_{d})=\left(F_{1}(X_{1}),F_{2}(X_{2}),\dots ,F_{d}(X_{d})\right)

has marginals that are uniformly distributed on the interval [0, 1].

The copula of (X_{1},X_{2},\dots ,X_{d}) is defined as the joint cumulative distribution function of (U_{1},U_{2},\dots ,U_{d}):

{\displaystyle C(u_{1},u_{2},\dots ,u_{d})=\Pr[U_{1}\leq u_{1},U_{2}\leq u_{2},\dots ,U_{d}\leq u_{d}].}

The copula C contains all information on the dependence structure between the components of (X_{1},X_{2},\dots ,X_{d}) whereas the marginal cumulative distribution functions F_{i} contain all information on the marginal distributions of X_{i}.

The reverse of these steps can be used to generate pseudo-random samples from general classes of multivariate probability distributions. That is, given a procedure to generate a sample (U_{1},U_{2},\dots ,U_{d}) from the copula function, the required sample can be constructed as

(X_{1},X_{2},\dots ,X_{d})=\left(F_{1}^{-1}(U_{1}),F_{2}^{-1}(U_{2}),\dots ,F_{d}^{-1}(U_{d})\right).

The inverses F_{i}^{-1} are unproblematic as the F_{i} were assumed to be continuous. Furthermore, the above formula for the copula function can be rewritten as:

{\displaystyle C(u_{1},u_{2},\dots ,u_{d})=\Pr[X_{1}\leq F_{1}^{-1}(u_{1}),X_{2}\leq F_{2}^{-1}(u_{2}),\dots ,X_{d}\leq F_{d}^{-1}(u_{d})].}

DefinitionEdit

In probabilistic terms, C:[0,1]^{d}\rightarrow [0,1] is a d-dimensional copula if C is a joint cumulative distribution function of a d-dimensional random vector on the unit cube [0,1]^{d} with uniform marginals.[3]

In analytic terms, C:[0,1]^{d}\rightarrow [0,1] is a d-dimensional copula if

  • C(u_{1},\dots ,u_{i-1},0,u_{i+1},\dots ,u_{d})=0, the copula is zero if any one of the arguments is zero,
  • C(1,\dots ,1,u,1,\dots ,1)=u, the copula is equal to u if one argument is u and all others 1,
  • C is d-non-decreasing, i.e., for each hyperrectangle B=\prod _{i=1}^{d}[x_{i},y_{i}]\subseteq [0,1]^{d} the C-volume of B is non-negative:
    {\displaystyle \int _{B}\mathrm {d} C(u)=\sum _{\mathbf {z} \in \prod _{i=1}^{d}\{x_{i},y_{i}\}}(-1)^{N(\mathbf {z} )}C(\mathbf {z} )\geq 0,}
where the N(\mathbf {z} )=\#\{k:z_{k}=x_{k}\}.

For instance, in the bivariate case, {\displaystyle C:[0,1]\times [0,1]\rightarrow [0,1]} is a bivariate copula if C(0,u)=C(u,0)=0C(1,u)=C(u,1)=u and C(u_{2},v_{2})-C(u_{2},v_{1})-C(u_{1},v_{2})+C(u_{1},v_{1})\geq 0 for all 0\leq u_{1}\leq u_{2}\leq 1 and 0\leq v_{1}\leq v_{2}\leq 1.

Sklar's theoremEdit

Density and contour plot of a Bivariate Gaussian Distribution
Density and contour plot of two Normal marginals joint with a Gumbel copula

Sklar's theorem, named after Abe Sklar, provides the theoretical foundation for the application of copulas.[4][5] Sklar's theorem states that every multivariate cumulative distribution function

{\displaystyle H(x_{1},\dots ,x_{d})=\Pr[X_{1}\leq x_{1},\dots ,X_{d}\leq x_{d}]}

of a random vector (X_{1},X_{2},\dots ,X_{d}) can be expressed in terms of its marginals {\displaystyle F_{i}(x_{i})=\Pr[X_{i}\leq x_{i}]} and a copula C. Indeed:

{\displaystyle H(x_{1},\dots ,x_{d})=C\left(F_{1}(x_{1}),\dots ,F_{d}(x_{d})\right).}

In case that the multivariate distribution has a density h, and if this is available, it holds further that

{\displaystyle h(x_{1},\dots ,x_{d})=c(F_{1}(x_{1}),\dots ,F_{d}(x_{d}))\cdot f_{1}(x_{1})\cdot \dots \cdot f_{d}(x_{d}),}

where c is the density of the copula.

The theorem also states that, given H, the copula is unique on \operatorname {Ran} (F_{1})\times \cdots \times \operatorname {Ran} (F_{d}), which is the cartesian product of the ranges of the marginal cdf's. This implies that the copula is unique if the marginals F_{i} are continuous.

The converse is also true: given a copula C:[0,1]^{d}\rightarrow [0,1] and marginals F_{i}(x) then C\left(F_{1}(x_{1}),\dots ,F_{d}(x_{d})\right) defines a d-dimensional cumulative distribution function with marginal distributions F_{i}(x).

Stationarity conditionEdit

Copulas mainly work when time series are stationary[6] and continuous.[7] Thus, a very important pre-processing step is to check for the auto-correlationtrend and seasonality within time series.

When time series are auto-correlated, they may generate a non existence dependence between sets of variables and result in incorrect Copula dependence structure.[8]

Fréchet–Hoeffding copula boundsEdit

Graphs of the bivariate Fréchet–Hoeffding copula limits and of the independence copula (in the middle).

The Fréchet–Hoeffding Theorem (after Maurice René Fréchet and Wassily Hoeffding[9]) states that for any Copula C:[0,1]^{d}\rightarrow [0,1] and any (u_{1},\dots ,u_{d})\in [0,1]^{d} the following bounds hold:

W(u_{1},\dots ,u_{d})\leq C(u_{1},\dots ,u_{d})\leq M(u_{1},\dots ,u_{d}).

The function W is called lower Fréchet–Hoeffding bound and is defined as

{\displaystyle W(u_{1},\ldots ,u_{d})=\max \left\{1-d+\sum \limits _{i=1}^{d}{u_{i}},\,0\right\}.}

The function M is called upper Fréchet–Hoeffding bound and is defined as

M(u_{1},\ldots ,u_{d})=\min\{u_{1},\dots ,u_{d}\}.

The upper bound is sharp: M is always a copula, it corresponds to comonotone random variables.

The lower bound is point-wise sharp, in the sense that for fixed u, there is a copula {\tilde {C}} such that {\tilde {C}}(u)=W(u). However, W is a copula only in two dimensions, in which case it corresponds to countermonotonic random variables.

In two dimensions, i.e. the bivariate case, the Fréchet–Hoeffding Theorem states

{\displaystyle \max\{u+v-1,\,0\}\leq C(u,v)\leq \min\{u,v\}}.

Families of copulasEdit

Several families of copulas have been described.

Gaussian copulaEdit

Cumulative and density distribution of Gaussian copula with ρ = 0.4

The Gaussian copula is a distribution over the unit cube [0,1]^{d}. It is constructed from a multivariate normal distribution over \mathbb {R} ^{d} by using the probability integral transform.

For a given correlation matrix {\displaystyle R\in [-1,1]^{d\times d}}, the Gaussian copula with parameter matrix R can be written as

C_{R}^{\text{Gauss}}(u)=\Phi _{R}\left(\Phi ^{-1}(u_{1}),\dots ,\Phi ^{-1}(u_{d})\right),

where \Phi ^{-1} is the inverse cumulative distribution function of a standard normal and \Phi _{R} is the joint cumulative distribution function of a multivariate normal distribution with mean vector zero and covariance matrix equal to the correlation matrix R. While there is no simple analytical formula for the copula function, {\displaystyle C_{R}^{\text{Gauss}}(u)}, it can be upper or lower bounded, and approximated using numerical integration.[10][11] The density can be written as[12]

{\displaystyle c_{R}^{\text{Gauss}}(u)={\frac {1}{\sqrt {\det {R}}}}\exp \left(-{\frac {1}{2}}{\begin{pmatrix}\Phi ^{-1}(u_{1})\\\vdots \\\Phi ^{-1}(u_{d})\end{pmatrix}}^{T}\cdot \left(R^{-1}-I\right)\cdot {\begin{pmatrix}\Phi ^{-1}(u_{1})\\\vdots \\\Phi ^{-1}(u_{d})\end{pmatrix}}\right),}

where \mathbf {I} is the identity matrix.

Archimedean copulasEdit

Archimedean copulas are an associative class of copulas. Most common Archimedean copulas admit an explicit formula, something not possible for instance for the Gaussian copula. In practice, Archimedean copulas are popular because they allow modeling dependence in arbitrarily high dimensions with only one parameter, governing the strength of dependence.

A copula C is called Archimedean if it admits the representation[13]

{\displaystyle C(u_{1},\dots ,u_{d};\theta )=\psi ^{[-1]}\left(\psi (u_{1};\theta )+\cdots +\psi (u_{d};\theta );\theta \right)}

where \psi \!:[0,1]\times \Theta \rightarrow [0,\infty ) is a continuous, strictly decreasing and convex function such that \psi (1;\theta )=0\theta is a parameter within some parameter space \Theta, and \psi is the so-called generator function and \psi ^{[-1]} is its pseudo-inverse defined by

{\displaystyle \psi ^{[-1]}(t;\theta )=\left\{{\begin{array}{ll}\psi ^{-1}(t;\theta )&{\mbox{if }}0\leq t\leq \psi (0;\theta )\\0&{\mbox{if }}\psi (0;\theta )\leq t\leq \infty .\end{array}}\right.}

Moreover, the above formula for C yields a copula for \psi^{-1} if and only if \psi^{-1} is d-monotone on [0,\infty ).[14] That is, if it is d-2 times differentiable and the derivatives satisfy

{\displaystyle (-1)^{k}\psi ^{-1,(k)}(t;\theta )\geq 0}

for all t\geq 0 and k=0,1,\dots ,d-2 and (-1)^{d-2}\psi ^{-1,(d-2)}(t;\theta ) is nonincreasing and convex.

Most important Archimedean copulasEdit

The following tables highlight the most prominent bivariate Archimedean copulas, with their corresponding generator. Not all of them are completely monotone, i.e. d-monotone for all d\in \mathbb {N} or d-monotone for certain \theta \in \Theta only.

Table with the most important Archimedean copulas[13]
Name of copulaBivariate copula \;C_{\theta }(u,v)parameter  
Ali–Mikhail–Haq[15]  {\frac {uv}{1-\theta (1-u)(1-v)}}   
Clayton[16]  \left[\max \left\{u^{-\theta }+v^{-\theta }-1;0\right\}\right]^{-1/\theta }   
Frank  -{\frac {1}{\theta }}\log \!\left[1+{\frac {(\exp(-\theta u)-1)(\exp(-\theta v)-1)}{\exp(-\theta )-1}}\right]       
Gumbel  {\textstyle \exp \!\left[-\left((-\log(u))^{\theta }+(-\log(v))^{\theta }\right)^{1/\theta }\right]}   
Independence  {\textstyle uv} 
Joe  {\textstyle {1-\left[(1-u)^{\theta }+(1-v)^{\theta }-(1-u)^{\theta }(1-v)^{\theta }\right]^{1/\theta }}}     
Table of correspondingly most important generators[13]
namegenerator \,\psi _{\theta }(t)generator inverse  
Ali–Mikhail–Haq[15]   \log \!\left[{\frac {1-\theta (1-t)}{t}}\right]    {\frac {1-\theta }{\exp(t)-\theta }}
Clayton[16]    {\displaystyle {\frac {1}{\theta }}\,(t^{-\theta }-1)}    \left(1+\theta t\right)^{-1/\theta }    
Frank   {\textstyle -\log \!\left({\frac {\exp(-\theta t)-1}{\exp(-\theta )-1}}\right)}    -{\frac {1}{\theta }}\,\log(1+\exp(-t)(\exp(-\theta )-1))    
Gumbel   \left(-\log(t)\right)^{\theta }       \exp \!\left(-t^{1/\theta }\right)
Independence    {\displaystyle -\log(t)}       \exp(-t)
Joe    -\log \!\left(1-(1-t)^{\theta }\right)       1-\left(1-\exp(-t)\right)^{1/\theta }

Expectation for copula models and Monte Carlo integrationEdit

In statistical applications, many problems can be formulated in the following way. One is interested in the expectation of a response function g:\mathbb {R} ^{d}\rightarrow \mathbb {R} applied to some random vector (X_{1},\dots ,X_{d}).[17] If we denote the cdf of this random vector with H, the quantity of interest can thus be written as

{\displaystyle \operatorname {E} \left[g(X_{1},\dots ,X_{d})\right]=\int _{\mathbb {R} ^{d}}g(x_{1},\dots ,x_{d})\,\mathrm {d} H(x_{1},\dots ,x_{d}).}

If H is given by a copula model, i.e.,

H(x_{1},\dots ,x_{d})=C(F_{1}(x_{1}),\dots ,F_{d}(x_{d}))

this expectation can be rewritten as

{\displaystyle \operatorname {E} \left[g(X_{1},\dots ,X_{d})\right]=\int _{[0,1]^{d}}g(F_{1}^{-1}(u_{1}),\dots ,F_{d}^{-1}(u_{d}))\,\mathrm {d} C(u_{1},\dots ,u_{d}).}

In case the copula C is absolutely continuous, i.e. C has a density c, this equation can be written as

{\displaystyle \operatorname {E} \left[g(X_{1},\dots ,X_{d})\right]=\int _{[0,1]^{d}}g(F_{1}^{-1}(u_{1}),\dots ,F_{d}^{-1}(u_{d}))\cdot c(u_{1},\dots ,u_{d})\,du_{1}\cdots \mathrm {d} u_{d},}

and if each marginal distribution has the density f_{i} it holds further that

{\displaystyle \operatorname {E} \left[g(X_{1},\dots ,X_{d})\right]=\int _{\mathbb {R} ^{d}}g(x_{1},\dots x_{d})\cdot c(F_{1}(x_{1}),\dots ,F_{d}(x_{d}))\cdot f_{1}(x_{1})\cdots f_{d}(x_{d})\,\mathrm {d} x_{1}\cdots \mathrm {d} x_{d}.}

If copula and margins are known (or if they have been estimated), this expectation can be approximated through the following Monte Carlo algorithm:

  1. Draw a sample (U_{1}^{k},\dots ,U_{d}^{k})\sim C\;\;(k=1,\dots ,n) of size n from the copula C
  2. By applying the inverse marginal cdf's, produce a sample of (X_{1},\dots ,X_{d}) by setting (X_{1}^{k},\dots ,X_{d}^{k})=(F_{1}^{-1}(U_{1}^{k}),\dots ,F_{d}^{-1}(U_{d}^{k}))\sim H\;\;(k=1,\dots ,n)
  3. Approximate {\displaystyle \operatorname {E} \left[g(X_{1},\dots ,X_{d})\right]} by its empirical value:
{\displaystyle \operatorname {E} \left[g(X_{1},\dots ,X_{d})\right]\approx {\frac {1}{n}}\sum _{k=1}^{n}g(X_{1}^{k},\dots ,X_{d}^{k})}

Empirical copulasEdit

When studying multivariate data, one might want to investigate the underlying copula. Suppose we have observations

(X_{1}^{i},X_{2}^{i},\dots ,X_{d}^{i}),\,i=1,\dots ,n

from a random vector (X_{1},X_{2},\dots ,X_{d}) with continuous margins. The corresponding "true" copula observations would be

(U_{1}^{i},U_{2}^{i},\dots ,U_{d}^{i})=\left(F_{1}(X_{1}^{i}),F_{2}(X_{2}^{i}),\dots ,F_{d}(X_{d}^{i})\right),\,i=1,\dots ,n.

However, the marginal distribution functions F_{i} are usually not known. Therefore, one can construct pseudo copula observations by using the empirical distribution functions

F_{k}^{n}(x)={\frac {1}{n}}\sum _{i=1}^{n}\mathbf {1} (X_{k}^{i}\leq x)

instead. Then, the pseudo copula observations are defined as

({\tilde {U}}_{1}^{i},{\tilde {U}}_{2}^{i},\dots ,{\tilde {U}}_{d}^{i})=\left(F_{1}^{n}(X_{1}^{i}),F_{2}^{n}(X_{2}^{i}),\dots ,F_{d}^{n}(X_{d}^{i})\right),\,i=1,\dots ,n.

The corresponding empirical copula is then defined as

C^{n}(u_{1},\dots ,u_{d})={\frac {1}{n}}\sum _{i=1}^{n}\mathbf {1} \left({\tilde {U}}_{1}^{i}\leq u_{1},\dots ,{\tilde {U}}_{d}^{i}\leq u_{d}\right).

The components of the pseudo copula samples can also be written as {\tilde {U}}_{k}^{i}=R_{k}^{i}/n, where R_{k}^{i} is the rank of the observation X_{k}^{i}:

R_{k}^{i}=\sum _{j=1}^{n}\mathbf {1} (X_{k}^{j}\leq X_{k}^{i})

Therefore, the empirical copula can be seen as the empirical distribution of the rank transformed data.

ApplicationsEdit

Quantitative financeEdit

Examples of bivariate copulæ used in finance.
Examples of bivariate copulæ used in finance.
Typical finance applications:
  • Analyzing systemic risk in financial markets[18]
  • Analyzing and pricing spread options, in particular in fixed income constant maturity swap spread options
  • Analyzing and pricing volatility smile/skew of exotic baskets, e.g. best/worst of
  • Analyzing and pricing volatility smile/skew of less liquid FX[clarification needed] cross, which is effectively a basket: C = S1/S2 or C = S1·S2
  • Value-at-Risk forecasting and portfolio optimization to minimize tail risk for US and international equities[1]
  • Forecasting equities returns for higher-moment portfolio optimization/full-scale optimization[18]
  • Improving the estimates of a portfolio's expected return and variance-covariance matrix for input into sophisticated mean-variance optimization strategies[2]
  • Statistical arbitrage strategies including pairs trading[19]

In quantitative finance copulas are applied to risk management, to portfolio management and optimization, and to derivatives pricing.

For the former, copulas are used to perform stress-tests and robustness checks that are especially important during "downside/crisis/panic regimes" where extreme downside events may occur (e.g., the global financial crisis of 2007–2008). The formula was also adapted for financial markets and was used to estimate the probability distribution of losses on pools of loans or bonds.

During a downside regime, a large number of investors who have held positions in riskier assets such as equities or real estate may seek refuge in 'safer' investments such as cash or bonds. This is also known as a flight-to-quality effect and investors tend to exit their positions in riskier assets in large numbers in a short period of time. As a result, during downside regimes, correlations across equities are greater on the downside as opposed to the upside and this may have disastrous effects on the economy.[20][21] For example, anecdotally, we often read financial news headlines reporting the loss of hundreds of millions of dollars on the stock exchange in a single day; however, we rarely read reports of positive stock market gains of the same magnitude and in the same short time frame.

 Copulas aid in analyzing the effects of downside regimes by allowing the modelling of the marginals and dependence structure of a multivariate probability model separately. For example, consider the stock exchange as a market consisting of a large number of traders each operating with his/her own strategies to maximize profits. The individualistic behaviour of each trader can be described by modelling the marginals. However, as all traders operate on the same exchange, each trader's actions have an interaction effect with other traders'. This interaction effect can be described by modelling the dependence structure. Therefore, copulas allow us to analyse the interaction effects which are of particular interest during downside regimes as investors tend to herd their trading behaviour and decisions. (See also agent-based computational economics, where price is treated as an emergent phenomenon, resulting from the interaction of the various market participants, or agents.)

The users of the formula have been criticized for creating "evaluation cultures" that continued to use simple copulæ despite the simple versions being acknowledged as inadequate for that purpose.[22] Thus, previously, scalable copula models for large dimensions only allowed the modelling of elliptical dependence structures (i.e., Gaussian and Student-t copulas) that do not allow for correlation asymmetries where correlations differ on the upside or downside regimes. However, the recent development of vine copulas[23] (also known as pair copulas) enables the flexible modelling of the dependence structure for portfolios of large dimensions.[24] The Clayton canonical vine copula allows for the occurrence of extreme downside events and has been successfully applied in portfolio optimization and risk management applications. The model is able to reduce the effects of extreme downside correlations and produces improved statistical and economic performance compared to scalable elliptical dependence copulas such as the Gaussian and Student-t copula.[25]

Other models developed for risk management applications are panic copulas that are glued with market estimates of the marginal distributions to analyze the effects of panic regimes on the portfolio profit and loss distribution. Panic copulas are created by Monte Carlo simulation, mixed with a re-weighting of the probability of each scenario.[26]

As regards derivatives pricing, dependence modelling with copula functions is widely used in applications of financial risk assessment and actuarial analysis – for example in the pricing of collateralized debt obligations (CDOs).[27] Some believe the methodology of applying the Gaussian copula to credit derivatives to be one of the reasons behind the global financial crisis of 2008–2009;[28][29][30] see David X. Li § CDOs and Gaussian copula.

Despite this perception, there are documented attempts within the financial industry, occurring before the crisis, to address the limitations of the Gaussian copula and of copula functions more generally, specifically the lack of dependence dynamics. The Gaussian copula is lacking as it only allows for an elliptical dependence structure, as dependence is only modeled using the variance-covariance matrix.[25] This methodology is limited such that it does not allow for dependence to evolve as the financial markets exhibit asymmetric dependence, whereby correlations across assets significantly increase during downturns compared to upturns. Therefore, modeling approaches using the Gaussian copula exhibit a poor representation of extreme events.[25][31] There have been attempts to propose models rectifying some of the copula limitations.[31][32][33]

Additional to CDOs, Copulas have been applied to other asset classes as a flexible tool in analyzing multi-asset derivative products. The first such application outside credit was to use a copula to construct a basket implied volatility surface,[34] taking into account the volatility smile of basket components. Copulas have since gained popularity in pricing and risk management[35] of options on multi-assets in the presence of a volatility smile, in equity-foreign exchange- and fixed income derivatives.

Civil engineeringEdit

Recently, copula functions have been successfully applied to the database formulation for the reliability analysis of highway bridges, and to various multivariate simulation studies in civil engineering,[36] reliability of wind and earthquake engineering,[37] and mechanical & offshore engineering.[38] Researchers are also trying these functions in the field of transportation to understand the interaction between behaviors of individual drivers which, in totality, shapes traffic flow.

Reliability engineeringEdit

Copulas are being used for reliability analysis of complex systems of machine components with competing failure modes. [39]

Warranty data analysisEdit

Copulas are being used for warranty data analysis in which the tail dependence is analysed [40]

Turbulent combustionEdit

Copulas are used in modelling turbulent partially premixed combustion, which is common in practical combustors. [41][42]

MedicineEdit

Copula has many applications in the area of medicine, for example,

  1. Copula has been used in the field of magnetic resonance imaging (MRI), for example, to segment images,[43] to fill a vacancy of graphical models in imaging genetics in a study on schizophrenia,[44] and to distinguish between normal and Alzheimer patients.[45]
  2. Copula has been in the area of brain research based on EEG signals, for example, to detect drowsiness during daytime nap,[46] to track changes in instantaneous equivalent bandwidths (IEBWs),[47] to derive synchrony for early diagnosis of Alzheimer's disease,[48] to characterize dependence in oscillatory activity between EEG channels,[49] and to assess the reliability of using methods to capture dependence between pairs of EEG channels using their time-varying envelopes.[50] Copula functions have been successfully applied to the analysis of neuronal dependencies[51] and spike counts in neuroscience .[52]
  3. A copula model has been developed in the field of oncology, for example, to jointly model genotypesphenotypes, and pathways to reconstruct a cellular network to identify interactions between specific phenotype and multiple molecular features (e.g. mutations and gene expression change). Bao et al.[53] used NCI60 cancer cell line data to identify several subsets of molecular features that jointly perform as the predictors of clinical phenotypes. The proposed copula may have an impact on biomedical research, ranging from cancer treatment to disease prevention. Copula has also been used to predict the histological diagnosis of colorectal lesions from colonoscopy images,[54] and to classify cancer subtypes.[55]

GeodesyEdit

The combination of SSA and Copula-based methods have been applied for the first time as a novel stochastic tool for EOP prediction.[56][57]

Hydrology researchEdit

Copulas have been used in both theoretical and applied analyses of hydroclimatic data. Theoretical studies adopted the copula-based methodology for instance to gain a better understanding of the dependence structures of temperature and precipitation, in different parts of the world.[8][58][59] Applied studies adopted the copula-based methodology to examine e.g., agricultural droughts [60] or joint effects of temperature and precipitation extremes on vegetation growth.[61]

Climate and weather researchEdit

Copulas have been extensively used in climate- and weather-related research.[62][63]

Solar irradiance variabilityEdit

Copulas have been used to estimate the solar irradiance variability in spatial networks and temporally for single locations. [64][65]

Random vector generationEdit

Large synthetic traces of vectors and stationary time series can be generated using empirical copula while preserving the entire dependence structure of small datasets.[66] Such empirical traces are useful in various simulation-based performance studies.[67]

Ranking of electrical motorsEdit

Copulas have been used for quality ranking in the manufacturing of electronically commutated motors.[68]

Signal processingEdit

Copulas are important because they represent a dependence structure without using marginal distributions. Copulas have been widely used in the field of finance, but their use in signal processing is relatively new. Copulas have been employed in the field of wireless communication for classifying radar signals, change detection in remote sensing applications, and EEG signal processing in medicine. In this section, a short mathematical derivation to obtain copula density function followed by a table providing a list of copula density functions with the relevant signal processing applications are presented.

Mathematical derivation of copula density functionEdit

For any two random variables X and Y, the continuous joint probability distribution function can be written as

{\displaystyle F_{XY}(x,y)=\Pr {\begin{Bmatrix}X\leq {x},Y\leq {y}\end{Bmatrix}},}

where {\textstyle F_{X}(x)=\Pr {\begin{Bmatrix}X\leq {x}\end{Bmatrix}}} and {\textstyle F_{Y}(y)=\Pr {\begin{Bmatrix}Y\leq {y}\end{Bmatrix}}} are the marginal cumulative distribution functions of the random variables X and Y, respectively.

then the copula distribution function {\displaystyle C(u,v)} can be defined using Sklar's theorem[69][70] as:

{\displaystyle F_{XY}(x,y)=C(F_{X}(x),F_{Y}(y))\triangleq C(u,v)},

where {\displaystyle u=F_{X}(x)} and {\displaystyle v=F_{Y}(y)} are marginal distribution functions, {\displaystyle F_{XY}(x,y)} joint and {\displaystyle u,v\in (0,1)}.

We start by using the relationship between joint probability density function (PDF) and joint cumulative distribution function (CDF) and its partial derivatives.

{\displaystyle {\begin{alignedat}{6}f_{XY}(x,y)={}&{\partial ^{2}F_{XY}(x,y) \over \partial x\,\partial y}\\\vdots \\f_{XY}(x,y)={}&{\partial ^{2}C(F_{X}(x),F_{Y}(y)) \over \partial x\,\partial y}\\\vdots \\f_{XY}(x,y)={}&{\partial ^{2}C(u,v) \over \partial u\,\partial v}\cdot {\partial F_{X}(x) \over \partial x}\cdot {\partial F_{Y}(y) \over \partial y}\\\vdots \\f_{XY}(x,y)={}&c(u,v)f_{X}(x)f_{Y}(y)\\\vdots \\{\frac {f_{XY}(x,y)}{f_{X}(x)f_{Y}(y)}}={}&c(u,v)\end{alignedat}}}

where c(u,v) is the copula density function, {\displaystyle f_{X}(x)} and {\displaystyle f_{Y}(y)} are the marginal probability density functions of X and Y, respectively. It is important to understand that there are four elements in this equation, and if any three elements are know, the fourth element can be calculated. For example, it may be used,

  • when joint probability density function between two random variables is known, the copula density function is known, and one of the two marginal functions are known, then, the other marginal function can be calculated, or
  • when the two marginal functions and the copula density function are known, then the joint probability density function between the two random variables can be calculated, or
  • when the two marginal functions and the joint probability density function between the two random variables are known, then the copula density function can be calculated.

List of copula density functions and applicationsEdit

Various bivariate copula density functions are important in the area of signal processing. {\displaystyle u=F_{X}(x)} and {\displaystyle v=F_{Y}(y)} are marginal distributions functions and {\displaystyle f_{X}(x)} and {\displaystyle f_{Y}(y)} are marginal density functions. Extension and generalization of copulas for statistical signal processing have been shown to construct new bivariate copulas for exponential, Weibull, and Rician distributions.[71] Zeng et al.[72] presented algorithms, simulation, optimal selection, and practical applications of these copulas in signal processing.

Copula density: c(uv)Use
Gaussian{\displaystyle {\begin{aligned}={}&{\frac {1}{\sqrt {1-\rho ^{2}}}}\exp \left(-{\frac {(a^{2}+b^{2})\rho ^{2}-2ab\rho }{2(1-\rho ^{2})}}\right)\\&{\text{where }}\rho \in (-1,1)\\&{\text{where }}a={\sqrt {2}}\operatorname {erf} ^{-1}({2u-1})\\&{\text{where }}b={\sqrt {2}}\operatorname {erf} ^{-1}({2v-1})\\&{\text{where }}\operatorname {erf} (z)={\frac {2}{\sqrt {\pi }}}\int \limits _{0}^{z}\exp(-t^{2})\,dt\end{aligned}}}supervised classification of synthetic aperture radar (SAR) images,[73]

validating biometric authentication,[74] modeling stochastic dependence in large-scale integration of wind power,[75] unsupervised classification of radar signals[76]

Exponential{\displaystyle {\begin{aligned}={}&{\frac {1}{1-\rho }}\exp \left({\frac {\rho (\ln(1-u)+\ln(1-v))}{1-\rho }}\right)\cdot I_{0}\left({\frac {2{\sqrt {\rho \ln(1-u)\ln(1-v)}}}{1-\rho }}\right)\\&{\text{where }}x=F_{X}^{-1}(u)=-\ln(1-u)/\lambda \\&{\text{where }}y=F_{Y}^{-1}(v)=-\ln(1-v)/\mu \end{aligned}}}queuing system with infinitely many servers[77]
Rayleighbivariate exponential, Rayleigh, and Weibull copulas have been proved to be equivalent[78][79][80]change detection from SAR images[81]
Weibullbivariate exponential, Rayleigh, and Weibull copulas have been proved to be equivalent[78][79][80]digital communication over fading channels[82]
Log-normalbivariate log-normal copula and Gaussian copula are equivalent[80][79]shadow fading along with multipath effect in wireless channel[83][84]
Farlie–Gumbel–Morgenstern (FGM){\displaystyle {\begin{aligned}={}&1+\theta (1-2u)(1-2v)\\&{\text{where }}\theta \in [-1,1]\end{aligned}}}information processing of uncertainty in knowledge-based systems[85]
Clayton{\displaystyle {\begin{aligned}={}&(1+\theta )(uv)^{(-1-\theta )}(-1+u^{-\theta }+v^{-\theta })^{(-2-1/\theta )}\\&{\text{where }}\theta \in (-1,\infty ),\theta \neq 0\end{aligned}}}location estimation of random signal source and hypothesis testing using heterogeneous data[86][87]
Frank{\displaystyle {\begin{aligned}={}&{\frac {\theta e^{\theta (u+v)}(e^{\theta }-1)}{(e^{\theta }-e^{\theta u}-e^{\theta v}+e^{\theta (u+v)})^{2}}}\\&{\text{where }}\theta \in (-\infty ,+\infty ),\theta \neq 0\end{aligned}}}change detection in remote sensing applications[88]
Student's t{\displaystyle {\begin{aligned}={}&{\frac {\Gamma (0.5v)\Gamma (0.5v+1)(1+(t_{v}^{-2}(u)+t_{v}^{-2}(v)-2\rho t_{v}^{-1}(u)t_{v}^{-1}(v))/(v(1-\rho ^{2})))^{-0.5(v+2)})}{{\sqrt {1-\rho ^{2}}}\cdot \Gamma (0.5(v+1))^{2}(1+t_{v}^{-2}(u)/v)^{-0.5(v+1)}(1+t_{v}^{-2}(v)/v)^{-0.5(v+1)}}}\\&{\text{where }}\rho \in (-1,1)\\&{\text{where }}\phi (z)={\frac {1}{\sqrt {2\pi }}}\int \limits _{-\infty }^{z}\exp \left({\frac {-t^{2}}{2}}\right)\,dt\\&{\text{where }}t_{v}(x\mid v)=\int \limits _{-\infty }^{x}{\frac {\Gamma {(0.5(v+1))}}{{\sqrt {v\pi }}(\Gamma {0.5v})(1+v^{-1}t^{2})^{0.5(v+1)}}}dt\\&{\text{where }}v={\text{degrees of freedom}}\\&{\text{where }}\Gamma {\text{ is the Gamma function}}\end{aligned}}}supervised SAR image classification,[81]

fusion of correlated sensor decisions[89]

Nakagami-m
Rician


This article uses material from the Wikipedia article
 Metasyntactic variable, which is released under the 
Creative Commons
Attribution-ShareAlike 3.0 Unported License
.