Diffusion map

<h2 id="definition-of-diffusion-maps">Definition of diffusion maps</h2>
Following <a class="footnote-ref" id="fnref:5" href="#fn:5">5</a> and,<a class="footnote-ref" id="fnref:6" href="#fn:6">6</a> diffusion maps can be defined in four steps.

<h3>Connectivity</h3>
Diffusion maps exploit the relationship between <a href="/facts/Heat_diffusion/2JPPr5GG">heat diffusion</a> and <a href="/facts/Random_walk/08v0jmfv">random walk</a> <a href="/facts/Markov_chain/5oP5hntk">Markov chain</a>. The basic observation is that if we take a random walk on the data, walking to a nearby data-point is more likely than walking to another that is far away. Let 
 
 
 
 (
 X
 ,
 
 
 A
 
 
 ,
 μ
 )
 
 
 {\displaystyle (X,{\mathcal {A}},\mu )}
 
 be a <a href="/facts/Measure_space/w9Dx4KY1">measure space</a>, where 
 
 
 
 X
 
 
 {\displaystyle X}
 
 is the data set and 
 
 
 
 μ
 
 
 {\displaystyle \mu }
 
 represents the distribution of the points on 
 
 
 
 X
 
 
 {\displaystyle X}
 
.
Based on this, the connectivity 
 
 
 
 k
 
 
 {\displaystyle k}
 
 between two data points, 
 
 
 
 x
 
 
 {\displaystyle x}
 
 and 
 
 
 
 y
 
 
 {\displaystyle y}
 
, can be defined as the probability of walking from 
 
 
 
 x
 
 
 {\displaystyle x}
 
 to 
 
 
 
 y
 
 
 {\displaystyle y}
 
 in one step of the random walk. Usually, this probability is specified in terms of a kernel function of the two points: 
 
 
 
 k
 :
 X
 ×
 X
 →
 
 R
 
 
 
 {\displaystyle k:X\times X\rightarrow \mathbb {R} }
 
. For example, the popular Gaussian kernel:

k
        (
        x
        ,
        y
        )
        =
        exp
        ⁡
        
          (
          
            −
            
              
                
                  
                    |
                  
                  
                    |
                  
                  x
                  −
                  y
                  
                    |
                  
                  
                    
                      |
                    
                    
                      2
                    
                  
                
                ϵ
              
            
          
          )
        
      
    
    {\displaystyle k(x,y)=\exp \left(-{\frac {||x-y||^{2}}{\epsilon }}\right)}

More generally, the <a href="/facts/Integral_kernel/AB2yjHJJ">kernel</a> function has the following properties

k
        (
        x
        ,
        y
        )
        =
        k
        (
        y
        ,
        x
        )
      
    
    {\displaystyle k(x,y)=k(y,x)}

(
 
 
 
 k
 
 
 {\displaystyle k}
 
 is symmetric)

k
        (
        x
        ,
        y
        )
        ≥
        0
        
        
        ∀
        x
        ,
        y
      
    
    {\displaystyle k(x,y)\geq 0\,\,\forall x,y}

(
 
 
 
 k
 
 
 {\displaystyle k}
 
 is positivity preserving).
The kernel constitutes the prior definition of the local geometry of the data-set. Since a given kernel will capture a specific feature of the data set, its choice should be guided by the application that one has in mind. This is a major difference with methods such as <a href="/facts/Principal_component_analysis/pCbVTqdR">principal component analysis</a>, where correlations between all data points are taken into account at once.
Given 
 
 
 
 (
 X
 ,
 k
 )
 
 
 {\displaystyle (X,k)}
 
, we can then construct a reversible discrete-time Markov chain on 
 
 
 
 X
 
 
 {\displaystyle X}
 
 (a process known as the normalized graph Laplacian construction):

d
        (
        x
        )
        =
        
          ∫
          
            X
          
        
        k
        (
        x
        ,
        y
        )
        d
        μ
        (
        y
        )
      
    
    {\displaystyle d(x)=\int _{X}k(x,y)d\mu (y)}

and define:

p
        (
        x
        ,
        y
        )
        =
        
          
            
              k
              (
              x
              ,
              y
              )
            
            
              d
              (
              x
              )
            
          
        
      
    
    {\displaystyle p(x,y)={\frac {k(x,y)}{d(x)}}}

Although the new normalized kernel does not inherit the symmetric property, it does inherit the positivity-preserving property and gains a conservation property:

∫
          
            X
          
        
        p
        (
        x
        ,
        y
        )
        d
        μ
        (
        y
        )
        =
        1
      
    
    {\displaystyle \int _{X}p(x,y)d\mu (y)=1}

<h3>Diffusion process</h3>
From 
 
 
 
 p
 (
 x
 ,
 y
 )
 
 
 {\displaystyle p(x,y)}
 
 we can construct a transition matrix of a Markov chain (
 
 
 
 M
 
 
 {\displaystyle M}
 
) on 
 
 
 
 X
 
 
 {\displaystyle X}
 
. In other words, 
 
 
 
 p
 (
 x
 ,
 y
 )
 
 
 {\displaystyle p(x,y)}
 
 represents the one-step transition probability from 
 
 
 
 x
 
 
 {\displaystyle x}
 
 to 
 
 
 
 y
 
 
 {\displaystyle y}
 
, and 
 
 
 
 
 M
 
 t
 
 
 
 
 {\displaystyle M^{t}}
 
 gives the t-step transition matrix.
We define the diffusion matrix 
 
 
 
 L
 
 
 {\displaystyle L}
 
 (it is also a version of graph <a href="/facts/Laplacian_matrix/Iwea2mm9">Laplacian matrix</a>)

L
          
            i
            ,
            j
          
        
        =
        k
        (
        
          x
          
            i
          
        
        ,
        
          x
          
            j
          
        
        )
        
      
    
    {\displaystyle L_{i,j}=k(x_{i},x_{j})\,}

We then define the new kernel

L
          
            i
            ,
            j
          
          
            (
            α
            )
          
        
        =
        
          k
          
            (
            α
            )
          
        
        (
        
          x
          
            i
          
        
        ,
        
          x
          
            j
          
        
        )
        =
        
          
            
              L
              
                i
                ,
                j
              
            
            
              (
              d
              (
              
                x
                
                  i
                
              
              )
              d
              (
              
                x
                
                  j
                
              
              )
              
                )
                
                  α
                
              
            
          
        
        
      
    
    {\displaystyle L_{i,j}^{(\alpha )}=k^{(\alpha )}(x_{i},x_{j})={\frac {L_{i,j}}{(d(x_{i})d(x_{j}))^{\alpha }}}\,}

or equivalently,

L
          
            (
            α
            )
          
        
        =
        
          D
          
            −
            α
          
        
        L
        
          D
          
            −
            α
          
        
        
      
    
    {\displaystyle L^{(\alpha )}=D^{-\alpha }LD^{-\alpha }\,}

where D is a diagonal matrix and 
 
 
 
 
 D
 
 i
 ,
 i
 
 
 =
 
 ∑
 
 j
 
 
 
 L
 
 i
 ,
 j
 
 
 .
 
 
 {\displaystyle D_{i,i}=\sum _{j}L_{i,j}.}

We apply the graph Laplacian normalization to this new kernel:

M
        =
        (
        
          
            D
          
          
            (
            α
            )
          
        
        
          )
          
            −
            1
          
        
        
          L
          
            (
            α
            )
          
        
        ,
        
      
    
    {\displaystyle M=({D}^{(\alpha )})^{-1}L^{(\alpha )},\,}

where 
 
 
 
 
 D
 
 (
 α
 )
 
 
 
 
 {\displaystyle D^{(\alpha )}}
 
 is a diagonal matrix and 
 
 
 
 
 
 D
 
 
 i
 ,
 i
 
 
 (
 α
 )
 
 
 =
 
 ∑
 
 j
 
 
 
 L
 
 i
 ,
 j
 
 
 (
 α
 )
 
 
 .
 
 
 {\displaystyle {D}_{i,i}^{(\alpha )}=\sum _{j}L_{i,j}^{(\alpha )}.}

p
        (
        
          x
          
            j
          
        
        ,
        t
        
          |
        
        
          x
          
            i
          
        
        )
        =
        
          M
          
            i
            ,
            j
          
          
            t
          
        
        
      
    
    {\displaystyle p(x_{j},t|x_{i})=M_{i,j}^{t}\,}

One of the main ideas of the diffusion framework is that running the chain forward in time (taking larger and larger powers of 
 
 
 
 M
 
 
 {\displaystyle M}
 
) reveals the geometric structure of 
 
 
 
 X
 
 
 {\displaystyle X}
 
 at larger and larger scales (the diffusion process). Specifically, the notion of a cluster in the data set is quantified as a region in which the probability of escaping this region is low (within a certain time t). Therefore, t not only serves as a time parameter, but it also has the dual role of scale parameter.
The eigendecomposition of the matrix 
 
 
 
 
 M
 
 t
 
 
 
 
 {\displaystyle M^{t}}
 
 yields

M
          
            i
            ,
            j
          
          
            t
          
        
        =
        
          ∑
          
            l
          
        
        
          λ
          
            l
          
          
            t
          
        
        
          ψ
          
            l
          
        
        (
        
          x
          
            i
          
        
        )
        
          ϕ
          
            l
          
        
        (
        
          x
          
            j
          
        
        )
        
      
    
    {\displaystyle M_{i,j}^{t}=\sum _{l}\lambda _{l}^{t}\psi _{l}(x_{i})\phi _{l}(x_{j})\,}

where 
 
 
 
 {
 
 λ
 
 l
 
 
 }
 
 
 {\displaystyle \{\lambda _{l}\}}
 
 is the sequence of eigenvalues of 
 
 
 
 M
 
 
 {\displaystyle M}
 
 and 
 
 
 
 {
 
 ψ
 
 l
 
 
 }
 
 
 {\displaystyle \{\psi _{l}\}}
 
 and 
 
 
 
 {
 
 ϕ
 
 l
 
 
 }
 
 
 {\displaystyle \{\phi _{l}\}}
 
 are the biorthogonal left and right eigenvectors respectively.
Due to the spectrum decay of the eigenvalues, only a few terms are necessary to achieve a given relative accuracy in this sum.

<h4>Parameter α and the diffusion operator</h4>
The reason to introduce the normalization step involving 
 
 
 
 α
 
 
 {\displaystyle \alpha }
 
 is to tune the influence of the data point density on the infinitesimal transition of the diffusion. In some applications, the sampling of the data is generally not related to the geometry of the manifold we are interested in describing. In this case, we can set 
 
 
 
 α
 =
 1
 
 
 {\displaystyle \alpha =1}
 
 and the diffusion operator approximates the <a href="/facts/Laplace%25E2%2580%2593Beltrami_operator/AJmyUpWz">Laplace–Beltrami operator</a>. We then recover the Riemannian geometry of the data set regardless of the distribution of the points. To describe the long-term behavior of the point distribution of a system of stochastic differential equations, we can use 
 
 
 
 α
 =
 0.5
 
 
 {\displaystyle \alpha =0.5}
 
 and the resulting Markov chain approximates the <a href="/facts/Fokker%25E2%2580%2593Planck_equation/974pPTer">Fokker–Planck diffusion</a>. With 
 
 
 
 α
 =
 0
 
 
 {\displaystyle \alpha =0}
 
, it reduces to the classical graph Laplacian normalization.

<h3>Diffusion distance</h3>
The diffusion distance at time 
 
 
 
 t
 
 
 {\displaystyle t}
 
 between two points can be measured as the similarity of two points in the observation space with the connectivity between them. It is given by

D
          
            t
          
        
        (
        
          x
          
            i
          
        
        ,
        
          x
          
            j
          
        
        
          )
          
            2
          
        
        =
        
          ∑
          
            y
          
        
        
          
            
              (
              p
              (
              y
              ,
              t
              
                |
              
              
                x
                
                  i
                
              
              )
              −
              p
              (
              y
              ,
              t
              
                |
              
              
                x
                
                  j
                
              
              )
              
                )
                
                  2
                
              
            
            
              
                ϕ
                
                  0
                
              
              (
              y
              )
            
          
        
      
    
    {\displaystyle D_{t}(x_{i},x_{j})^{2}=\sum _{y}{\frac {(p(y,t|x_{i})-p(y,t|x_{j}))^{2}}{\phi _{0}(y)}}}

where 
 
 
 
 
 ϕ
 
 0
 
 
 (
 y
 )
 
 
 {\displaystyle \phi _{0}(y)}
 
 is the stationary distribution of the Markov chain, given by the first left eigenvector of 
 
 
 
 M
 
 
 {\displaystyle M}
 
. Explicitly:

ϕ
          
            0
          
        
        (
        y
        )
        =
        
          
            
              d
              (
              y
              )
            
            
              
                ∑
                
                  z
                  ∈
                  X
                
              
              d
              (
              z
              )
            
          
        
      
    
    {\displaystyle \phi _{0}(y)={\frac {d(y)}{\sum _{z\in X}d(z)}}}

Intuitively, 
 
 
 
 
 D
 
 t
 
 
 (
 
 x
 
 i
 
 
 ,
 
 x
 
 j
 
 
 )
 
 
 {\displaystyle D_{t}(x_{i},x_{j})}
 
 is small if there is a large number of short paths connecting 
 
 
 
 
 x
 
 i
 
 
 
 
 {\displaystyle x_{i}}
 
 and 
 
 
 
 
 x
 
 j
 
 
 
 
 {\displaystyle x_{j}}
 
. There are several interesting features associated with the diffusion distance, based on our previous discussion that 
 
 
 
 t
 
 
 {\displaystyle t}
 
 also serves as a scale parameter:

<ol><li>Points are closer at a given scale (as specified by 
 
 
 
 
 D
 
 t
 
 
 (
 
 x
 
 i
 
 
 ,
 
 x
 
 j
 
 
 )
 
 
 {\displaystyle D_{t}(x_{i},x_{j})}
 
) if they are highly connected in the graph, therefore emphasizing the concept of a cluster.</li>
<li>This distance is robust to noise, since the distance between two points depends on all possible paths of length 
 
 
 
 t
 
 
 {\displaystyle t}
 
 between the points.</li>
<li>From a machine learning point of view, the distance takes into account all evidences linking 
 
 
 
 
 x
 
 i
 
 
 
 
 {\displaystyle x_{i}}
 
 to 
 
 
 
 
 x
 
 j
 
 
 
 
 {\displaystyle x_{j}}
 
, allowing us to conclude that this distance is appropriate for the design of inference algorithms based on the majority of preponderance.<a class="footnote-ref" id="fnref:7" href="#fn:7">7</a></li></ol>
<h3>Diffusion process and low-dimensional embedding</h3>
The diffusion distance can be calculated using the eigenvectors by

D
          
            t
          
        
        (
        
          x
          
            i
          
        
        ,
        
          x
          
            j
          
        
        
          )
          
            2
          
        
        =
        
          ∑
          
            l
          
        
        
          λ
          
            l
          
          
            2
            t
          
        
        (
        
          ψ
          
            l
          
        
        (
        
          x
          
            i
          
        
        )
        −
        
          ψ
          
            l
          
        
        (
        
          x
          
            j
          
        
        )
        
          )
          
            2
          
        
        
      
    
    {\displaystyle D_{t}(x_{i},x_{j})^{2}=\sum _{l}\lambda _{l}^{2t}(\psi _{l}(x_{i})-\psi _{l}(x_{j}))^{2}\,}

So the eigenvectors can be used as a new set of coordinates for the data. The diffusion map is defined as:

Ψ
          
            t
          
        
        (
        x
        )
        =
        (
        
          λ
          
            1
          
          
            t
          
        
        
          ψ
          
            1
          
        
        (
        x
        )
        ,
        
          λ
          
            2
          
          
            t
          
        
        
          ψ
          
            2
          
        
        (
        x
        )
        ,
        …
        ,
        
          λ
          
            k
          
          
            t
          
        
        
          ψ
          
            k
          
        
        (
        x
        )
        )
      
    
    {\displaystyle \Psi _{t}(x)=(\lambda _{1}^{t}\psi _{1}(x),\lambda _{2}^{t}\psi _{2}(x),\ldots ,\lambda _{k}^{t}\psi _{k}(x))}

Because of the spectrum decay, it is sufficient to use only the first k eigenvectors and eigenvalues.
Thus we get the diffusion map from the original data to a k-dimensional space which is embedded in the original space.
In <a class="footnote-ref" id="fnref:8" href="#fn:8">8</a> it is proved that

D
          
            t
          
        
        (
        
          x
          
            i
          
        
        ,
        
          x
          
            j
          
        
        
          )
          
            2
          
        
        ≈
        
          |
        
        
          |
        
        
          Ψ
          
            t
          
        
        (
        
          x
          
            i
          
        
        )
        −
        
          Ψ
          
            t
          
        
        (
        
          x
          
            j
          
        
        )
        
          |
        
        
          
            |
          
          
            2
          
        
        
      
    
    {\displaystyle D_{t}(x_{i},x_{j})^{2}\approx ||\Psi _{t}(x_{i})-\Psi _{t}(x_{j})||^{2}\,}

so the Euclidean distance in the diffusion coordinates approximates the diffusion distance.

<h2 id="algorithm">Algorithm</h2>
The basic algorithm framework of diffusion map is as:
Step 1. Given the similarity matrix L.
Step 2. Normalize the matrix according to parameter 
 
 
 
 α
 
 
 {\displaystyle \alpha }
 
: 
 
 
 
 
 L
 
 (
 α
 )
 
 
 =
 
 D
 
 −
 α
 
 
 L
 
 D
 
 −
 α
 
 
 
 
 {\displaystyle L^{(\alpha )}=D^{-\alpha }LD^{-\alpha }}
 
.
Step 3. Form the normalized matrix 
 
 
 
 M
 =
 (
 
 
 D
 
 
 (
 α
 )
 
 
 
 )
 
 −
 1
 
 
 
 L
 
 (
 α
 )
 
 
 
 
 {\displaystyle M=({D}^{(\alpha )})^{-1}L^{(\alpha )}}
 
.
Step 4. Compute the k largest eigenvalues of 
 
 
 
 
 M
 
 t
 
 
 
 
 {\displaystyle M^{t}}
 
 and the corresponding eigenvectors.
Step 5. Use diffusion map to get the embedding 
 
 
 
 
 Ψ
 
 t
 
 
 
 
 {\displaystyle \Psi _{t}}
 
.

<h2 id="application">Application</h2>
In the paper <a class="footnote-ref" id="fnref:9" href="#fn:9">9</a> Nadler et al. showed how to design a kernel that reproduces the diffusion induced by a <a href="/facts/Fokker%25E2%2580%2593Planck_equation/974pPTer">Fokker–Planck equation</a>. They also explained that, when the data approximate a manifold, one can recover the geometry of this manifold by computing an approximation of the <a href="/facts/Laplace%25E2%2580%2593Beltrami_operator/AJmyUpWz">Laplace–Beltrami operator</a>. This computation is completely insensitive
to the distribution of the points and therefore provides a separation of the statistics and the geometry of the
data. Since diffusion maps give a global description of the data-set, they can measure the distances between pairs of sample points in the manifold in which the data is embedded. Applications based on diffusion maps include <a href="/facts/Facial_recognition_system/mtVxaDln">face recognition</a>,<a class="footnote-ref" id="fnref:10" href="#fn:10">10</a> <a href="/facts/Spectral_clustering/GorfFMRT">spectral clustering</a>, low dimensional representation of images, image segmentation,<a class="footnote-ref" id="fnref:11" href="#fn:11">11</a> 3D model segmentation,<a class="footnote-ref" id="fnref:12" href="#fn:12">12</a> speaker verification<a class="footnote-ref" id="fnref:13" href="#fn:13">13</a> and identification,<a class="footnote-ref" id="fnref:14" href="#fn:14">14</a> sampling on manifolds, anomaly detection,<a class="footnote-ref" id="fnref:15" href="#fn:15">15</a><a class="footnote-ref" id="fnref:16" href="#fn:16">16</a> image inpainting,<a class="footnote-ref" id="fnref:17" href="#fn:17">17</a> revealing brain resting state networks organization <a class="footnote-ref" id="fnref:18" href="#fn:18">18</a> and so on.
Furthermore, the diffusion maps framework has been productively extended to <a href="/facts/Complex_networks/6zTa9z4e">complex networks</a>,<a class="footnote-ref" id="fnref:19" href="#fn:19">19</a> revealing a functional organisation of networks which differs from the purely topological or structural one.

<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/Nonlinear_dimensionality_reduction/1lL1Y0vN">Nonlinear dimensionality reduction</a></li>
<li><a href="/facts/Spectral_clustering/GorfFMRT">Spectral clustering</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1">Coifman, R.R.; Lafon, S; Lee, A B; Maggioni, M; Nadler, B; Warner, F; Zucker, S W (2005). "Geometric diffusions as a tool for harmonic analysis and structure definition of data: Diffusion maps". PNAS. 102 (21): 7426–7431. Bibcode:2005PNAS..102.7426C. doi:10.1073/pnas.0500334102. PMC 1140422. PMID 15899970. <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1140422" target="_blank">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1140422</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></li>
<li id="fn:2">Coifman, R.R.; Lafon, S; Lee, A B; Maggioni, M; Nadler, B; Warner, F; Zucker, S W (2005). "Geometric diffusions as a tool for harmonic analysis and structure definition of data: Multiscale methods". PNAS. 102 (21): 7432–7437. Bibcode:2005PNAS..102.7432C. doi:10.1073/pnas.0500896102. PMC 1140426. PMID 15899969. <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1140426" target="_blank">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1140426</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></li>
<li id="fn:3">Coifman, R.R.; S. Lafon. (2006). "Diffusion maps". Applied and Computational Harmonic Analysis. 21: 5–30. doi:10.1016/j.acha.2006.04.006. S2CID 17160669. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></li>
<li id="fn:4">Lafon, S.S. (2004). Diffusion Maps and Geometric Harmonics (PDF) (PhD). Yale University. <a href="https://690cd646-a-62cb3a1a-s-sites.googlegroups.com/site/stefansresearchpapers/home/dissertation.pdf" target="_blank">https://690cd646-a-62cb3a1a-s-sites.googlegroups.com/site/stefansresearchpapers/home/dissertation.pdf</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></li>
<li id="fn:5">Coifman, R.R.; S. Lafon. (2006). "Diffusion maps". Applied and Computational Harmonic Analysis. 21: 5–30. doi:10.1016/j.acha.2006.04.006. S2CID 17160669. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></li>
<li id="fn:6">De la Porte, J.; Herbst, B M; Hereman, W; Van der Walt, S J (2008). "An Introduction to Diffusion Maps". Proceedings of the Nineteenth Annual Symposium of the Pattern Recognition Association of South Africa (PRASA). CiteSeerX 10.1.1.309.674. <a href="/wiki/CiteSeerX_(identifier)" target="_blank">/wiki/CiteSeerX_(identifier)</a> <a href="#fnref:6" class="footnote-back-ref">↩</a></li>
<li id="fn:7">Coifman, R.R.; S. Lafon. (2006). "Diffusion maps". Applied and Computational Harmonic Analysis. 21: 5–30. doi:10.1016/j.acha.2006.04.006. S2CID 17160669. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></li>
<li id="fn:8">Nadler, Boaz; Stéphane Lafon; Ronald R. Coifman; Ioannis G. Kevrekidis (2005). "Diffusion Maps, Spectral Clustering and Eigenfunctions of Fokker–Planck Operators" (PDF). Advances in Neural Information Processing Systems. 18. arXiv:math/0506090. Bibcode:2005math......6090N. <a href="http://www.wisdom.weizmann.ac.il/~nadler/Publications/dm_nips05.pdf" target="_blank">http://www.wisdom.weizmann.ac.il/~nadler/Publications/dm_nips05.pdf</a> <a href="#fnref:8" class="footnote-back-ref">↩</a></li>
<li id="fn:9">Nadler, Boaz; Stéphane Lafon; Ronald R. Coifman; Ioannis G. Kevrekidis (2005). "Diffusion Maps, Spectral Clustering and Eigenfunctions of Fokker–Planck Operators" (PDF). Advances in Neural Information Processing Systems. 18. arXiv:math/0506090. Bibcode:2005math......6090N. <a href="http://www.wisdom.weizmann.ac.il/~nadler/Publications/dm_nips05.pdf" target="_blank">http://www.wisdom.weizmann.ac.il/~nadler/Publications/dm_nips05.pdf</a> <a href="#fnref:9" class="footnote-back-ref">↩</a></li>
<li id="fn:10">Barkan, Oren; Weill, Jonathan; Wolf, Lior; Aronowitz, Hagai. "Fast high dimensional vector multiplication face recognition" (PDF). Proceedings of the IEEE International Conference on Computer Vision 2013: 1960–1967. <a href="http://www.cv-foundation.org/openaccess/content_iccv_2013/papers/Barkan_Fast_High_Dimensional_2013_ICCV_paper.pdf" target="_blank">http://www.cv-foundation.org/openaccess/content_iccv_2013/papers/Barkan_Fast_High_Dimensional_2013_ICCV_paper.pdf</a> <a href="#fnref:10" class="footnote-back-ref">↩</a></li>
<li id="fn:11">Zeev, Farbman; Fattal Raanan; Lischinski Dani (2010). "Diffusion maps for edge-aware image editing". ACM Trans. Graph. 29 (6): 145:1–145:10. doi:10.1145/1882261.1866171. <a href="/wiki/Doi_(identifier)" target="_blank">/wiki/Doi_(identifier)</a> <a href="#fnref:11" class="footnote-back-ref">↩</a></li>
<li id="fn:12">Oana, Sidi; van Kaick, Oliver; Kleiman, Yanir; Zhang, Hao; Cohen-Or, Daniel (2011). Unsupervised Co-Segmentation of a Set of Shapes via Descriptor-Space Spectral Clustering (PDF). ACM Transactions on Graphics. <a href="https://www.cs.sfu.ca/~haoz/pubs/sidi_siga11_coseg.pdf" target="_blank">https://www.cs.sfu.ca/~haoz/pubs/sidi_siga11_coseg.pdf</a> <a href="#fnref:12" class="footnote-back-ref">↩</a></li>
<li id="fn:13">Barkan, Oren; Aronowitz, Hagai (2013). "Diffusion maps for PLDA-based speaker verification" (PDF). Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing: 7639–7643. <a href="http://smartfp7.eu/sites/default/files/field/files/page/DIFFUSION%20MAPS%20FOR%20PLDA-BASED%20SPEAKER%20VERIFICATION.pdf" target="_blank">http://smartfp7.eu/sites/default/files/field/files/page/DIFFUSION%20MAPS%20FOR%20PLDA-BASED%20SPEAKER%20VERIFICATION.pdf</a> <a href="#fnref:13" class="footnote-back-ref">↩</a></li>
<li id="fn:14">Michalevsky, Yan; Talmon, Ronen; Cohen, Israel (2011). Speaker Identification Using Diffusion Maps (PDF). European signal processing conference 2011. <a href="http://www.eurasip.org/Proceedings/Eusipco/Eusipco2011/papers/1569414913.pdf" target="_blank">http://www.eurasip.org/Proceedings/Eusipco/Eusipco2011/papers/1569414913.pdf</a> <a href="#fnref:14" class="footnote-back-ref">↩</a></li>
<li id="fn:15">Mishne, Gal; Cohen, Israel (2013). "Multiscale Anomaly Detection Using Diffusion Maps". IEEE Selected Topics in Signal Processing. 7 (1): 111–123. Bibcode:2013ISTSP...7..111M. doi:10.1109/jstsp.2012.2232279. S2CID 1954466. <a href="/wiki/Bibcode_(identifier)" target="_blank">/wiki/Bibcode_(identifier)</a> <a href="#fnref:15" class="footnote-back-ref">↩</a></li>
<li id="fn:16">Shabat, Gil; Segev, David; Averbuch, Amir (2018-01-07). "Uncovering Unknown Unknowns in Financial Services Big Data by Unsupervised Methodologies: Present and Future trends". KDD 2017 Workshop on Anomaly Detection in Finance. 71: 8–19. <a href="http://proceedings.mlr.press/v71/shabat18a.html" target="_blank">http://proceedings.mlr.press/v71/shabat18a.html</a> <a href="#fnref:16" class="footnote-back-ref">↩</a></li>
<li id="fn:17">Gepshtein, Shai; Keller, Yosi (2013). "Image Completion by Diffusion Maps and Spectral Relaxation". IEEE Transactions on Image Processing. 22 (8): 2983–2994. Bibcode:2013ITIP...22.2983G. doi:10.1109/tip.2013.2237916. PMID 23322762. S2CID 14375333. <a href="/wiki/Bibcode_(identifier)" target="_blank">/wiki/Bibcode_(identifier)</a> <a href="#fnref:17" class="footnote-back-ref">↩</a></li>
<li id="fn:18">Margulies, Daniel S.; Ghosh, Satrajit S.; Goulas, Alexandros; Falkiewicz, Marcel; Huntenburg, Julia M.; Langs, Georg; Bezgin, Gleb; Eickhoff, Simon B.; Castellanos, F. Xavier; Petrides, Michael; Jefferies, Elizabeth; Smallwood, Jonathan (2016). "Situating the default-mode network along a principal gradient of macroscale cortical organization". Proceedings of the National Academy of Sciences. 113 (44): 12574–12579. Bibcode:2016PNAS..11312574M. doi:10.1073/pnas.1608282113. PMC 5098630. PMID 27791099. <a href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5098630" target="_blank">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5098630</a> <a href="#fnref:18" class="footnote-back-ref">↩</a></li>
<li id="fn:19">De Domenico, Manlio (2017). "Diffusion geometry unravels the emergence of functional clusters in collective phenomena". Physical Review Letters. 118 (16): 168301. arXiv:1704.07068. Bibcode:2017PhRvL.118p8301D. doi:10.1103/PhysRevLett.118.168301. PMID 28474920. S2CID 2638868. <a href="https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.118.168301" target="_blank">https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.118.168301</a> <a href="#fnref:19" class="footnote-back-ref">↩</a></li>
</ol>

Diffusion map open-in-new

Diffusion map