Skip to content

Commit ef2d641

Browse files
youdongguoyoudongguotimholy
authored
add illustration example of NMFMerge concept (#30)
* add illustration example of NMFMerge concept * delete repeat sentence * Update README.md Co-authored-by: Tim Holy <tim.holy@gmail.com> --------- Co-authored-by: youdongguo <1010705897@qq.com> Co-authored-by: Tim Holy <tim.holy@gmail.com>
1 parent dbf03e0 commit ef2d641

File tree

2 files changed

+7
-0
lines changed

2 files changed

+7
-0
lines changed

README.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,13 @@ This package implements the technique in the paper [An optimal pairwise merge al
99

1010
This approach is motivated by the idea that convergence of NMF becomes poor when one is forced to make difficult tradeoffs in describing different features of the data matrix; thus, performing an initial factorization with an excessive number of components grants the opportunity to escape such constraints and reliably describe the full behavior of the data matrix. Later, any redundant or noisy components are identified and merged together.
1111

12+
The concept of NMF-Merge in an illustrative example:
13+
![Sample Figure](images/ovrsimumerge.png)
14+
15+
The data matrix is $\mathbf{X}=\mathbf{WH}+\mathbf{N}$, where $\mathbf{W}$ and $\mathbf{H}$ are rank-5 and $\mathbf{N}$ denotes the noise. The 'Good' and 'Bad' factorizations (blue box) represent two local minima reached by rank-5 NMF across 1000 different initializations, while the factorizations in the green boxes denote minima identified by NMF with $r\ge 6$. (These minima were found from every random initialization tested, but uniqueness is not required.) The higher-rank solutions can be merged to produce a rank 5 factorization using NMFMerge. Thus, by first identifying a higher-rank NMF, and then merging to lower rank, you can more reliably identify high-quality solutions. We demonstrate this experimentally in the linked manuscript.
16+
17+
18+
1219
Let's start with a simple demo:
1320

1421
Install the package: type `]` at the `julia>` prompt to enter `pkg>` mode, and type

images/ovrsimumerge.png

993 KB
Loading

0 commit comments

Comments
 (0)