1. Introduction
Let
be a finite dimensional Hilbert space over
(
or
). A finite collection
in
is said to be a
frame (also known as
dictionary) [
1,
2] for
if there are
such that
A frame
for
is said to be
normalized if
for all
. Note that any frame can be normalized by dividing each element by its norm. Given a frame
for
, we define the analysis operator
Adjoint of the analysis operator is known as the synthesis operator whose expression is
Given
, let
be the number of nonzero entries in
d. Following
-minimization problem appears in many of electronic devices.
Problem 1.
Let be a normalized frame for . Given , solve
Recall that is said to be a unique solution to Problem 1 if it satisfies following two conditions.
- (i)
.
- (ii)
If
satisfies
, then
In 1995, Natarajan showed that Problem 1 is NP-Hard [
3,
4]. As the operator
is surjective, for a given
, there is a
such that
Thus the central problem is to say when the solution to Problem 1 is unique. It is well-known that [
5,
6,
7] following problem is the closest convex relaxation problem to Problem 1.
Problem 2.
Let be a normalized frame for . Given , solve
There are several linear programmings available to obtain solution of Problem 2 and it is a P-problem [
8,
9,
10].
Most important result which shows that by solving Problem 2 we also get a solution to Problem 1 is obtained independently by Donoho and Elad [
11], Gribonval and Nielsen [
12] and Fuchs [
13,
14] is the following.
Theorem 3.
[11,12,13,14,15,16] (Donoho-Elad-Gribonval-Nielsen-Fuchs Sparsity Theorem) Let be a normalized frame for . If can be written as for some satisfying
then c is the unique solution to Problem 2 and Problem 1.
Our fundamental motivation comes from the following question: What is the noncommutative analogue of Theorem 3? This is then naturally connected with the notion of Hilbert C*-modules which are first introduced by Kaplansky [
17] for modules over commutative C*-algebras and later developed for modules over arbitrary C*-algebras by Paschke [
18] and Rieffel [
19]. We end the introduction by recalling the definition of Hilbert C*-modules.
Definition 4. [17,18,19] Let be a unital C*-algebra. A left module over is said to be a (left) Hilbert C*-module if there exists a map such that the following hold.
- (i)
, . If satisfies , then .
- (ii)
, .
- (iii)
, , .
- (iv)
, .
- (v)
is complete w.r.t. the norm , .
2. Noncommutative Donoho-Elad-Gribonval-Nielsen-Fuchs Sparsity Theorem
Observe that the notion of frames is needed for Theorem 3. Thus we want noncommutative frames. These are introduced in 2002 by Frank and Larson in their seminal paper [
20]. We begin by recalling the definition of noncommutative frames for Hilbert C*-modules. This notion is already well-developed in parallel with Hilbert space frame theory [
21,
22,
23]. In the paper, we consider only finite rank modules.
Definition 5.
[20] Let be a Hilbert C*-module over a unital C*-algebra . A collection in is said to be a (modular)framefor if there are real such that
A collection
in a Hilbert C*-module
over unital C*-algebra
with identity 1 is said to have
unit inner product if
Let
be a unital C*-algebra. For
, let
be the standard left Hilbert C*-module over
with inner product
Hence norm on
is
We define
A frame
for
gives the modular analysis morphism
and the modular synthesis morphism
With these notions, we generalize Problems 1 and 2. In the entire paper,
denotes a finite rank Hilbert C*-module over a unital C*-algebra
.
Problem 6.
Let be a unit inner product frame for . Given , solve
Problem 7.
Let be a unit inner product frame for . Given , solve
A very powerful property used to show Theorem 3 is the notion of null space property (see [
15,
24]). We now define the same property for Hilbert C*-modules. We use following notations. Let
be the canonical basis for
. Given
and
, define
Definition 8.
A unit inner product frame for is said to have the (modular)null space property(we write NSP) of order if for every with , we have
We first relate NSP with Problem 7.
Theorem 9. Let be a unit inner product frame for and let . The following are equivalent.
- (i)
If can be written as for some satisfying , then c is the unique solution to Problem 7.
- (ii)
satisfies the NSP of order k.
Proof.
- (i)
-
⇒ (ii) Let
with
and let
. Then we have
which gives
Define
and
. Then we have
and
By assumption (i), we then have
Rewriting previous inequality gives
Hence satisfies the NSP of order k.
- 1.
-
⇒ (i) Let
can be written as
for some
satisfying
. Define
. Then
. By assumption (ii), we then have
Let
be such that
and
. Define
. Then
and hence
. Using Inequality (
1), we get
Using Inequality (
2) and the information that
c is supported on
M, we get
Hence c is the unique solution to Problem 7.
□
Using Theorem 9 we obtain modular version of Theorem 3.
Theorem 10.
Let be a unit inner product frame for . If can be written as for some satisfying
then c is the unique solution to Problem 7.
Proof. We show that
satisfies the NSP of order
. Then Theorem 9 says that
c is the unique solution to Problem 7. Let
can be written as
for some
satisfying
. Let
with
and let
. Then we have
For each fixed
, above equation gives
Therefore
By taking norm,
By rewriting above inequality we get
Summing Inequality (
4) over
M leads to
Finally using Inequality (
3)
Hence
satisfies the NSP of order
k. □
Theorem 11.
(Noncommutative Donoho-Elad-Gribonval-Nielsen-Fuchs Sparsity Theorem) Let be a unit inner product frame for . If can be written as for some satisfying
then c is the unique solution to Problem 6.
Proof. Theorem 10 says that
c is the unique solution to Problem 7. Let
be such that
. We claim that
. If this fails, we must have
. We then have
Theorem 10 again says that
d is also the unique solution to Problem 7. Therefore we must have
and
which is a contradiction. So claim holds and we have
. □
References
- Benedetto, J.J.; Fickus, M. Finite normalized tight frames. Adv. Comput. Math. 2003, 18, 357–385. [Google Scholar] [CrossRef]
- Han, D.; Kornelson, K.; Larson, D.; Weber, E. Frames for undergraduates; Vol. 40, Student Mathematical Library, American Mathematical Society, Providence, RI, 2007; pp. xiv+295. [CrossRef]
- Natarajan, B.K. Sparse approximate solutions to linear systems. SIAM J. Comput. 1995, 24, 227–234. [Google Scholar] [CrossRef]
- Foucart, S.; Rauhut, H. A mathematical introduction to compressive sensing; Applied and Numerical Harmonic Analysis, Birkhäuser/Springer, New York, 2013; pp. xviii+625. [CrossRef]
- Chen, S.S.; Donoho, D.L.; Saunders, M.A. Atomic decomposition by basis pursuit. SIAM J. Sci. Comput. 1998, 20, 33–61. [Google Scholar] [CrossRef]
- Donoho, D.L.; Huo, X. Uncertainty principles and ideal atomic decomposition. IEEE Trans. Inform. Theory 2001, 47, 2845–2862. [Google Scholar] [CrossRef]
- Bruckstein, A.M.; Donoho, D.L.; Elad, M. From sparse solutions of systems of equations to sparse modeling of signals and images. SIAM Rev. 2009, 51, 34–81. [Google Scholar] [CrossRef]
- Xue, G.; Ye, Y. An efficient algorithm for minimizing a sum of p-norms. SIAM J. Optim. 2000, 10, 551–579. [Google Scholar] [CrossRef]
- Terlaky, T. On lp programming. European J. Oper. Res. 1985, 22, 70–100. [Google Scholar] [CrossRef]
- Tillmann, A.M. Equivalence of Linear Programming and Basis Pursuit. Proc. Appl. Math. Mech. 2015, 15, 735–738. [Google Scholar] [CrossRef]
- Donoho, D.L.; Elad, M. Optimally sparse representation in general (nonorthogonal) dictionaries via l1 minimization. Proc. Natl. Acad. Sci. USA 2003, 100, 2197–2202. [Google Scholar] [CrossRef] [PubMed]
- Gribonval, R.; Nielsen, M. Sparse representations in unions of bases. IEEE Trans. Inform. Theory 2003, 49, 3320–3325. [Google Scholar] [CrossRef]
- Fuchs, J.J. On sparse representations in arbitrary redundant bases. IEEE Trans. Inform. Theory 2004, 50, 1341–1344. [Google Scholar] [CrossRef]
- Fuchs, J.J. More on sparse representations in arbitrary bases. IFAC Proceedings Volumes 2003, 36, 1315–1320. [Google Scholar] [CrossRef]
- Kutyniok, G. Data separation by sparse representations. In Compressed sensing; Cambridge Univ. Press, Cambridge, 2012; pp. 485–514. [CrossRef]
- Elad, M. Sparse and redundant representations : From theory to applications in signal and image processing; Springer, New York, 2010; pp. xx+376. [CrossRef]
- Kaplansky, I. Modules over operator algebras. Amer. J. Math. 1953, 75, 839–858. [Google Scholar] [CrossRef]
- Paschke, W.L. Inner product modules over B*-algebras. Trans. Amer. Math. Soc. 1973, 182, 443–468. [Google Scholar] [CrossRef]
- Rieffel, M.A. Induced representations of C*-algebras. Advances in Math. 1974, 13, 176–257. [Google Scholar] [CrossRef]
- Frank, M.; Larson, D.R. Frames in Hilbert C*-modules and C*-algebras. J. Operator Theory 2002, 48, 273–314. [Google Scholar]
- Raeburn, I.; Thompson, S.J. Countably generated Hilbert modules, the Kasparov stabilisation theorem, and frames with Hilbert modules. Proc. Amer. Math. Soc. 2003, 131, 1557–1564. [Google Scholar] [CrossRef]
- Arambašić, L. On frames for countably generated Hilbert C*-modules. Proc. Amer. Math. Soc. 2007, 135, 469–478. [Google Scholar] [CrossRef]
- Han, D.; Jing, W.; Mohapatra, R.N. Perturbation of frames and Riesz bases in Hilbert C*-modules. Linear Algebra Appl. 2009, 431, 746–759. [Google Scholar] [CrossRef]
- Cohen, A.; Dahmen, W.; DeVore, R. Compressed sensing and best k-term approximation. J. Amer. Math. Soc. 2009, 22, 211–231. [Google Scholar] [CrossRef]
|
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).