- Research
- Open access
- Published:
Convergence results for a common solution of a finite family of variational inequality problems for monotone mappings with Bregman distance function
Fixed Point Theory and Applications volume 2013, Article number: 343 (2013)
Abstract
In this paper, we introduce an iterative process which converges strongly to a common solution of a finite family of variational inequality problems for monotone mappings with Bregman distance function. Our convergence theorem is applied to the convex minimization problem. Our theorems extend and unify most of the results that have been proved for the class of monotone mappings.
MSC:47H05, 47J05, 47J25.
1 Introduction
Throughout this paper, E is a real reflexive Banach space with as its dual and is a proper, lower semicontinuous and convex function. We denote by domf the domain of f, defined by . For any and , the right-hand derivative of f at x in the direction of y is defined by
The function f is said to be Gâteaux differentiable at x if exists for any . In this case, coincides with , the value of the gradient ∇f of f at x. The function f is said to be Gâteaux differentiable if it is Gâteaux differentiable for any . The function f is said to be Fréchet differentiable at x if this limit is attained uniformly in . We say that f is uniformly Fréchet differentiable on a subset C of E if the limit is attained uniformly for and .
Let be a Gâteaux differentiable function. The function defined by
is called the Bregman distance with respect to f [1].
A Bregman projection with respect to f [1] of onto the nonempty, closed and convex set is the unique vector satisfying
Remark 1.1 If E is a smooth and strictly convex Banach space and for all , then we have that for all , where J the normalized duality mapping from E into , and hence becomes for all , which is the Lyapunov function introduced by Alber [2] and studied by many authors (see, e.g., [3–9] and the references therein). In addition, under the same condition, the Bregman projection reduces to the generalized projection (see, e.g., [2]) which is defined by
If , a Hilbert space, J is the identity mapping, and hence the Bregman projection reduces to the metric projection of H on to C, .
A mapping is said to be γ-inverse strongly monotone if there exists a positive real number γ such that
A is said to be monotone if, for each , the following inequality holds:
Clearly, the class of monotone mappings includes the class of γ-inverse strongly monotone mappings.
Let C be a nonempty, closed and convex subset of E and be a monotone mapping. The problem of finding
is called the variational inequality problem. The set of solutions of the variational inequality is denoted by .
Variational inequality problems are related with the convex minimization problem, the zero of monotone mappings and the complementarity problem. Consequently, many researchers (see, e.g., [3, 5, 10–15]) have made efforts to obtain iterative methods for approximating solutions of variational inequality problems.
If , a Hilbert space, Iiduka et al. [16] introduced the following projection algorithm:
where is the metric projection from H onto C and is a sequence of positive real numbers. They proved that the sequence generated by (1.6) converges weakly to some element of provided that A is a γ-inverse strongly monotone mapping.
If E is a 2-uniformly convex and uniformly smooth Banach space, and A is γ-inverse strongly monotone, Iiduka and Takahashi [17] introduced the following iteration scheme for finding a solution of the variational inequality problem:
where is the generalized projection from E onto C, J is the normalized duality mapping from E into and is a sequence of positive real numbers. They proved that the sequence generated by (1.7) converges weakly to some element of .
It is worth mentioning that the convergence obtained above is weak convergence. Our concern now is to look for an iteration scheme which converges strongly to a solution of the variational inequality problem for a monotone mapping A.
In this regard, when E is a 2-uniformly convex and uniformly smooth Banach space and A is a γ-inverse strongly monotone mapping satisfying for all and for , Iiduka and Takahashi [10] studied the following iterative scheme for a solution of the variational inequality problem:
where is a positive real sequence satisfying certain mild conditions and is the generalized projection from E onto , J is the duality mapping from E into . Then they proved that the sequence converges strongly to an element of .
Recently, Zegeye and Shahzad [18] studied the following iterative scheme for a common point of a solution of two variational inequality problems for continuous monotone mappings in a uniformly smooth and strictly convex real Banach space E which also enjoys the Kadec-Klee property:
where for all , , and satisfy certain mild conditions. Then they proved that the sequence converges strongly to , where is the generalized projection from E onto .
In 1967, Bregman [1] discovered an elegant and effective technique for using the so-called Bregman distance function in the process of designing and analyzing feasibility and optimization algorithms. Using Bregman’s distance function and its properties, authors have opened a growing area of research not only for iterative algorithms of solving feasibility and optimization problems but also for algorithms of solving nonlinear, equilibrium, variational inequality, fixed point problems and others (see, e.g., [19–25] and the references therein).
In 2010, Reich and Sabach [25] proposed an algorithm for finding a common zero point of a finite family of maximal monotone mappings () in a general reflexive Banach space E as follows:
where , are error sequences in E with and is the Bregman projection with respect to f from E onto a closed and convex subset C of E. Those authors showed that the sequence defined by (1.10) converges strongly to a common element in under some mild conditions. Similar results are also available in [26, 27].
Remark 1.2 But it is worth mentioning that the iteration processes (1.8)-(1.10) seem difficult in the sense that at each stage of iteration, the set(s) and (or) is (are) computed and the next iterate is taken as the Bregman projection of onto the intersection of and (or ). This seems difficult to do in applications.
It is our purpose in this paper to introduce an iterative scheme which converges strongly to a common solution of a finite family of variational inequality problems for monotone mappings in real reflexive Banach spaces. Our scheme does not involve computations of or for each . Furthermore, we apply our convergence theorem to a convex minimization problem. Our theorems extend and unify most of the results that have been proved for this important class of nonlinear operators.
2 Preliminaries
Let . The subdifferential of f at x is the convex set defined by , where the Fenchel conjugate of f is the function defined by .
The function f is said to be:
-
(i)
Essentially smooth if ∂f is both locally bounded and single-valued on its domain.
-
(ii)
Essentially strictly convex if is locally bounded on its domain and f is strictly convex on every convex subset of domf.
-
(iii)
Legendre if it is both essentially smooth and essentially strictly convex.
We remark that we have the following:
-
(i)
f is essentially smooth if and only if is essentially strictly convex (see [19], Theorem 5.4).
-
(ii)
(see [28]).
-
(iii)
f is Legendre if and only if is Legendre (see [19], Corollary 5.5).
-
(iv)
If f is Legendre, then ∇f is a bijection satisfying , and (see [19], Theorem 5.10).
When the subdifferential of f is single-valued, then (see [29]).
A function f on E is coercive [30] if the sublevel set of f is bounded; equivalently, .
Let be a convex and Gâteaux differentiable function. The modulus of total convexity of f at x∈ domf is the function defined by
The function f is called totally convex at x if , whenever . The function f is called totally convex if it is totally convex at any point and it is said to be totally convex on bounded sets if for any nonempty bounded subset B of E and , where the modulus of total convexity of the function f on the set B is the function defined by
We know that f is totally convex on bounded sets if and only if f is uniformly convex on bounded sets (see [22], Theorem 2.10). The following lemmas will be useful in the proof of our main result.
Lemma 2.1 [31]
The function is totally convex on bounded subsets of E if and only if for any two sequences and in and domf, respectively, such that the first one is bounded,
Lemma 2.2 [22]
Let C be a nonempty, closed and convex subset of E. Let be a Gâteaux differentiable and totally convex function, and let . Then:
-
(i)
if and only if , .
-
(ii)
, .
Lemma 2.3 [29]
Let be a proper, lower semi-continuous and convex function, then is a proper, weak∗ lower semicontinuous and convex function. Thus, for all , we have
Lemma 2.4 [32]
Let be Gâteaux differentiable on such that is bounded on bounded subsets of . Let and . If is bounded, so is the sequence .
Let be a Legendre and Gâteaux differentiable function. Following [2] and [33], we make use of the function associated with f, which is defined by
Then is nonnegative and
Moreover, by the subdifferential inequality,
and (see [34]).
Lemma 2.5 [35]
Let be a sequence of nonnegative real numbers satisfying the following relation:
where and satisfy the following conditions: , , and . Then .
Lemma 2.6 [4]
Let be a sequence of real numbers such that there exists a subsequence of such that for all . Then there exists an increasing sequence such that and the following properties are satisfied by all (sufficiently large) numbers :
In fact, is the largest number n in the set such that the condition holds.
Following the agreement in [26], we have the following lemma.
Lemma 2.7 Let be a coercive Legendre function and C be a nonempty, closed and convex subset of E. Let be a continuous monotone mapping. For and , define the mapping as follows:
for all . Then the following hold:
-
(1)
is single-valued;
-
(2)
;
-
(3)
for ;
-
(4)
is closed and convex.
3 Main result
Let C be a nonempty, closed and convex subset of E. Let , for , be continuous monotone mappings. For , define for all and , where f is a Legendre and convex function from E into . Then, in what follows, we shall study the following iteration process:
where satisfies and , and for some .
Theorem 3.1 Let be a strongly coercive Legendre function which is bounded, uniformly Fréchet differentiable and totally convex on bounded subsets of E. Let C be a nonempty, closed and convex subset of and , for , be a finite family of continuous monotone mappings with . Let be a sequence defined by (3.1). Then converges strongly to .
Proof By Lemma 2.7 we have that each for each and hence ℱ are closed and convex. Thus, we can take . Let and . Then, from (3.1), Lemmas 2.2, 2.3 and the property of ϕ, we get that
Thus, by induction,
which implies by Lemma 2.4 that and hence are bounded. Now let . Then we have from (3.1) that . Using Lemmas 2.2, 2.3, 2.7(3), (2.3) and (2.4), we obtain that
which implies that
Now, we consider two possible cases.
Case 1. Suppose that there exists such that is decreasing. Then we obtain that is convergent. Thus, from (3.3) we have that as , and hence by Lemma 2.1 we get that
Furthermore, from the property of and the fact that as , we have that
and hence from Lemma 2.1 we have that and this with (3.4) implies that
Since is bounded and E is reflexive, we choose a subsequence of such that and . Then, from (3.5) and (3.4), we get that for each .
Now, we show that for each . But from the definition of , we have that
and hence
for each . Set for all and . Consequently, we get that . Now, from (3.6) it follows that
In addition, since f is uniformly Fréchet differentiable and bounded, we have that ∇f is uniformly continuous (see [36]). Thus, from (3.4) and the uniform continuity of ∇f, we obtain that
and since A is monotone, we also have that . Thus, it follows that
and hence
If , the continuity of implies that
This implies that for all .
Therefore, we obtain that . Thus, by Lemma 2.2, we immediately obtain that . It follows from Lemma 2.5 and (3.3) that as . Consequently, .
Case 2. Suppose that there exists a subsequence of such that
for all . Then, by Lemma 2.6, there exists a nondecreasing sequence such that , and for all . From (3.3) and , we have
which implies that , and hence as . Thus, as in Case 1, we obtain that
Furthermore, from (3.3) we have that
Thus, since , we get that
Moreover, since , we obtain that
It follows from (3.7) that as . This together with (3.8) implies that . Therefore, since for all , we conclude that as . Hence, both cases imply that converges strongly to and the proof is complete. □
If in Theorem 3.1 , then we get the following corollary.
Corollary 3.2 Let be a strongly coercive Legendre function which is bounded, uniformly Fréchet differentiable and totally convex on bounded subsets of E. Let C be a nonempty, closed and convex subset of , and let be a continuous monotone mapping with . Let be a sequence defined by (3.1),
where for all ; satisfies and and for some . Then the sequence converges strongly to a point .
If , then and hence the following corollary holds.
Corollary 3.3 Let be a strongly coercive Legendre function which is bounded, uniformly Fréchet differentiable and totally convex on bounded subsets of E. Let , for , be a finite family of continuous monotone mappings. Let . Let be a sequence defined by (3.1). Then converges strongly to .
If in Theorem 3.1 we assume , then the scheme converges strongly to the common minimum-norm zero of a finite family of continuous monotone mappings. In fact, we have the following corollary.
Corollary 3.4 Let be a strongly coercive Legendre function which is bounded, uniformly Fréchet differentiable and totally convex on bounded subsets of E. Let C be a nonempty, closed and convex subset of , and let , for , be a finite family of continuous monotone mappings with . Let be a sequence defined by (3.1) with . Then converges strongly to , which is the common minimum-norm (with respect to the Bregman distance) solution of the variational inequalities.
4 Application
In this section, we study the problem of finding a minimizer of a continuously Fréchet differentiable convex functional in Banach spaces.
Let , for , be continuously Fréchet differentiable convex functionals such that the gradients of , are continuous and monotone. For , let for all and for each . Then the following theorem holds.
Theorem 4.1 Let be a strongly coercive Legendre function which is bounded, uniformly Fréchet differentiable and totally convex on bounded subsets of E. Let , , be continuously Fréchet differentiable convex functionals such that the gradients of , are continuous, monotone and , where . Let be a sequence defined by
where satisfies and and for some . Then the sequence converges strongly to .
Proof We note that from the convexity and Fréchet differentiability of f, we have for each . Thus, by Theorem 3.1, converges strongly to . □
Remark 4.2 Our results are new even if the convex function f is chosen to be () in uniformly smooth and uniformly convex spaces.
Remark 4.3 Our theorems extend and unify most of the results that have been proved for this important class of nonlinear operators. In particular, Theorem 3.1 extends Theorem 3.3 of [16], Theorem 3.1 of [17], Theorem 3.1 of [17] and Theorem 3.3 of [10] and Theorem 4.2 of [25] either to a more general class of continuous monotone operators or to a more general Banach space E. Moreover, in all our theorems and corollaries, the computation of or for each is not required.
References
Bregman LM: The relaxation method for finding the common point of convex sets and its application to the solution of problems in convex programming. USSR Comput. Math. Math. Phys. 1967, 7: 200–217.
Alber YI: Metric and generalized projection operators in Banach spaces: properties and applications. Lect. Notes Pure Appl. Math. Theory and Applications of Nonlinear Operators of Accretive and Monotone Type 1996, 15–50.
Kamimura S, Takahashi W: Strong convergence of proximal-type algorithm in a Banach space. SIAM J. Optim. 2002, 13: 938–945. 10.1137/S105262340139611X
Maingé PE: Strong convergence of projected subgradient methods for nonsmooth and non-strictly convex minimization. Set-Valued Anal. 2008, 16: 899–912. 10.1007/s11228-008-0102-z
Zegeye H, Ofoedu EU, Shahzad N: Convergence theorems for equilibrium problem, variational inequality problem and countably infinite relatively quasi-nonexpansive mappings. Appl. Math. Comput. 2010, 216: 3439–3449. 10.1016/j.amc.2010.02.054
Zegeye H, Shahzad N: Strong convergence theorems for a finite family of nonexpansive mappings and semi-groups via the hybrid method. Nonlinear Anal. 2010, 72: 325–329. 10.1016/j.na.2009.06.056
Zegeye H, Shahzad N: A hybrid approximation method for equilibrium, variational inequality and fixed point problems. Nonlinear Anal. Hybrid Syst. 2010, 4: 619–630. 10.1016/j.nahs.2010.03.005
Zegeye H, Shahzad N: A hybrid scheme for finite families of equilibrium, variational inequality and fixed point problems. Nonlinear Anal. 2011, 74: 263–272. 10.1016/j.na.2010.08.040
Zegeye H, Shahzad N: Convergence theorems for a common point of solutions of equilibrium and fixed point of relatively nonexpansive multi-valued mapping problems. Abstr. Appl. Anal. 2012., 2012: Article ID 859598
Iiduka H, Takahashi W: Strong convergence studied by a hybrid type method for monotone operators in a Banach space. Nonlinear Anal. 2008, 68: 3679–3688. 10.1016/j.na.2007.04.010
Kinderlehrer D, Stampaccia G: An Iteration to Variational Inequalities and Their Applications. Academic Press, New York; 1990.
Lions JL, Stampacchia G: Variational inequalities. Commun. Pure Appl. Math. 1967, 20: 493–517. 10.1002/cpa.3160200302
Zegeye H, Shahzad N: Strong convergence for monotone mappings and relatively weak nonexpansive mappings. Nonlinear Anal. 2009, 70: 2707–2716. 10.1016/j.na.2008.03.058
Zegeye H, Shahzad N, Alghamdi MA: Strong convergence theorems for a common point of solution of variational inequality, solutions of equilibrium and fixed point problems. Fixed Point Theory Appl. 2012., 2012: Article ID 119
Zegeye H, Shahzad N: An iteration to a common point of solution of variational inequality and fixed point-problems in Banach spaces. J. Appl. Math. 2012., 2012: Article ID 504503
Iiduka H, Takahashi W, Toyoda M: Approximation of solutions of variational inequalities for monotone mappings. Panam. Math. J. 2004, 14: 49–61.
Iiduka H, Takahashi W: Weak convergence of projection algorithm for variational inequalities in Banach spaces. J. Math. Anal. Appl. 2008, 339: 668–679. 10.1016/j.jmaa.2007.07.019
Zegeye H, Shahzad N: Approximating common solution of variational inequality problems for two monotone mappings in Banach spaces. Optim. Lett. 2011, 5: 691–704. 10.1007/s11590-010-0235-5
Bauschke HH, Borwein JM, Combettes PL: Essential smoothness, essential strict convexity, and Legendre functions in Banach spaces. Commun. Contemp. Math. 2001, 3: 615–647. 10.1142/S0219199701000524
Bauschke HH, Borwein JM, Combettes PL: Bregman monotone optimization algorithms. SIAM J. Control Optim. 2003, 42: 596–636. 10.1137/S0363012902407120
Butnariu D, Iusem AN, Zalinescu C: On uniform convexity, total convexity and convergence of the proximal point and outer Bregman projection algorithms in Banach spaces. J. Convex Anal. 2003, 10: 35–61.
Butnariu D, Resmerita E: Bregman distances, totally convex functions and a method for solving operator equations in Banach spaces. Abstr. Appl. Anal. 2006., 2006: Article ID 84919
Reich S: A weak convergence theorem for the alternating method with Bregman distances. In Theory and Applications of Nonlinear Operators of Accretive and Monotone Type. Dekker, New York; 1996:313–318.
Reich S, Sabach S: A projection method for solving nonlinear problems in reflexive Banach spaces. J. Fixed Point Theory Appl. 2011, 9: 101–116. 10.1007/s11784-010-0037-5
Reich S, Sabach S: Two strong convergence theorems for a proximal method in reflexive Banach spaces. Numer. Funct. Anal. Optim. 2010, 31: 22–44. 10.1080/01630560903499852
Reich S, Sabach S: Two strong convergence theorems for Bregman strongly nonexpansive operators in reflexive Banach spaces. Nonlinear Anal. TMA 2010, 73: 122–135. 10.1016/j.na.2010.03.005
Reich S, Sabach S: Existence and approximation of fixed points of Bregman firmly nonexpansive mappings in reflexive Banach spaces. In Fixed-Point Algorithms for Inverse Problems in Science and Engineering. Springer, New York; 2011:301–316.
Bonnans JF, Shapiro A: Perturbation Analysis of Optimization Problems. Springer, New York; 2000.
Phelps RP Lecture Notes in Mathematics 1364. In Convex Functions, Monotone Operators, and Differentiability. 2nd edition. Springer, Berlin; 1993.
Hiriart-Urruty J-B, Lemarchal C Grundlehren der Mathematischen Wissenschaften 306. In Convex Analysis and Minimization Algorithms II. Springer, Berlin; 1993.
Butnariu D, Iusem AN: Totally Convex Functions for Fixed Points Computation and Infinite Dimensional Optimization. Kluwer Academic, Dordrecht; 2000.
Martin-Marquez V, Reich S, Sabach S: Bregman strongly nonexpansive operators in reflexive Banach spaces. J. Math. Anal. Appl. 2013, 400: 597–614. 10.1016/j.jmaa.2012.11.059
Censor Y, Lent A: An iterative row-action method for interval convex programming. J. Optim. Theory Appl. 1981, 34: 321–353. 10.1007/BF00934676
Kohsaka F, Takahashi W: Proximal point algorithms with Bregman functions in Banach spaces. J. Nonlinear Convex Anal. 2005, 6: 505–523.
Xu HK: Another control condition in an iterative method for nonexpansive mappings. Bull. Aust. Math. Soc. 2002, 65: 109–113. 10.1017/S0004972700020116
Reich S, Sabach S: A strong convergence theorem for a proximal-type algorithm in reflexive Banach spaces. J. Nonlinear Convex Anal. 2009, 10: 471–485.
Acknowledgements
This article was funded by the Deanship of Scientific Research (DSR), King Abdulaziz University, Jeddah. The first and third authors acknowledge with thanks DSR for financial support. The second author undertook this work when he was visiting the Abdus Salam International Center for Theoretical Physics (ICTP), Trieste, Italy, as a regular associate.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally to this work. All authors read and approved final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Shahzad, N., Zegeye, H. & Alotaibi, A. Convergence results for a common solution of a finite family of variational inequality problems for monotone mappings with Bregman distance function. Fixed Point Theory Appl 2013, 343 (2013). https://doi.org/10.1186/1687-1812-2013-343
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1687-1812-2013-343