We have recently demonstrated that oral intake of glycine propionyl-L-carnitine (GPLC) increases plasma nitrate/nitrite (NOx), a surrogate measure of nitric oxide production. However, these findings were observed at rest, and in previously sedentary subjects.
Purpose
In the present study, we sought to determine the impact of oral GPLC on plasma NOx at rest and in response to a period of reactive hyperemia in resistance trained men.
Methods
Using a double blind, crossover design, 15 healthy men (24 ± 4 years) were assigned to GPLC (3 g/d PLC + 1044 mg glycine) and a placebo in random order, for a four-week period, with a two-week washout between condition assignment. Blood samples were taken from subjects at rest and at 0, 3, and 10 minutes following an ischemia-reperfusion protocol (six minutes of upper arm cuff occlusion at 200 mmHg followed by rapid reperfusion with cuff removal). Blood samples were taken from a forearm vein from the same arm used for the protocol and analyzed for total nitrate/nitrite. Data are presented as mean ± SEM.
Results
A condition main effect (p = 0.0008) was noted for NOx, with higher values in subjects when using GPLC (45.6 ± 2.8 μmol·L-1) compared to placebo (34.9 ± 1.2 μmol·L-1). No time main effect was noted (p = 0.7099), although values increased approximately 12% from rest (37.7 ± 2.7 μmol·L-1) to a peak at 10 minutes post protocol (42.3 ± 3.3 μmol·L-1). The interaction effect was not significant (p = 0.8809), although paired time contrasts revealed higher values for GPLC compared to placebo at 3 (48.2 ± 6.7 vs. 34.9 ± 2.4 μmol·L-1; p = 0.033) and 10 (48.8 ± 5.9 vs. 35.7 ± 2.1 μmol·L-1; p = 0.036) minutes post protocol, with non-statistically significant differences noted at rest (41.8 ± 4.5 vs. 33.6 ± 2.5 μmol·L-1; p = 0.189) and at 0 minutes (43.6 ± 5.1 vs. 35.4 ± 2.7 μmol·L-1; p = 0.187) post protocol. An analysis by subject (collapsed across time) indicated that 11 of the 15 subjects experienced an increase in NOx with GPLC treatment.
Conclusion
These findings indicate that short-term oral GPLC supplementation can increase NOx in resistance trained men. However, as with many dietary supplements, there exist both "responders" and "non-responders" to treatment. Future work may focus on the mechanisms for the discrepancy in response to GPLC supplementation for purposes of NOx elevation.
Introduction
Nitric oxide (NO•) is an important signaling molecule, promoting vasodilation by acting on vascular smooth muscle [1]. In addition, NO• has been linked to other physiological functions such as inhibition of platelet aggregation and platelet adhesion [2]. In these ways, NO• mediates increased blood flow at rest [3–5] and during exercise [4, 6, 7], which may have implications for those with chronic ischemic disease as well as for athletes interested in enhancing blood flow to working skeletal muscle (e.g., endurance athletes, bodybuilders).
Nitric oxide is synthesized from L-arginine by the endothelium in the vascular system [2] and has been reported to increase in response to acute exercise [8–13]. This is true for dynamic [4], as well as for isometric [7] exercise, in which reperfusion is present following cessation of the contraction. Moreover, chronic exercise training has been reported to result in an increase in plasma nitrate/nitrite (NOx) levels [14–16], a surrogate marker of NO•.
Aside from exercise, pharmaceutical agents have been used with success to induce NO• biosynthesis, in an attempt to promote vasodilation (for review please see [17]). Treatments have sometimes included high dosages of L-arginine, often provided via intravenous injection. This has led to the development of several nutritional supplements, often containing small amounts of L-arginine, which are purported to have "drug-like" action, ultimately leading to increased NO•. While the fitness industry is inundated with advertisements for such products, the scientific data are scant. We have recently demonstrated an increase in plasma NOx in healthy sedentary subjects following oral treatment with a novel carnitine agent, glycine propionyl-L-carnitine (GPLC; [18]). This finding extends recent work of Lofreddo et al. [19] who reported an increase in blood NOx in response to 6 grams per day of PLC given via IV infusion to patients with peripheral arterial disease. Other reports suggest vasodilatation actions with PLC [20], in addition to glycine [21] treatment independently. However, our initial findings using oral GPLC were observed at rest, and in previously sedentary subjects, individuals who quite possibly have lower resting NOx levels compared to well-trained subjects; hence, may have a greater potential for responding to GPLC treatment. To our knowledge, no studies have been done to evaluate the efficacy of nutritional supplements to increase NOx levels in a sample of potential users (e.g., resistance trained athletes). Therefore, in the present study, our purpose was to determine the impact of oral GPLC on plasma NOx at rest and in response to a period of reactive hyperemia in resistance trained men. Using a double blind, randomized, crossover design, we hypothesized that plasma NOx would be higher with GPLC treatment compared to placebo, at rest and in response to the ischemia-reperfusion protocol.
Methods
Subjects
Fifteen healthy, resistance trained men participated in this investigation. Subjects completed a medical history, diet and supplementation history, and physical activity questionnaire to determine eligibility. No subject was a smoker or used anti-inflammatory drugs or antioxidant supplements before (for a minimum of six months) or during the study period. Subjects were young (24 ± 4 yrs; mean ± SD), and of average height (177 ± 5 cm), weight (83 ± 4 kg), and body fat percentage (14 ± 5 %). Subjects were considered to be well-trained and performed resistance exercise for 5 ± 2 hrs per week for 8 ± 5 yrs. They were instructed not to deviate from their current training regimen during the course of the study with the exception of refraining from exercise for the 48 hours prior to each testing day. All experimental procedures were performed in accordance with the Helsinki Declaration. The University of Memphis Human Subjects Committee approved all experimental procedures. All subjects provided both verbal and written consent prior to participating in this study.
Conditions
Subjects were randomly assigned in double-blind manner using a cross-over design to GPLC and a placebo. Each intake period consisted of four weeks, with a two-week washout period between condition assignments. Subjects were instructed to ingest a total of six capsules per day of GPLC or placebo (at two separate times – morning and evening). Based on recent evidence indicating that carnitine uptake is enhanced with carbohydrate feeding [22, 23], subjects were instructed to take capsules along with a carbohydrate rich meal. GPLC is a USP grade nutritional supplement as of March 2006, consisting of a molecular bonded form of propionyl-L-carnitine (PLC) and the amino acid glycine (GlycoCarn™, Sigma-tau HealthScience S.p.A, Rome, Italy). In the total 4.5 g/d dosage of GPLC, the actual PLC content was equal to 3 g and the glycine content was equal to 1044 mg (the remainder of the capsule consisted primarily of cellulose). The short term (8–9 week) safety of GPLC supplementation at the dosage provided (4.5 g/d) was established in our initial work [18], where we noted no adverse changes in subjects' complete blood count or blood chemistry panel data. Capsules were manufactured by Jarrow Formulas (Los Angeles, CA), were identical in appearance, and were provided to subjects in unlabeled bottles every two weeks. Compliance to intake was determined based on capsule counts upon bottle return.
Ischemia reperfusion protocol
Following each four-week period of either GPLC or placebo intake, subjects underwent a protocol involving five minutes of upper arm cuff occlusion in conjunction with submaximal isometric handgrip dynamometry to induce ischemia. The tests were conducted on day 29, following the four-week treatment period. The time of testing was matched for placebo and GPLC conditions for all subjects, and all testing was done between 0600–0900 hours. All subjects reported to the lab for testing, on both days, in a 10-hour fasted state. No food was allowed until after the 10-min post protocol blood draw. A standard blood pressure cuff was applied to the dominant upper arm and inflated to 200 mmHg. This is a common procedure used in the study of brachial artery blood flow in response to various stimuli, which results in enhanced blood flow and artery dilation during the reperfusion period, mediated by NO• [24–27]. Hence, we used this protocol to study the plasma NOx response. At the end of the five minute period, subjects performed an isometric contraction using a handgrip dynamometer at 50% of their maximal predetermined capacity, for one minute. Therefore, the total duration of cuff occlusion was six minutes. At the end of the six minute period, the pressure in the cuff was immediately removed to allow for rapid reperfusion (reactive hyperemia). Blood samples were collected before, immediately post (0), 3 min post, and 10 min post protocol, as described below.
Blood collection and biochemistry
Venous blood samples (~7 mL) were taken from subjects via needle and EDTA containing vacutainer by a trained phlebotomist. Following collection, blood samples were placed on ice and immediately centrifuged at 1500 × g at 4°C for 15 min. Plasma was then removed and immediately stored at -80°C until assayed for nitrate/nitrite (NOx). Nitrate/nitrite was analyzed using commercially available assay kits (Caymen Chemical, Ann Arbor, MI). Following conversion of nitrate to nitrite using nitrate reductase, Greiss reagent was added to the sample, which converts nitrite into a deep purple azo compound. The absorbance of this azo chromophore was then detected photometrically at 540 nm using a BioTek Instruments Powerwave 340 microplate reader (Winooski, Vermont), and unknown sample values were determined using a nitrite standard curve, via software (BioTek Gen5™). Assays were performed in duplicate and the coefficient of variation was 5.1%.
Dietary records
Subjects were instructed to maintain their normal diet during the study period and to complete food records to allow for nutrient intake assessment for the seven days prior to each testing session. Subjects were given specific instructions regarding the recording of portion sizes and quantities, in addition to viewing food models in order to enhance precision. Diet records were analyzed for total calories, protein, carbohydrate, and fat (Food Processor SQL, version 9.9, ESHA Research, Salem, OR).
Statistical analysis
Plasma NOx data were analyzed using a 2 (condition) × 4 (time) repeated measures analysis of variance (ANOVA). Single degree of freedom contrasts were used to determine condition differences at each time. Such a priori contrasts do not require adjustment of the type I error rate. Dietary data were analyzed using a one way ANOVA. These data are presented as mean ± standard error of the mean. Subject descriptive characteristics are presented as mean ± standard deviation. All analyses were performed using JMP statistical software (version 4.0.3, SAS Institute, Cary, NC). Statistical significance was set at P ≤ 0.05.
Results
Of the 16 subjects who started the study, only data from 15 subjects were included in the analysis. One subject failed to return to the lab for the second testing session; therefore, data for this subject were excluded. Compliance to GPLC and placebo intake was ≥ 97% for both conditions based on capsule counting upon return of bottles. Subjects indicated their compliance to our recommendation of maintenance of their specific exercise regimen during the course of the study period. The mean daily intake of kilocalories (2750 ± 195 vs. 2801 ± 217; p = 0.86), protein grams (155 ± 14 vs. 157 ± 15; p = 0.91), carbohydrate grams (330 ± 23 vs. 340 ± 34; p = 0.76), and fat grams (87 ± 9 vs. 81 ± 7; p = 0.60) during the week prior to GPLC and placebo conditions, respectively, did not differ. Analyses of diet records indicated that no subject regularly consumed nitrate- (e.g., spinach, cabbage, beets, radishes) or nitrite-rich foods during the diet reporting periods; therefore, we do not believe that dietary intake influenced the plasma NOx values.
A condition main effect (p = 0.0008) was noted for NOx, with higher values in subjects when using GPLC (45.6 ± 2.8 μmol·L-1) compared to placebo (34.9 ± 1.2 μmol·L-1). No time main effect was noted for NOx (p = 0.7099), although values increased approximately 12% from rest to a peak at 10 minutes post protocol. The interaction effect for NOx was not significant (p = 0.8809), although paired time contrasts revealed higher values for GPLC compared to placebo at 3 (p = 0.033) and 10 (p = 0.036) minutes post protocol. The interaction data for NOx are presented in Figure 1. An analysis by subject (collapsed across time) indicated that 11 of the 15 subjects experienced an increase in NOx with GPLC treatment (Figure 2).
Figure 1
Plasma nitrate/nitrite before and after an ischemia-reperfusion protocol in 15 resistance trained men supplemented with GPLC and placebo in a cross-over design. Note: Condition main effect (p = 0.0008); No time main effect (p = 0.7099) or interaction effect (p = 0.8809); paired time contrasts at 3 (p = 0.033) and 10 (p = 0.036) minutes post protocol; rest (p = 0.189) and 0 (p = 0.187) minutes post protocol; % change from rest presented for each time post protocol. Values are mean ± SEM.
Figure 2
Individual subject data for plasma nitrate/nitrite before and after an ischemia-reperfusion protocol in 15 resistance trained men supplemented with GPLC and placebo in a cross-over design. Note: NOx data collapsed over time.
Discussion
We report for the first time that a nutritional supplement, in the form of oral GPLC, can increase plasma NOx in resistance trained men. These findings may have implications for enhanced blood flow to active skeletal muscle during exercise. This may be important for endurance athletes, for whom increased blood flow may aid exercise performance [15, 28], as well as for bodybuilders, for whom increased blood flow may lead to greater delivery of substrates (e.g., amino acids) during recovery, which may increase protein synthesis [29].
Although we noted no time main effect or interaction effect of NOx (Figure 1), values were generally higher at all times following the protocol, with a peak increase from rest at 10 minutes post protocol. Furthermore, although no interaction effect was noted, values were statistically higher with the GPLC treatment compared to placebo at 3 and 10 minutes post protocol, with non-statistically higher values noted at rest and at 0 minutes post protocol. Therefore, while resting NOx levels may not be increased significantly with GPLC treatment in resistance trained men, NOx in response to an acute physical stimulus appears higher with GPLC treatment compared to placebo. For example, the increase from rest with GPLC was 16% and 17% at 3 and 10 minutes post protocol, respectively. Whereas, the increase from rest with placebo was only 4% and 6% at 3 and 10 minutes post protocol, respectively (Figure 1). Although these findings are interesting, future work should include flow mediated dilation studies as a compliment to the plasma NOx measurement, in order to investigate bloodflow specific changes due to GPLC treatment. This would provide insight into the physiological relevance of the NOx increase.
Despite our findings that the majority of subjects responded to GPLC treatment (11 of 15; Figure 2), there were those individuals who were "non-responders". This is common with nutritional supplements, and with regards to dietary carnitine supplementation, may be related to carbohydrate intake. That is, based on the recent findings of Stephens and coworkers [22, 23], carbohydrate rich feedings, which induce a state of hyperinsulinemia, appear to improve carnitine transport into skeletal muscle. Hence, subjects with a low carbohydrate intake, in particular as related to the actual time of carnitine ingestion, may experience less than optimal uptake into tissue. This may also be true as related to uptake into endothelial cells. If this were the case, it is possible that the effects of GPLC on NOx would be minimized. However, we analyzed the mean daily carbohydrate intake of all subjects and noted no difference between the carbohydrate intake of "responders" (342 ± 27 g) and "non-responders (316 ± 31 g). Moreover, we noted no correlation between carbohydrate intake and NOx levels (p = 0.27). Therefore, other mechanisms must be involved related to these subjects' inability to respond to GPLC treatment. Future study is needed to explore the potential mechanisms associated with this finding. In addition, the specific mechanisms responsible for the increase in plasma NOx with GPLC supplementation remain to be elucidated. That is, in vitro data indicate that maintenance of NO• with PLC treatment may be associated with decreased NADPH oxidase activation [30], an enzyme which subsequently leads to superoxide radical generation [31] and decreased NO• bioavailability. Moreover, recent work indicates that PLC augments endothelial nitric oxide synthase (eNOS) [32], the major enzyme responsible for NO• production. Clearly, these findings provide some mechanistic evidence to support our data; however more work is needed to more fully understand the mechanisms associated with the increase in plasma NOx (perhaps investigation of second messenger systems such as cGMP) with GPLC supplementation in human subjects.
Conclusion
In summary, our findings indicate that short-term oral GPLC supplementation can increase NOx in resistance trained men. However, there exist both "responders" and "non-responders" to treatment. Findings from this study may have health implications for those with ischemic conditions such as peripheral vascular disease and ischemic heart disease, as increased NOx may allow for enhanced blood flow, in particular during times of physical stress. Moreover, these findings may relate specifically to athletes who seek enhanced blood flow during periods of strenuous exercise, as such a change may be associated with improved physical performance during training and optimal post exercise recovery. Future study is needed to determine what, if any, physiologic benefit is associated with the observed increase in plasma NOx with GPLC supplementation.
Declarations
Acknowledgements
Funding for this work was provided in part by Sigma-tau HealthSciences, Inc. and the University of Memphis.
Authors’ Affiliations
(1)
Department of Health and Sport Sciences, University of Memphis
References
Maiorana A, O'Driscoll G, Taylor R, Green D: Exercise and the nitric oxide vasodilator system. Sports Med. 2003, 33 (14): 1013-1035. 10.2165/00007256-200333140-00001.View ArticlePubMedGoogle Scholar
Joannides R, Haefeli WE, Linder L, Richard V, Bakkali EH, Thuillez C, Luscher TF: Nitric oxide is responsible for flow-dependent dilatation of human peripheral conduit arteries in vivo. Circulation. 1995, 91 (5): 1314-1319.View ArticlePubMedGoogle Scholar
Hickner RC, Fisher JS, Ehsani AA, Kohrt WM: Role of nitric oxide in skeletal muscle blood flow at rest and during dynamic exercise in humans. Am J Physiol. 1997, 273 (1 Pt 2): H405-410.PubMedGoogle Scholar
Duffy SJ, Castle SF, Harper RW, Meredith IT: Contribution of vasodilator prostanoids and nitric oxide to resting flow, metabolic vasodilation, and flow-mediated dilation in human coronary circulation. Circulation. 1999, 100: 1951-1957.View ArticlePubMedGoogle Scholar
Dyke CK, Proctor DN, Dietz NM, Joyner MJ: Role of nitric oxide in exercise hyperemia during prolonged rhythmic handgripping in humans. J Physiol (Lond). 1995, 488: 259-265.View ArticleGoogle Scholar
Gilligan DM, Panza JA, Kilcoyne CM, Waclawiw MA, Casino PR, Quyyumi AA: Contribution of endothelium-derived nitric oxide to exercise-induced vasodilation. Circulation. 1994, 90: 2853-2858.View ArticlePubMedGoogle Scholar
Ambring A, Benthin G, Petersson AS, Jungerstenm L, Wennmalm A: Indirect evidence of increased expression of NO synthase in marathon runners, and up regulation of NO synthase activity during running. Circulation. 90: I-137. (abstract)Google Scholar
Clarkson P, Montgomery HE, Mullen MJ, Donald AE, Powe AJ, Bull T, Jubb M, World M, Deanfield JE: Exercise training enhances endothelial function in young men. J Am Coll Cardiol. 1999, 33: 1379-1385. 10.1016/S0735-1097(99)00036-4.View ArticlePubMedGoogle Scholar
DeSouza CA, Shapiro LF, Clevenger C, Dinenno F, Monahan M, Tanka H, Seals DR: Regular aerobic exercise prevents and restores age-related declines in endothelium-dependent vasodilation in healthy men. Circulation. 2000, 102: 1351-1357.View ArticlePubMedGoogle Scholar
Di Massimo C, Scarpelli P, Tozzi-Ciancarelli MG: Possible involvement of oxidative stress in exercise-mediated platelet activation. Clin Hemorheol Microcirc. 2004, 30 (3–4): 313-316.PubMedGoogle Scholar
Tozzi-Ciancarelli MG, Penco M, Di Massimo C: Influence of acute exercise on human platelet responsiveness: possible involvement of exercise-induced oxidative stress. Eur J Appl Physiol. 2002, 86 (3): 266-272. 10.1007/s00421-001-0542-8.View ArticlePubMedGoogle Scholar
Edwards DG, Schofield RS, Lennon SL, Pierce GL, Nichols WW, Braith RW: Effect of exercise training on endothelial function in men with coronary artery disease. Am J Cardiol. 2004, 93 (5): 617-20. 10.1016/j.amjcard.2003.11.032.View ArticlePubMedGoogle Scholar
Tordi N, Colin E, Mourot L, Bouhaddi M, Regnard J, Laurant P: Effects of resuming endurance training on arterial stiffness and nitric oxide production during exercise in elite cyclists. Appl Physiol Nutr Metab. 2006, 31 (3): 244-249. 10.1139/H05-033.View ArticlePubMedGoogle Scholar
Poveda JJ, Riestra A, Salas E, Cagigas ML, Lopez-Somoza C, Amado JA, Berrazueta JR: Contribution of nitric oxide to exercise-induced changes in healthy volunteers: effects of acute exercise and long-term physical training. Eur J Clin Invest. 1997, 27 (11): 967-971. 10.1046/j.1365-2362.1997.2220763.x.View ArticlePubMedGoogle Scholar
Burgaud JL, Ongini E, Del Soldato P: Nitric oxide-releasing drugs: a novel class of effective and safe therapeutic agents. Ann N Y Acad Sci. 2002, 962: 360-71.View ArticlePubMedGoogle Scholar
Bloomer RJ, Tschume LC, Smith WA: Glycine propionyl-L-carnitine modulates lipid peroxidation and nitric oxide in human subjects. Int J Vitam Nutr Res.Google Scholar
Loffredo L, Marcoccia A, Pignatelli P, Andreozzi P, Borgia MC, Cangemi R, Chiarotti F, Violi F: Oxidative-stress-mediated arterial dysfunction in patients with peripheral arterial disease. Eur Heart J. 2007, 28 (5): 608-612. 10.1093/eurheartj/ehl533.View ArticlePubMedGoogle Scholar
Cipolla MJ, Nicoloff A, Rebello T, Amato A, Porter JM: Propionyl-L-carnitine dilates human subcutaneous arteries through an endothelium-dependent mechanism. J Vasc Surg. 1999, 29 (6): 1097-1103. 10.1016/S0741-5214(99)70251-X.View ArticlePubMedGoogle Scholar
Hafidi ME, Perez I, Banos G: Is glycine effective against elevated blood pressure?. Curr Opin Clin Nutr Metab Care. 2006, 9: 26-31.View ArticlePubMedGoogle Scholar
Stephens FB, Constantin-Teodosiu D, Laithwaite D, Simpson EJ, Greenhaff PL: Insulin stimulates L-carnitine accumulation in human skeletal muscle. FASEB J. 2006, 20 (2): 377-379.PubMedGoogle Scholar
Doshi SN, Naka KK, Payne N, Jones CJ, Ashton M, Lewis MJ, Goodfellow J: Flow-mediated dilatation following wrist and upper arm occlusion in humans: the contribution of nitric oxide. Clin Sci (Lond). 2001, 101 (6): 629-635.View ArticleGoogle Scholar
Engelke KA, Halliwill JR, Proctor DR, Dietz NM, Joyner MJ: Contribution of nitric oxide and prostaglandins to reactive hyperemia in the human forearm. J Appl Physiol. 1996, 81 (4): 1807-1814.PubMedGoogle Scholar
Meredith IT, Currie KE, Anderson TJ, Roddy MA, Ganz P, Creager MA: Postischemic vasodilation in human forearm is dependent on endothelium-derived nitric oxide. Am J Physiol. 1996, 270 (4 Pt 2): H1435-1440.PubMedGoogle Scholar
Mullen MJ, Kharbanda RK, Cross J, Donald AE, Taylor M, Vallance P, Deanfield JE, MacAllister RJ: Heterogenous nature of flow-mediated dilatation in human conduit arteries in vivo: relevance to endothelial dysfunction in hypercholesterolemia. Circ Res. 2001, 88 (2): 145-151.View ArticlePubMedGoogle Scholar
Miyachi M, Iemitsu M, Okutsu M, Onodera S: Effects of endurance training on the size and blood flow of the arterial conductance vessels in humans. Acta Physiol Scand. 1998, 163 (1): 13-6. 10.1046/j.1365-201x.1998.0337f.x.View ArticlePubMedGoogle Scholar
Pignatelli P, Lenti L, Sanguigni V, Frati G, Simeoni I, Gazzaniga PP, Pulcinelli FM, Violi F: Carnitine inhibits arachidonic acid turnover, platelet function, and oxidative stress. Am J Physiol Heart Circ Physiol. 2003, 284 (1): H41-8.View ArticlePubMedGoogle Scholar
Zalba G, San Jose G, Moreno MU, Fortuno MA, Fortuno A, Beaumont FJ, Diez J: Oxidative stress in arterial hypertension: role of NAD(P)H oxidase. Hypertension. 2001, 38 (6): 1395-9. 10.1161/hy1201.099611.View ArticlePubMedGoogle Scholar
de Sotomayor MA, Mingorance C, Rodriguez-Rodriguez R, Marhuenda E, Herrera MD: l-carnitine and its propionate improvement of endothelial function in SHR through superoxide dismutase-dependent mechanisms. Free Radic Res. 2007, 41 (8): 884-891. 10.1080/10715760701416467.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
