Volume 2 Supplement 1
Temporal differences in the development of organ dysfunction based on two different approaches to induce experimental intra-abdominal hypertension in swine
© Moller et al.; licensee Springer 2012
Published: 5 July 2012
Intra-abdominal hypertension [IAH] occurs frequently among critically ill patients and is associated with increased mortality and organ failure. Two porcine models of IAH that cause abdominal compartment syndrome [ACS] with organ dysfunction were created. We investigated whether the two methods used to create IAH - CO2 pneumoperitoneum or adding volume to the intra-abdominal space - exerted different impacts on the temporal development of organ dysfunction.
Twenty-four 40-kg female pigs were allocated to four groups: 25 mmHg IAH with CO2 pneumoperitoneum (n = 8), > 20 mmHg IAH caused by addition of volume (n = 8), and two corresponding sham groups (each n = 4). The two sham groups were later pooled into one control group (n = 8). The animals were monitored for 12 h. Repeated serial measurements were taken of group differences over time and analyzed using analysis of variance.
Thirty-eight percent of the animals (n = 3) in each intervention group died near the end of the 12-h experiment. Both intervention groups experienced kidney impairment: increased creatinine concentration (P < 0.0001), anuria (P = 0.0005), hyperkalemia (P < 0.0001), decreased abdominal perfusion pressure, and decreased dynamic lung compliance. CO2 pneumoperitoneum animals developed hypercapnia (P < 0.0001) and acidosis (P < 0.0001).
Both methods caused ACS and organ dysfunction within 12 h. Hypercapnia and acidosis developed in the CO2 pneumoperitoneum group.
Keywordsmultiple organ failure multiple organ dysfunction syndrome swine acute kidney injury acidosis abdomen.
The multiple organ dysfunction syndrome [MODS] is a major cause of death among patients with infection/sepsis and traumatic or surgical injury . Intra-abdominal hypertension [IAH] occurs frequently among critically ill patients and is both a predictor of MODS  and associated with mortality and organ failure [3, 4]. An increase in intra-abdominal pressure [IAP] > 20 mmHg and associated new organ damage are referred to as the abdominal compartment syndrome [ACS] . Prior studies have shown that risk factors for the development of IAH and ACS include acute respiratory failure, abdominal surgery, sepsis, massive fluid resuscitation, and major trauma .
It is difficult to develop a single experimental animal model of MODS based on IAH, and unfortunately, the ideal model of ACS is not yet developed . CO2 pneumoperitoneum generated by laparoscopic insufflation was used to generate IAH in experimental models [8–12]. CO2 pneumoperitoneum is known to impact the immune response in at least two ways: as a direct consequence of the peritoneal acidosis  and by causing systemic acidosis , which also influences the immune response . Fluid-filled bags placed intra-abdominally were used to simulate IAH . Both methods generate IAH and cause ACS, and might therefore produce MODS. The question remains whether there are differences in the effects that the models have on organ dysfunction.
The main aim of this study was to investigate differences in creating IAH by CO2 pneumoperitoneum or by adding volume to the intra-abdominal space using a fluid bag model. With IAH generated by laparoscopic CO2 insufflations in one model and volume added to the intra-abdominal cavity in another model, we could evaluate and compare the impacts on the kidneys, cardiovascular system, metabolism, and mortality.
Materials and methods
The investigation conformed to the Danish law for animal research (Act no. 1306 of 23/11/2007, Danish Ministry of Justice) and the guidelines from Guide for the Care and Use of Laboratory Animals, published by the U.S. National Institutes of Health (NIH Publication No. 85-23, revised 1996).
The study was an experimental animal study performed at a university research laboratory. Twenty-four pigs were allocated to four groups: IAH with CO2 pneumoperitoneum [CO2] (n = 8), CO2 pneumoperitoneum sham (n = 4), IAH with intra-abdominal volume addition [VOL] (n = 8), and intra-abdominal volume addition sham (n = 4). After all experiments were performed, we evaluated the data from the CO2 sham group and the VOL sham group at T = 0 h and T = 10 h for the following parameters: weight, diuresis, pH, partial pressure of CO2 [pCO2], base excess, K+, lactate, heart rate, mean arterial pressure [MAP], mean pulmonary artery pressure [MPAP], central venous pressure [CVP], and creatinine. The groups were similar for all measured values except lactate T = 0 h (mean value for the three groups: control = 0.963, CO2 = 0.863, VOL = 1.125) (P = 0.03). Data from the CO2 sham group and the VOL sham group were therefore pooled into one control group (n = 8). After baseline measurements (T = 0 h), the pigs were randomized to one of the four study groups, and the IAH induction procedure or the sham operation was performed. Sampling started at baseline (T = 0 h) and continued with one sample per hour for 12 h (T = 1 h to T = 12 h). The following data were collected: (1) physiological parameters: intra-bladder pressure [IBP], heart rate, MAP, MPAP, CVP, abdominal perfusion pressure (APP = MAP - IAP), and tidal volume; (2) arterial blood samples: pH, pCO2, base excess, K+, and lactate; and (3) venous blood samples: creatinine.
The animals were female Danish Landrace pigs that had fasted for 24 h prior to the experiment and had free access to water. Prior to transportation to the institute, they received 0.5 mg/kg midazolam (Janssen Pharmaceutica, Beerse, Belgium) and 4 mg/kg azeperone (Janssen-Cilag GmbH, Neuss, Germany) intramuscularly. General anesthesia was induced with an intramuscular injection of 4.35 mg/kg (S)-ketamine (Pfizer ApS, Ballerup, Denmark) and 0.375 mg/kg midazolam (Hameln Pharmaceuticals GmbH, Hameln, Germany) intravenously, followed by intubation. After intubation, the animals were ventilated via a respirator (Datex-Ohmeda S/5 Avance, GE Healthcare, Brøndby, Denmark). Sedation was maintained with sevoflurane (Abbott Scandinavia AB, Solna, Sweden) inhalation to obtain a minimal alveolar concentration of approximately 1.5. Fentanyl was infused intravenously at a constant rate of 12.5 μg/kg/h. No muscular relaxant was used. Pressure-controlled respirator settings were used. Initial settings were a fraction of inspired oxygen [FiO2] of 0.3; positive end-expiratory pressure [PEEP] of 4 cm H20; inspiratory pressure [P insp] of 12 cm H2O, restricting peak airway pressure to a maximum of 16 cm H2O; respiratory frequency of 12/min, and inhalation/expiration ration [I/E] of 1:2. Saline was infused at a constant rate of 1.5 ml/kg/h.
A 6Fr catheter was placed in the carotid artery using a cutdown technique for the measurement of arterial blood pressure and arterial blood sampling. An 8Fr catheter was placed in the right external jugular vein for infusions and to introduce a Swan-Ganz catheter (CCOmbo®, Edwards Lifesciences LLC, Irvine, CA, USA) connected to a Baxter Vigilance monitor (Edwards Life Sciences LLC, Irvine, CA, USA) in order to measure MPAP and CVP. A 7Fr catheter was placed in the left external jugular vein for venous blood sampling. The urinary bladder was catheterized using a 12G Foley catheter connected to an IBP measuring catheter (UnoMeter Abdo-Pressure, Unomedical, Birkerød, Denmark) and a sample tube to monitor diuresis. A rectal thermometer was inserted to measure core temperature. A pulse oximetry device was attached to the pig's tail to observe arterial blood oxygen saturation.
Induction of intra-abdominal hypertension
Induction of IAH with the CO2 group
Verres Cannula was inserted below the umbilicus and attached to a laparoscopic CO2 insufflator (Thermoflator 26432020, Karl Storz, Holte, Denmark or Vision F103, Lemke, Berlin, Germany). The insufflator was set to IAP = 25 mmHg.
Induction of IAH with the VOL group
Via a 15-cm incision above the umbilicus, seven 1-l ordinary saline infusion bags were placed in the abdominal cavity. Bags were positioned into the small pelvis until IBP was above 20 mmHg. The abdominal wall was closed in two layers, including the fascia, using running sutures.
CO2 pneumoperitoneum sham group
These animals underwent a procedure similar to the CO2 group, but Verres Cannula remained unattached to the insufflator.
Intra-abdominal volume addition sham group
The animals underwent a procedure similar to the VOL group, but empty saline bags were inserted into the abdominal cavity.
Anesthesia maintenance and ventilator settings during experiment
IAH decreases lung capacity and requires the adjustment of respirator settings to ensure sufficient ventilation. Our priorities were to maintain arterial oxygen saturation > 90%, pCO2 < 5 kPa, MAP > 60 mmHg, and a tidal volume of 400 ml. Initial respirator settings could be increased up to FiO2 = 0.7; PEEP = 8 cm H2O; P insp = 24 cm H2O, restricting peak airway pressure to a maximum of 32 cm H2O; respiratory frequency = 24; and I/E = 1:1.5. Immediately following IAH generation, all respirator settings, except FiO2, were adjusted to maximally allowed settings in order to avoid respiratory complications such as atelectasis. A 500-ml bag of Rheomacrodex® 100 mg/ml with saline was infused when arterial pressure was < 60 mmHg. Two bags of Rheomacrodex® (Meda A/S, Alleroed, Denmark) were allowed for each pig.
A fixed point at bladder level was marked on the animals. Prior to IBP measurements, the bladder pressure-measuring catheter was elevated. This installed the fluid inside the catheter into the bladder, ensuring that the bladder was not empty when IBP was measured. The zero point of the IBP-measuring catheter was aligned with the marked point on the pig, and the catheter was held vertically. End-expiratory bladder pressure was noted. The animals were in supine position.
Arterial blood samples were analyzed on a blood gas analyzer (ABL 700 series, Radiometer, Copenhagen, Denmark). Heart rates and blood pressures were sampled and recorded through a computer connected to the respirator using software (Datex-Ohmeda S5 Collect Program, version 4.0, Datex-Ohmeda Division, Instrumentarium Corp, Helsinki, Finland). Venous blood samples were stored at -20°C, and the creatinine content was measured by trained personnel at Aarhus University Hospital. APP was calculated as MAP - IBP. Dynamic lung compliance [Cdyn] was calculated as tidal volume/(P insp - PEEP).
Repeated serial measurements were tested for group differences over time by univariate repeated measures using analysis of variance [ANOVA]. MedCalc 184.108.40.206 (MecCalc Software, Mariakerke, Belgium) and Intercooled STATA 9.2 (College Station, TX, USA) were used in the analyses. Furthermore, a Kruskal-Wallis one-way ANOVA on ranks using Dunn's method for multiple comparisons was performed between the three groups at corresponding moments. Sigmastat™ version 3.5 (Systat Software, San Jose, California, USA) was used in the analyses. The similarity between the two sham groups (CO2 pneumoperitoneum sham group (n = 4) and the intra-abdominal volume addition sham group (n = 4)) was tested with the Mann-Whitney rank sum test using SigmaStat™ version 3.11 (Systat Software, San Jose, California, USA) at two points: T = 0 h and T = 10 h. For all analyses, a P value of less than 0.05 was considered significant.
T= 0 h (baseline)a
T= 12 ha
Base excess (mmol/l)
Hemodynamic and pulmonary parameters.
T= 0 h (baseline)a
T= 12 ha
Heart rate (beats/min)
Cdyn (ml/cm H2O)
Intra-bladder pressure and survival
IBP in the control group was lower than that in the intervention groups (P < 0.0001, repeated measures ANOVA. VOL group IBP differed from control at most other times than T = 12 h (P < 0.05, Kruskal-Wallis), data not presented). In both intervention groups, IBP was above 20 mmHg and remained stable. CO2 group mean IBP was constantly 1 to 2 mmHg above the 25 mmHg IAP to which the laparoscopic insufflators were adjusted. No animals died in the control group during the experiment. Three animals (38%) died in each intervention group (Table 1).
Respirator settings were changed immediately after IAH induction to maintain or to counteract decreasing tidal volume and saturation and increasing pCO2. Cdyn was immediately decreased in both experimental groups and remained stable (P < 0.0001, repeated measures ANOVA) (Table 2, Figure 1). At the end of the experiment, the lungs were macroscopically inspected, and the basal posterior parts were darker than the rest of the lungs.
In this study, we investigated whether the choice of a method to create IAH, either CO2 pneumoperitoneum or addition of volume to the intra-abdominal cavity, had any impact on the development of organ dysfunction. We observed both the specific organ damage generated and the temporal development of organ damage.
Our results showed that both methods of generating IAH produce ACS . Our finding that three animals (38%) died in each group toward the end of the experiment demonstrates that the animals sustained organ damage. The development of organ dysfunction was found to be simultaneous for creatinine increase, K+ increase, MPAP, and Cdyn. Both intervention groups needed an immediate change in respirator settings after IAH generation to ensure sufficient ventilation. Both intervention groups ended up with APP < 50 mmHg, which is below the suggested recommendations . All findings observed changed throughout study, except Cdyn which immediately decreased and then remained stable. The major differences between the models were hypercapnia and acidosis observed in the animals with CO2 pneumoperitoneum. Other differences included different temporal development of lactate increase, initial VOL group tachycardia, the VOL group's CVP increase after 8 h, and initially higher MAP in the CO2 group.
Previous studies on IAH, both clinical and experimental, demonstrate an impact on organs similar to our findings. Kidney damage is known to appear as an early sign of organ damage during IAH and ACS [4, 17]. Experimentally decreased blood flow in the peritubular capillaries has been shown , as well as redistribution of blood away from the kidneys  during IAH. Among IAH/ACS patients, impaired respiratory function and the need for mechanical ventilation are well-known complications [3, 4, 17]. In a previously published study regarding IAH generated by CO2 pneumoperitoneum in pigs, all animals survived for 24 h , which is a much higher survival rate than we found.
Control animals experienced increased creatinine concentration, heart rate, and CVP. Nevertheless, these were minor changes and probably caused by the sham operative procedures. Accordingly, significant difference in organ damage between the control group and the intervention groups must be caused by IAH. Furthermore, control animals showed no increase in IBP after the sham procedures. Therefore, these animals must have been sedated to such a degree that muscle contractions did not increase the IAP. Any IAH observed in our animals was thus likely to be caused by the CO2 insufflations or the placement of extra volume in the experimental groups.
Comparison of models
The excess pCO2 in the CO2 group was most likely caused by the absorption of CO2 inserted into the abdominal cavity with the laparoscopic insufflator. This effect is already known . All changes in acid-base status occurred despite our attempts to ensure sufficient ventilation, as described in the 'Materials and methods' section. Base excess was lowered almost equally in both our experimental groups. This could mean that the maximum capacity of metabolic compensation for acidosis was reached in the CO2 group. In addition, the anuria precluded metabolic compensatory mechanisms that require functioning kidneys.
After initial IAH generation in the VOL group, we found no further IBP increase. Cheatham et al. stated: 'The more the degree of IAH, the more urgent is the need for decompression of the abdomen...' . Since the animals suffered multiple organ damage, an increase in IBP might be expected to resemble the deteriorating condition. We did not observe this.
Comparing IAP with IBP in the CO2 group showed that IBP was constantly 1 to 2 mmHg above IAP. In the VOL model, the IBP was slightly lower than that in the CO2 group. The reason for this was that the abdominal cavity of our animals could only hold seven saline bags, producing an IBP of 22 mmHg. The lower IBP in the VOL group could result in less impact than if the IBP had been as high as in the CO2 group.
Both methods used to generate IAH are easy to apply. Pneumoperitoneum will rarely be the cause of real-life IAH. The VOL method is therefore probably closer to resembling pathological IAH than the CO2 method. Because acidosis is part of MODS, the CO2 model could be used if acidosis is desired in a given experiment. Care must be taken, however, not to confuse artificial with pathologic acidosis.
After approximately 8 h of IAH, unexplained results were observed. Base excess became lower in the CO2 group than in the VOL group; the CO2 group's lactate increased from baseline values; the VOL group heart rate decreased back to baseline level; and CVP increased. We are unable to explain these results, yet we cannot rule out that the model was unstable, which would introduce a bias. Better monitoring of loading conditions in animals by monitoring cardiac output or pulmonary artery occlusion pressure would have provided valuable information that might reveal why heart rate and CVP developed as they did. Measurement of esophageal pressure could provide information regarding the relation between intra-thoracic pressure and the observed changes in CVP. Monitoring cytokines could also have provided valuable information about the animals' condition during ACS development. IBP was not measured as recommended: at the mid-axillary line at the iliac crest with not more than 25 ml of intravesicular volume . We measured IBP at the symphysis pubis and did not have control over the intravesical volume.
We only included eight animals in each group. This small number makes observations vulnerable to bias caused by few outlier animals. Toward the end of the experiment, the animals died in the IAH groups. It may have influenced results that data regarding the sickest animals were not included in the analytical evaluation after their deaths. This could explain the CO2 group's decreasing pCO2 and K+ at 12 h.
A drawback of the VOL method is the inability to ensure that the intra-abdominally bags are placed in the same position in every experiment. This may result in nonuniform pressure transmission producing a local pelvic compartment syndrome. Combining IBP and intragastric pressure could provide further information on this issue . Another drawback when using saline bags is that the bags' borders are not smooth. They may cause bleeding or inflammation if the sharp parts interfere with surrounding tissues or vessels. We did not perform post-mortem examinations for organ or vessel damage.
Our study showed that IAH generated with either of two methods: CO2 pneumoperitoneum or intra-abdominal placement of saline bags, causes abdominal compartment syndrome and organ dysfunction within 12 h. The animals subjected to CO2 pneumoperitoneum developed artificial hypercapnia and acidosis.
The work was performed at the Institute of Clinical Medicine, Aarhus University, Aarhus University Hospital, Skejby, Denmark.
abdominal compartment syndrome
analysis of variance
abdominal perfusion pressure
dynamic lung compliance
group with IAH with CO2 pneumoperitoneum
central venous pressure
mean arterial pressure
multiple organ dysfunction syndrome
mean pulmonary artery pressure
- pCO2 :
Partial pressure of carbon dioxide
positive end-expiratory pressure
- P insp :
group with IAH with intra-abdominal volume addition.
This article has been published as part of Annals of Intensive Care Volume 2 Supplement 1, 2012: Diagnosis and management of intra-abdominal hypertension and abdominal compartment syndrome. The full contents of the supplement are available online at http://www.annalsofintensivecare.com/supplements/2/S1
This project was financially supported by The Danish Council for Independent Research, Medical Sciences.
- Barie PS, Hydo LJ, Pieracci FM, Shou J, Eachempati SR: Multiple organ dysfunction syndrome in critical surgical illness. Surg Infect (Larchmt) 2009, 10: 369–377. 10.1089/sur.2009.9935View ArticleGoogle Scholar
- Balogh Z, McKinley BA, Holcomb JB, Miller CC, Cocanour CS, Kozar RA, Valdivia A, Ware DN, Moore FA: Both primary and secondary abdominal compartment syndrome can be predicted early and are harbingers of multiple organ failure. J Trauma 2003, 54: 848–861. 10.1097/01.TA.0000070166.29649.F3PubMedView ArticleGoogle Scholar
- Malbrain ML, Chiumello D, Pelosi P, Bihari D, Innes R, Ranieri VM, Del Turco M, Wilmer A, Brienza N, Malcangi V, Cohen J, Japiassu A, De Keulenaer BL, Daelemans R, Jacquet L, Laterre PF, Frank G, de Souza P, Cesana B, Gattinoni L: Incidence and prognosis of intraabdominal hypertension in a mixed population of critically ill patients: a multiple-center epidemiological study. Crit Care Med 2005, 33: 315–322. 10.1097/01.CCM.0000153408.09806.1BPubMedView ArticleGoogle Scholar
- Vidal MG, Ruiz Weisser J, Gonzalez F, Toro MA, Loudet C, Balasini C, Canales H, Reina R, Estenssoro E: Incidence and clinical effects of intra-abdominal hypertension in critically ill patients. Crit Care Med 2008, 36: 1823–1831. 10.1097/CCM.0b013e31817c7a4dPubMedView ArticleGoogle Scholar
- Malbrain ML, Cheatham ML, Kirkpatrick A, Sugrue M, Parr M, De Waele J, Balogh Z, Leppaniemi A, Olvera C, Ivatury R, D'Amours S, Wendon J, Hillman K, Johansson K, Kolkman K, Wilmer A: Results from the international conference of experts on intra-abdominal hypertension and abdominal compartment syndrome. I. Definitions. Intensive Care Med 2006, 32: 1722–1732. 10.1007/s00134-006-0349-5PubMedView ArticleGoogle Scholar
- Cheatham ML, Malbrain ML, Kirkpatrick A, Sugrue M, Parr M, De Waele J, Balogh Z, Leppaniemi A, Olvera C, Ivatury R, D'Amours S, Wendon J, Hillman K, Wilmer A: Results from the international conference of experts on intra-abdominal hypertension and abdominal compartment syndrome. II. Recommendations. Intensive Care Med 2007, 33: 951–962. 10.1007/s00134-007-0592-4PubMedView ArticleGoogle Scholar
- Schachtrupp A, Wauters J, Wilmer A: What is the best animal model for ACS? Acta Clin Belg Suppl 2007, 225–232.Google Scholar
- Toens C, Schachtrupp A, Hoer J, Junge K, Klosterhalfen B, Schumpelick V: A porcine model of the abdominal compartment syndrome. Shock 2002, 18: 316–321. 10.1097/00024382-200210000-00005PubMedView ArticleGoogle Scholar
- Olofsson PH, Berg S, Ahn HC, Brudin LH, Vikstrom T, Johansson KJ: Gastrointestinal microcirculation and cardiopulmonary function during experimentally increased intra-abdominal pressure. Crit Care Med 2009, 37: 230–239. 10.1097/CCM.0b013e318192ff51PubMedView ArticleGoogle Scholar
- Sassa N, Hattori R, Yamamoto T, Kato M, Komatsu T, Matsukawa Y, Funahashi Y, Gotoh M: Direct visualization of renal hemodynamics affected by carbon dioxide-induced pneumoperitoneum. Urology 2009, 73: 311–315. 10.1016/j.urology.2008.09.047PubMedView ArticleGoogle Scholar
- Wauters J, Claus P, Brosens N, McLaughlin M, Malbrain M, Wilmer A: Pathophysiology of renal hemodynamics and renal cortical microcirculation in a porcine model of elevated intra-abdominal pressure. J Trauma 2009, 66: 713–719. 10.1097/TA.0b013e31817c5594PubMedView ArticleGoogle Scholar
- Gudmundsson FF, Heltne JK: Respiratory changes during prolonged increased intra-abdominal pressure in pigs. Acta Anaesthesiol Scand 2004, 48: 463–468. 10.1111/j.0001-5172.2004.0354.xPubMedView ArticleGoogle Scholar
- Hanly EJ, Aurora AA, Shih SP, Fuentes JM, Marohn MR, De Maio A, Talamini MA: Peritoneal acidosis mediates immunoprotection in laparoscopic surgery. Surgery 2007, 142: 357–364. 10.1016/j.surg.2007.02.017PubMedView ArticleGoogle Scholar
- Baratz RA, Karis JH: Blood gas studies during laparoscopy under general anesthesia. Anesthesiology 1969, 30: 463–464. 10.1097/00000542-196904000-00018PubMedView ArticleGoogle Scholar
- Curley G, Contreras MM, Nichol AD, Higgins BD, Laffey JG: Hypercapnia and acidosis in sepsis: a double-edged sword? Anesthesiology 2010, 112: 462–472. 10.1097/ALN.0b013e3181ca361fPubMedView ArticleGoogle Scholar
- Benninger E, Laschke MW, Cardell M, Keel M, Seifert B, Trentz O, Menger MD, Meier C: Intra-abdominal pressure development after different temporary abdominal closure techniques in a porcine model. J Trauma 2009, 66: 1118–1124. 10.1097/TA.0b013e3181820d94PubMedView ArticleGoogle Scholar
- Malbrain ML, Chiumello D, Pelosi P, Wilmer A, Brienza N, Malcangi V, Bihari D, Innes R, Cohen J, Singer P, Japiassu A, Kurtop E, De Keulenaer BL, Daelemans R, Del Turco M, Cosimini P, Ranieri M, Jacquet L, Laterre PF, Gattinoni L: Prevalence of intra-abdominal hypertension in critically ill patients: a multicentre epidemiological study. Intensive Care Med 2004, 30: 822–829. 10.1007/s00134-004-2169-9PubMedView ArticleGoogle Scholar
- Malbrain ML, De Laet IE, Willems A, Van Regenmortel N, Schoonheydt K, Dits H: Localised abdominal compartment syndrome: bladder-over-gastric pressure ratio (B/G ratio) as a clue to diagnosis. Acta Clin Belg 2010, 65: 98–106.PubMedView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.