eISSN: 1731-2531
ISSN: 1642-5758
Anaesthesiology Intensive Therapy
Current issue Archive Manuscripts accepted About the journal Supplements Editorial board Reviewers Subscription Contact Instructions for authors Publication charge Ethical standards and procedures
Editorial System
Submit your Manuscript
SCImago Journal & Country Rank
2/2021
vol. 53
 
Share:
Share:
Original paper

Blood transfusion decisions cannot be based on percutaneous haemoglobin measurements

Angela Spronk
1
,
Renate de Jong
1
,
Seppe Koopman
2
,
Sanne Hoeks
1
,
Robert Jan Stolker
1

  1. Department of Anesthesiology, Erasmus University Medical Center, Rotterdam, The Netherlands
  2. Department of Anesthesiology, Maasstad Ziekenhuis, Rotterdam, The Netherlands
Anaesthesiol Intensive Ther 2021; 53, 2: 103–107
Online publish date: 2021/05/05
Article file
- Blood transfusion.pdf  [0.12 MB]
Get citation
 
PlumX metrics:
 

Adequate tissue oxygenation is imperative for survival and requires sufficient levels of haemoglobin (Hb) to transport oxygen. In the case of anaemia, a blood transfusion might be required to ensure adequate oxygen transport capacity. The diagnosis of anaemia is usually confirmed after a blood test [1]. Sampling of blood and analyses of the sample are a time-consuming process requiring a venous or arterial puncture, which may cause patient discomfort and complications (such as haematoma formation and infection) and, more importantly though, it may delay diagnosis of possible life-threatening anaemia resulting in a treatment delay.

In the last decades, percutaneous measurement of Hb has been emerging in the clinical field [1, 2]. A CO-oximetry probe capable of detecting haemoglobin (SpHb) or carbon monoxide and meth-haemoglobin in combination with oxygen saturation was developed by the Masimo cooperation (Radical-7 Pulse CO-Oximeter, Masimo Cooperation, Neuchatel, Switzerland). The main advantage of SpHb measurement is direct display of Hb without requiring time-consuming and expensive blood samples. However, to be a useful decision support tool for transfusion, SpHb needs to be comparable to an invasive measurement. Accuracy of SpHb has been evaluated in a diversity of patient categories with various results. Some studies found a significant correlation between SpHb and invasive Hb, whereas others showed limited comparability [1, 2]. Recently, some influencing factors, such as perfusion index and haemodilution, have been demonstrated by several studies [38]. Again, the results are contradictory. Several studies suggested that SpHb could be used as a trend monitor rendering the decision for transfusion of erythrocyte concentrate easier [1, 3, 912]. It has even been claimed that using SpHb as a guidance for transfusion decisions would limit the administration of erythrocyte concentrate, resulting in an economic benefit [9, 13, 14]. However, no study has been designed to evaluate the ability of SpHb to give the correct decision whether to transfuse or not.

Therefore, the main objective of this study was to investigate whether using SpHb instead of invasive Hb leads to the same transfusion decisions in patients undergoing major surgery. Secondly we aimed to measure the bias from SpHb from invasive Hb in matched pair analysis.

METHODS

The study protocol was approved by the local medical ethical committee (MEC-2016-044). Signed written consent was obtained from each patient included in this study. Patients were included from August 2015 to December 2017 in Erasmus University Medical Center, Rotterdam, The Netherlands and Maasstad Hospital, Rotterdam, The Netherlands (large secondary care centre). Patients scheduled for surgery with a suspected blood loss of 800 mL or more were included. Type of surgery included hyper-thermic intraperitoneal chemotherapy (HIPEC), liver transplantation, large orthopaedic procedures, open abdominal aortic repair and major gynaecology surgery. Exclusion criteria were atrial fibrillation and age < 18 years. Baseline information such as gender, age, American Society of Anesthesiologists (ASA) classification, transfusion trigger, type of surgery and a baseline Hb was obtained from each patient. The invasive Hb (mmol L-1) was measured with the ABL 90 FLEX PLUS (Radiometer, Copenhagen, Denmark, one machine in each hospital) or in the general clinical chemical laboratory according to the local protocol. Haemoglobin is depicted in mmol L-1. The perfusion index (PI) was obtained to investigate whether SpHb is influenced by perfusion state.

A Masimo Radical-7 Pulse CO-Oximetry sensor K (Masimo Cooperation, Neuchatel, Switzerland) was placed on de 4th finger on the opposite side to the non-invasive blood pressure cuff as per manufacturer recommendations. The sensor was protected from outside light pollution with an optical shield manufactured and provided by Masimo. The SpHb value was not depicted on the monitor; the anaesthesiologist in charge of the patient was therefore blinded to the SpHb reading. Induction and maintenance of anaesthesia were at the discretion of the attending anaesthesiologist. The decision for blood transfusion was based on the national guideline for patients with acute normovolaemic anaemia [15]. This rule is applied in patients with acute normovolaemic anaemia. To summarize: Healthy young patients with acute blood loss will receive erythrocyte concentrate when Hb drops below 4 mmol L–1 (6.4 γ dL–1) or below 5 mmol L–1 (8.0 γ dL–1) if there is continuous blood loss suspected as during major surgery. Patients with extensive co-morbidities, such as coronary heart disease, who are unlikely to compensate for the fall in Hb, will receive blood when Hb falls below 6 mmol L–1 (9.6 γ dL–1).

A pre-operative and post-operative blood sample were drawn from each patient. Depending on the length of the surgery and intraoperative blood loss, additional samples were drawn when clinically indicated by the attending anaesthesiologist. Changes in invasive Hb and SpHb were obtained between intra-operative measurements.

Data extraction (SpHb, PI) was performed by two researchers (AS, RdJ) who were blinded for transfusion data. SpHb was obtained at exactly the same time as the blood sample was taken. Both physicians retrospectively decided the appropriate transfusion trigger by using the extracted data and patient background information [15]. They both separately determined whether a transfusion was indicated. In case of disagreement, they discussed until a consensus was reached.

Outcome parameters

The primary outcome of this study was to investigate whether there would be a difference in the transfusion decision when using SpHb instead of invasive Hb in patients with > 800 mL blood loss during surgery.

Secondary outcomes were the agreement between SpHb and laboratory measurements. The complete dataset was used to compare laboratory Hb with SpHb. Also the influence of PI on accuracy was investigated.

Statistical analysis

IBM SPSS Statistics for Windows, Version 25.0 (Armonk, NY: IBM Corp.) and R statistics 3.5.0 (R foundation, free edition) were used to analyse the data. Continuous, normally distributed variables were reported as means with standard deviation (SD). Non-normally distributed variables are reported as medians with 25th–75th percentile. Bland-Altman analysis, corrected for multiple measurements per subject was used to assess the agreement between SpHb and invasive Hb. The bias (mean difference between the reference and test method) represents the systemic error between the two methods. As a measure of precision (i.e. the spread of repeated measurements), the limits of agreement were calculated as bias ±1.96 SD, defining the range in which 95% of the differences between the methods are expected to lie. Proportional bias was assessed by generalized least squares [16, 17].

RESULTS

A total of 75 patients undergoing surgery with expected blood loss > 800 mL were included in the study. Signal quality was adequate in all patients. In 48 (64%) individuals blood loss exceeded the 800 mL threshold (Figure 1). Demographic data are displayed in Table 1. The average age was 61.6 years, 56% were male and most patients had mild comorbidities (ASA 2, 60.7). Most patients underwent abdominal cancer-related surgery. Nine patients (18.8%) meeting the inclusion criteria (> 800 mL blood loss) received a total combined number of 51 (1–12) erythrocyte concentrates during surgery. Additionally, 44 (0–9) fresh frozen plasma units and 1 unit of thrombocytes were transfused.

FIGURE 1

Inclusion of patients

/f/fulltexts/AIT/43933/AIT-53-43933-g001_min.jpg
TABLE 1

Patient characteristics

FactorAll (n = 75)> 800 mL (n = 48)< 800 mL (n = 27)P-value
Male, n (%)42 (56)31 (64.6)11 (40.7)0.046
Age (years ± SD)61.6 (± 13.2)63.7 (± 11.8)57.8 (± 14.8)0.060
Blood loss (mL ± SD)1000 (IQR 1500)1462 (2000)300 (210)< 0.001
ASA score (mean ± SD)2.1 (± 0.6)2.2 (± 0.5)1.9 (± 0.6)0.005
ASA1, n (%)9 (12.0)2 (4.2)7 (25.9)0.011
ASA2, n (%)50 (66.7)33 (68.8)17 (63.0)
ASA3, n (%)16 (21.3)13 (27.1)3 (11.1)
Transfusion trigger (Hb in mmol L–1), n (%)
42 (2.7)0 (0.0)2 (7.4)0.014
560 (80.0)36 (75.0)24 (88.9)
613 (17.3)12 (25.0)1 (3.7)
Type of surgery, n (%)
Abdominal cancer52 (69.3)31 (64.6)21 (77.8)0.203
Orthopaedic10 (13.3)5 (10.4)5 (18.5)
Vascular9 (12.0)8 (16.7)1 (3.7)
Transplantation3 (4.0)3 (6.3)0 (0.0)
Neurosurgery1 (1.3)1 (2.1)0 (0.0)
Transfused, n (%)10 (13.3)9 (18.8)1 (3.7)0.066
Erythrocyte concentrate17 (22.7)16 (21.3)1 (3.7)
Fresh frozen plasma11 (14.7)11 (22.9)0 (0.0)
Thrombocyte1 (1.3)1 (2.1)0 (0.0)
Cell saver blood7 (9.3)7 (14.6)0 (0.0)

[i] ASA score – American Society of Anesthesiologists score.

Transfusion decision

Retrospectively 13 (27.1%) patients would have received an incorrect transfusion treatment using the SpHb value. In seven patients (14.6%) erythrocyte concentrate would have been given based on SpHb while the invasive Hb did not justify this. Moreover, 6 (12.5%) patients would not have been transfused based on SpHb while they should have based on invasive Hb.

Haemoglobin levels before, during and after surgery

A total of 266 paired measurements of Hb and SpHb measurements were available in 75 patients (2–6 per patient). The mean invasive Hb was 7.44 ± 1.33 mmol L–1 and the mean SpHb was 6.47 ± 0.8 mmol L–1 (P < 0.001). BlandAltman analysis with correction for repeated measurements (Figure 2) revealed a proportional bias with a slope of 0.78 (bias= –4.05 + 0.78 × average Hb). At an average Hb of 5.6 the bias was the smallest. At higher and lower Hb the bias became higher. The lower and upper LOA had the same patterns (bias –1.96 SD = –5.53 +0.68 Hb; bias +1.96 SD = –2.53 + 0.76 Hb).

FIGURE 2

Bland-Altman plot with correction for repeated measurements. Difference (SpHb – invasive Hb) vs. average Hb ((SpHb + invasive Hb)/2) shows a proportional bias of –4.05 + 0.78 Hb, upper LoA = bias +1.96 SD = –2.53 + 0.76 Hb, lower LoA = bias –1.96 SD = –5.53 + 0.68 Hb

/f/fulltexts/AIT/43933/AIT-53-43933-g002_min.jpg

Correlation between SpHb and perfusion index

Due to technical difficulties retrieving data from some devices, PI was only available in a subset of patients (n = 18). PI was > 1 in all subjects. No relationship was found between bias and PI (r = 0.06; P = 0.62).

DISCUSSION

We found that 27.1% of patients would not have been transfused according to the National Guideline (40) using SpHb measurement. Moreover, we found a low agreement between SpHb and invasive Hb (proportional bias = 0.78 × average Hb –4.05).

Our findings correspond with several previous investigations regarding SpHb in the operating theatre and emergency department [7, 1822]. The Food and Drug Administration approved the Rainbow SET Pulse CO–Oximeter device (Masimo Corporation, Irvine CA) with a published bias of 0.94 γ dL-1 compared with reference laboratory methods in adult volunteers undergoing haemodilution [23]. Therefore, most studies used a cut-off point of 1 γ dL-1, which corresponds to 0.6 mmol L-1. In this study we found a bias larger than that described by Masimo and several other studies [911, 2429].

This difference might be explained by the laboratory method with which invasive Hb was measured. Every hospital has its own gold standard concerning Hb measurement [1, 30]. In our current study, invasive Hb was measured using the ABL 90 FLEX PLUS, which has a bias of 0.08 with small limits of agreement; thus we used a device with good reliability [31]. Therefore, we think the laboratory measurement used does not explain the difference between SpHb and invasive Hb found in our study.

We collected data from several groups of patients including liver transplantation and orthopaedic procedures. In existing literature, there are controversies between studies regarding SpHb studying comparable patient categories. For example, in liver transplant patients Huang et al. found a bias of 2.28 γ dL–1 compared to the results of Erdogan et al. demonstrating a bias of 0.86 [11, 32]. Both studies compared SpHb with Hb measured in a clinical laboratory. It therefore seems that type of surgery cannot explain the difference in bias.

In our current study, no relationship was found between PI and bias between invasive Hb and SpHb. This is in line with previous investigations by Park et al. 6. However, multiple studies revealed a negative relationship between lower PI states and bias of SpHb [3, 5, 33]. It is imaginable that PI could interfere with SpHb, as SpHb is measured in real time in a blood vessel using spectrometry. It might be possible that this study was underpowered to demonstrate a correlation between bias and low PI.

The European guideline for management of perioperative bleeding does not recommend non-invasive haemoglobin devices to target transfusions, due to the bias between invasive and non-invasive measurements. The guideline states, based on previous research, that SpHb could be used as a trend monitor [34]. However, we failed to determine this effect, given that we found evidence of proportional bias with SpHb overestimating Hb at low levels and this difference increasing as invasively determined Hb falls.

Applegate et al. and Gamal et al. observed improving precision of SpHb at lower levels of Hb [23, 35]. In this study precision of SpHb improved until an Hb of 5.6. With a further drop in actual Hb the difference between invasive Hb and SpHb increased. This is particularly disadvantageous at low values because to be useful as a clinical decision tool, high reliability at low values is required given the value of transfusion triggers.

With regard to transfusion of red blood cell concentrate based on transfusion triggers, 27.1% of patients would have received erythrocyte concentrate without justification (14.5%) or did not receive blood when needed according to guidelines (12.5%). Current literature is controversial, with studies describing saving of red blood cell concentrate and even an economic benefit when transfusion decisions are guided by non-invasive measurements [1, 9, 11, 13, 14, 23]. On the other hand, other studies supported our findings. Again, this could be a result of the variability in accuracy between studies.

Limitations

The effect of vasopressors on accuracy of SpHb was not included in this study. Due to technical difficulties the PI was not available in the whole patient cohort.

Due to the study protocol we had no influence in sampling of invasive Hb during surgery; this was only done when clinically indicated by the attending anaesthesiologist. We therefore could not say if the blood sample was taken before or after transfusion. However, it would be logical that transfusion was given after sampling.

The type of surgery is rather heterogeneous.

CONCLUSIONS

The precision of the SpHb measurement exceeded the acceptable range of error. It was concluded that SpHb measurement using the Rainbow device is too unreliable to be an acceptable alternative to the invasive Hb measurement, even as a trend monitor or decision support tool.

ACKNOWLEDGEMENTS

Financial support and sponsorship

none.

Conflicts of interest

none.

References

1 

Barker SJ, Shander A, Ramsay MA. Continuous noninvasive hemoglobin monitoring: a measured response to a critical review. Anesth Analg 2016; 122: 565-572. doi: 10.1213/ANE.0000000000000605.

2 

Kim SH, Lilot M, Murphy LSL, et al. Accuracy of continuous noninvasive hemoglobin monitoring: a systematic review and meta-analysis. Anesth Analg 2014; 119: 332-346. doi: 10.1213/ANE.0000000000000272.

3 

Patino M, Schultz L, Hossain M, et al. Trending and accuracy of noninvasive hemoglobin monitoring in pediatric perioperative patients. Anesth Analg 2014; 119: 920-925. doi: 10.1213/ANE.0000000000000369.

4 

Adel A, Awada W, Abdelhamid B, et al. Accuracy and trending of non-invasive hemoglobin measurement during different volume and perfusion statuses. J Clin Monit Comput 2018; 32: 1025-1031. doi: 10.1007/s10877-018-0101-z.

5 

Nguyen BV, Vincent JL, Nowak E, et al. The accuracy of noninvasive hemoglobin measurement by multiwavelength pulse oximetry after cardiac surgery. Anesth Analg 2011; 113: 1052-1057. doi: 10.1213/ANE.0b013e31822c9679.

6 

Park SG, Lee OH, Park YH, et al. The changes of non-invasive hemoglobin and perfusion index of Pulse CO-Oximetry during induction of general anesthesia. Korean J Anesthesiol 2015; 68: 352-357. doi: 10.4097/kjae.2015.68.4.352.

7 

Hahn RG, Li Y, Zdolsek J. Non-invasive monitoring of blood haemoglobin for analysis of fluid volume kinetics. Acta Anaesthesiol Scand 2010; 54: 1233-1240. doi: 10.1111/j.1399-6576.2010.02321.x.

8 

Isosu T, Obara S, Hosono A, et al. Validation of continuous and noninvasive hemoglobin monitoring by pulse CO-oximetry in Japanese surgical patients. J Clin Monit Comput 2013; 27: 55-60. doi: 10.1007/s10877-012-9397-2.

9 

Awada WN, Mohmoued MF, Radwan TM, Hussien GZ, Elkady HW. Continuous and noninvasive hemoglobin monitoring reduces red blood cell transfusion during neurosurgery: a prospective cohort study. J Clin Monit Comput 2015; 29: 733-740. doi: 10.1007/s10877-015-9660-4.

10 

Yamada H, Saeki M, Ito J, et al. The relative trending accuracy of noninvasive continuous hemoglobin monitoring during hemodialysis in critically ill patients. J Clin Monit Comput 2015; 29: 107-112. doi: 10.1007/s10877-014-9574-6.

11 

Erdogan Kayhan G, Colak YZ, Sanli M, Ucar M, Toprak HI. Accuracy of non-invasive hemoglobin monitoring by pulse CO-oximeter during liver transplantation. Minerva Anestesiol 2017; 83: 485-492. doi: 10.23736/S0375-9393.17.11652-4.

12 

Welker E, Novak J, Jelsma L, et al. Continuous hemoglobin monitoring in pediatric trauma patients with solid organ injury. J Pediatr Surg 2018; 53: 2055-2058. doi: 10.1016/j.jpedsurg.2017.12.015.

13 

Martin JR, Camp CL, Stitz A, et al. Noninvasive hemoglobin monitoring: a rapid, reliable, and cost-effective method following total joint replacement. J Bone Joint Surg Am 2016; 98: 349-355. doi: 10.2106/JBJS.O.00820.

14 

Ribed-Sánchez B, González-Gaya C, Varea-Díaz S, Corbacho-Fabregat C, Pérez-Oteyza J, Belda-Iniesta C. Economic analysis of the reduction of blood transfusions during surgical procedures while continuous hemoglobin monitoring is used. Sensors (Basel) 2018; 18: 1367. doi: 10.3390/s18051367.

15 

Kranenburg FJ, So-Osman C, van der Bom JG. Blood is not for everyone: the usefulness of erythrocyte transfusion. Ned Tijdschr Geneeskd 2015; 159: A9408.

16 

Bland JM, Altman DG. Agreement between methods of measurement with multiple observations per individual. J Biopharm Stat 2007; 17: 571-582. doi: 10.1080/10543400701329422.

17 

Ludbrook J. Linear regression analysis for comparing two measurers or methods of measurement: but which regression? Clin Exp Pharmacol Physiol 2010; 37: 692-699. doi: 10.1111/j.1440-1681.2010.05376.x.

18 

Baulig W, Seifert B, Spahn DR, Theusinger OM. Accuracy of non-invasive continuous total hemoglobin measurement by Pulse CO-oximetry in severe traumatized and surgical bleeding patients. J Clin Monit Comput 2017; 31: 177-185. doi: 10.1007/s10877-015-9816-2.

19 

Bridges E, Hatzfeld JJ. Noninvasive continuous hemoglobin monitoring in combat casualties: a pilot study. Shock 2016; 46: 55-60. doi: 10.1097/SHK.0000000000000654.

20 

Galvagno SM Jr, Hu P, Yang S, et al. Accuracy of continuous noninvasive hemoglobin monitoring for the prediction of blood transfusions in trauma patients. J Clin Monit Comput 2015; 29: 815-821. doi: 10.1007/s10877-015-9671-1.

21 

Butwick A, Hilton G, Carvalho B. Non-invasive haemoglobin measurement in patients undergoing elective Caesarean section. Br J Anaesth 2012; 108: 271-277. doi: 10.1093/bja/aer373.

22 

Skelton VA, Wijayasinghe N, Sharafudeen S, Sange A, Parry NS, Junghans C. Evaluation of point-of-care haemoglobin measuring devices: a comparison of Radical-7™ pulse co-oximetry, HemoCue® and laboratory haemoglobin measurements in obstetric patients*. Anaesthesia 2013; 68: 40-45. doi: 10.1111/anae.12039.

23 

Applegate RL, Barr SJ, Collier CE, Rook JL, Mangus DB, Allard MW. Evaluation of pulse cooximetry in patients undergoing abdominal or pelvic surgery. Anesthesiology 2012; 116: 65-72. doi: 10.1097/ALN.0b013e31823d774f.

24 

Berkow L, Rotolo S, Mirski E. Continuous noninvasive hemoglobin monitoring during complex spine surgery. Anesth Analg 2011; 113: 1396-1402. doi: 10.1213/ANE.0b013e318230b425.

25 

Causey MW, Miller S, Foster A, Beekley A, Zenger D, Martin M. Validation of noninvasive hemoglobin measurements using the Masimo Radical-7 SpHb Station. Am J Surg 2011; 201: 592-598. doi: 10.1016/j.amjsurg.2011.01.020.

26 

Frasca D, Dahyot-Fizelier C, Catherine K, Levrat Q, Debaene B, Mimoz O. Accuracy of a continuous noninvasive hemoglobin monitor in intensive care unit patients. Crit Care Med 2011; 39: 2277-2282. doi: 10.1097/CCM.0b013e3182227e2d.

27 

Macknet MR, Allard M, Applegate RL, Rook J. The accuracy of noninvasive and continuous total hemoglobin measurement by pulse CO-oximetry in human subjects undergoing hemodilution. Anesth Analg 2010; 111: 1424-1426. doi: 10.1213/ANE.0b013e3181fc74b9.

28 

Vos JJ, Kalmar AF, Struys MMRF, et al. Accuracy of non-invasive measurement of haemoglobin concentration by pulse co-oximetry during steady-state and dynamic conditions in liver surgery. Br J Anaesth 2012; 109: 522-528. doi: 10.1093/bja/aes234.

29 

Gupta N, Kulkarni A, Bhargava A, Prakash A, Gupta N. Utility of non-invasive haemoglobin monitoring in oncosurgery patients. Indian J Anaesth 2017; 61: 543-548. doi: 10.4103/ija.IJA_707_16.

30 

Miller RD, Ward TA, Shiboski SC, Cohen NH. A comparison of three methods of hemoglobin monitoring in patients undergoing spine surgery. Anesth Analg 2011; 112: 858-863. doi: 10.1213/ANE.0b013e31820eecd1.

31 

Zhang JB, Lin J, Zhao XD. Analysis of bias in measurements of potassium, sodium and hemoglobin by an emergency department-based blood gas analyzer relative to hospital laboratory autoanalyzer results. PLoS One 2015; 10: e0122383. doi: 10.1371/journal.pone.0122383.

32 

Huang PH, Shih BF, Tsai YF, et al. Accuracy and trending of continuous noninvasive hemoglobin monitoring in patients undergoing liver transplantation. Transplantation Proceedings 2016; 48: 1067-1070. doi: 10.1016/j.transproceed.2015.12.121.

33 

García-Soler P, Alonso JMC, González-Gómez JM, Milano-Manso G. Noninvasive hemoglobin monitoring in critically ill pediatric patients at risk of bleeding. Med Intensiva 2017; 41: 209-215. doi: 10.1016/j.medin.2016.06.011.

34 

Kozek-Langenecker SA, Ahmed AB, Afshari A, et al. Management of severe perioperative bleeding: guidelines from the European Society of Anaesthesiology: first update 2016. Eur J Anaesthesiol 2017; 34: 332-395. doi: 10.1097/EJA.0000000000000630.

35 

Gamal M, Abdelhamid B, Zakaria D, et al. Evaluation of noninvasive hemoglobin monitoring in trauma patients with low hemoglobin levels. Shock 2018; 49: 150-153.

This is an Open Access journal, all articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0). License (http://creativecommons.org/licenses/by-nc-sa/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material, provided the original work is properly cited and states its license.
 
Quick links
© 2024 Termedia Sp. z o.o.
Developed by Bentus.