Çà÷åì ÷èòàòü ìåäèöèíñêèå ñòàòüè? 5 ñòðàíèöà

 

3.8. Òðàäèöèîííàÿ «èåðàðõèÿ äîêàçàòåëüñòâ»

Ïðè ïðèíÿòèè ðåøåíèé î ïðîâåäåíèè êëèíè÷åñêèõ âìåøàòåëüñòâ ðàç­ëè÷íûå òèïû ïåðâè÷íûõ èññëåäîâàíèé èìåþò ðàçëè÷íóþ öåííîñòü («èåðàðõèÿ äîêàçàòåëüñòâ»). Äîêàçàòåëüñòâà ðàñïîëàãàþòñÿ â ñëåäóþ­ùåì ïîðÿäêå20.

1. Ñèñòåìàòè÷åñêèå îáçîðû è ìåòà-àíàëèçû (ñì. ãëàâó 8).

2. ÐÊÏ ñ îïðåäåëåííûìè ðåçóëüòàòàìè (äîâåðèòåëüíûå èíòåðâàëû íå âûõîäÿò çà ðàìêè êëèíè÷åñêè çíà÷èìîãî ýôôåêòà, ñì. ðàçäåë 5.5).

3. ÐÊÈ ñ íåîïðåäåëåííûìè ðåçóëüòàòàìè (äîâåðèòåëüíûå èíòåðâàëû âûõîäÿò çà ðàìêè êëèíè÷åñêè çíà÷èìîãî ýôôåêòà, ñì. ðàçäåë 5.5).

4. Êîãîðòíûå èññëåäîâàíèÿ.

5. Èññëåäîâàíèÿ «ñëó÷àé—êîíòðîëü».

6. Ïîïåðå÷íûå èññëåäîâàíèÿ.

7. Ñîîáùåíèÿ î ñëó÷àÿõ.

Íà âåðøèíå èåðàðõèè çàêîíîìåðíî ðàñïîëàãàþòñÿ âòîðè÷íûå èññëå­äîâàíèÿ, â êîòîðûõ îáîáùåíû ðåçóëüòàòû âñåõ ïåðâè÷íûõ èññëåäîâàíèé ïî äàííîìó âîïðîñó ñ ó÷åòîì èõ êðèòè÷åñêîé îöåíêè íà îñíîâå æåñòêèõ êðèòåðèåâ (ñì. ãëàâó 8). Îäíàêî ñëåäóåò ïîìíèòü, ÷òî è íåêà÷åñòâåííûé ìåòà-àíàëèç, è ÐÊÈ ñ ñåðüåçíûìè ìåòîäîëîãè÷åñêèìè íåäîñòàòêàìè óñ­òóïàþò ïî çíà÷èìîñòè êðóïíîìó è õîðîøî îðãàíèçîâàííîìó êîãîðòíîìó èññëåäîâàíèþ. Êàê ïîêàçàíî â ãëàâå 11, ìíîãèå âàæíûå è äîñòîâåðíûå êà÷åñòâåííûå èññëåäîâàíèÿ âîîáùå íå âïèñûâàþòñÿ â ýòó èåðàðõèþ. Èíûìè ñëîâàìè, îöåíêà âîçìîæíîãî âêëàäà êîíêðåòíîãî èññëåäîâàíèÿ â ðàçâèòèå ìåäèöèíñêîé íàóêè òðåáóåò çíà÷èòåëüíî áîëüøèõ óñèëèé, íåæåëè ýòî íåîáõîäèìî ñîãëàñíî ïðèâåäåííîé 7-ñòóïåí÷àòîé «èåðàðõèè äîêàçàòåëüñòâ».


.5.9. Ýòè÷åñêèå çàìå÷àíèÿ

Êîãäà ÿ áûëà ìîëîäûì âðà÷îì, ÿ ïîëó÷èëà ðàáîòó âî âñåìèðíî èçâå­ñòíîé áîëüíèöå. Îäíîé èõ ìîèõ îáÿçàííîñòåé áûëî âåäåíèå ïîæèëûõ ïàöèåíòîâ, ïîñòðàäàâøèõ â ðåçóëüòàòå íåñ÷àñòíûõ ñëó÷àåâ. Âñêîðå ïîñ­ëå íà÷àëà ðàáîòû ìåíÿ ïðèãëàñèëè ïîîáåäàòü äâà î÷àðîâàòåëüíûõ ìåäè­öèíñêèõ ñîòðóäíèêà èç îòäåëà ñòàòèñòèêè, êîòîðûå (êàê ÿ ïîíÿëà âïîñ­ëåäñòâèè) èñêàëè ìîåé ïîìîùè â ïðîâîäèìîì èìè èññëåäîâàíèè.  îá­ìåí íà îáåùàíèå âêëþ÷èòü ìåíÿ â ñïèñîê àâòîðîâ îíè ïîïðîñèëè ìåíÿ ïðîâåñòè áèîïñèþ ïðÿìîé êèøêè (ò.å. âûðåçàòü èç íåå êóñî÷åê òêàíè) ó êàæäîãî ïàöèåíòà ñòàðøå 90 ëåò, ñòðàäàþùåãî çàïîðîì. ß ïîïðîñèëà ó íèõ êîïèþ äîêóìåíòà, ïîäòâåðæäàþùåãî ñîãëàñèå ïàöèåíòà íà òàêîå èññëåäîâàíèå. Êîãäà îíè ñòàëè óâåðÿòü ìåíÿ, ÷òî ÷åëîâåê â âîçðàñòå 90 ëåò åäâà ëè çàìåòèò äàííóþ ïðîöåäóðó, ÿ ïî÷óÿëà ïîäâîõ è îòêàçàëàñü ñ íèìè ñîòðóäíè÷àòü.

ß áûëà ñëèøêîì íàèâíà è íåãðàìîòíà, ÷òîáû îñîçíàòü ñåðüåçíîñòü ïðåñòóïëåíèÿ, ïëàíèðóåìîãî ýòèìè âðà÷àìè. Ïðîâåäåíèå ëþáîãî èñ­ñëåäîâàíèÿ, îñîáåííî èíâàçèâíûõ ïðîöåäóð, íà áåççàùèòíîì áîëü­íîì áåç ó÷åòà âñåõ ýòè÷åñêèõ ñîîáðàæåíèé ÿâëÿåòñÿ ïðåñòóïëåíèåì, à òàêæå è ïîâîäîì äëÿ óâîëüíåíèÿ âðà÷à. Ïðè âîçíèêíîâåíèè ýòè÷åñ­êèõ òðóäíîñòåé ïîëó÷åíèå ðàçðåøåíèÿ íà ïðîâåäåíèå èññëåäîâàíèÿ ìîæåò áûòü ñåðüåçíûì áþðîêðàòè÷åñêèì ïðåïÿòñòâèåì58, íî ýòî çà­êîííîå òðåáîâàíèå, êîòîðîå ðàíüøå ÷àñòî èãíîðèðîâàëè, îñîáåííî ïðè ïðîâåäåíèè èññëåäîâàíèé íà ïîæèëûõ è ïàöèåíòàõ ñ óìñòâåííîé îò­ñòàëîñòüþ. Áîëüøèíñòâî ðåäàêòîðîâ íå ñòàíóò ïóáëèêîâàòü ñòàòüþ, íå îäîáðåííóþ ëîêàëüíûì ýòè÷åñêèì êîìèòåòîì. Åñëè ó ðåäàêòîðà èëè ÷èòàòåëÿ âîçíèêàþò ñîìíåíèÿ â ýòè÷åñêîé áåçóïðå÷íîñòè ðàáîòû, íèêòî íå ìåøàåò íàïðÿìóþ ïîòðåáîâàòü ó àâòîðîâ êîïèþ ñîîòâåòñòâó­þùåãî äîêóìåíòà.

Íà ýòè âîïðîñû ìîæíî âçãëÿíóòü è ñ äðóãîé ñòîðîíû. Ýòè÷åñêèå êî­ìèòåòû ÷àñòî âûíîñÿò îòðèöàòåëüíûå çàêëþ÷åíèÿ, íåñìîòðÿ íà òî, ÷òî â íåîïðåäåëåííûõ êëèíè÷åñêèõ ñèòóàöèÿõ èíôîðìèðîâàííûé ïàöèåíò ìî­æåò ïîìî÷ü èññëåäîâàòåëÿì óìåíüøèòü ýòó íåîïðåäåëåííîñòü. Ìîæíî òàêæå âñïîìíèòü òàêîé ïðèìåð: ÐÊÈ, ïîêàçàâøèå ýôôåêòèâíîñòü ôî-ëèåâîé êèñëîòû ó æåíùèí íà ðàííèõ ñðîêàõ áåðåìåííîñòè äëÿ ïðåäîò­âðàùåíèÿ äåôåêòîâ íåðâíîé òðóáêè ó ïëîäà60, ãîäàìè îòêëàäûâàëèñü èç-çà ñîïðîòèâëåíèÿ ýòè÷åñêèõ êîìèòåòîâ.


Ëèòåðàòóðà

I. Altman D.G. The scandal of poor medical research // BMJ. — 1994. —
Vol. 308. - Ð. 283A.

2.Jefferson Ò., GodleeF. PeerReviewin Health Sciences. - Lond.: BMJ Books, 1999.

3. Sackett D.L., Haynes R.B., Guyatt G.H., Tugwell P. Clinical Epidemiology — aBasic Science orClinicalMedicine. — Lond.: Little, Brown, 1991.

4. Sackett D.L., Richardson W.S., Rosenberg W.M.C., Haynes R.B. Evidence Based Medicine: How to Practice and Teach EBM. — 2nd ed. — Lond.: Churchill Livingstone, 2000.

5. Crombie I.M. The Pocket Guide to Critical Appraisal. — Lond.: BMJ Publications, 1996.

6. FletcherR.H., FletcherS.W., WagnerE.H. Clinical Epidemiology: the Essentials. — 3rd ed. — Baltimore: Williams and Wilkins, 1996.

7. Rose G., Barker D.J.P. Epidemiology for the Uninitiated. — 4th ed. — Lond.: BMJ Publications, 1999.

8. OxmanA.D., Sackett D.S., Guyatt G.H. Users' guides to the medical literature. I. Howto get started // JAMA. - 1993. - Vol. 270. - P. 2093-2095.

9. Guyatt G.H., Sackett D.L., Cook D.J. Users' guides to the medical literature. II. How to use an article about therapy or prevention. A. Are the results of the study valid? // Ibid. - P. 2598-2601.

10. Guyatt G.H., Sackett D.L., Cook D.J. Users' guides to the medical
literature. II. How to use an article about therapy or prevention. B. What
were the results and will they help me in caring for my patients? // Ibid. —
1994. -Vol. 271. -P. 59-63.

II. Jaeschke R., Guyatt G., Sackett D.L. Users' guides to the medical
literature. III. Howto use an article about a diagnostic test. A. Are the results
of the study valid? // Ibid. - P. 389-391.

12. Jaeschke R., Guyatt G., Sackett D.L. Users' guides to the medical literature. III. ,'Howto use an article about a diagnostic test. B. What were the results and will they help me in caring for my patients? // Ibid. — 703-707.

13. Levine M., Walter S., Lee H. et al. Users' guides to the medical literature. IV. Howto use an article about harm// Ibid. — P. 1615—1619.

14. Laupacis A., Wells G., Richardson W.S., Tugwell P. Users' guides to the medical literature. V. Howto use an article about prognosis. // Ibid. — P. 234-237.


15. Îõòàï A.D., Cook D.J., Guyatt G.H. Users' guides to the medical literature. VI. Howto use an overview// Ibid. - Vol. 272. - P. 1367-1371.

16. Richardson W.S., Detsky A.S. Users' guides to the medical literature. VII. How to use a clinical decision analysis. A. Are the results of the study valid? //Ibid. - 1995. - Vol. 273. - P. 1292-1295.

17. Richardson W.S., Detsky A.S. Users' guides to the medical literature. VII. How to use a clinical decision analysis. B. What are the results and will Ihey help me in caring for my patients? // Ibid. — P. 1610-1613.

18. Hayward R.S.A.,Wilson M.C., Tunis S.R- et al. Users' guides to the inedical literature. VIII. How to use clinical practice guidelines. A. Are the recommendations valid? // Ibid. — Vol. 274. — P. 570.

19. Wllson M.C., Hayward R.S., Tunis S.R- et al. Users' guides to the inedical literature. VIII. How to use clinical practice guidelines. B. Will the recommendations help me in caring for my patients? // ibid. — P. 1630— 1632.

20. Guyatt G.H., Sackett D.L., Sinclair J.C. et al. Users' guides to the medical literature. IX. A method for grading health care recommendations. // Ibid. - P. 1800.

21. Naylor C.D., Guyatt G.H. Users' guides to the medical literature. X. Howto use an article reporting variations in the outcomes of health services // Ibid. - 1996. - Vol. 275. - P. 554-558.

22. Naylor C.D., Guyatt G.H. Users' guides to the medical literature. XI. Howto use an article about a clinical utilization review// Ibid. — P. 1435— 1439.

 

23. Guyatt G.H., Naylor C.D., Juniper E. et al. Users' guides to the medical literature. XII. How to use articles about health-related quality of life // Ibid. - 1997. - Vol. 277. - P. 1232-1237.

24. DrumtnondM.F., Richardson W.S., 0'Brien B.J. eral. Users' guides to the medical literature. XIII. Howto use an article on economic analysis of elinical practice. A. Are the results of the study valid? // Ibid. — P. 1552— 1557.

25. 0'Brien B.J., Heyland D., Rlchardson W.S. et al. Users' guides to the medical literature. XIII. How to use an article on economic analysis of elinical practice. B. What are the results and will they help me in caring for my patients? // Ibid. - P. 1802-1806.

26. Dans A.L., Dans L.F., Guyatt G.H., Richardson S. Users' guides to the medical literature. XIV. How to decide on the applicability of clinical trial results to your patient // JAMA. - 1998. - Vol. 279. - P. 545-549.


27. Richardson W.S., Wilson M.C., Guyatt G.H. et al. Users' guides to the medical literature. XV. How to use an article about disease probability for differential diagnosis//Ibid. - 1999. - Vol. 281. - P. 1214-1219.

28. Guyatt G.H., SinclairJ., Cook D.J., Glasziou P. Users' guides to the medical literature. XVI. Howto use a treatment recommendation // Ibid. — P. 1836-1843.

29. Barratt A., IrwigL., Glasziou P. et al. Users' guides to the medical literature: XVII. How to use guidelines and recommendations about screening// Ibid. - P. 2029-2034.

30. Randolph A.G., Haynes R.B., Wyatt J.C. et al. Users' guides to the medical literature. XVIII. Howto use an article evaluating the clinical impact of a computer-based clinical decision support system // Ibid. — Vol. 282. — P. 67-74.

31. Giacomini M.K., Cook D.J. A user's guide to qualitative research in health care. Part I: Are the results of the study valid? // JAMA. - 2000. -R 357-362.

32. Giacomini M.K., Cook D.J. A user's guide to qualitative research in health ñàãå. Part II: What are the results and how do they help me care for my patients? // Ibid. - P. 478-482.

33. Popper K. Conjectures and Refutations: the Growth of Scientific Knowledge. - N.Y.: Routledge and Kegan Paul, 1963.

34. Thornton J.G., Ulford R.J., Johnson N. Decision analysis in medicine // BMJ. - 1992. - Vol. 304. - P. 1099-1103.

35. Thornton J.G., Lilford R.J. Decision analysis for medical managers // Ibid. - 1995. -Vol. 310. - P. 791.

36. DowieJ. «Evidence-based», «cost-effective», and «preference-driven» medicine //J. Health Serv. Res. Policy. - 1996. - Vol. 1. - P. 104-113.

37. ISIS-2 Collaborative Group. Randomized trial of intravenous
streptokinase, aspirin, both, or neither among 17187 cases of suspected acute
myocardial infarction: ISIS-2 // Lancet. - 1988. - Vol. 2. - P. 349-360.

38. http://cebm.jr2.ox.ac.uk/docs/studies.html.

39. Sackett D.L.,Wennberg J.E. Choosing the best research design for each question // BMJ. - 1997. - Vol. 315. - P. 1636.

40. Stewart L.A., Partnar M.K.B. Bias in the analysis and reporting of randomized conirolled trials // Int. J. Technol. Assess Health Care. — 1996. — Vol. 12. - P. 264-275.

41. Âåþ L.A., Rennle D. Influences on the quality of published drug studies // Ibid. - P. 209-237.


42. Maclntyre I.M.C. Tribulations for clinical trials. Poor recruitment is li;unperingresearch//BMJ. - 1991. - Vol. 302. - P. 1099-1100.

43. Stern J.M., Simes R.J. Publication bias: evidence of delayed Iê ihlication in a cohort study of clinical research projects // Ibid. — 1997. — Vol. 315. — R 640-645.

44. FarrellB. Efficient management of randomized controlled trials: nature ..i nurture // Ibid. - 1998. - Vol. 317. - P. 1236-1239.

45. McCormack J., Greenhaigh T. Seeing what you want to see in i.nidomized controlled trials: versions and perversions of the UK PDS data // Ibid. - 2000. - Vol. 320. - R 720-723.

 

46. Lumley J., Bastian H. Competing or complementary: ethical ronsiderations and the quality of randomized trials // Int. J. Technol. Assess. I lealth Ñàãå. - 1996. - Vol. 12. - P. 247-263.

47. Mays N.. Pope C. (eds). Qualitative Research in Health Care. — 2nd ed. - Lond.: BMJ Publications, 2000.

48. Altman D. Better reporting of randomized controlled trials: the CONSORT statement // BMJ. - 1996. - Vol. 313. - P. 570-571.

49. JadadA.R. Randomized Controlled Trials: a User's Guide. — Lond.: BMJ Publications, 1998.

50. Brltton À., McKee M., Black N. et al. Choosing between randomized and non-randomized studies: a systematic review// Health Technol. Assess. — 1998.-Vol. 2.-P. 1-124.

51. Doll R., Hill A.B. Mortality in relation to smoking: ten years' observationsonBritishdoctors//BMJ. - 1964. - No. I. - P. 1399-1414, 1460-1467.

52. Doll R., Peto R. Mortality in relation to smoking: ten years' observations on British doctors // Ibid. - 1976. - No. II. - 1525-1536.

53. Doll R., Peto R., Wheatley K, Gray R,. Sutherland I. Mortality in relation to smoking: 40 years' observations on male British doctors // Ibid. — 1994. - Vol. 309. - P. 901-911.

54. Guillebaud J. The Pill. — 4th ed. — Oxford: Oxford University Press, 1991.

55. Macnaughton J. Anecdote in clinical practice // Narrative Based Medicine: Dialogue and Discourse in Clinical Practice. / Eds T. Greenhalgh, B. Hurwitz. - Lond.: BMJ Publications, 1999. - P. 202-211.

56. McBride W.G. Thalidomide and congenital abnormalities // Lancet. — 1961. - Vol. 2. - R 1358.

57. Pohjola-Sintonen S., Viitasalo M., Toivonen L., Neuvonen P. Itraconazole prevents terfenadine metabolism and increases the risk of


torsades de pointes ventricular tachycardia // Eur. J. Clin. Pharmacol. — 1993.-Vol. 45.-P. 191-193.

58. Middle C, Johnson A., Petty T, Sims L., Macfarlane A. Ethics approval for a national postal survey: recent experience // BMJ. - 1995. -Vol. 311. - P. 659-660.

59. Olde Rickert M.G.M., ten Have H.A.M.J., Hoemagels W.H.L. Informed consent in biomedical studies on ageing: survey of four journals // Ibid. - 1996. - Vol. 313. - Ð. 1117.

60. IVitamin Research Group. Prevention of neural tube defects. Results of the MRC Vitamin Study// Lancet. - 1991. - Vol. 338. - P. 131-137.


Ãëàâà 4

Îöåíêà ìåòîäîëîãè÷åñêîãî êà÷åñòâà

 

 ðàçäåëå 3.1 ìû îòìå÷àëè, ÷òî êà÷åñòâî ñòàòüè çàâèñèò îò òîãî, íà­ñêîëüêî õîðîøî íàïèñàí ðàçäåë «Ìåòîäû».  ýòîé ãëàâå ïðèâåäåíû 5 îñ­íîâíûõ âîïðîñîâ, êîòîðûå äîëæíû ëå÷ü â îñíîâó âàøåãî ðåøåíèÿ î òîì, âûáðàñûâàòü» ñòàòüþ èëè íåò, êàêèå âûâîäû äåëàòü íà åå îñíîâàíèè è èñïîëüçîâàòü ëè ñòàòüþ â ïðàêòè÷åñêîé äåÿòåëüíîñòè:

• ßâëÿåòñÿ ëè èññëåäîâàíèå îðèãèíàëüíûì?

• Î êîì ãîâîðèòñÿ â èññëåäîâàíèè?

• Õîðîøî ëè èññëåäîâàíèå ñïëàíèðîâàíî?

• Óäàëîñü ëè â èññëåäîâàíèè èçáåæàòü ñèñòåìàòè÷åñêèõ îøèáîê (ò.å. áûëî ëè îíî àäåêâàòíî «êîíòðîëèðóåìûì»)?

• ßâëÿåòñÿ ëè èññëåäîâàíèå äîñòàòî÷íî êðóïíûì è ïðîäîëæèòåëü­íûì äëÿ òîãî, ÷òîáû ðåçóëüòàòû âûçûâàëè äîâåðèå?

Ýòè âîïðîñû ïîäðîáíî ðàññìîòðåíû íèæå.

 

4.1. ßâëÿåòñÿ ëè èññëåäîâàíèå îðèãèíàëüíûì?

Îòâå÷àòü íà íàó÷íûé âîïðîñ íåò ñìûñëà, åñëè íà íåãî óæå îòâåòèë êòî-òî äðóãîé. Íà ïðàêòèêå íàó÷íûå îòêðûòèÿ âñòðå÷àþòñÿ ðåäêî. Òîëü­êî íåçíà÷èòåëüíàÿ ÷àñòü ìåäèöèíñêèõ èññëåäîâàíèé îòêðûâàåò íîâûå îáëàñòè, ïðèìåðíî ñòîëüêî æå ïîâòîðÿåò øàãè ïðåäûäóùèõ. Áîëüøèí­ñòâî íàó÷íûõ èññëåäîâàíèé (åñëè îíè ìåòîäîëîãè÷åñêè ïðàâèëüíû) ãî­âîðèò íàì î òîì, ÷òî îïðåäåëåííàÿ ãèïîòåçà ÿâëÿåòñÿ ñ áîëüøåé èëè ìåíü­øåé âåðîÿòíîñòüþ ïðàâèëüíîé, — òàêèì îáðàçîì, ê îáøèðíîé íàó÷íîé ìîçàèêå äîáàâëÿåòñÿ åùå îäèí «êóñî÷åê». Èòàê, ìîæíî ïðîâåñòè áåçóï­ðå÷íîå èññëåäîâàíèå, êîòîðîå ïðè áëèæàéøåì ðàññìîòðåíèè îêàæåòñÿ «íåîðèãèíàëüíûì». Âñÿ íàóêà ìåòà-àíàëèçà îñíîâûâàåòñÿ íà òîì, ÷òî ïî ìíîãèì êëèíè÷åñêèì âîïðîñàì ïðîâåäåíî íåñêîëüêèõ êëèíè÷åñêèõ èññëåäîâàíèé, â êîòîðûõ çàäàâàëñÿ îäèí è òîò æå âîïðîñ ïðèìåðíî îäè­íàêîâûì ñïîñîáîì.


Ïðàêòè÷íåå çàäàâàòü íå âîïðîñ «ïðîâîäèëè ëè ðàíüøå ïîäîáíîå èñ­ñëåäîâàíèå», à «âíîñèò ëè ýòî èññëåäîâàíèå íîâûé âêëàä â ìåäèöèíñ­êóþ íàóêó».

• ßâëÿåòñÿ ëè ýòî èññëåäîâàíèå áîëåå êðóïíûì, ïðîäîëæèòåëüíûì èëè â èíûõ îòíîøåíèÿõ áîëåå çíà÷èìûì, ÷åì ïðåäûäóùèå?

• ßâëÿþòñÿ ëè ìåòîäû ýòîãî èññëåäîâàíèÿ áîëåå òî÷íûìè (îñîáåííî ó÷èòûâàåò ëè îíî êðèòè÷åñêèå çàìå÷àíèÿ ê ìåòîäîëîãèè ïðåäûäó­ùèõ èññëåäîâàíèé)?

• Âíåñóò ëè êîëè÷åñòâåííûå ðåçóëüòàòû ýòîãî èññëåäîâàíèÿ çíà÷è­òåëüíûé âêëàä â ðåçóëüòàòû ìåòà-àíàëèçà, ïðîâåäåííîãî íà îñíîâå ïðåäûäóùèõ èññëåäîâàíèé?

• Îòëè÷àåòñÿ ëè èçó÷àåìàÿ ïîïóëÿöèÿ (ïî ýòíè÷åñêîìó ïðîèñõîæäåíèþ, âîçðàñòó èëè ïîëó) îò ïîïóëÿöèé â ïðåäûäóùèõ èññëåäîâàíèÿõ?

• Äîñòàòî÷íî ëè âàæåí ïîñòàâëåííûé èññëåäîâàíèåì âîïðîñ ñ êëè­íè÷åñêîé òî÷êè çðåíèÿ; èìåþòñÿ ëè ó îáùåñòâåííîñòè èëè ëèö, ïðè­íèìàþùèõ ðåøåíèÿ, ñîìíåíèÿ è «ïîëèòè÷åñêàÿ» ïîòðåáíîñòü â íîâûõ äîêàçàòåëüñòâàõ, äàæå åñëè ñ òî÷êè çðåíèÿ íàóêè îíè íå ÿâ­ëÿþòñÿ ñòðîãî íåîáõîäèìûìè?

 

4.2. Î êîì ãîâîðèòñÿ â èññëåäîâàíèè?

Îäíà èç ïåðâûõ ñòàòåé, êîòîðàÿ êîãäà-òî ïîïàëàñü ìíå íà ãëàçà, íàçûâà­ëàñü «Íî ïîìîæåò ëè ýòî ìîèì ïàöèåíòàì ñ èíôàðêòîì ìèîêàðäà?». ß íå ïîìíþ âñåõ äåòàëåé ñòàòüè, íî îíà îòêðûëà ìíå ãëàçà íà òî, ÷òî èññëåäîâàíèå, ïðîâåäåííîå íà ãðóïïå ïàöèåíòîâ, ìîæåò îêàçàòüñÿ íåïðèãîäíûì äëÿ ìîåé ïðàêòèêè. Îñíîâíûå ïðè÷èíû, ïî êîòîðûì ïàöèåíòû (ó÷àñòíèêè) â êëèíè÷åñ­êîì èññëåäîâàíèè ìîãóò îòëè÷àòüñÿ îò ïàöèåíòîâ â «ðåàëüíîé æèçíè»:

• ó íèõ áûëà áîëüøàÿ èëè ìåíüøàÿ ñòåïåíü òÿæåñòè çàáîëåâàíèÿ, ÷åì ó âàøèõ ïàöèåíòîâ;

• îíè îòíîñèëèñü ê äðóãîé ýòíè÷åñêîé ãðóïïå, èëè ñòèëü èõ æèçíè îòëè÷àëñÿ îò òàêîâîãî âàøèõ ïàöèåíòîâ;

• îíè ïîëó÷àëè áîëåå ïðèñòàëüíîå âíèìàíèå âî âðåìÿ èññëåäîâàíèÿ, ÷åì òî, êîòîðîå âû ìîæåòå óäåëèòü ñâîèì ïàöèåíòàì;

• â îòëè÷èå îò îáû÷íûõ ïàöèåíòîâ, ó íèõ íå áûëî äðóãèõ ïðîáëåì ñî çäîðîâüåì, êðîìå èçó÷àåìîãî ñîñòîÿíèÿ;

• íèêòî èç íèõ íå êóðèë, íå óïîòðåáëÿë àëêîãîëü è íå ïðèíèìàë ïå-ðîðàëüíûå êîíòðàöåïòèâû.

Òàêèì îáðàçîì, äî òîãî, êàê «ïðîãëîòèòü» ðåçóëüòàòû ñòàòüè, íóæíî çàäàòü ñåáå ñëåäóþùèå âîïðîñû.


Êàê îñóùåñòâëÿëñÿ íàáîð ó÷àñòíèêîâ èññëåäîâàíèÿ?

Åñëè âû õîòèòå ïðîâåñòè àíêåòíûé îïðîñ ëèö, ïîïàâøèõ â îòäåëåíèå íåî­òëîæíîé ïîìîùè, âû ìîæåòå íàáðàòü ðåñïîíäåíòîâ, ïîìåñòèâ îáúÿâëåíèå â ãàçåòå. Òàêîé ñïîñîá — õîðîøèé ïðèìåð ñèñòåìàòè÷åñêîé îøèáêè âñëåäñòâèå îòáîðà (recruitment bias), ïîñêîëüêó âûáîðêà, êîòîðóþ âû ïîëó÷èòå, îêàæåò­ñÿ ñìåùåííîé â ñòîðîíó ëèö ñ âûñîêîé ìîòèâàöèåé, êîòîðûì íðàâèòñÿ ÷èòàòü ãàçåòû. Ëó÷øå àäðåñîâàòü ýòó àíêåòó âñåì ëþäÿì (èëè êàæäîìó 10-ìó â ýòîé ãðóïïå), ïîïàâøèì â îòäåëåíèå íåîòëîæíîé ïîìîùè â îïðåäåëåííûé äåíü.

Êàêèõ ïàöèåíòîâ âêëþ÷àëè â èññëåäîâàíèå?

 Âåëèêîáðèòàíèè âî ìíîãèõ èñïûòàíèÿõ èñêëþ÷àþò ïàöèåíòîâ ñ ñî­ïóòñòâóþùèìè çàáîëåâàíèÿìè, ïàöèåíòîâ, íå ãîâîðÿùèõ íà àíãëèéñêîì ÿçûêå, ïðèíèìàþùèõ ëåêàðñòâåííûå ïðåïàðàòû è íåîáðàçîâàííûõ ëèö. Òà­êîé ïîäõîä ìîæåò áûòü «÷èñòûì» ñ íàó÷íîé òî÷êè çðåíèÿ. Îäíàêî, ó÷èòû­âàÿ, ÷òî ðåçóëüòàòû êëèíè÷åñêèõ èñïûòàíèé ïðèìåíÿþòñÿ â áîëåå øèðîêîé âûáîðêå, îí íå áåçóïðå÷åí ñ òî÷êè çðåíèÿ ëîãèêè3. Ðåçóëüòàòû èññëåäîâà­íèé ôàðìàêîêèíåòèêè íîâûõ ïðåïàðàòîâ íà çäîðîâûõ ìóæ÷èíàõ â âîçðàñòå 23 ëåò î÷åâèäíî íåëüçÿ ïðèìåíÿòü ê æåíùèíå ïîæèëîãî âîçðàñòà. Ýòîò âîï­ðîñ, êîòîðûé íåêîòîðîå âðåìÿ îòïóãèâàë âðà÷åé4, ñ íåäàâíèõ ïîð áûë âçÿò íà âîîðóæåíèå ñàìèìè ïàöèåíòàìè. Ýòî ïðîÿâèëîñü â ïðåäëîæåíèÿõ ñî ñòî­ðîíû ãðóïï ïîääåðæêè ïàöèåíòîâ ðàñøèðèòü «êðèòåðèè âêëþ÷åíèÿ» ïàöè­åíòîâ â èñïûòàíèÿ ëåêàðñòâåííûõ ïðåïàðàòîâ ïðè ÑÏÈÄå5.

Êàêèõ ïàöèåíòîâ èñêëþ÷àëè èç èññëåäîâàíèÿ?

ÐÊÏ, îãðàíè÷åííîå ïàöèåíòàìè ñ óìåðåííûìè è òÿæåëûìè ôîðìàìè çà­áîëåâàíèÿ, íàïðèìåð ñåðäå÷íîé íåäîñòàòî÷íîñòè, ìîæåò áûòü íåïðèìåíèìûì äëÿ ëå÷åíèÿ ëåãêèõ ôîðì ñåðäå÷íîé íåäîñòàòî÷íîñòè. Ýòî èìååò âàæíîå ïðàê­òè÷åñêîå çíà÷åíèå, êîãäà ðåçóëüòàòû êëèíè÷åñêèõ èñïûòàíèé, ïðîâåäåííûõ íà ãîñïèòàëüíûõ áîëüíûõ, èñïîëüçóþòñÿ äëÿ ðåêîìåíäàöèé ïî ëå÷åíèþ àìáó­ëàòîðíûõ áîëüíûõ, ó êîòîðûõ òÿæåñòü çàáîëåâàíèé, êàê ïðàâèëî, ìåíüøå.

Ïðîâîäèëîñü ëè èçó÷åíèå ïàöèåíòîâ â îáñòîÿòåëüñòâàõ «ðåàëü­íîé æèçíè»?

Íàïðèìåð, ïîñòóïàëè ëè ïàöèåíòû â ñòàöèîíàð òîëüêî äëÿ íàáëþäåíèÿ? Îáúÿñíÿëè ëè èì ïîòåíöèàëüíûå ïðåèìóùåñòâà âìåøàòåëüñòâà? Ïðåäîñòàâ­ëÿëñÿ ëè ïàöèåíòàì êîíòàêòíûé òåëåôîí ñîòðóäíèêà, îòâå÷àþùåãî çà ïðîâå­äåíèå èññëåäîâàíèÿ? Ïðåäîñòàâëÿëà ëè êîìïàíèÿ—ñïîíñîð èññëåäîâàíèÿ íîâîå îáîðóäîâàíèå, íåäîñòóïíîå îáû÷íîìó âðà÷ó? Ýòè ôàêòîðû íå îáåñöå­


íèâàþò ðåçóëüòàòîâ èññëåäîâàíèÿ, íî îíè äîëæíû çàðîíèòü ñîìíåíèå îòíî­ñèòåëüíî ïðèìåíèìîñòè åãî ðåçóëüòàòîâ ïî îòíîøåíèþ ê âàøèì ïàöèåíòàì.

 

4.3. Õîðîøî ëè èññëåäîâàíèå ñïëàíèðîâàíî?

Ñëîæíàÿ òåðìèíîëîãèÿ äèçàéíà íàó÷íûõ èññëåäîâàíèé ìîæåò îòïó­ãèâàòü, õîòÿ òàê íàçûâàåìàÿ êðèòè÷åñêàÿ îöåíêà (critical appraisal) îñ­íîâûâàåòñÿ íà ïðîñòîì çäðàâîì ñìûñëå. Äèçàéí èññëåäîâàíèÿ ÿ îöåíè­âàþ ïðè ïîìîùè äâóõ âîïðîñîâ.

Êàêèå âìåøàòåëüñòâà îöåíèâàëèñü â èññëåäîâàíèè è ñ ÷åì èõ ñðàâ­íèâàëè?

Ýòî îäèí èç îñíîâîïîëàãàþùèõ âîïðîñîâ ïðè îöåíêå ñòàòüè. Âîçíèêà­åò ñîáëàçí ñðàçó æå ïðèíÿòü íà âåðó ðåçóëüòàòû èññëåäîâàíèÿ, íî ñëåäóåò ïîìíèòü, ÷òî àâòîðû ÷àñòî èñêàæàþò (ñêîðåå ïîäñîçíàòåëüíî) ïðåäñòàâ­ëåíèå î ñâîåé ðàáîòå è ïåðåîöåíèâàþò åå îðèãèíàëüíîñòü è ïîòåíöèàëü­íóþ çíà÷èìîñòü.  ïðèìåðàõ (âðåçêà 4.1) ïðèâåäåíû ãèïîòåòè÷åñêèå (÷òî­áû íèêîãî íå îáèæàòü) óòâåðæäåíèÿ, íî îíè ïîñòðîåíû íà îøèáêàõ, ÷àñòî âñòðå÷àþùèõñÿ â íàó÷íûõ ñòàòüÿõ.

Êàêèå èçìåðÿëèñü èñõîäû è êàêèì îáðàçîì ?

Åñëè âû ñòðàäàåòå íåèçëå÷èìûì çàáîëåâàíèåì è íåêàÿ ôàðìàöåâòè­÷åñêàÿ êîìïàíèÿ îáúÿâëÿåò, ÷òî îíà ïðîèçâîäèò íîâûé ÷óäî-ïðåïàðàò, âû ñìîæåòå îöåíèòü åãî ýôôåêòèâíîñòü, åñëè ïðîæèâåòå, ïðèíèìàÿ ýòîò ïðåïàðàò, äîëüøå (êîíå÷íî, åñëè êà÷åñòâî æèçíè òîãî ñòîèò, ó÷èòûâàÿ âàøå ñîñòîÿíèå è ïîáî÷íûå ýôôåêòû ïðåïàðàòà). Íàâåðíîå, âàñ ìàëî èíòåðåñóåò êîíöåíòðàöèÿ â êðîâè ñëîæíîãî ôåðìåíòà, äàæå åñëè âàñ óâåðÿþò, ÷òî ýòî íàäåæíûé ïîêàçàòåëü øàíñîâ íà âûæèâàíèå. Èñïîëü­çîâàíèå ïîäîáíûõ ñóððîãàòíûõ êîíå÷íûõ òî÷åê (èñõîäîâ), èëè êîñâåí­íûõ êðèòåðèåâ îöåíêè, îáñóæäàåòñÿ äàëåå â ðàçäåëå 6.3.

Èçìåðåíèå ñèìïòîìàòè÷åñêèõ (íàïðèìåð, áîëü), ôóíêöèîíàëüíûõ (íà­ïðèìåð, ïîäâèæíîñòü), ïñèõîëîãè÷åñêèõ (íàïðèìåð, òðåâîæíîñòü) èëè ñî­öèàëüíûõ (íàïðèìåð, íåóäîáñòâî) ýôôåêòîâ âìåøàòåëüñòâà óäðó÷àåò åùå áîëüøèì êîëè÷åñòâîì ïðîáëåì. Ìåòîäîëîãèÿ ðàçâèòèÿ, âíåäðåíèÿ â ïðàê­òèêó, à òàêæå èíòåðïðåòàöèè òàêèõ «ìÿãêèõ» ïîêàçàòåëåé èñõîäîâ â ýòîé êíèãå íå îáñóæäàåòñÿ.  öåëîì âû âñåãäà äîëæíû èñêàòü â ñòàòüå äîêàçà­òåëüñòâà òîãî, ÷òî èñõîäû èçìåðÿëèñü îáúåêòèâíûìè ìåòîäàìè, ÷òî øêàëà òðåâîæíîñòè èëè áîëè äîñòîâåðíî îòðàæàåò èçìåðÿåìûé ïîêàçàòåëü è ÷òî îáúåêòèâíûå èçìåíåíèÿ äàííîãî èñõîäà àäåêâàòíî îòðàæàþò èçìåíåíèÿ â


Âðåçêà 4.1. Ïðèìåðû îøèáîê â ðàçäåëå «Ìåòîäû»  
×òî ãîâîðèëè àâòîðû ×òî èì ñëåäîâàëî ñêàçàòü (èëè ñäåëàòü) Îáúÿñíåíèå îøèáêè
Ìû èçìåðÿëè, êàê ÷àñòî âðà- ÷è îáùåé ïðàêòèêè ñïðàøèâà- þò ïàöèåíòîâ î òîì, êóðÿò ëè îíè Ìû ïðîñìîòðåëè ìåäèöèíñêèå êàðòû ïàöèåíòîâ è ïîäñ÷èòàëè, â êàêîì ïðîöåíòå ñëó÷àåâ âðà÷è ðåãèñòðèðîâàëè ôàêò êóðåíèÿ Ïðåäïîëîæåíèå, ÷òî ìå- äèöèíñêèå êàðòû â 100 % ñëó÷àåâ òî÷íî îòðàæà- þò èñòèííîå ïîëîæåíèå âåùåé
Ìû èçìåðÿëè, êàê âðà÷è ëå÷àò áîëü â íèæíåé ÷àñòè ñïèíû Ìû èçìåðÿëè, ÷òî ãîâîðÿò âðà÷è î ñâîèõ äåéñòâèÿõ ïðè ïðèåìå ïàöè- åíòà ñ áîëüþ â íèæíåé ÷àñòè ñïèíû Ïðåäïîëîæåíèå, ÷òî âðà- ÷è ãîâîðÿò î òîì, ÷òî äåé- ñòâèòåëüíî äåëàþò
Ìû ñðàâíèâàëè íèêîòèíîâûé ïëàñòûðü ñ ïëàöåáî Ïàöèåíòîâ ýêñïåðèìåíòàëüíîé ãðóïïû ïðîñèëè íàêëàäûâàòü ïëà- ñòûðü, ñîäåðæàùèé 15 ìã íèêîòè- íà, 2 ðàçà â ñóòêè; ïàöèåíòàì êîí- òðîëüíîé ãðóïïû äàâàëè ïëàñòûðè, êîòîðûå âûãëÿäåëè èäåíòè÷íî Íå óêàçàíû äîçà ïðåïà- ðàòà èëè âèä ïëàöåáî
Ìû ïîïðîñèëè 100 ïîäðîñòêîâ ïðèíÿòü ó÷àñòèå â èññëåäîâà- íèè ñåêñóàëüíûõ îòíîøåíèé Ìû îáðàòèëèñü ê 167 àìåðèêàí- ñêèì ïîäðîñòêàì (åâðîïåîèäàì)â âîçðàñòå 12—18 ëåò (èç íèõ 85 ìóæñêîãî ïîëà) â ëåòíåì ëàãåðå; 100èçíèõ(31 ìóæñêîãî ïîëà) ñî- ãëàñèëèñü ïðèíÿòü ó÷àñòèå â èñ- ñëåäîâàíèè Íåñïîñîáíîñòü ïðèâåñòè äîñòàòî÷íóþ èíôîðìàöèþ î ñóáúåêòàõ (îáðàòèòå âíèìàíèå, ÷òî öèôðû â ýòîì ïðèìåðå óêàçûâàþò íà ñèñòåìàòè÷åñêóþ îøèáêó âñëåäñòâèå îòáî- ðà ïî íàïðàâëåíèþ ê ïðåäñòàâèòåëüíèöàì æåí- ñêîãî ïîëà)
Ìû ðàíäîìèçèðîâàëè ïàöèåí- òîâ â ãðóïïó ñ ïëàíîì èíäèâè- äóàëüíîãî óõîäà è ãðóïïó ñ «îáû÷íûì» óõîäîì Ó÷àñòíèêàì ýêñïåðèìåíòàëüíîé ãðóïïû ïðåäëàãàëè èíäèâèäóàëü- íûé ïëàí óõîäà, ñîñòîÿùèé èç...; ïàöèåíòàì êîíòðîëüíîé ãðóïïû ïðåäëàãàëè... Íåñïîñîáíîñòü äàòü äîñ- òàòî÷íóþ èíôîðìàöèþ î âìåøàòåëüñòâå (èíôîð- ìàöèÿ äîëæíà áûòü äîñ- òàòî÷íîé äëÿ òîãî, ÷òîáû èññëåäîâàíèå ìîãëè ïî- âòîðèòü äðóãèå)
Äëÿ îöåíêè îáó÷àþùåé áðîøþ- ðû îáñëåäóåìûì ýêñïåðèìåí- òàëüíîé ãðóïïû ìû ïðåäîñòàâ- ëÿëè áðîøþðó è êîíòàêòíûé òåëåôîí äëÿ ñíÿòèÿ âîïðîñîâ.  êîíòðîëüíîé ãðóïïå ìû íå äà- âàëè íè áðîøþðû, íè òåëåôîíà Åñëè èññëåäîâàíèå íàïðàâëåíî èñêëþ÷èòåëüíî íà îöåíêó áðîøþ- ðû, ïðåäñòàâèòåëåé îáåèõ ãðóïï ñëåäîâàëî ñíàáäèòü êîíòàêòíûì òåëåôîíîì Íåñïîñîáíîñòü âåñòè ãðóïïû îäèíàêîâî, çà èñ- êëþ÷åíèåì ñïåöèôè÷åñ- êîãî âìåøàòåëüñòâà
Ìû èçìåðèëè ýôôåêòèâíîñòü âèòàìèíà Ñ äëÿ ïðîôèëàêòè- êè ïðîñòóäû Ñèñòåìàòè÷åñêèé îáçîð ïîçâîëèë áû îáíàðóæèòü ìíîæåñòâî èññëå- äîâàíèé íà ýòó òåìó, ïðîâåäåííûõ â ïðîøëîì (ñì. ðàçäåë 8.1) Íåîðèãèíàëüíîå èññëå- äîâàíèå

ñîñòîÿíèè ïàöèåíòà. Ñëåäóåò ïîìíèòü: òî, ÷òî âàæíî ñ òî÷êè çðåíèÿ âðà­÷à, ìîæåò íå ïðåäñòàâëÿòü öåííîñòè äëÿ ïàöèåíòà, è íàîáîðîò.

 

4.4. Óäàëîñü ëè â èññëåäîâàíèè èçáåæàòü ñèñòåìàòè÷åñêèõ îøèáîê èëè ìèíèìèçèðîâàòü èõ?

Ýïèäåìèîëîãè Äæåôôðè Ðîóç (Geoffrey Rose) è Äýâèä Áàðêåð (David Barker) îïðåäåëÿþò ñèñòåìàòè÷åñêóþ îøèáêó êàê ëþáîé ôàêòîð, êîòî­ðûé âëèÿåò íà âûâîäû è èñêàæàåò ñðàâíèòåëüíóþ îöåíêó7. Íåçàâèñèìî îò äèçàéíà èññëåäîâàíèÿ (ÐÊÈ, íåðàíäîìèçèðîâàííîå ñðàâíèòåëüíîå èñ­ïûòàíèå, êîãîðòíîå èññëåäîâàíèå èëè èññëåäîâàíèå «ñëó÷àé—êîíò­ðîëü»), ãðóïïû äîëæíû áûòü èäåíòè÷íû, çà èñêëþ÷åíèåì èçó÷àåìîãî ïàðàìåòðà. Ó÷àñòíèêè èññëåäîâàíèÿ äîëæíû ïîëó÷àòü îäíè è òå æå èíñòðóêöèè, èìåòü îäèíàêîâûé êîíòàêò ñ ìåäèöèíñêèì ïåðñîíàëîì è îá­ñëåäîâàòüñÿ îäèíàêîâîå ÷èñëî ðàç ñ èñïîëüçîâàíèåì îäíèõ è òåõ æå ïî­êàçàòåëåé èñõîäîâ.  ðàçëè÷íûõ ïî äèçàéíó èññëåäîâàíèÿõ ñëåäóåò ïðè­íèìàòü ðàçëè÷íûå ìåðû äëÿ ñíèæåíèÿ âåðîÿòíîñòè ñèñòåìàòè÷åñêîé îøèáêè.

Ðàíäîìèçèðîâàííûå êîíòðîëèðóåìûå èñïûòàíèÿ

Ïðè ïðîâåäåíèè ÐÊÈ ñèñòåìàòè÷åñêîé îøèáêè ìîæíî èçáåæàòü (òå­îðåòè÷åñêè) ïóòåì îòáîðà ó÷àñòíèêîâ èç îïðåäåëåííîé ïîïóëÿöèè è èõ ñëó÷àéíîãî ðàñïðåäåëåíèÿ ïî ãðóïïàì.  ðàçäåëå 3.3 îïèñàíû ñèòóàöèè, â êîòîðûõ ñèñòåìàòè÷åñêàÿ îøèáêà ìîæåò çàêðàñòüñÿ äàæå â ýòîò «çî­ëîòîé ñòàíäàðò» êëèíè÷åñêèõ èñïûòàíèé; íà ðèñ. 4.1. îáîáùåíû íåêîòî­ðûå ïðèìåðû, íà êîòîðûå ñëåäóåò îáðàòèòü îñîáîå âíèìàíèå.

Íåðàíäîìèçèðîâàííûå êîíòðîëèðóåìûå èñïûòàíèÿ

Íåäàâíî ÿ ïðîâîäèëà ñåìèíàð, íà êîòîðîì ìîè ñòóäåíòû äîêëàäûâà­ëè ðåçóëüòàòû ñîáñòâåííûõ íàó÷íûõ èññëåäîâàíèé. Âñå èññëåäîâàíèÿ (êðîìå îäíîãî) áûëè ñðàâíèòåëüíîãî, íî íåðàíäîìèçèðîâàííîãî äèçàé­íà — ïàöèåíòû èç îäíîé ãðóïïû (íàïðèìåð, àìáóëàòîðíûå ïàöèåíòû ñ áðîíõèàëüíîé àñòìîé) ïîëó÷àëè îäèí âèä âìåøàòåëüñòâà (íàïðèìåð, îáðàçîâàòåëüíóþ áðîøþðó), à ó÷àñòíèêè äðóãîé ãðóïïû (íàïðèìåð, ïà­öèåíòû ñ áðîíõèàëüíîé àñòìîé, ïîñåùàþùèå õèðóðãîâ) ïîëó÷àëè äðóãîé âèä âìåøàòåëüñòâà (íàïðèìåð, çàíèìàëèñü íà îáðàçîâàòåëüíûõ ñåìèíà­ðàõ). ß áûëà óäèâëåíà òåì, ÷òî ìíîãèå äîêëàä÷èêè ñ÷èòàëè ñâîå èññëåäî­âàíèå ðàíäîìèçèðîâàííûì è êîíòðîëèðóåìûì. Ýòè äîñòîéíûå ïîõâàëû, ïðåäàííûå íàóêå ìîëîäûå èññëåäîâàòåëè-ýíòóçèàñòû íå îáðàòèëè âíè-



pµ_1_ªÏ[-«U,¿)_±3·RŽ_÷dµS_%ݵÖ"_.Ÿuô,/ÌCÎ,‘SŽ�_›Ú±ú�ùµ£ê_hÓ`·____ÏÓ_Dkp%°_D’_ €__�___ÊMf_ €__µ_´ØÕ¸ˆµp´6¼X_øÔ_Nµˆ__§ŒéÈF¼W¼@·|*ti JâÏBÊíóÓÆQb>ñ”_›ÏìY"#äz7mŒ[ÆéÚ_ÏæêM+°ãõï_j__V_2B____@À¥__°K8NC____ðQ@:µ­$_.Ìp.”U½_"ú-†½êdfc!­òs_�?ÓÆ$h_mÛ__[¯,e_�ûØ_jÒr Üv_8,EõY‚ä_@___¢-@__íö£ô_ €@_ŠK3çõz_"a=_–#§…_…­B.y!¯6·¸°–tðábµFÑ‚]­ôâzáœVH-_—A±§[�À³_ÖÆ ð9üΆ___ €@___€£Øj”____ˆ©@!__s›K×yÒ/úÕ«]8ü¶H†Jaˆ¸8ºZÐX;Ù(€ùNEêm’_,;å´Md_ã›Öhw|òå`Ó_¸Û™Ú•µ)__�Ë_U±!€___ _E__à(¶_eF___â*PX˪°_taùãÂm‰ôp®°ê”±ê³R¸q¯¼_‘±–ôíWñlé�ªó_‹iµ_B^¹,–¸_Ù³_X–nhH]§ºV|j½´rE@^v˜1ý»t…/µÚæë¦‹‹K;¹ƒ“¢d_+®Í6I:,j.õB____ˆ†__p4Ú‰R"€__ _(]_ºÒÆÒÌÅP_uÉ_·x•¶2szq§¼›’_î_Ãßš_5__(MY$m8ÝhS_¥ó_žlÅÒÕ–½ø_Eƒ q:__ €__Í_ _nŽ;¹"€___T_°^_Z»ç®ùb^qqpÙÂVæ[_‰DÌϪgë¿W�6m_G-@éH§zº_¡daÁ­â%¿… Ð…!kÏzE…—G)ëó =J�d_@_____Z ÕßߟËå²ÙlÐ9“___ €___ €___ €__�_<°qý‚…‹____›L_@____@____@___š-@_Üì_ __@____@____@_�@__€_a&___@____@____@_�f___7»_È____@____@____@ ___à@˜É____@____@____@ Ù__ÀÍn_òG____@____@_____D€_8_f2A____@____@____h¶__p³[€ü_@____@____@_____ __„™L_@____@____@___š-@_Üì_ __@____@____@_�@__€_a&___@____@____@_�f___7»_È____@____@____@ ___à@˜É____@____@____@ Ù__ÀÍn_òG____@____@_____D€_8_f2A____@____@____h¶__p³[€ü_@____@____@_____ __„™L_@____@____@___š-@_Üì_ __@____@____@_�@__€_a&___@____@____@_�f___7»_È____@____@____@ ___à@˜É____@____@____@ Ù__ÀÍn_òG____Hž@[[[ò*_D��B™<_@_�(_¤úûûs¹›�r-(;__ €€___lWÒIMwtõxå_^œ_ï_–°�'K_ €__ñ__j_,_p<Z“Z €___ €___ €___Ô_ _¦‹ €___ €___ €___$B€_8_ÍL%_@____@____@____€é__ €___ €___ €__‰_ _ND3SI__@____@____@___`ú___ €€§_Ûþ÷Ú‹.oÕ_×þ`›ž´ºó–»=ÍGMÌm²w^/a«M©,_w›£—U7 KçÏÞã*ù0Ô¥²àá,•+`NB_____¡__p__…"!€__‘_¸ç–ÖŽµo_[7±A<¾tÞÀ»Š1°Wuò @ºïŽÿXt£^È�½Á«‚_šÎ5_S…ug¥Ûô]ƒ1<Ð_´žd†___ €€·__ÀÞz’___ �d�mÿóµÛ>8ü…?�+_.ùäð5w_Œz?ðÛ ñ¶§_VÎ9C/dƒi…áô°:‡Á†2 €___ P*@_L�@____ðH`Ûÿýô®kÞ|™)µË>6±¡bˆµ8ƒ÷_ÿS˜"­ˆ¡ãÂÄéÖÏß§&!_»î–Ï^'¦øšçNß÷ÙŽÏÜ©Üö¡‹,Î-Î_¶ÌB–K<¥§pùg`š˜msŠ8«P¼k¿û¸Q½­?ø„Qf—“�=‚W.»òƒÊ£OIL»Š4§å`]qwÍjšÎ]bX_o2WD:_ €__¡_ __MSP___@ ê_[_¿óŠ³Î¨Q__ƒ_æH_Ÿóé__ÜÞ÷Ùn1tMè_¾Fù�ÿÐ_ã»nS>$všCèK>9ö©+_1_Ø_g¾íCwOüzw!5‹,Åšûίè)ûäåFY-KUxV_iÝ�Ê)Ó]Êmw__é��sôyÈśՄs[®X?¹E“ìøÌyº¤Ák”ªa=-À¶ª¸»f5•vìS_ëÍ'ò¨lÓfÁ’/__ €@Ü__€ãÖ¢Ô_____µÀ=w~ýŠÅ—ËéÇ—uÞxÅmw¨_8]òÉë>)‡ŽÕÁLc[ÔrzÍÚ,ºñ½—¨_�~Ö•òXë,lÓ±=e뺵w~à_r^÷_Þ+Âoc+_ºZ_t×,¸__¨³»_ƒðæaáªy¹Ó«¨¸»fUÏúÔ_Èv__L_¿é¨(•_V¤‰___ �H__àD6;•F___ü__!è]�?U3å»>óGúlçwú®ÂÑÅ©°×








Äàòà äîáàâëåíèÿ: 2015-09-21; ïðîñìîòðîâ: 744;


Ïîèñê ïî ñàéòó:

Ïðè ïîìîùè ïîèñêà âû ñìîæåòå íàéòè íóæíóþ âàì èíôîðìàöèþ.

Ïîäåëèòåñü ñ äðóçüÿìè:

Åñëè âàì ïåðåí¸ñ ïîëüçó èíôîðìàöèîííûé ìàòåðèàë, èëè ïîìîã â ó÷åáå – ïîäåëèòåñü ýòèì ñàéòîì ñ äðóçüÿìè è çíàêîìûìè.
helpiks.org - Õåëïèêñ.Îðã - 2014-2026 ãîä. Ìàòåðèàë ñàéòà ïðåäñòàâëÿåòñÿ äëÿ îçíàêîìèòåëüíîãî è ó÷åáíîãî èñïîëüçîâàíèÿ. | Ïîääåðæêà
Ãåíåðàöèÿ ñòðàíèöû çà: 0.035 ñåê.