An ambitious project to test the reproducibility of biomedical experiments by Brazilian scientists is about to get under way.<\/p>\n
The Brazilian Reproducibility Initiative was launched last year by researchers at the Federal University of Rio de Janeiro (UFRJ). Now, the first wave of reproducibility testing is set to begin in August, with help from more than 60 laboratories scattered over 43 Brazilian research centres.<\/p>\n
The project is one of the first to test the reproducibility of scientific research from a particular country,\u00a0instead of a particular field<\/a>.<\/p>\n Participants will attempt to replicate up to 100 biomedical experiments \u2014 with each experiment tested by 3 labs1<\/a><\/sup>. The team decided to take that approach, rather than trying to reproduce full studies, to broaden its coverage of the published literature and to make it easier for volunteers to participate, says project coordinator Olavo Bohrer Amaral, a physician at the UFRJ Institute of Medical Biochemistry.<\/p>\n \u201cWe intend to systematically assess the reproducibility of biomedical research, covering different areas of life-science research in Brazil in an open, unbiased and transparent way,\u201d he says.<\/p>\n <\/p>\n Drilling down<\/strong><\/p>\n To determine which experiments to test, the project\u2019s leaders examined a sample of 30,000 biomedical articles published over the past two decades. They narrowed this list down by identifying 5,000 papers in which most of the authors \u2014 including the corresponding one \u2014 were from a Brazilian institution.<\/p>\n From this set of studies, the team drew up a list of 10 analytical methods commonly used in Brazil \u2014 including the MTT assay to assess cells’ metabolic activity, RT-PCR to amplify and detect specific genetic sequences, and the elevated plus maze to test rodent behaviour. The researchers then randomly chose experiments for replication that use one of these techniques.<\/p>\n Amaral and his team expect to finish the project by 2021, with funding from the Serrapilheira Institute in Rio de Janeiro \u2014 Brazil\u2019s first private organization dedicated to supporting basic research in the natural sciences, computer sciences, engineering and mathematics. An initial 145,000-Brazilian-real (US$37,000) grant allowed the researchers to establish the project\u2019s general methodology, select the experiments to analyse and build a countrywide network of collaborators.<\/p>\n Now the project is working with participating labs to establish protocols for replication attempts, with the help of another 1,000,000-real grant from the institute, awarded in January.<\/p>\n <\/p>\n Lather, rinse, repeat<\/strong><\/p>\n The Brazilian project follows in the footsteps of several attempts to replicate scientific outcomes on a large scale. One of the first was\u00a0the Reproducibility Project: Psychology, which launched in 2011<\/a>. It gathered 270 scientists to replicate the results of 100 psychology articles in different journals, yielding a reproducibility rate of 36\u201347%2<\/a><\/sup>. Similar initiatives in experimental economics, philosophy and social sciences arrived at replication rates ranging between 57 and 78%.<\/p>\n The effort\u2019s leaders hope that it will reveal ways to predict the reproducibility of scientific studies. \u201cIt might be invaluable for future decisions on how to finance and elevate science in Brazil,\u201d says Roger Chammas, an oncologist at University of S\u00e3o Paulo School of Medicine and coordinator of one of the replicating labs.<\/p>\n Daniel Martins-de-Souza, a biochemist at the University of Campinas in Brazil, agrees. \u201cIf the project moves forward, it may aid defining which types of studies or methods have more potential to obtain new possibilities of therapy against diseases,\u201d he says. \u201cIt could guide the decision-making process of funding agencies.\u201d<\/p>\n Others are more sceptical. Lygia da Veiga Pereira, a geneticist at the University of S\u00e3o Paulo, says it is too early to tell whether the project\u2019s findings will be able to help guide future research. Still, she says, \u201ctesting how much of Brazilian science is reproducible will be a good diagnosis for us\u201d.<\/p>\n <\/p>\n <\/p>\n<\/div>\n <\/p>\n (\uc6d0\ubb38: \uc5ec\uae30<\/a>\ub97c \ud074\ub9ad\ud558\uc138\uc694~)<\/p>\n <\/p>\n <\/p>\n <\/p>\n","protected":false},"excerpt":{"rendered":"