Showing posts with label Peer Review. Show all posts
Showing posts with label Peer Review. Show all posts

Tuesday, October 25, 2011

The OA Interviews: InTech’s Nicola Rylett

The history of Open Access (OA) publisher InTech is a complicated and somewhat confusing one. According to a Scribd presentation, the company was founded in Vienna in 2004. Over the subsequent seven years it has undergone a series of name changes, moved country, and attracted considerable criticism, both for the quality of its peer review and the way in which it markets its services. The company appears to inhabit a strange binary world: while some accuse it of repeatedly spamming researchers, and preying on the vulnerabilities and egos of researchers in order to make money, the company itself maintains that it is a victim of misinformation and misperception, and that it has a growing and happy customer base. As evidence of the latter, it cites a survey that it commissioned earlier this year. 81% of those responding to the survey, says InTech’s new marketing director Nicola Rylett, rated their publishing experience with the company as either 'excellent' or 'good'.

What do we make of these conflicting pictures of InTech? The quality of peer review can be difficult to assess. Nevertheless, the publisher has acknowledged problems with its peer review in the past, and when I drew Rylett’s attention to a chapter in one of its recently published books she agreed that the quality was “unacceptable”. It also seems fair to conclude that the company’s marketing techniques leave a lot to be desired. However, Rylett insists that InTech is addressing these issues. To that end, she explains, it is currently recruiting a new middle and senior management team.

It seems clear that InTech has proved very successful in selling its pay-to-publish services to thousands of researchers around the world. But can it persuade the wider research community, the scholarly publishing industry, and the Open Access movement to endorse it?

Nicola Rylett
InTech first came to my attention in 2007, when researchers began to raise questions about a Vienna-based company called I-Tech Education and Publishing which, they complained, was sending out unsolicited emails inviting scientists to contribute chapters to books — for which a 380Euros publication charge was being demanded. Many appeared to be concluding that the company was engaged in either mass spamming, or scamming, or possibly both.

At the time, I contacted the CEO of the company Vedran Kordic, who posted a response to the American Scientist Open Access Forum. “[M]ore than 1,500 authors published to date in the open access mode by us,” he said. “There is no one of them thinking that this is a kind of online cheat or that we are working on pay-publish mode.”

Over the next couple of years the complaints appeared only to grow, and by now researchers were posting their grievances on blogs as well as mailing lists. At some point the company changed its name to In-Tech. It also began to launch scholarly journals.

In November 2009 the company changed its name again — to Sciyo. It also created a second web site that appeared to be running in parallel to In-Tech’s site (intechweb.org). And shortly afterwards it announced that anyone publishing a book chapter with the company would receive royalties. These would be based on the number of times an author’s work was downloaded.

An OA publisher paying royalties was a novel idea; an idea, however, greeted with some scepticism. Nevertheless, it stimulated me to contact the company again — an enquiry that led to my doing an email interview with Aleksandar Lazinica, who introduced himself to me as the CEO of Sciyo ...

####

If you wish to read the rest of this introduction and the interview with Nicola Rylett please click on the link below. 

I am publishing it under a Creative Commons licence, so you are free to copy and distribute it as you wish, so long as you credit me as the author, do not alter or transform the text, and do not use it for any commercial purpose. 

To read the interview and introduction (as a PDF file) click here.


IN-TECH HAS ISSUED A STATEMENT AND A RESPONSE TO THE INTRODUCTION TO THIS INTERVIEW. IT CAN BE READ IN THE PDF FILE LINKED ABOVE, OR ALTERNATIVELY HERE


Wednesday, August 17, 2011

The Open Access Interviews: WebmedCentral’s Kamal Mahawar

In any discussion about scholarly communication today two thorny issues quickly emerge: the so-called access problem, and the problem of declining peer review standards. Kamal Mahawar, co-founder and CEO of a new web platform for publishing biomedical research called WebmedCentral, believes he has a solution to both problems. WebmedCentral, however, is not without its critics.

The access problem afflicting the research community is essentially an issue of affordability. Researchers submit a paper to a publisher, who then invites other researchers to assess it for quality and value. Assuming it is deemed to be adequate the paper is then published in a journal. To fund this process publishers sell subscriptions to their journals. Research institutions buy these subscriptions to ensure that their researchers have access to all relevant research being done around the world.

As library budgets have declined, however, research institutions have struggled to find the necessary money to pay for all the subscriptions their faculty require, depriving researchers of access to more and more research — a phenomenon known as the serials crisis.

Advocates of open-access publishing (as distinct from self-archiving) believe that the answer to this access/affordability problem is for researchers to abandon publishing in subscription journals and publish in OA journals instead. Rather than imposing charges for access (subscriptions), OA journals levy a publication fee, or “article-processing charge” on authors, or more usually their institutions. This enables publishers to make the papers they publish freely available on the Web, and so provide unfettered access to them.

The problem with OA publishing, however, is that the publication fees are far from cheap — around $1,350 to $3,000 per paper. Consequently, not all researchers have access to the necessary funds. While some OA publishers offer waivers for those without the wherewithal, this is generally done on a case-by-case basis, and the practice could very well be discontinued at some point in the future. If it was, indigent authors could find themselves unable to get their research published, particularly authors based in the developing world.

Raghavendra Gadagkar, a researcher at the Centre for Ecological Sciences at the Indian Institute of Science in Bangalore, made this point eloquently in a letter to Nature in 2008. He concluded that author-pays OA, “does more harm than good in the developing world”.

Wednesday, June 22, 2011

Peer review: Still no practical alternative?

The UK House of Commons Science & Technology Select Committee is currently conducting an inquiry into peer review. It held its fourth oral evidence session on June 8th, taking evidence from both funders of scientific research and from Government. 

UPDATE: THE COMMITTEE’S REPORT HAS NOW BEEN PUBLISHED. THE DETAILS ARE AVAILABLE HERE.

While the Committee gave no specific reason for launching the current inquiry it seems evident from the questions MPs have been asking that two particular incidents have been exercising their minds: the long-running saga over Andrew Wakefield and the MMR vaccine scare, and the so-called Climategate incident.

In the June 8th session the Committee asked questions not just about the efficacy of peer review, but about scientific fraud, bias, the willingness of universities to investigate allegations of misconduct, and the need to make research data freely available so that others can access, examine and test them.

MPs seemed particularly concerned that universities may be unwilling to investigate claims of misconduct. As MP Graham Stringer put it in one of the questions he asked the witnesses, “There is a certain amount of evidence that very little fraud is detected in universities and major research institutions in this country. Do you think we should be doing more to try and detect that, because in one sense there is an interest within those bodies not to discover or expose the problems they have, to sweep it under the carpet, isn’t there? If you are running a university and you find you have a researcher who just writes down his figures without doing the work, which has happened in one or two cases, the university doesn’t want to say that it has been employing a fraudster for 10 years, does it?”

Politicians also probed the witnesses about the use of journal impact factors as a “proxy measure for research quality” when assessing the performance of academics, and whether “the growth of online repository journals” like PLoS ONE is a “technically sound” development.

Robust defence

For their part the witnesses put up a robust defence of current practices. They denied that universities would cover up fraud; they dismissed suggestions that the impact factor is used as a proxy measure of quality; and they insisted that, while it might not be perfect, there is no practical alternative to traditional peer review.

In support of the latter claim they repeated the oft-made analogy with Winston Churchill’s description of democracy. Churchill famously described democracy as “the worst form of government, except for all those other forms that have been tried from time to time.” Thus it is with peer review, averred the witnesses: no one has come up with anything better.

Those with any experience or knowledge of how peer review works in practice might have been tempted to conclude that analogising peer review with democracy is to obfuscate the issue. At the very least, it appears oxymoronic.

Such a conclusion was all the more likely in light of the opening question and answer. The Chair suggested that it might be helpful to conduct some research into the efficacy of the current system — on the grounds that “evaluation of peer review is poor”. To this Wellcome Trust director Sir Mark Walport replied: “Peer review is no more and no less than review by experts. I am not sure that we would want to do a comparison of a review by experts with a review by ignoramuses.”

Sir Mark’s statement can only have served to remind the audience that peer review is more oligarchic than democratic in effect. Rather than encouraging egalitarianism, it promotes elitism, and all the privileges one might associate with an old boy’s club (appositely perhaps, there was not a single female witness called to give evidence on June 8th).

Of course the Churchillian analogy is not really meant to suggest that peer review is a democratic process. Nevertheless the witnesses’ repeated claims that the current peer review system is “good enough” would surely be challenged by many junior researchers, who frequently complain that scholarly journals tend to be controlled by small elite groups of insiders, invariably senior researchers.

As one researcher pointed out to me recently, this is particularly problematic for those working outside North American and Europe. As he put it, “Peer-reviewed journals with a high impact factor are either dominated by certain gangs, or groups, or the editors rely on the opinion of reviewers too much.”

The upshot, he added, is that “a small guy from Russia, Brazil or Thailand will never get published, even with excellent results, unless he or she has a prominent Western colleague as a co-author.”

In fact, it is not just researchers in less privileged parts of the world who can struggle to get published in scientific journals today. Nor is it only junior researchers who complain about the peer review system. In 2009, for instance, 14 leading stem cell researchers wrote an open letter to journal editors highlighting their disquiet at the way in which the system operates.

Speaking to the BBC about the letter Professor Lovell-Badge commented: "It's turning things into a clique where only papers that satisfy this select group of a few reviewers who think of themselves as very important people in the field is published.”

Responding in a (separate) BBC interview, Sir Mark downplayed the criticism. Scientists, he said, “are always a bit paranoid” about peer review. And to make his point Sir Mark again used the analogy with democracy — peer review is not perfect, but it is the best system that the research community has been able to come up with.

Sunday, June 12, 2011

UK politicians puzzle over peer review in an open access environment

The UK House of Commons Science & Technology Committee is currently conducting an inquiry into peer review. The third public event of the inquiry was held on Monday 23rd May, when the Committee heard evidence from experts on open access publishing and post-publication review, and from representatives of the research community.

SOME OF THE ISSUES EXPLORED BY THE COMMITTEE ARE HIGHLIGHTED IN THE EDITED QUESTIONS AND ANSWERS LISTED BELOW. THE ASTERISKED HEADINGS ARE MINE.

I COMMENT ON THE SESSION AT THE BOTTOM OF THIS POST. 

UPDATE: THE COMMITTEE’S REPORT HAS NOW BEEN PUBLISHED. THE DETAILS ARE AVAILABLE HERE.

The Chair of the Science & Technology Committee is Andrew Miller, Labour MP for Ellesmere Port and Neston. Other politicians to pose the questions below were Graham Stringer, Labour MP for Blackley and Broughton, Roger Williams, Liberal Democrat MP for Brecon and Radnorshire, and Stephen Metcalfe, Conservative MP for South Basildon and East Thurrock. (A full list of Committee members is available here).

The hearing was split into two sessions.

== FIRST SESSION ==

Those giving evidence in the first session were Dr Rebecca Lawrence, Director, New Product Development at Faculty of 1000 Ltd., Mark Patterson, Director of Publishing at the Public Library of Science, Dr Michaela Torkar, Editorial Director at Biomed Central, and Dr Malcolm Read OBE, Executive Secretary of JISC.

Friday, May 20, 2011

More on the UK Inquiry into Peer Review

The UK House of Commons Science & Technology Committee is currently conducting an inquiry into peer review. The second public event of the inquiry was held at Portcullis House, in London, on May 11th.
 
(NOTE: The third public event will be held next Monday, 23rd May, and will explore Open Access (OA) and post-publication review details and a link are available at the bottom of this post; some subsequent abstracts and commentary are available here). 

UPDATE: THE COMMITTEE’S REPORT HAS NOW BEEN PUBLISHED. THE DETAILS ARE AVAILABLE HERE.

The second public event was split into two sessions.

The first Session was concerned with publication ethics. For this the witnesses were Tracey Brown, Managing Director of Sense About Science, and Dr Liz Wager, Chair of the Committee on Publication Ethics (COPE) and Board Member of the UK Research Integrity Office (UKRIO).

The second session took evidence from publishers. Here the witnesses were Mayur Amin, Senior Vice President, Research and Academic Relations at Elsevier, Dr Philip Campbell, Editor-in-Chief of Nature Publishing Group, Robert Campbell, Senior Publisher at Wiley-Blackwell, Dr Fiona Godlee, Editor-in-Chief at the BMJ Group, and Dr Andrew Sugden, Deputy Editor and International Managing Director of Science.

The Chair of the Science & Technology Committee is Andrew Miller, Labour MP for Ellesmere Port and Neston.
 
Other politicians to pose the questions extracted from the transcript and listed under the video of the event inserted below were Graham Stringer, Labour MP for Blackley and Broughton, David Morris, Conservative MP for Morecambe and Lunesdale, Roger Williams, Liberal Democrat MP for Brecon and Radnorshire, and Gavin Barwell, Conservative MP for Croydon Central. (A full list of Committee members is available here).

The (uncorrected) transcript of the meeting is available here.

The video of the event can be accessed here.

SOME OF THE ISSUES EXPLORED BY THE COMMITTEE ARE HIGHLIGHTED IN THE QUESTIONS AND ANSWERS LISTED BELOW

Thursday, May 19, 2011

UK Inquiry into Peer Review

On 27th January 2011 the UK House of Commons Science & Technology Committee announced that it planned to hold an inquiry into peer review. That inquiry is now underway. Below are some links to the first public event held to take oral evidence. (Click here for details of the second public event). 

The terms of reference for the inquiry are the following: 

The Committee welcomes submissions on all aspect of the process and among the issues it is likely to examine are the following:
  1. the strengths and weaknesses of peer review as a quality control mechanism for scientists, publishers and the public;
  2. measures to strengthen peer review;
  3. the value and use of peer reviewed science on advancing and testing scientific knowledge;
  4. the value and use of peer reviewed science in informing public debate;
  5. the extent to which peer review varies between scientific disciplines and between countries across the world;
  6. the processes by which reviewers with the requisite skills and knowledge are identified, in particular as the volume of multi-disciplinary research increases;
  7. the impact of IT and greater use of online resources on the peer review process; and
  8. possible alternatives to peer review.
The first public event took place on May 4th, with oral evidence being given by a number of experts, including:
  • Dr Nicola Gulley, Editorial Director, Institute of Physics Publishing Ltd
  • Professor Ronald Laskey CBE FRS FMedSci, Vice-President, Academy of Medical Sciences
  • Dr Robert Parker, Interim Chief Executive, Royal Society of Chemistry
  • Professor John Pethica FRS, Physical Secretary and Vice-President, Royal Society
The opening question from the chair of the Committee, Andrew Miller, Labour MP for Ellesmere Port and Neston, was: 

Q: Peer review is perceived to be "fundamental to scholarly communications". If it disappeared tomorrow, what would the consequences be? 

The first reply, from Dr Robert Parker, was: 

A: You would have to come up with something else with which to replace it. There isn’t anything very obvious to replace peer review with currently. The danger would be to the scientific record, really. The importance of it is laid out in the evidence that has been submitted with great clarity from most people who have submitted evidence in writing to this review. The value and quality of that scientific record is paramount, and peer review helps to keep that in place. 

The written evidence Dr Parker refers to can be read here.

The (uncorrected) transcript of the meeting is available here.

A video of the event is available here, or can be viewed below.
 
UPDATE: THE COMMITTEE’S REPORT HAS NOW BEEN PUBLISHED. THE DETAILS ARE AVAILABLE HERE.

Monday, March 07, 2011

PLoS ONE, Open Access, and the Future of Scholarly Publishing

Open Access (OA) advocates argue that PLoS ONE is now the largest scholarly journal in the world. Its parent organisation Public Library of Science (PLoS) was co-founded in 2001 by Nobel Laureate Harold Varmus. What does the history of PLoS tell us about the development of PLoS ONE? What does the success of PLoS ONE tell us about OA? And what does the current rush by other publishers to clone PLoS ONE tell us about the future of scholarly communication?

Our story begins in 1998, in a coffee shop located on the corner of Cole and Parnassus in San Francisco. It was here, Harold Varmus reports, that the seeds of PLoS were sown, during a seminal conversation he had with colleague Patrick Brown. Only at that point did Varmus realise what a mess scholarly communication was in. Until then, he says, he had been “an innocent person who went along with the system as it existed”.

Enlightenment began when Brown pointed out to Varmus that when scientists publish their papers they routinely (and without payment) assign ownership in them to the publisher. Publishers then lock the papers behind a paywall and charge other researchers a toll (subscription) to read them, thereby restricting the number of potential readers.

Since scientists crave readers (and the consequent “impact”) above all else, Brown reminded Varmus, the current system is illogical, counterproductive, and unfair to the research community. While it may have been necessary to enter into this Faustian bargain with publishers in a print environment (since it was the only way to get published, and print inevitably restricts readership), Brown added, it is no longer necessary in an online world — where the only barriers to the free-flow of information are artificial ones.

Physicists, Brown said, have overcome this “access” problem by posting preprints of all their papers on a web-based server called arXiv. Created by Paul Ginsparg in 1991, arXiv allows physical scientists to ensure that their work is freely available to all. “Should not the biomedical sciences be doing something similar?” Brown asked Varmus.

It was doubtless no accident that Brown — who had previously worked with the Nobel Laureate — chose Varmus as his audience for a lecture on scholarly publishing: at the time Varmus was director of the National Institutes of Health (NIH) — the largest source of funding for medical research in the world. He was, therefore, ideally placed to spearhead the revolution that Brown believed was necessary.

Fortunately for the open access movement (as it later became known) Varmus immediately grasped the nature of the problem — aided perhaps by some residual Zen wisdom emanating from the walls of the coffee shop they were sitting in, which had once been the Tassajara Bakery. Varmus emerged from the cafĂ© persuaded that it would be a good thing if publicly-funded research could be freed from the publishers’ digital padlocks. And he went straight back to the NIH to consult with colleagues to that end.

Again fortuitously, one of the first people Varmus broached the topic with was David Lipman — director of the NIH-based National Center for Biotechnology Information (NCBI). NCBI was home to the OA sequence database GenBank, and Lipman was an enthusiastic supporter of the notion that research should be freely available on the Web. By now Varmus’ conversion was complete.

This conversion was to see Varmus embark on a journey that would lead to the founding of a new publisher called Public Library of Science, the launch of two prestigious OA journals (PLoS Biology and PLoS Medicine), and subsequently to the creation of what OA advocates maintain is now the largest scholarly journal in the world — PLOS ONE.

As we shall see, Varmus’ journey was to prove no walk in the park, and some believe his project lost its bearings on the way. Rather than providing a solution, they argue, PLoS may have become part of the problem.

Certainly PLoS ONE has proved controversial. This became evident to me last year, when a researcher drew my attention to a row that had erupted over a paper the journal had published on “wind setdown”.

Even some of the journal’s own academic editors appeared to be of the view that the paper should not have been published (in its current form at least). As the row appeared to raise questions about PLoS ONE’s review process — and about PLoS ONE more broadly — I contacted PLoS ONE executive editor Damian Pattinson.

The response I got served only to pique my interest: While Pattinson invited me to send over a list of questions, I subsequently received an email from PLoS ONE publisher Peter Binfield informing me that it had been decided not to answer my questions after all. 

To read on please click here (for a long PDF file). 

The PDF includes a response from PLoS. I will also be publishing the response as a separate post. (Now available here).
 
This article was cited in a 2011 report on peer review in scientific publications by the British House of Commons Science and Technology Committee.


**** UPDATE FEBRUARY 2012: AN INTERVIEW WITH PUBLIC LIBRARY OF SCIENCE CO-FOUNDER MICHAEL EISEN IS NOW AVAILABLE HERE ****

Friday, February 12, 2010

The OA Interviews: Sciyo's Aleksandar Lazinica

In their efforts to derail the onward march of Open Access (OA) opponents have conjured up a number of bogeymen about Open Access publishing. First, they maintain, asking authors to pay to publish could turn scholarly publishing into a vanity press. Second, they say, OA publishing will in any case inevitably lead to lax or even non-existent peer review. Third, they argue, OA publishing is not financially sustainable. I felt the breath of all three bogeymen on the back of my neck recently, as I conducted an email interview with the CEO of OA publisher Sciyo, Aleksandar Lazinica — an interview that led the Open Access Scholarly Publishers Association (OASPA) to ask Sciyo to remove OASPA's logo from its web site. 

A MORE RECENT INTERVIEW WITH THE PUBLISHER IS AVAILABLE HERE.

Sciyo1
Aleksandar Lazinica, CEO, Sciyo

At the heart of the criticism deployed against OA publishing is the claim that levying an article processing charge (APC) on authors will inevitably corrupt the age-old process of scholarly publishing, and the independent peer review system on which it is based.

Certainly one obvious consequence of "author-pays" publishing is that the nature of the relationship between publisher and author changes radically from the traditional arrangement. While most researchers will doubtless obtain the necessary funds to pay to publish from their institution or funder, they nevertheless become paying customers of publishers not, as heretofore, supplicants seeking a free publishing slot.

For publishers it means migrating from a business environment in which their marketing efforts are focused primarily on selling journal subscriptions to intermediary libraries, to one where they have to sell a publishing service directly to authors.

Amongst other things, this means that many OA publishers have had to start utilising the mass marketing techniques characteristic of business-to-consumer (B2C) markets, rather than the business-to-business (B2B) methods traditionally associated with scholarly publishing. 

Cultural shift

For some this cultural shift proved difficult, with angry researchers reporting that they were being bombarded with spam messages that — they complained — were unwelcome, badly targetted and probably illegal. (Some argue, for instance, that legislation like the UK Privacy and Electronic Communications Regulations 2003 and New Zealand's Unsolicited Electronic Messages Act, outlaws the "cold calling" approach that some OA publishers are even now engaging in).

The spam plague was exacerbated by a rash of new publishers entering the market and launching hundreds of new journals — for which it was necessary to recruit in double quick time thousands of researchers willing to sit on journal editorial boards and submit papers.

By the end of 2008 it was clear that unless something was done the entire OA publishing industry could fall into disrepute. Consequently a group of OA publishers — including BioMed Central (BMC), Public Library of Science (PLoS) and Hindawi — created a new organisation called the Open Access Scholarly Publishers Association (OASPA).

One of the main tasks OASPA set itself was to "Promote a uniform definition of OA publishing, best practices for maintaining and disseminating OA scholarly communications, and ethical standards."

How effective OASPA has proved in reducing the spam plague remains for now unclear. In the middle of last year, for instance, I myself (a journalist, not a researcher) received several bulk email messages inviting me to submit papers to a couple of scientific journals published by OASPA co-founder BMC. (BMC publisher Matthew Cockerill, however, vehemently denied that the company had done anything untoward in emailing me in this way, or that it has ever been overzealous in its direct marketing activities).

But however legitimate these continuing mass solicitations may be, their effectiveness has to be in doubt — since it inevitably means asking recipients to pay to publish, and researchers are used to getting their papers published in a very different way. As Cornell postgraduate student Phil Davis put it last year: "Most of the journals in which I aspire to publish never ask me for a manuscript. They don't need to. They receive thousands of voluntary contributions each year and turn most away."

As a result, many researchers receiving these messages immediately conclude they are being invited to participate in some form of vanity publishing, particularly when the invitations arrive from unknown publishers. This serves to breathe life into the vanity press bogeyman.

These suspicions lead naturally to the further conclusion that, even if the invitations are not from a vanity publisher, since there must be huge pressure to accept papers (in order to generate revenue), the publishers concerned will inevitably set more lax peer review standards than traditional subscription publishers.

Such fears were fuelled last June when it was reported that OA publisher Bentham Open had accepted a software-generated "nonsense" paper, for which it demanded a publishing fee of $800. With a chorus of "we told you so", critics quickly wheeled out the peer-review bogeyman.

And such incidents, combined with the dawning realisation that mass email invitations are as likely to alienate researchers as they are to "clinch a sale", inevitably also feed the "sustainable business model" bogeyman, with critics arguing that OA publishers have still to arrive at a viable business proposition. 

Free for all

Against this background my curiosity was piqued last December when I received a press release from an OA publisher called Sciyo announcing that it was discontinuing charging APCs for the papers it publishes in its journals.

The release also announced that Sciyo plans, from this year, to pay royalties to authors who publish chapters in its OA books (although these authors will still pay an APC — of 470 euro). The royalties, the release explained, will be based on the number of times an author's chapter is downloaded.

Curious, I emailed Sciyo and proposed an email interview. My request was accepted, and after several interchanges with the company's Communications Director Jelena Katic, I was passed over to the CEO of Sciyo, Aleksandar Lazinica.

As the interview proceeded I also learned that Sciyo views its current strategy as a transitional arrangement only: the long-term plan, said Lazinica, is to dispense with APCs all together, and move to what he called a "free for all" environment — in which all the research Sciyo publishes (both journals and books) will be published without charge, but will nevertheless be made freely available on the Internet.

"We strongly believe that the APC has no future," Lazinica told me, adding that Sciyo is therefore exploring a number of alternative revenue streams. In the interim, he added, the APCs generated by charging authors to publish book chapters will subsidise the cost of publishing papers without charge in Sciyo's journals.

Could it be, I wondered, that Sciyo has discovered a business model able to slay both the vanity press and sustainability bogeymen in one fell swoop?

For the moment that's not clear, since Lazinica would not go into details about the alternative revenue streams he is exploring, although he did provide a clue: "We are basing our future development on the assumption that in the online environment the number of eyeballs is what counts and that people using a particular service do not necessarily have to be the ones paying for it," he told me, adding, "As soon as we're ready, we will be sharing the specifics with the community."

Time will tell. But what about the peer review bogeyman? 

Scepticism

I took time out between the to-ing and fro-ing of emails with Sciyo to do some web research.

As a result I discovered that Sciyo is not a new company, but one originally founded in 2004 as In-Tech. And I recalled that In-Tech was a publisher already known to me. I had first come across it in 2007, when I was alerted to the fact that researchers had begun complaining that they were receiving what they felt were suspicious invitations to pay to publish book chapters. On contacting the company, however, I was told that the invitations were entirely legitimate.

But similar complaints have continued to dog the company. Last year one disgruntled researcher — who said he had received repeated invitations from In-Tech — wondered whether he might have been targetted by a variation of the so-called Nigerian Scam.

A press released published last November announced that In-Tech had been renamed Sciyo. This has not, however, curtailed criticism of its email solicitations, with recipients still inclined to believe that they are being approached by a vanity press, or even perhaps a disreputable organisation. Sciyo's offer of royalties has likewise been greeted with scepticism.

To its credit, Sciyo appears to have been assiduous in its efforts to reply publicly to critics, insisting that those receiving its email invitations are not chosen randomly, and that all Sciyo's publications "undergo rigorous refereeing". As such, the company stresses, "Chapters which don't meet the quality criteria do not get published, meaning it is not vanity publishing or any sort of pay-to-publish scheme."

Faced with what appeared to be an increasingly muddy picture I emailed a dozen or so authors who had published with In-Tech/Sciyo. Only a few replied, but the responses I received were not entirely positive.

Commenting on Sciyo's plans to pay royalties, one of those I contacted emailed me: "I do not think this would be for the benefit of the authors but of the journal. It pushes authors to advertise their work (as if it were perfume in Harrods) in order to receive a small amount of money. The journal will receive more visits and therefore it will be ranked in the best places of the scientific community." 

Achilles Heel

Another one of the authors to reply was critical of In-Tech/Sciyo's peer review process. As he put it, "The review process is blind, but it is actually non-existent. We never received any real review for our papers, rather just an acceptance note for an initial abstract. The full papers were not reviewed at all and, furthermore, for some papers we did not have a chance for proof reading. Finally, two articles of ours were published without notifying us at all, in one case (the journal) the initially submitted draft was taken as it was and suddenly appeared on the web some months later (I just accidentally noticed this publication when I searched the web)."

He added: "I do not know how their review process works internally, but from what I experienced and heard from others, I fear, in comparison to all other publishers/journals/books I have experiences with, In-Tech/Sciyo ... well, I cannot even begin to compare it. It is simply highly unprofessional."
Other researchers have posted comments directly on the Web claiming that work they have published with In-Tech was also not peer reviewed.

When I asked Lazinica to comment on this he was unfazed, saying: "Admittedly, consistency in peer review is our Achilles heel and it is also one of our priorities in 2009/10. We do not have a bullet proof review system yet. We have managed to improve the process a lot but there is still an unacceptably high deviation in the quality between the publications."

From one perspective Lazinica's response could be viewed as refreshingly honest. When Bentham Open was accused of not conducting proper peer review the publisher repeatedly denied the charges — even after the editor of the Bentham journal concerned resigned, complaining that he had not seen the fake paper before it was accepted. (It is, of course, possible that the allegations made against Bentham were inaccurate).

Lazinica, by contrast, appeared to be holding up his hands and saying a loud mea culpa about the inadequacy of In-Tech/Sciyo's peer review. (Although when I asked him to confirm whether the problem was a consequence of inadequate peer reviewers, or whether the company does not always send papers out for external review, he declined to answer directly). 

Outdated

From another perspective, Lazinica's response suggests that the OA peer review bogeyman is alive and well.

For Lazinica went on to argue that the current model of peer review is in any case outdated. He added rhetorically: "[W]hat is the purpose of such reviews, other than to be seen to be abiding by some formal regulations? Scientific publishing today is still at the same level as it was in the 19th century, with journals and the review process still the main parts of it. After more than 100 years, I believe it's time to move on and apply new mechanisms. Readers are the ones who should review the article by reading it or not."

The implication appears to be that Lazinica believes peer review would be better conducted after publication, rather than prior to it.

As it happens, many would be sympathetic to Lazinica's views. Peer review is regularly criticised for being little more than a charade.

Writing in The Lancet ten years ago Richard Horton famously put it this way: "Editors and scientists alike insist on the pivotal importance of peer review. We portray peer review to the public as a quasi-sacred process that helps to make science our most objective truth teller. But we know that the system of peer review is biased, unjust, unaccountable, incomplete, easily fixed, often insulting, usually ignorant, occasionally foolish, and frequently wrong."

And since then, many believe, peer review has got worse. Only this month the BBC reported that an open letter had been sent to major scientific journals by 14 leading stem cell researchers alleging that "papers that are scientifically flawed or comprise only modest technical increments often attract undue profile. At the same time publication of truly original findings may be delayed or rejected".

The claim, said the BBC, is that "a small group of scientists is effectively vetoing high quality science from publication in journals."

Critics argue, the BBC added, that in some cases " it might be done to deliberately stifle research that is in competition with their own." 

Problematic

But however justified Lazinica's views on the inadequacies of peer review may be, it is perhaps problematic when a publisher responds to criticism of his own peer review process by arguing that the practice is outdated.

For whether one likes it or not, peer review remains the sacred cow of scholarly publishing. However inadequate and pointless the research community may at times feel it to be, any publisher speaking out against peer review needs first to be able to demonstrate that his system is as good as it gets.

Moreover, publicly Sciyo appears to take a somewhat different line on the quality of its peer-review. "We aim to provide quality tools and infrastructure facilitating science communication," it says on its web site. "That means providing first-class peer reviewed literature compliant with the highest standards of scientific publishing and then making it freely available to anyone, anywhere in the world."

And if Lazinica is happy to concede that his company does not have a bullet-proof peer review system in place those researchers paying 470 euro to publish book chapters are bound to wonder what they are getting for their money, particularly given that Sciyo expects authors to help market their work.

Finally, Lazinica's comments will doubtless concern other OA publishers who, as we have said, face continuing claims that OA inevitably means lax or non-existent peer review. As the author who spoke to me about his experiences of publishing with In-Tech put it, "It might be that I have a little bias regarding OA resulting from my past experience with this publisher."

Unsurprisingly, therefore, OA advocates were concerned to hear Lazinica's views on peer review, particularly since In-Tech was a member of OASPA (as was Sciyo until my interview), and OASPA was created to ensure high standards in OA publishing, including the best possible peer review.

As one member of the OA community commented to me (on a non-attributable basis) after reading Lazinica's remarks: "Sciyo seems to plead guilty to the charge that it skimps on peer review. First it says that peer review is the company's Achilles Heel. Then it pretends that peer review is an obsolete 19th century practice and argues that readers should judge for themselves. Although these two replies are actually inconsistent, they both acknowledge serious laxity (in the first case, inadvertent and regrettable, and in the second case deliberate and advantageous). This laxity should be a concern to OASPA."

OA advocate Stevan Harnad also believes that OASPA should be concerned: "Sciyo seems to want to do high-volume, fleet publishing; they don't seem to be doing peer review; probably they can't find the competent reviewers willing to review for them; and now they think readers should do the reviewing. (Journals with such low-level standards and practices are just capitalising on author publish-or-perish needs to produce a product that could never survive if they had to charge subscriptions to user institutions, rather than publication charges to eager authors.)"

And with Sciyo's emailing activities continuing to attract criticism from recipients — many of whom assume that they are being spammed haphazardly — the publisher's activities seem to pose a double challenge to the OA publishing industry: OASPA's web site states quite clearly that: "Any direct marketing activities publishers engage in shall be appropriate and unobtrusive."

In other words, OASPA would appear to deprecate spamming. Yet, as Harnad points out, Sciyo's recruitment process "looks to me like spamming."

While we should certainly welcome the kind of experimentation that Sciyo is engaged in, one is tempted to conclude that its activities will make it more difficult for OASPA to slay the bogeymen that critics of OA publishing have conjured up.

However, Lazinica denies that the company has done anything OASPA should be concerned about: "All Sciyo's activities conform to OASPA's ethical standards," he told me.

And on its marketing activities he said: "Our author database to date consists of a respectable number of registered members. These are informed about Sciyo activities on regular basis."
Yet messages appearing on the Web complaining about the company's activities would seem to belie this — e.g. this message posted by Dr Sanjay Velamparambil in March 2009. 

Same but different

When I contacted OASPA President Caroline Sutton for her views, she commented: "OASPA takes very seriously the importance of compliance by its members with its code of conduct, including ensuring that peer review processes are genuine, and that email marketing is responsible. The issues raised regarding In-Tech/Sciyo will be carefully reviewed by OASPA, and action will be taken if they are found to be substantiated."

In a spirit of transparency, Sutton sent a copy of her quote to Sciyo, at which point there was a strange twist in events: Shortly afterwards, I received an email from Lazinica. "I am surprised by the review issue, and do not see where the problem is at all," he wrote.

He added that there had been a misunderstanding. Contrary to what he had said during the interview — ("Sciyo was founded in Vienna in 2004 as In-Tech. In 2008 we moved our headquarters to Croatia to cut down on operating costs. In November the company changed its name to Sciyo" ... Sciyo and In-Tech are the same company."); contrary to what the company's press release of 20th November 2009 said ("Effective today, In-Tech is changing its name to Sciyo and continues publishing using a new website, sciyo.com ... The company ownership and management remain unchanged"); contrary to what it says on Sciyo's web site; and contrary to what its Scribd company backgrounder says — Lazinica now insisted that Sciyo is not in fact the same company as In-Tech.

"Sciyo is a new Open Access publisher," he said. "Sciyo has no publications yet; the first Sciyo book will be published in May/June this year. So how does anyone know anything about the Sciyo review process?"

He continued: "Sciyo has taken all In-Tech publications, which without doubt have high scientific quality (which can be seen by the number of readers); Sciyo has a different strategy and development policy than In-Tech."

He concluded: "We were aware of In-Tech's process disadvantages, and Sciyo has improved the services and processes which were inherited from In-Tech."

Sutton, however, emailed me to say that she stood by her earlier quote. She added: "We have taken Sciyo's name off of the OASPA website, and have asked Sciyo to remove the 'member of OASPA' logo from their site. OASPA has asked Sciyo to apply for membership at which time we will be reviewing carefully their practices and policies. Sciyo has agreed to apply for membership."
Let's hope that this matter can be settled to the satisfaction of both OASPA and Sciyo: that OASPA finds Sciyo's practices and policies sufficient to warrant membership, and that the publisher is therefore able to put OASPA's logo back on its web site.

We are, however, left with two questions:

- Did not OASPA review In-Tech's practices and policies carefully prior to accepting it as a member of the organisation in the first place?

- In the light of this comment posted on the Web a month after In-Tech became Sciyo, how confident can we be that Sciyo's bulk emailing activities are any different from those of In-Tech?

## 
If you wish to read the interview with Aleksandar Lazinica please click on the link below. I am publishing it under a Creative Commons licence, so you are free to copy and distribute it as you wish, so long as you credit me as the author, do not alter or transform the text, and do not use it for any commercial purpose.

If you would like to republish the article on a commercial basis, or have any comments on it, please email me at richard.poynder@btinternet.com. 

To read the interview with Aleksandar Lazinica (as a PDF file, including this introduction) click here.