Crosspost: Using Google Scholar in Scholarly Workflows

I wrote this for the Google Scholar blog where it was posted yesterday.  I am reposting it here, in part because comments are not allowed on the GS Blog (not sure why) and some people have asked me about that.  So here it is


When Anurag Acharya asked me recently if I would be interested in writing a guest post for the Google Scholar blog in relation to the 10th anniversary of Google Scholar I immediately responded “Yes.” Literally, that was the full content of my email response email response to his request. Why did I answer so enthusiastically? Well, I can put this down to three main reasons:

So – in thinking about what to write for this post, I came up with three main topics I thought would be good to cover – how I got interested in topics of searching for and sharing scholarly papers, how I use Google Scholar, and some ideas about future possible uses of Google Scholar.

Part 1: Some Background 

One day, in ancient history, my wife came home from work (at a biotech startup up focusing on bioinformatics) raving about this new search engine “Google” that people at her company were talking about. As someone who thought of himself as on the cutting edge of web technology, I was a bit dismayed that I had not somehow discovered this myself. But I got over that and tried it out. And, after searching for my name (and being impressed with how well this new search engine worked on such an important topic) I immediately started playing around with searching for scientific papers and data. I did this, I guess, because ever since I was in college, I had been becoming more and more interested in (or some would say obsessed with) issues relating to finding and sharing scientific knowledge.

Without going into two much detail some of the factors that contributed to my obsession included:

  • Working as a shelver and then assistant in the Museum of Comparative Zoology library in college and seeing how people struggled to find papers of relevance to their work;
  • Spending many years in graduate school (in the 1990s) working on projects that had been largely unstudied since the 1960s, including one (so called adaptive mutation) where researchers claimed to have discovered something new in the 1990s but had in fact missed a rich literature on the topic from the 1950s and 1960s (e.g., see this from 1955).
  • Building and sharing databases where I was trying to include a description of every paper that had been published about specific genes. I note – thanks to the Wayback machine my Stanford website from when I was a PhD student is still available – although alas the specific linked databases are not. I have reposted some of them for people to see what they were like (though many of the links in them are busted). See for example my sites on RecASNF2MutS and more
  • Working on projects to catalog everything known about specific organisms in association with work I was doing to characterize the genomes of these organisms

In these and other projects I had seen and experienced just how much time could be spent on searching for papers and data about a particular topics. I am not sure I had a well-defined strategy in every case but I came to rely upon some preferred methods including:

  • “Citation walking” where one takes a paper of interest and then asks “how has this paper been cited?” and traverses across the literature via citations
  • Searching for keywords in abstracts and titles
  • Browsing through specific journals
  • Looking for papers by specific authors
  • For data, I mostly would look in specific centralized data repositories such as Genbank for DNA sequence information and PDB for three-dimensional structural data on proteins.

And of course many other approaches. Nothing really novel or brilliant here though I do think I got pretty good at how to carry out such searches. But one of the challenges was each approach had to be done in a different system and some of the systems were only available for a fee and some were not even online. And even with lots of time and pain, many things could be missed.

Thus when my wife introduced me to this new fangled Google thing my thoughts rapidly turned to – how can I use this new tool to help in finding and then sharing scientific papers or data about these genes and organisms I was studying? Did Google searches solve all my “issues” in this regard? Alas, no. But jump forward ~15 years to today and I am quite amazed in retrospect how much of my scholarly workflow flows through Google Scholar. But rather than try to recall and write about how my workflow changed with the advent of Google Scholar I thought I would just jump to the present time and discuss some ways that I use Google Scholar now.

Part 2: Using Google Scholar today

When working on this post I started to look around at how I use Google Scholar and I confess I was amazed at how many different ways I use it in my work. Here are some examples:

Tracking and using citations. One major general use of Google Scholar lies in tracking of citations to specific scholarly works. Here are some ways that I use such information:

  • Citations to individual works. A key aspect of scholarly work in many fields is examining how specific works are cited. Such information has many uses include discovering new works on a topic by seeing how specific papers from the past are cited, assessing impact of works, ego satisfying, and more. For many years, information on how a specific work was cited was nearly impossible to come by without paying for access to citation tracking databases. Now, with Google Scholar I (and others) can very rapidly gather such information.
  • Citation from diverse sources. One aspect of using Google Scholar to track citations to individual works is the way GS finds citations in diverse sources – not just in the peer reviewed scholarly literature. Now, in some ways this can be viewed as a limitation (some may not want to count or even know about citations from self published white papers, for example). But in others ways this is a wonderful thing as one can find citations to one’s work from very diverse sources outside of the “normal” mold.
  • Citation metrics. It is not a large conceptual leap to go from the ability to track citations to individual works to the ability to create summary statistics about citations across many works. There are many indices for such purposes – some useful and some not. But whatever you think of such indices – Google Scholar has opened up the ability for people to calculate such metrics for oneself or to offer services to calculate metrics for others. Such indices can be used in many ways but perhaps the most common is to summarize the citations for one individual researcher. Which leads into my next topic …

Google Scholar Pages. Perhaps my favorite development from Google Scholar in the last 10 years has been the introduction of Google Scholar Pages for individuals. I make use of my Google Scholar page and pages of others for dozens of things including these:

  • Citation metrics for myself. See above for a discussion of citation metrics in general. I use Google Scholar pages to examine citation metrics for myself and my papers all the time (right now GS shows two summary statistics H-index and I-10 index). And I use this information in many ways including putting it on my CV, including it in grant reports, and examining which of my scholarly works have had more “impact”.
  • As landing page for my publication list. Once one has a GS page, GS automatically adds new publications to one’s list and also updates citation counts and other information regularly. Thus I now include a link to my GS page on my blogs, my work web sites, and in my email signature.
  • To keep track of my coauthors. I have been blessed (and perhaps a bit cursed) to work in a field (genomics) where many projects involve large-scale collaborations across many institutions, involving many researchers. And I have found that a nice way to track these coauthors is via GS (although – note to GS folks – there used to be a way to show, publically, all coauthors in a list but I cannot seem to figure out how to do this anymore).
  • Author disambiguation. For people like myself with a relatively unique name, when others search for my scholarly works, they are pretty easy to find (although I note the fact that there is another Jonathan Eisen out there who publishes some works with a bit of a conspiracy theory angle has been both good and bad for me at times). But for many others, their name is not a perfect way to find their work. This may be because they have a name that is relatively common, or it may be because they have changed their name (e.g., after marriage). For such people creating a GS page can be very useful because once one trains GS with a set of works, it can find new works by that same person quite well (I first found out about this author disambiguation by GS when Anurag gave a talk at a meeting I organized last year). GS is certainly not the only tool in author disambiguation and others – like author UIDs (e.g., ORCIDare almost certainly better long term options. I note – author disambiguation may seem like a esoteric topic to many but it has major implications on important issues such as gender equity in academia, since women are much more likely to change their names during their career than men are.
  • Automated updates of new papers by specific authors. One option associated with GS author pages I use extensively is the ability to “follow” specific authors and get notified of new publications of theirs.
  • To keep track of a collection of people. Most researchers do not regularly update their individual publication pages on their websites. However, if those researchers have GS pages one can keep track of their new papers quite easily (either by the follow option mentioned above or just by browsing occasionally). For example, for my microBEnet project I curate a list of GS pages for researchers in the whole field with connections to studies of “microbiology of the built environment” and thus (hopefully) help others keep up with what is going on in the field.
  • Who is in a specific field? One feature of GS author pages that is not used a lot as far as I can tell, but which has some value is the “areas of interest” tag one can add to one’s profile. Though not everyone uses such tags, I have found they are a useful tool in finding researchers working on specific topics. For example, I list “symbiosis” as one of my areas of interest and if I click on the link for that on my page I get a list (sorted by citation counts – which is both useful and annoying) of others who have listed that same area of interest. And many of the people in this list I am not familiar with yet they do work on topics in which I am very interested.

Automated discovery of new papers by topic. Pretty much all scholars these days are drowning in information and in keeping up with scholarly works. There are many reasons for this of course, and there are also some solutions. I find, for example, that social media is a great way to keep up to date on what new papers are coming out or have come out recently. But social media does not find everything and as someone who is responsible for keeping others up to date on various fields (e.g., this is one of my jobs at microBEnet) I also rely on both manual and automated searchers of the scholarly literature to find new papers or old papers I have missed. GS has two key ways to help in this regard. The first is relatively simple in concept but takes advantage of the power of Google indexing – which is just directly searching GS for papers on particular topics. And the advanced search options allow some customization of such searches. But as someone who is quite busy, I do not actually end up searching GS for new papers all that often. Instead I rely upon automated searches through various services including PubmedPubchase, and GS. I use GS in two ways for such automated searches:

  • Create an alert. When one does a search on GS, in addition to results one is presented with an option to “Create an alert” (which I think may only come up if one is logged in with a Google account). I now have dozens of such alerts in operation. To avoid getting drowned by the results I set them up to send only once a week and I filter them into a separate mail folder that I only look at when I have time. But I frequently find interesting new papers this way.
  • GS Updates. Another option now available, if one has a GS profile, is to use the GS Updates system (which I have written about before here and here for example). This system uses one’s publication list to scan for new papers that are related in some way to one’s prior work.

Many other uses of GS. I have gone on perhaps way too long here so I am only going to briefly mention a few other uses of GS.

  • Finding online versions of papers. Unquestionably one of the most valuable uses of GS is to find online versions of scholarly works. But since others have written extensively about this I will just say the following: if you publish any scholarly work I recommend you make it freely and openly available AND that you make sure that it gets indexed by GS.
  • Full text searches of the literature. Another critically important aspect of GS is that it facilitates full text searching of the scholarly literature which is important for many reasons.
  • Finding works outside of the “normal” places to publish. Another key feature of GS is that it indexes much more than just publisher’s sites. If one posts a preprint on one’s own web server, that paper may show up in GS (which I think is a good thing). GS also indexes many diverse sources of scholarly works and thus helps in finding works that may otherwise not see the light of day.

Part 3: Where do we go from here?

As an active user of Google Scholar I of course have many comments, complaints, ideas and thoughts about what it could do better and where it might go in the future. And there are SO many things that could be added or improved upon – things like better figure and table searching, better exporting of information, better abilities to curate and create collections and to then use such collections as training sets for automated searchers, and more and more and more.  I have written about some such issues and suggestions from time to time in my blog (see for example, this and this and this).  There is certainly lots of work to be done.

But in thinking about this I realized that making a list of issues and suggestions is only of limited value. What I think GS really needs is a better public forum where GS can discuss what their plans are for the future and also where users and developers can discuss what they would find useful. And though I see some places for such discussions on the Google Scholar blog and in related sites, I don’t see a lot. So – I would like to end with a call for GS to create a better site for such discussions of the future of GS …


Update – Adding some comments and responses from Twitter

Advice needed from a future reviewer…

I found myself writing this email to some collaborators, but halfway through realized that it’d be nice to get EVERYBODY’s input. Probably, one of you is going to review my next paper, so how awesome would it be for you to just tell me what you think now, and make both of our lives easier later.

To test whether taxa vary significantly across groups of samples, we first need to filter the OTU table to get rid of OTUs that are not present in most of the samples and/or that do not vary across samples. This must happen for statistical reasons.

As far as I know, there are two ways to do this. One, is to remove OTUs that occur in fewer than 25% of the samples (25% is suggested by the QIIME folks). The other is to calculate the variance of the OTUs across samples and remove the OTUs that have a variance less than 0.00001 (0.00001 is an arbitrary number thrown out there by the phyloseq developer.)

A third option would be to apply both criteria.

My inclination would be to go with the third option, but mostly because I want to limit as much as possible the number of hypothesis tests that we do in order to avoid draconian p-value corrections.

I’m not a big fan of arbitrary thresholds, but they are so frequently required that I’ve made my peace with them. However, if someone can suggest a non-arbitrary threshold, that’d be great.

But mostly, I want to make sure that everyone agrees now on the method that we use so that I only have to do this once. Thoughts?

Microbe-themed art of the month: Seung-Hwan Oh portraits w/ mold

OK this is pretty cool (from a microbe-art-science point of view): An Artist Who Paints Portraits With Mold | WIRED.  Seung-Hwan Oh “had to set up a micro-fungus farm in his studio” and he puts film in a warm wet environment (note to self – there could be a new human microbiome aspect of this project depending on what warm wet environment is chosen) and sometimes seeds the system with some mold.  And then he lets nature do its work.

See more about his Impermanence works here. (Really – check out the works – they are wild).

At that site the work is described in the following way:

The visual result of the symbiosis between film matter and organic matter is the conceptual origin of this body of work. The process involves the cultivation of emulsion consuming microbes on a visual environment created through portraits and a physical environment composed of developed film immersed in water. As the microbes consume light-sensitive chemical over the course of months or years, the silver halides destabilize, obfuscating the legibility of foreground, background, and scale. This creates an aesthetic of entangled creation and destruction that inevitably is ephemeral, and results in complete disintegration of the film so that it can only be delicately digitized before it is consumed.

Also see his Tumbl page where one can find many other images like this one:

Hat tip to Kate Scow for posting about this on Facebook.

UC #OpenAccess policy comments wanted from Academic Senate members by 1/7/15

The University invites comments on the proposed draft Presidential Policy on Open Access, which is based on the Academic Senate Open Access Policy for all Academic Senate members adopted on July 24, 2013.

The proposed new policy extends open access rights and responsibilities to all non-Senate members of the UC community who are authors of scholarly articles, including faculty, other academic personnel, students, administrators, and staff. The policy allows non-Senate authors of scholarly articles to maintain legal control over their research articles while making their work freely available to the public. In addition, the proposed policy outlines procedures for implementing the policy for all UC authors, both Senate and non-Senate. Although the policy assumes all authors will make their scholarly articles available to the public, there is a procedure, which authors must undertake proactively, to opt out of the open access process.

The proposal is located on the UCOP Academic Personnel and Programs website, “Policies under review,” under the “Systemwide Review” tab at http://www.ucop.edu/academic-personnel-programs/academic-personnel-policy/policies-under-review/index.html. If you prefer these documents as attachments, please let me know.

Talk for UC Davis Pre-Health Meeting (#UCDPHSA): Opening up to Diversity

Sunday I gave a talk at the “12th National UC Davis Pre-Health Student Alliance Pre-Medical and Pre-Health Professions Conference“.  I normally try to not give talks on weekends (to spend time with my family) but I made an exception here since this meeting has a strong commitment to issues relating to diversity in health and STEM fields.  This mission statement for the meeting reads:

The UC Davis Pre-Health Student Alliance’s objective is to introduce and support academic, admission, and preparatory opportunities for all students interested in health professions with a focus on those underrepresented in healthcare (with regard to gender, economic, social, educational, linguistic, cultural, racial, and ethnic background). We target universities, community colleges and high schools throughout the United States. The UC Davis Pre-Health Student Alliance aims to impact health education, increase diversity amongst the healthcare workforce, and inspire future leaders of healthcare through hosting the largest national pre-health professions conference.

It was that mission statement that got me to ditch my wife and kids Sunday AM (and also much of Saturday PM for a dinner and to work on my talk).  I went to a dinner Saturday for some of the speakers with the new Dean of the UC Davis School of Medicine Julie Freischlag.  The dinner had about 20 or so people and I met some quite interesting folks there working on various aspects of human and animal health.

And then Sunday AM I got up early, decided to use slides (was not sure) and finished off the slide set I had worked on the night before.  I decided that, in the spirit of the meeting, I would talk about two main things – diversity and access.  And I planned to tell three stories about my work in this area.  I wove in some personal stories since, at the dinner the night before Barbara Ross-Lee (who I sat next to) helped remind me of the importance of making talks personal.  So in the end I talked about myself, diabetes, diversity of microbes, antibiotics, diversity in STEM, and open science.  I came up with a title I was OK with: Opening up to Diversity.

My talk went well, I think.  I am pretty sure it was vbideotaped but not sure where that recording will end up. I did however post my slides to slideshare.  See below:

Opening up to Diversity talk by @phylogenomics at #UCDPHSA from Jonathan Eisen

And I also recorded the talk using Camtasia (basically, it allows recording of the screen, the video camera on my computer, and the audio).  I posted the recording (without the video feed which shows mostly my neck) to Youtube.  See below:

UPDATE 10/16 –

I have scanned in my notes that I made in planning this talk.  Figured, why not post them.

Update: 12/10/2014 – just discovered a video of the talk was posted to Youtube 

Aspen Center for Biophysics: Workshop on Microscale Ocean Biophysics

Just got this from the Moore Foundation ..

Dear colleague,

The MMI team would like to apprise you of the following meeting on microscale ocean processes. Please share with potentially interested colleagues; the application deadline is quickly approaching — October 15, 2014. Further information can be found at http://www.aspenphys.org/physicists/winter/winterapps.html and tinyurl.com/MicroAspen.

Workshop on Microscale Ocean Biophysics

At Aspen center for physics

11-16 January 2015

Application deadline: 15 October

This highly interdisciplinary meeting will focus on how physical processes affect aquatic organisms at small scales, and thereby the global processes in oceans and lakes that microorganisms overwhelmingly govern. Over the past two decades, there has been a growing realization that the ecology of these organisms depends not only on the bulk environmental conditions, but also crucially on small-scale biophysical interactions and microscale heterogeneity in the physical and chemical conditions. It is becoming clear that physical processes play a fundamental role in shaping the microscale landscapes that form the arena in which these organisms forage, reproduce and encounter each other. A key goal of this meeting is to help advance our understanding of aquatic ecosystems by replacing current statistical and heuristic descriptions with a mechanistic understanding of the component processes. This cannot be achieved without a strong appeal to small-scale fluid physics, mass transport, active suspensions, turbulence, and mechanics in general. The result is a rich landscape of opportunities for physicists, mathematicians, chemists and engineers to be involved in oceanographic and environmental problems, and for oceanographers, biologists and ecologists to inspire and utilize physical concepts and approaches more pervasively. The vision underpinning this meeting is that the interdisciplinary application and advancement of these topics in the context of oceanographic processes will greatly improve our understanding of how organism life is constrained and has evolved to exploit the fundamental laws of physics.

Deadline to apply is October 15, 2014

Apply here:

http://www.aspenphys.org/physicists/winter/winterapps.html

Organizers:
Roman Stocker (MIT)
Stuart Humphries (University of Hull)
Thomas Kiørboe (Technical University of Denmark)
Lee Karp-Boss (University of Maine)
Justin Seymour (University of Technology, Sydney)

Why I Tweet and Blog: Captured by Beryl Lieff Benderly

You know, many people ask me – why do I talk to science reporters so often.  They ask this and then claim that science reporters are just all kinds of evil because they always get quotes and facts and concepts wrong.  Well, that has really not been my experience.  Sure, I have my examples of problems.  But overall, I have been impressed and pleased more often than not.  And here is a great example. I was interviewed a while back by Beryl Lieff Benderly about my somewhat obsessive experimentation with social media for communicating science.  And then, of course, I forgot about it.  So I was exceptionally pleased when I saw the story come out today: To tweet or not to tweet? | Science Careers.  Beryl did a remarkably good job in capturing the essence of my thoughts about Tweeting, Blogging, social media, and science communication.

If you want to know what I think about how to not get overwhelmed with Twitter, how to not spend too much time on social media, and what I think abotu aboutb social media, you don’t need to wait for me to try to write my thoughts on the topic down.  Read what Beryl wrote.

Sexism in Science

“Are you going to church before your oral exam?”. That was the question I’d asked my friend jokingly when I saw her dressed in a funny looking attire, which I can only describe as a floral print, beige colored, raincoat. Except it wasn’t waterproof.
“No, I’m wearing it to the oral exam”, was her simple response. Something didn’t seem right here. This is a girl who is very fashion conscious and in a city like Davis, where T-shirt and jeans/shorts is the norm she can sometimes standout as well dressed.
She doesn’t just wear clothes that are “expected” of a female grad student, but she also wear skirts, dresses and a menagerie of clothing articles for which I don’t even know the names. She dresses nice because she like to. That’s her individuality and freedom of expression. So I probed her some more.

She said, “One of my committee member had given me a review on one of my previous talks. It said, Please don’t treat these seminars as a fashion show. It distracts the people away from your work”.

Safe to say I was not only stunned but riled up. It was incredibly sexist.
And then she pointed out that she also sewed another button to make sure that this dress can’t be considered even revealing. A beige color floral dress with puffy shoulders going below the knees that could be adorned by septuagenarian.
How can someone say that? This is not appropriate. This is was my second hand encounter was with sexism in science.
No one would ever say such a thing to me. Not that I dress very fashionably, but to any man. No one points out a guy’s baggy jeans mopping up the university buildings. Or comments on the unkempt male grad students who might be spreading more than their “usual” skin microbiota around. And trust me, there are plenty of those in Davis. That’s a ok. But we are judging a woman’s clothes because she decides to “dress up”. And to make it worse, we are blaming her of distracting people from her talk/seminar/work. Where have I heard that before. Ohh, here or here or here.
I know it’s taking it to extreme, but this is where is begins. One that needs to be distracted at a science talk can always look at the guy sleeping in the front row, or the loud whisperers in the back. They don’t need to look at a speaker’s clothes for that.

But the cake isn’t finished without the icing.

After her exams, I met up with her to congratulate. I asked about what all happened in the exam. She said something to the tune of “Towards the end, the person who’d commented earlier was apologetic for clothing remarks. But.”
There was a but.
“But when reviewing my transcript the committee laughed about how come I played varsity basketball. And as I was leaving another committee member tried to explain that they weren’t laughing about my basketball career because I was short, but because I wore a dress”.
Listening to it my jaw dropped. Are you f…ing kidding me? They’re incredulous towards her sports career. And made an effort to explain that’s not because of her below average height but the fact she wore a dress. I didn’t realize that for a girl to be taken seriously as an athlete she has to wear Tee, shorts and sneakers. Even three-four years after the fact. And these are “well educated” scientists from a renowned university we’re talking about.

How is that we have seminars and counseling available on sexual harassment and ethics in science, but nothing on sexism, another widespread scourge in the STEM fields. It should be part of the sensitivity training. It might be possible that the university offers it now, but I don’t remember being mandated to take one. They could also be useful for the international students like myself, where the cultural differences may require one to get acquainted with the local customs and the knowledge of “Acceptable or not acceptable”. It is about time we realize and break the stereotypes that were created decades (if not centuries) ago. No one deserves to be mistreated and (mis)judged because of their genitalia. We need an environment which supports science from men and women equally. Gone are the days when universities had only men’s room, today’s scientists should be free to do science in a supportive environment, free of sexism and gender discrimination.

Disclaimer
As a promise to her, I’ve kept certain details confidential and will not be divulged.
My PI is one of the campaigners for the women’s right and #STEMwomen and had no influence on this post. It is my own rant.

Michi Taga at #UCDavis today: Corrinoids in Communities: Nutrient Sharing in the Microbial World

MIC 291: Selected Topics in Microbiology

Work-in-Progress Seminars

Dr. Michi Taga
(UC Berkeley)

"Corrinoids in Communities: Nutrient Sharing in the Microbial World"

Wednesday, October 1, 2014

4:10 pm

1022 Life Sciences

Taga 10-01-14.doc

Crosspost from microBEnet: Some interesting new papers on functional analysius of metagenomics

Crossposting from microBEnet:

Some new papers that may be of interest to people: